2024-05-08T17:55:13.377 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T17:55:13.378 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} --owner scheduled_ivancich@teuthology --name ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi --archive /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871 --verbose -- /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/orig.config.yaml 2024-05-08T17:55:13.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T17:55:13.489 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871 branch: wip-eric-testing-1 description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} email: ivancich@redhat.com first_in_suite: false job_id: '7697871' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-eric-testing-1 ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-eric-testing-1 sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 owner: scheduled_ivancich@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 831 sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 sleep_before_teardown: 0 subset: 1/50 suite: rgw suite_branch: wip-eric-testing-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 targets: smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOwmm6I245TvQ59NZRMOTHXVwqvvgvULEjNUr1dkfnzqVNkYDY4LXKlCk4ZaqZW5nQIv7dJtBU7umy1B45rSNo= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBANeVtMQxjmk+TyFvG4+/feykSXJMHV3b8bffxQYMKtaeFB1r0Sd47fDeX+eJcxrGvxI+FUYooF/APAF6UXkg3k= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_17:43:43 tube: smithi user: ivancich verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T17:55:13.489 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa; will attempt to use it 2024-05-08T17:55:13.490 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa/tasks 2024-05-08T17:55:13.490 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T17:55:13.492 INFO:teuthology.task.internal:Checking packages... 2024-05-08T17:55:13.517 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '27d371685027569bcfa4efc661d3d3186f3a1776' 2024-05-08T17:55:13.517 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T17:55:13.517 INFO:teuthology.packaging:ref: None 2024-05-08T17:55:13.517 INFO:teuthology.packaging:tag: None 2024-05-08T17:55:13.517 INFO:teuthology.packaging:branch: wip-eric-testing-1 2024-05-08T17:55:13.517 INFO:teuthology.packaging:sha1: 27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T17:55:13.518 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-eric-testing-1 2024-05-08T17:55:13.671 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3525-g27d37168-1jammy 2024-05-08T17:55:13.672 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T17:55:13.680 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T17:55:13.680 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T17:55:13.691 INFO:teuthology.task.internal:Saving configuration 2024-05-08T17:55:13.703 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T17:55:13.710 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T17:55:13.737 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 17:46:49.823039', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILwyaihhGMtVKt+MDzZLaIUHg3RdhItazIc0uMwwD1OF'} 2024-05-08T17:55:13.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 17:46:49.821049', 'locked_by': 'scheduled_ivancich@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHSr4+e/zqacY8yTuB0P4kMGpDd5pg2bswVDAL+pSljC'} 2024-05-08T17:55:13.760 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T17:55:13.813 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-08T17:55:13.813 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-08T17:55:13.813 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T17:55:13.915 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f33449440d0>, signals=[15]) 2024-05-08T17:55:13.916 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T17:55:13.922 INFO:teuthology.task.internal:Opening connections... 2024-05-08T17:55:13.922 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T17:55:13.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:55:14.008 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T17:55:14.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:55:14.087 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T17:55:14.095 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2024-05-08T17:55:14.106 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2024-05-08T17:55:14.106 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Ubuntu" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="22.04" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_CODENAME=jammy 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:ID=ubuntu 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE=debian 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T17:55:14.156 INFO:teuthology.orchestra.run.smithi053.stdout:UBUNTU_CODENAME=jammy 2024-05-08T17:55:14.157 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2024-05-08T17:55:14.182 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-05-08T17:55:14.190 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-05-08T17:55:14.190 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="Ubuntu" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="22.04" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_CODENAME=jammy 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:ID=ubuntu 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE=debian 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-08T17:55:14.239 INFO:teuthology.orchestra.run.smithi114.stdout:UBUNTU_CODENAME=jammy 2024-05-08T17:55:14.240 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-05-08T17:55:14.257 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T17:55:14.266 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T17:55:14.274 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T17:55:14.274 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2024-05-08T17:55:14.277 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-05-08T17:55:14.289 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T17:55:14.296 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T17:55:14.296 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2024-05-08T17:55:14.325 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-05-08T17:55:14.356 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T17:55:14.410 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T17:55:14.425 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T17:55:14.426 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T17:55:14.426 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T17:55:14.426 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T17:55:14.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T17:55:14.432 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-05-08T17:55:14.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T17:55:14.433 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-05-08T17:55:14.479 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-56-generic 2024-05-08T17:55:14.479 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.15.0-56-generic 2024-05-08T17:55:14.479 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get clean 2024-05-08T17:55:14.480 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-56-generic 2024-05-08T17:55:14.480 INFO:teuthology.task.kernel:Running kernel on smithi053: 5.15.0-56-generic 2024-05-08T17:55:14.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-05-08T17:55:14.612 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-05-08T17:55:14.621 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-05-08T17:55:14.756 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:55:14.778 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:55:14.779 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T17:55:14.779 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T17:55:14.785 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-08T17:55:14.862 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T17:55:14.863 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-08T17:55:14.877 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-08T17:55:14.992 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T17:55:15.008 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T17:55:15.105 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T17:55:15.109 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,638 kB] 2024-05-08T17:55:15.113 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T17:55:15.116 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T17:55:15.116 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T17:55:15.116 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T17:55:15.133 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T17:55:15.142 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T17:55:15.145 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:55:15.146 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T17:55:15.153 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T17:55:15.165 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T17:55:15.199 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T17:55:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T17:55:15.200 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T17:55:15.200 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [624 kB] 2024-05-08T17:55:15.201 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T17:55:15.201 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T17:55:15.201 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T17:55:15.201 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T17:55:15.202 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T17:55:15.202 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T17:55:15.202 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T17:55:15.203 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T17:55:15.204 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T17:55:15.204 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T17:55:15.208 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [307 kB] 2024-05-08T17:55:15.211 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-08T17:55:15.212 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,864 kB] 2024-05-08T17:55:15.224 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T17:55:15.245 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-08T17:55:15.246 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [316 kB] 2024-05-08T17:55:15.251 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:55:15.252 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-08T17:55:15.255 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T17:55:15.255 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T17:55:15.255 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T17:55:15.280 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,073 kB] 2024-05-08T17:55:15.281 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T17:55:15.286 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:55:15.286 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T17:55:15.292 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [245 kB] 2024-05-08T17:55:15.295 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-08T17:55:15.295 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T17:55:15.295 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-08T17:55:15.298 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-08T17:55:15.301 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-08T17:55:15.301 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-08T17:55:15.302 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-08T17:55:15.303 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-08T17:55:15.306 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [458 kB] 2024-05-08T17:55:15.306 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T17:55:15.309 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T17:55:15.309 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T17:55:15.310 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T17:55:15.310 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T17:55:15.311 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T17:55:15.317 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-08T17:55:15.318 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-08T17:55:15.318 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-08T17:55:15.318 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-08T17:55:15.318 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-08T17:55:15.321 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-08T17:55:15.599 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,421 kB] 2024-05-08T17:55:15.793 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [246 kB] 2024-05-08T17:55:15.811 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-08T17:55:15.812 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,807 kB] 2024-05-08T17:55:15.908 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-08T17:55:15.909 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [307 kB] 2024-05-08T17:55:15.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-08T17:55:15.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [849 kB] 2024-05-08T17:55:15.954 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [602 kB] 2024-05-08T17:55:16.140 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-05-08T17:55:16.543 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-08T17:55:16.557 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-08T17:55:16.557 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-08T17:55:16.564 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-08T17:55:16.567 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-08T17:55:20.971 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 13.4 MB in 2s (7,030 kB/s) 2024-05-08T17:55:21.405 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 13.4 MB in 2s (6,771 kB/s) 2024-05-08T17:55:22.279 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-05-08T17:55:22.296 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:55:22.355 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-05-08T17:55:22.548 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-05-08T17:55:22.548 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-05-08T17:55:22.704 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:55:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:55:22.704 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:55:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:55:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T17:55:22.705 INFO:teuthology.orchestra.run.smithi114.stdout: python2.7-minimal 2024-05-08T17:55:22.705 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:55:22.706 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-05-08T17:55:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:55:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T17:55:22.706 INFO:teuthology.orchestra.run.smithi114.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T17:55:22.707 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-05-08T17:55:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T17:55:22.707 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-05-08T17:55:22.707 INFO:teuthology.orchestra.run.smithi114.stdout: thermald 2024-05-08T17:55:22.763 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-05-08T17:55:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:55:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T17:55:22.763 INFO:teuthology.orchestra.run.smithi114.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T17:55:22.764 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages will be upgraded: 2024-05-08T17:55:22.765 INFO:teuthology.orchestra.run.smithi114.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T17:55:22.798 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-05-08T17:55:22.817 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:55:22.823 INFO:teuthology.orchestra.run.smithi114.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:55:22.823 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 113 MB of archives. 2024-05-08T17:55:22.823 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T17:55:22.823 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T17:55:22.868 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-05-08T17:55:23.050 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-05-08T17:55:23.050 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-05-08T17:55:23.213 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:55:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:55:23.213 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:55:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:55:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-08T17:55:23.214 INFO:teuthology.orchestra.run.smithi053.stdout: python2.7-minimal 2024-05-08T17:55:23.214 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:55:23.215 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-05-08T17:55:23.215 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:55:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-generic linux-image-5.15.0-106-generic 2024-05-08T17:55:23.216 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-5.15.0-106-generic linux-modules-extra-5.15.0-106-generic 2024-05-08T17:55:23.217 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-05-08T17:55:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-08T17:55:23.217 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2024-05-08T17:55:23.217 INFO:teuthology.orchestra.run.smithi053.stdout: thermald 2024-05-08T17:55:23.270 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-05-08T17:55:23.270 INFO:teuthology.orchestra.run.smithi053.stdout: linux-headers-5.15.0-106 linux-headers-5.15.0-106-generic 2024-05-08T17:55:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.15.0-106-generic linux-modules-5.15.0-106-generic 2024-05-08T17:55:23.271 INFO:teuthology.orchestra.run.smithi053.stdout: linux-modules-extra-5.15.0-106-generic 2024-05-08T17:55:23.272 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages will be upgraded: 2024-05-08T17:55:23.272 INFO:teuthology.orchestra.run.smithi053.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-08T17:55:23.383 INFO:teuthology.orchestra.run.smithi053.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:55:23.383 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 113 MB of archives. 2024-05-08T17:55:23.383 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-08T17:55:23.384 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-106-generic amd64 5.15.0-106.116 [22.7 MB] 2024-05-08T17:55:23.599 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T17:55:23.999 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T17:55:24.764 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-106-generic amd64 5.15.0-106.116 [11.5 MB] 2024-05-08T17:55:25.219 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-106-generic amd64 5.15.0-106.116 [63.9 MB] 2024-05-08T17:55:25.695 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T17:55:25.695 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T17:55:25.695 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T17:55:25.879 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T17:55:25.927 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T17:55:26.302 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 113 MB in 3s (35.9 MB/s) 2024-05-08T17:55:26.457 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T17:55:26.890 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.106.106 [1,692 B] 2024-05-08T17:55:26.890 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.106.106 [2,502 B] 2024-05-08T17:55:26.891 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106 all 5.15.0-106.116 [12.3 MB] 2024-05-08T17:55:27.043 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-106-generic amd64 5.15.0-106.116 [2,876 kB] 2024-05-08T17:55:27.082 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.106.106 [2,366 B] 2024-05-08T17:55:27.489 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 113 MB in 4s (29.8 MB/s) 2024-05-08T17:55:27.703 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-5.15.0-106-generic. 2024-05-08T17:55:28.479 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T17:55:28.484 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:28.599 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:29.715 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-08T17:55:29.719 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../0-linux-modules-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:29.851 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:30.747 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T17:55:30.768 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:30.866 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:31.633 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T17:55:31.654 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:31.691 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:32.036 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-image-5.15.0-106-generic. 2024-05-08T17:55:32.058 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../1-linux-image-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:32.152 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:32.581 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-106-generic. 2024-05-08T17:55:32.602 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:32.648 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:38.451 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:55:38.559 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:55:38.883 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:55:39.004 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:55:39.316 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T17:55:39.338 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T17:55:39.374 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:55:39.779 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../3-linux-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:55:39.921 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:55:40.221 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:55:40.340 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-image-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:55:40.643 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-106. 2024-05-08T17:55:40.654 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../5-linux-headers-5.15.0-106_5.15.0-106.116_all.deb ... 2024-05-08T17:55:40.710 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:55:44.924 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T17:55:44.960 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:44.998 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:46.367 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package linux-headers-5.15.0-106-generic. 2024-05-08T17:55:46.404 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../6-linux-headers-5.15.0-106-generic_5.15.0-106.116_amd64.deb ... 2024-05-08T17:55:46.441 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:48.111 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:55:48.234 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:55:48.609 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:55:48.730 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:48.858 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T17:55:49.010 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:49.815 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.106.106_amd64.deb ... 2024-05-08T17:55:49.943 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking linux-headers-generic (5.15.0.106.106) over (5.15.0.56.54) ... 2024-05-08T17:55:50.478 INFO:teuthology.orchestra.run.smithi114.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:55:50.478 INFO:teuthology.orchestra.run.smithi114.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T17:55:50.478 INFO:teuthology.orchestra.run.smithi114.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:55:50.478 INFO:teuthology.orchestra.run.smithi114.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T17:55:51.152 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-106 (5.15.0-106.116) ... 2024-05-08T17:55:51.179 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:51.273 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:51.441 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-headers-generic (5.15.0.106.106) ... 2024-05-08T17:55:51.570 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:52.605 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:52.939 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:55:52.939 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-08T17:55:52.939 INFO:teuthology.orchestra.run.smithi053.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:55:52.939 INFO:teuthology.orchestra.run.smithi053.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-106-generic 2024-05-08T17:55:53.122 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:54.023 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T17:55:54.124 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T17:55:54.226 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:54.279 INFO:teuthology.orchestra.run.smithi114.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T17:55:54.279 INFO:teuthology.orchestra.run.smithi114.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:55:54.565 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-modules-extra-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:56.175 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-image-generic (5.15.0.106.106) ... 2024-05-08T17:55:56.977 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up linux-generic (5.15.0.106.106) ... 2024-05-08T17:55:57.078 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for linux-image-5.15.0-106-generic (5.15.0-106.116) ... 2024-05-08T17:55:57.144 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-08T17:55:57.144 INFO:teuthology.orchestra.run.smithi053.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:56:08.040 INFO:teuthology.orchestra.run.smithi114.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T17:56:08.040 INFO:teuthology.orchestra.run.smithi114.stdout:Sourcing file `/etc/default/grub' 2024-05-08T17:56:08.061 INFO:teuthology.orchestra.run.smithi114.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:56:08.077 INFO:teuthology.orchestra.run.smithi114.stdout:Generating grub configuration file ... 2024-05-08T17:56:08.371 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:56:08.402 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:56:08.668 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:56:08.674 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:56:08.741 INFO:teuthology.orchestra.run.smithi114.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:56:08.746 INFO:teuthology.orchestra.run.smithi114.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:56:08.911 INFO:teuthology.orchestra.run.smithi114.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:56:08.912 INFO:teuthology.orchestra.run.smithi114.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:56:08.912 INFO:teuthology.orchestra.run.smithi114.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:56:08.960 INFO:teuthology.orchestra.run.smithi114.stdout:done 2024-05-08T17:56:09.416 DEBUG:teuthology.orchestra.run.smithi114:> dpkg -s linux-image-generic 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Package: linux-image-generic 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Status: install ok installed 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Priority: optional 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Section: kernel 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Installed-Size: 21 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: amd64 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Source: linux-meta 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Version: 5.15.0.106.106 2024-05-08T17:56:09.438 INFO:teuthology.orchestra.run.smithi114.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:56:09.439 INFO:teuthology.orchestra.run.smithi114.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:56:09.439 INFO:teuthology.orchestra.run.smithi114.stdout:Recommends: thermald 2024-05-08T17:56:09.439 INFO:teuthology.orchestra.run.smithi114.stdout:Description: Generic Linux kernel image 2024-05-08T17:56:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:56:09.439 INFO:teuthology.orchestra.run.smithi114.stdout: available. 2024-05-08T17:56:09.439 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T17:56:09.439 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T17:56:09.439 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T17:56:09.439 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-08T17:56:09.439 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T17:56:09.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get clean 2024-05-08T17:56:09.609 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-05-08T17:56:09.758 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:56:09.758 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T17:56:09.769 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T17:56:09.861 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T17:56:11.111 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-05-08T17:56:11.129 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:56:11.181 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-05-08T17:56:11.359 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-05-08T17:56:11.360 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T17:56:11.520 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:56:11.555 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:56:11.557 DEBUG:teuthology.orchestra.run.smithi114:> dpkg -s linux-image-generic 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Package: linux-image-generic 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Status: install ok installed 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Priority: optional 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Section: kernel 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Installed-Size: 21 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:56:11.616 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: amd64 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout:Source: linux-meta 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout:Version: 5.15.0.106.106 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout:Recommends: thermald 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout:Description: Generic Linux kernel image 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:56:11.617 INFO:teuthology.orchestra.run.smithi114.stdout: available. 2024-05-08T17:56:11.618 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-05-08T17:56:11.633 INFO:teuthology.orchestra.run.smithi053.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-08T17:56:11.633 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub' 2024-05-08T17:56:11.655 INFO:teuthology.orchestra.run.smithi053.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:56:11.665 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.uetrnBA4Qb 2024-05-08T17:56:11.665 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uetrnBA4Qb 2024-05-08T17:56:11.681 INFO:teuthology.orchestra.run.smithi053.stdout:Generating grub configuration file ... 2024-05-08T17:56:11.721 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.uetrnBA4Qb 2024-05-08T17:56:11.844 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.uetrnBA4Qb is 10KB 2024-05-08T17:56:11.857 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.uetrnBA4Qb 2024-05-08T17:56:11.862 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T17:56:11.918 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T17:56:11.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T17:56:11.918 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T17:56:11.987 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:56:11.996 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T17:56:11.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo update-grub 2024-05-08T17:56:12.013 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:56:12.354 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:56:12.360 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:56:12.427 INFO:teuthology.orchestra.run.smithi053.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:56:12.432 INFO:teuthology.orchestra.run.smithi053.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:56:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:56:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:56:12.585 INFO:teuthology.orchestra.run.smithi053.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:56:12.623 INFO:teuthology.orchestra.run.smithi053.stdout:done 2024-05-08T17:56:13.125 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2024-05-08T17:56:13.143 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2024-05-08T17:56:13.143 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.106.106 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-05-08T17:56:13.144 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:56:13.145 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-05-08T17:56:13.145 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-106-generic 2024-05-08T17:56:13.145 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T17:56:13.145 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T17:56:13.145 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T17:56:13.145 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi053.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T17:56:13.145 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get clean 2024-05-08T17:56:13.173 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub' 2024-05-08T17:56:13.174 INFO:teuthology.orchestra.run.smithi114.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:56:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-05-08T17:56:13.324 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-05-08T17:56:13.379 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:56:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:56:13.469 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T17:56:13.586 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T17:56:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:56:13.609 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:56:13.650 INFO:teuthology.orchestra.run.smithi114.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:56:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:56:13.667 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T17:56:13.749 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T17:56:13.808 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:56:13.808 INFO:teuthology.orchestra.run.smithi114.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:56:13.808 INFO:teuthology.orchestra.run.smithi114.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:56:13.831 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-05-08T17:56:13.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-05-08T17:56:14.949 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-05-08T17:56:14.967 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-08T17:56:15.020 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-05-08T17:56:15.207 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-05-08T17:56:15.208 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-05-08T17:56:15.373 INFO:teuthology.orchestra.run.smithi053.stdout:linux-image-generic is already the newest version (5.15.0.106.106). 2024-05-08T17:56:15.373 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T17:56:15.373 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T17:56:15.373 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T17:56:15.374 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T17:56:15.374 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T17:56:15.374 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T17:56:15.374 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T17:56:15.413 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-05-08T17:56:15.415 DEBUG:teuthology.orchestra.run.smithi053:> dpkg -s linux-image-generic 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Package: linux-image-generic 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Status: install ok installed 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Priority: optional 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Section: kernel 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Installed-Size: 21 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Maintainer: Ubuntu Kernel Team 2024-05-08T17:56:15.475 INFO:teuthology.orchestra.run.smithi053.stdout:Architecture: amd64 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout:Source: linux-meta 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout:Version: 5.15.0.106.106 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-106), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout:Depends: linux-image-5.15.0-106-generic, linux-modules-extra-5.15.0-106-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout:Recommends: thermald 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout:Description: Generic Linux kernel image 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout: This package will always depend on the latest generic kernel image 2024-05-08T17:56:15.476 INFO:teuthology.orchestra.run.smithi053.stdout: available. 2024-05-08T17:56:15.476 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-05-08T17:56:15.523 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.TTLrVcSyQG 2024-05-08T17:56:15.523 DEBUG:teuthology.orchestra.run.smithi053:> sudo cp /boot/grub/grub.cfg /tmp/tmp.TTLrVcSyQG 2024-05-08T17:56:15.579 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.TTLrVcSyQG 2024-05-08T17:56:15.689 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.TTLrVcSyQG is 10KB 2024-05-08T17:56:15.702 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.TTLrVcSyQG 2024-05-08T17:56:15.707 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-08T17:56:15.763 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T17:56:15.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-08T17:56:15.763 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-08T17:56:15.844 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-106-generic 2024-05-08T17:56:15.844 DEBUG:teuthology.orchestra.run.smithi053:> sudo update-grub 2024-05-08T17:56:17.153 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub' 2024-05-08T17:56:17.154 INFO:teuthology.orchestra.run.smithi053.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-08T17:56:17.158 INFO:teuthology.orchestra.run.smithi053.stderr:Generating grub configuration file ... 2024-05-08T17:56:17.351 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-106-generic 2024-05-08T17:56:17.357 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-106-generic 2024-05-08T17:56:17.643 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-08T17:56:17.649 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-08T17:56:17.690 INFO:teuthology.orchestra.run.smithi053.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-08T17:56:17.695 INFO:teuthology.orchestra.run.smithi053.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-08T17:56:17.882 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-08T17:56:17.882 INFO:teuthology.orchestra.run.smithi053.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-08T17:56:17.882 INFO:teuthology.orchestra.run.smithi053.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-08T17:56:17.893 INFO:teuthology.orchestra.run.smithi053.stderr:done 2024-05-08T17:56:17.895 DEBUG:teuthology.orchestra.run.smithi053:> sudo shutdown -r now 2024-05-08T17:56:43.866 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-08T17:56:43.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T17:56:43.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:56:47.902 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T17:56:47.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T17:56:47.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:57:02.366 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-05-08T17:57:06.463 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-08T17:57:11.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T17:57:11.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:57:14.434 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-05-08T17:57:15.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T17:57:15.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:57:26.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T17:57:26.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:57:33.859 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-08T17:57:44.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-05-08T17:57:45.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T17:57:45.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:57:45.865 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.53 2024-05-08T17:57:59.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T17:57:59.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:58:00.504 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-05-08T17:58:00.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T17:58:00.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T17:58:01.103 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-05-08T17:58:01.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T17:58:01.404 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-106-generic"... 2024-05-08T17:58:01.404 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-05-08T17:58:01.451 INFO:teuthology.orchestra.run.smithi114.stdout:5.15.0-106-generic 2024-05-08T17:58:01.451 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T17:58:01.451 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T17:58:01.451 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T17:58:01.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T17:58:01.778 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-106-generic"... 2024-05-08T17:58:01.778 DEBUG:teuthology.orchestra.run.smithi053:> uname -r 2024-05-08T17:58:01.827 INFO:teuthology.orchestra.run.smithi053.stdout:5.15.0-106-generic 2024-05-08T17:58:01.827 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-106-generic vs 5.15.0-106-generic 2024-05-08T17:58:01.827 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T17:58:01.827 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-08T17:58:02.452 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-08T17:58:02.452 DEBUG:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T17:58:02.551 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2024-05-08T17:58:02.608 DEBUG:teuthology.parallel:result is None 2024-05-08T17:58:02.828 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T17:58:02.828 DEBUG:teuthology.orchestra.run.smithi053:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T17:58:02.909 INFO:teuthology.orchestra.run.smithi053.stdout:ttyS1 2024-05-08T17:58:02.940 DEBUG:teuthology.parallel:result is None 2024-05-08T17:58:02.941 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T17:58:02.948 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T17:58:02.949 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T17:58:02.951 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T17:58:02.959 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T17:58:02.965 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T17:58:02.977 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T17:58:02.977 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T17:58:03.000 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T17:58:03.028 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T17:58:03.035 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T17:58:03.035 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T17:58:03.056 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T17:58:03.079 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:58:03.087 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:58:03.097 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:58:03.105 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T17:58:03.107 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T17:58:03.114 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T17:58:03.114 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T17:58:03.132 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T17:58:03.175 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T17:58:03.184 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T17:58:03.184 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T17:58:03.187 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T17:58:03.223 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T17:58:03.239 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T17:58:03.287 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T17:58:03.288 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T17:58:03.351 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T17:58:03.358 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T17:58:03.407 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T17:58:03.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T17:58:03.597 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2024-05-08T17:58:03.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-05-08T17:58:03.689 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T17:58:03.697 INFO:teuthology.task.internal:Starting timer... 2024-05-08T17:58:03.697 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T17:58:03.712 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T17:58:03.724 DEBUG:teuthology.task.selinux:Excluding smithi053: OS 'ubuntu' does not support SELinux 2024-05-08T17:58:03.724 DEBUG:teuthology.task.selinux:Excluding smithi114: OS 'ubuntu' does not support SELinux 2024-05-08T17:58:03.724 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T17:58:03.724 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-08T17:58:03.724 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T17:58:03.729 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T17:58:03.742 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T17:58:03.782 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T17:58:03.783 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi053.front.sepia.ceph.com,smithi114.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T18:05:30.374 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com')] 2024-05-08T18:05:30.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:05:30.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:05:30.462 DEBUG:teuthology.orchestra.run.smithi053:> true 2024-05-08T18:05:30.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2024-05-08T18:05:30.539 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T18:05:30.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T18:05:30.619 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-05-08T18:05:30.698 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-05-08T18:05:30.699 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T18:05:30.710 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T18:05:30.710 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:05:30.711 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:05:30.713 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T18:05:30.713 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Command line: ntpd -gq 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: ---------------------------------------------------- 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: corporation. Support and training for ntp-4 are 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: available at https://www.nwtime.org/support 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: ---------------------------------------------------- 2024-05-08T18:05:30.743 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: proto: precision = 0.061 usec (-24) 2024-05-08T18:05:30.745 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: basedate set to 2022-02-04 2024-05-08T18:05:30.745 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: gps base set to 2022-02-06 (week 2196) 2024-05-08T18:05:30.745 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:05:30.745 INFO:teuthology.orchestra.run.smithi053.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:05:30.745 INFO:teuthology.orchestra.run.smithi053.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:05:30.746 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:05:30.746 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T18:05:30.746 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T18:05:30.747 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T18:05:30.747 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listen normally on 3 ens1f0 172.21.15.53:123 2024-05-08T18:05:30.747 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listen normally on 4 lo [::1]:123 2024-05-08T18:05:30.747 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:3718%4]:123 2024-05-08T18:05:30.747 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:30 ntpd[17143]: Listening on routing socket on fd #22 for interface updates 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Command line: ntpd -gq 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: ---------------------------------------------------- 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: ntp-4 is maintained by Network Time Foundation, 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: corporation. Support and training for ntp-4 are 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: available at https://www.nwtime.org/support 2024-05-08T18:05:30.770 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: ---------------------------------------------------- 2024-05-08T18:05:30.771 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: proto: precision = 0.042 usec (-24) 2024-05-08T18:05:30.771 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: basedate set to 2022-02-04 2024-05-08T18:05:30.771 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: gps base set to 2022-02-06 (week 2196) 2024-05-08T18:05:30.771 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:05:30.771 INFO:teuthology.orchestra.run.smithi114.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-08T18:05:30.772 INFO:teuthology.orchestra.run.smithi114.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: restrict ::: KOD does nothing without LIMITED. 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listen and drop on 0 v6wildcard [::]:123 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listen normally on 2 lo 127.0.0.1:123 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listen normally on 3 enp3s0f1 172.21.15.114:123 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listen normally on 4 lo [::1]:123 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cb63%5]:123 2024-05-08T18:05:30.773 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:30 ntpd[17275]: Listening on routing socket on fd #22 for interface updates 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:31.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:31.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:31 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:32.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:32.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:32 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:32.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:32.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:32 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:32.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:32 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:32.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:32 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:33.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:33.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:33.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:33.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:33 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:33.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:33 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:33.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:33 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:33.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:33.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:33.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:33.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:33.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:33.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:33 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:34.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:34.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:34 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:34.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:34 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:34.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:34 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:34.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:34 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:34.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:34 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:34.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:34 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:34.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:34 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:35.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:35 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:35.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:35.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:35 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:36.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:36 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:36.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:36 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:36.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:36 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:36.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:36 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:36.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:36 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:36.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:36 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:36.770 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:36 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:36.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:36 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:36.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:36 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:36.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:36 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:36.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:36 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:36.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:36 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:37.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:37.745 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:37 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:37.771 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:37.772 INFO:teuthology.orchestra.run.smithi114.stdout: 8 May 18:05:37 ntpd[17275]: ntpd: time slew -0.001597 s 2024-05-08T18:05:37.772 INFO:teuthology.orchestra.run.smithi114.stdout:ntpd: time slew -0.001597s 2024-05-08T18:05:37.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T18:05:37.772 INFO:teuthology.orchestra.run.smithi114.stderr: 8 May 18:05:37 ntpd[17275]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T18:05:37.830 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:05:37.830 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-05-08T18:05:37.830 INFO:teuthology.orchestra.run.smithi114.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:37.830 INFO:teuthology.orchestra.run.smithi114.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:37.830 INFO:teuthology.orchestra.run.smithi114.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:37.830 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:38.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:38.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:38.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-08T18:05:38.743 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: can't open /var/log/ntpstats/rawstats.20240508: Permission denied 2024-05-08T18:05:38.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-08T18:05:38.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: can't open /var/log/ntpstats/peerstats.20240508: Permission denied 2024-05-08T18:05:38.744 INFO:teuthology.orchestra.run.smithi053.stdout: 8 May 18:05:38 ntpd[17143]: ntpd: time slew -0.002027 s 2024-05-08T18:05:38.744 INFO:teuthology.orchestra.run.smithi053.stdout:ntpd: time slew -0.002027s 2024-05-08T18:05:38.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-08T18:05:38.744 INFO:teuthology.orchestra.run.smithi053.stderr: 8 May 18:05:38 ntpd[17143]: can't open /var/log/ntpstats/loopstats.20240508: Permission denied 2024-05-08T18:05:38.815 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:05:38.815 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-05-08T18:05:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:38.816 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:05:38.816 INFO:teuthology.run_tasks:Running task install... 2024-05-08T18:05:38.825 DEBUG:teuthology.task.install:project ceph 2024-05-08T18:05:38.826 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}} 2024-05-08T18:05:38.826 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'} 2024-05-08T18:05:38.826 INFO:teuthology.task.install:Using flavor: default 2024-05-08T18:05:38.832 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T18:05:38.832 INFO:teuthology.task.install:extra packages: [] 2024-05-08T18:05:38.832 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-key list | grep Ceph 2024-05-08T18:05:38.833 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-key list | grep Ceph 2024-05-08T18:05:38.896 INFO:teuthology.orchestra.run.smithi114.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T18:05:38.914 INFO:teuthology.orchestra.run.smithi053.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-08T18:05:38.928 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T18:05:38.928 INFO:teuthology.orchestra.run.smithi114.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T18:05:38.929 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T18:05:38.929 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:05:38.944 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-08T18:05:38.944 INFO:teuthology.orchestra.run.smithi053.stdout:uid [ unknown] Ceph.com (release key) 2024-05-08T18:05:38.945 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-05-08T18:05:38.945 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:05:39.150 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default/ 2024-05-08T18:05:39.150 INFO:teuthology.task.install.deb:Package version is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:05:39.156 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default/ 2024-05-08T18:05:39.156 INFO:teuthology.task.install.deb:Package version is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:05:39.421 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:05:39.421 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T18:05:39.424 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:05:39.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-08T18:05:39.438 DEBUG:teuthology.orchestra.run.smithi114:> sudo apt-get update 2024-05-08T18:05:39.440 DEBUG:teuthology.orchestra.run.smithi053:> sudo apt-get update 2024-05-08T18:05:39.609 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:05:39.609 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:05:39.614 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-08T18:05:39.622 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:05:39.627 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-08T18:05:39.645 INFO:teuthology.orchestra.run.smithi114.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:05:39.648 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-08T18:05:39.799 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T18:05:39.848 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T18:05:39.867 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy InRelease 2024-05-08T18:05:39.900 INFO:teuthology.orchestra.run.smithi114.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T18:05:39.932 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-08T18:05:39.952 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-05-08T18:05:39.998 INFO:teuthology.orchestra.run.smithi053.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-08T18:05:40.011 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-08T18:05:40.064 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,418 B] 2024-05-08T18:05:40.112 INFO:teuthology.orchestra.run.smithi053.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-08T18:05:40.141 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-05-08T18:05:40.153 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 29.3 kB in 1s (56.1 kB/s) 2024-05-08T18:05:40.282 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 29.3 kB in 1s (45.2 kB/s) 2024-05-08T18:05:41.163 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-05-08T18:05:41.179 DEBUG:teuthology.orchestra.run.smithi114:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3525-g27d37168-1jammy cephadm=19.0.0-3525-g27d37168-1jammy ceph-mds=19.0.0-3525-g27d37168-1jammy ceph-mgr=19.0.0-3525-g27d37168-1jammy ceph-common=19.0.0-3525-g27d37168-1jammy ceph-fuse=19.0.0-3525-g27d37168-1jammy ceph-test=19.0.0-3525-g27d37168-1jammy ceph-volume=19.0.0-3525-g27d37168-1jammy radosgw=19.0.0-3525-g27d37168-1jammy python3-rados=19.0.0-3525-g27d37168-1jammy python3-rgw=19.0.0-3525-g27d37168-1jammy python3-cephfs=19.0.0-3525-g27d37168-1jammy python3-rbd=19.0.0-3525-g27d37168-1jammy libcephfs2=19.0.0-3525-g27d37168-1jammy libcephfs-dev=19.0.0-3525-g27d37168-1jammy librados2=19.0.0-3525-g27d37168-1jammy librbd1=19.0.0-3525-g27d37168-1jammy rbd-fuse=19.0.0-3525-g27d37168-1jammy 2024-05-08T18:05:41.240 INFO:teuthology.orchestra.run.smithi114.stdout:Reading package lists... 2024-05-08T18:05:41.277 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-05-08T18:05:41.292 DEBUG:teuthology.orchestra.run.smithi053:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3525-g27d37168-1jammy cephadm=19.0.0-3525-g27d37168-1jammy ceph-mds=19.0.0-3525-g27d37168-1jammy ceph-mgr=19.0.0-3525-g27d37168-1jammy ceph-common=19.0.0-3525-g27d37168-1jammy ceph-fuse=19.0.0-3525-g27d37168-1jammy ceph-test=19.0.0-3525-g27d37168-1jammy ceph-volume=19.0.0-3525-g27d37168-1jammy radosgw=19.0.0-3525-g27d37168-1jammy python3-rados=19.0.0-3525-g27d37168-1jammy python3-rgw=19.0.0-3525-g27d37168-1jammy python3-cephfs=19.0.0-3525-g27d37168-1jammy python3-rbd=19.0.0-3525-g27d37168-1jammy libcephfs2=19.0.0-3525-g27d37168-1jammy libcephfs-dev=19.0.0-3525-g27d37168-1jammy librados2=19.0.0-3525-g27d37168-1jammy librbd1=19.0.0-3525-g27d37168-1jammy rbd-fuse=19.0.0-3525-g27d37168-1jammy 2024-05-08T18:05:41.356 INFO:teuthology.orchestra.run.smithi053.stdout:Reading package lists... 2024-05-08T18:05:41.440 INFO:teuthology.orchestra.run.smithi114.stdout:Building dependency tree... 2024-05-08T18:05:41.440 INFO:teuthology.orchestra.run.smithi114.stdout:Reading state information... 2024-05-08T18:05:41.555 INFO:teuthology.orchestra.run.smithi053.stdout:Building dependency tree... 2024-05-08T18:05:41.556 INFO:teuthology.orchestra.run.smithi053.stdout:Reading state information... 2024-05-08T18:05:41.636 INFO:teuthology.orchestra.run.smithi114.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:05:41.637 INFO:teuthology.orchestra.run.smithi114.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:05:41.637 INFO:teuthology.orchestra.run.smithi114.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:05:41.637 INFO:teuthology.orchestra.run.smithi114.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:05:41.637 INFO:teuthology.orchestra.run.smithi114.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:05:41.637 INFO:teuthology.orchestra.run.smithi114.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:05:41.637 INFO:teuthology.orchestra.run.smithi114.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:05:41.638 INFO:teuthology.orchestra.run.smithi114.stdout:The following additional packages will be installed: 2024-05-08T18:05:41.638 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T18:05:41.638 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T18:05:41.638 INFO:teuthology.orchestra.run.smithi114.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T18:05:41.638 INFO:teuthology.orchestra.run.smithi114.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T18:05:41.639 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:05:41.640 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet zip 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout:Suggested packages: 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T18:05:41.641 INFO:teuthology.orchestra.run.smithi114.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout:Recommended packages: 2024-05-08T18:05:41.642 INFO:teuthology.orchestra.run.smithi114.stdout: btrfs-tools 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout:The following NEW packages will be installed: 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T18:05:41.743 INFO:teuthology.orchestra.run.smithi114.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T18:05:41.744 INFO:teuthology.orchestra.run.smithi114.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T18:05:41.744 INFO:teuthology.orchestra.run.smithi114.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T18:05:41.744 INFO:teuthology.orchestra.run.smithi114.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T18:05:41.744 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T18:05:41.744 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T18:05:41.745 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T18:05:41.746 INFO:teuthology.orchestra.run.smithi114.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T18:05:41.757 INFO:teuthology.orchestra.run.smithi053.stdout:The following packages were automatically installed and are no longer required: 2024-05-08T18:05:41.757 INFO:teuthology.orchestra.run.smithi053.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-08T18:05:41.757 INFO:teuthology.orchestra.run.smithi053.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-08T18:05:41.758 INFO:teuthology.orchestra.run.smithi053.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-08T18:05:41.758 INFO:teuthology.orchestra.run.smithi053.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-08T18:05:41.758 INFO:teuthology.orchestra.run.smithi053.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-08T18:05:41.758 INFO:teuthology.orchestra.run.smithi053.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-08T18:05:41.759 INFO:teuthology.orchestra.run.smithi053.stdout:The following additional packages will be installed: 2024-05-08T18:05:41.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-08T18:05:41.759 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-08T18:05:41.759 INFO:teuthology.orchestra.run.smithi053.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-08T18:05:41.759 INFO:teuthology.orchestra.run.smithi053.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-08T18:05:41.760 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-08T18:05:41.760 INFO:teuthology.orchestra.run.smithi053.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:05:41.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-08T18:05:41.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet zip 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout:Suggested packages: 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-08T18:05:41.763 INFO:teuthology.orchestra.run.smithi053.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-08T18:05:41.764 INFO:teuthology.orchestra.run.smithi053.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-08T18:05:41.764 INFO:teuthology.orchestra.run.smithi053.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-08T18:05:41.764 INFO:teuthology.orchestra.run.smithi053.stdout:Recommended packages: 2024-05-08T18:05:41.764 INFO:teuthology.orchestra.run.smithi053.stdout: btrfs-tools 2024-05-08T18:05:41.823 INFO:teuthology.orchestra.run.smithi114.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T18:05:41.823 INFO:teuthology.orchestra.run.smithi114.stdout:Need to get 181 MB of archives. 2024-05-08T18:05:41.823 INFO:teuthology.orchestra.run.smithi114.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-08T18:05:41.824 INFO:teuthology.orchestra.run.smithi114.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T18:05:41.871 INFO:teuthology.orchestra.run.smithi053.stdout:The following NEW packages will be installed: 2024-05-08T18:05:41.871 INFO:teuthology.orchestra.run.smithi053.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-08T18:05:41.871 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-08T18:05:41.871 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-05-08T18:05:41.871 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-05-08T18:05:41.871 INFO:teuthology.orchestra.run.smithi053.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-05-08T18:05:41.872 INFO:teuthology.orchestra.run.smithi053.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-08T18:05:41.873 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-05-08T18:05:41.874 INFO:teuthology.orchestra.run.smithi053.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-05-08T18:05:41.974 INFO:teuthology.orchestra.run.smithi114.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T18:05:41.979 INFO:teuthology.orchestra.run.smithi114.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T18:05:42.004 INFO:teuthology.orchestra.run.smithi114.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T18:05:42.063 INFO:teuthology.orchestra.run.smithi053.stdout:0 upgraded, 118 newly installed, 0 to remove and 303 not upgraded. 2024-05-08T18:05:42.063 INFO:teuthology.orchestra.run.smithi053.stdout:Need to get 181 MB of archives. 2024-05-08T18:05:42.063 INFO:teuthology.orchestra.run.smithi053.stdout:After this operation, 829 MB of additional disk space will be used. 2024-05-08T18:05:42.063 INFO:teuthology.orchestra.run.smithi053.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-08T18:05:42.064 INFO:teuthology.orchestra.run.smithi114.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3525-g27d37168-1jammy [3,555 kB] 2024-05-08T18:05:42.137 INFO:teuthology.orchestra.run.smithi114.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T18:05:42.143 INFO:teuthology.orchestra.run.smithi114.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T18:05:42.159 INFO:teuthology.orchestra.run.smithi114.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T18:05:42.169 INFO:teuthology.orchestra.run.smithi114.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T18:05:42.170 INFO:teuthology.orchestra.run.smithi114.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T18:05:42.172 INFO:teuthology.orchestra.run.smithi114.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T18:05:42.190 INFO:teuthology.orchestra.run.smithi114.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T18:05:42.193 INFO:teuthology.orchestra.run.smithi114.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T18:05:42.199 INFO:teuthology.orchestra.run.smithi114.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T18:05:42.202 INFO:teuthology.orchestra.run.smithi114.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T18:05:42.203 INFO:teuthology.orchestra.run.smithi053.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3525-g27d37168-1jammy [3,555 kB] 2024-05-08T18:05:42.245 INFO:teuthology.orchestra.run.smithi114.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T18:05:42.249 INFO:teuthology.orchestra.run.smithi114.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T18:05:42.254 INFO:teuthology.orchestra.run.smithi114.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T18:05:42.257 INFO:teuthology.orchestra.run.smithi114.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T18:05:42.258 INFO:teuthology.orchestra.run.smithi114.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T18:05:42.286 INFO:teuthology.orchestra.run.smithi114.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T18:05:42.288 INFO:teuthology.orchestra.run.smithi114.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T18:05:42.288 INFO:teuthology.orchestra.run.smithi114.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T18:05:42.289 INFO:teuthology.orchestra.run.smithi114.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T18:05:42.290 INFO:teuthology.orchestra.run.smithi114.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T18:05:42.336 INFO:teuthology.orchestra.run.smithi114.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T18:05:42.337 INFO:teuthology.orchestra.run.smithi114.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T18:05:42.337 INFO:teuthology.orchestra.run.smithi114.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T18:05:42.343 INFO:teuthology.orchestra.run.smithi114.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T18:05:42.344 INFO:teuthology.orchestra.run.smithi114.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T18:05:42.387 INFO:teuthology.orchestra.run.smithi114.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T18:05:42.388 INFO:teuthology.orchestra.run.smithi114.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T18:05:42.390 INFO:teuthology.orchestra.run.smithi114.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T18:05:42.391 INFO:teuthology.orchestra.run.smithi114.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T18:05:42.391 INFO:teuthology.orchestra.run.smithi114.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T18:05:42.415 INFO:teuthology.orchestra.run.smithi114.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T18:05:42.416 INFO:teuthology.orchestra.run.smithi114.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T18:05:42.417 INFO:teuthology.orchestra.run.smithi114.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T18:05:42.428 INFO:teuthology.orchestra.run.smithi114.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T18:05:42.428 INFO:teuthology.orchestra.run.smithi114.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T18:05:42.437 INFO:teuthology.orchestra.run.smithi114.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T18:05:42.438 INFO:teuthology.orchestra.run.smithi114.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T18:05:42.441 INFO:teuthology.orchestra.run.smithi114.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T18:05:42.445 INFO:teuthology.orchestra.run.smithi114.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T18:05:42.446 INFO:teuthology.orchestra.run.smithi114.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T18:05:42.460 INFO:teuthology.orchestra.run.smithi114.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T18:05:42.462 INFO:teuthology.orchestra.run.smithi114.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T18:05:42.467 INFO:teuthology.orchestra.run.smithi114.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T18:05:42.468 INFO:teuthology.orchestra.run.smithi114.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T18:05:42.470 INFO:teuthology.orchestra.run.smithi114.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T18:05:42.488 INFO:teuthology.orchestra.run.smithi114.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T18:05:42.494 INFO:teuthology.orchestra.run.smithi053.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-08T18:05:42.514 INFO:teuthology.orchestra.run.smithi053.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-08T18:05:42.625 INFO:teuthology.orchestra.run.smithi053.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-08T18:05:42.664 INFO:teuthology.orchestra.run.smithi114.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T18:05:42.666 INFO:teuthology.orchestra.run.smithi114.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T18:05:42.669 INFO:teuthology.orchestra.run.smithi114.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T18:05:42.670 INFO:teuthology.orchestra.run.smithi114.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T18:05:42.672 INFO:teuthology.orchestra.run.smithi114.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T18:05:42.703 INFO:teuthology.orchestra.run.smithi114.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T18:05:42.705 INFO:teuthology.orchestra.run.smithi114.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T18:05:42.705 INFO:teuthology.orchestra.run.smithi114.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T18:05:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T18:05:42.724 INFO:teuthology.orchestra.run.smithi114.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T18:05:42.739 INFO:teuthology.orchestra.run.smithi114.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T18:05:42.740 INFO:teuthology.orchestra.run.smithi114.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T18:05:42.740 INFO:teuthology.orchestra.run.smithi114.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T18:05:42.741 INFO:teuthology.orchestra.run.smithi114.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T18:05:42.742 INFO:teuthology.orchestra.run.smithi114.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T18:05:42.777 INFO:teuthology.orchestra.run.smithi114.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T18:05:42.783 INFO:teuthology.orchestra.run.smithi114.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T18:05:42.786 INFO:teuthology.orchestra.run.smithi114.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T18:05:42.789 INFO:teuthology.orchestra.run.smithi114.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T18:05:42.790 INFO:teuthology.orchestra.run.smithi114.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T18:05:42.797 INFO:teuthology.orchestra.run.smithi114.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3525-g27d37168-1jammy [3,223 kB] 2024-05-08T18:05:42.805 INFO:teuthology.orchestra.run.smithi114.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T18:05:42.810 INFO:teuthology.orchestra.run.smithi114.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T18:05:42.812 INFO:teuthology.orchestra.run.smithi114.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T18:05:42.813 INFO:teuthology.orchestra.run.smithi114.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T18:05:42.821 INFO:teuthology.orchestra.run.smithi114.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T18:05:42.829 INFO:teuthology.orchestra.run.smithi114.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T18:05:42.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T18:05:42.835 INFO:teuthology.orchestra.run.smithi114.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T18:05:42.836 INFO:teuthology.orchestra.run.smithi114.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T18:05:42.836 INFO:teuthology.orchestra.run.smithi114.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T18:05:42.850 INFO:teuthology.orchestra.run.smithi114.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T18:05:42.851 INFO:teuthology.orchestra.run.smithi114.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T18:05:42.864 INFO:teuthology.orchestra.run.smithi114.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T18:05:42.864 INFO:teuthology.orchestra.run.smithi114.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T18:05:42.865 INFO:teuthology.orchestra.run.smithi114.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T18:05:42.871 INFO:teuthology.orchestra.run.smithi114.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T18:05:42.872 INFO:teuthology.orchestra.run.smithi114.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T18:05:43.149 INFO:teuthology.orchestra.run.smithi114.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3525-g27d37168-1jammy [712 kB] 2024-05-08T18:05:43.220 INFO:teuthology.orchestra.run.smithi114.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3525-g27d37168-1jammy [356 kB] 2024-05-08T18:05:43.233 INFO:teuthology.orchestra.run.smithi114.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3525-g27d37168-1jammy [32.8 kB] 2024-05-08T18:05:43.234 INFO:teuthology.orchestra.run.smithi114.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3525-g27d37168-1jammy [180 kB] 2024-05-08T18:05:43.289 INFO:teuthology.orchestra.run.smithi114.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3525-g27d37168-1jammy [67.4 kB] 2024-05-08T18:05:43.291 INFO:teuthology.orchestra.run.smithi114.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3525-g27d37168-1jammy [330 kB] 2024-05-08T18:05:43.302 INFO:teuthology.orchestra.run.smithi114.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3525-g27d37168-1jammy [6,900 kB] 2024-05-08T18:05:43.792 INFO:teuthology.orchestra.run.smithi053.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3525-g27d37168-1jammy [3,223 kB] 2024-05-08T18:05:43.915 INFO:teuthology.orchestra.run.smithi114.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3525-g27d37168-1jammy [112 kB] 2024-05-08T18:05:43.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3525-g27d37168-1jammy [466 kB] 2024-05-08T18:05:43.972 INFO:teuthology.orchestra.run.smithi114.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3525-g27d37168-1jammy [25.8 MB] 2024-05-08T18:05:44.671 INFO:teuthology.orchestra.run.smithi053.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-08T18:05:45.030 INFO:teuthology.orchestra.run.smithi053.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3525-g27d37168-1jammy [712 kB] 2024-05-08T18:05:45.110 INFO:teuthology.orchestra.run.smithi053.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-08T18:05:45.236 INFO:teuthology.orchestra.run.smithi053.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3525-g27d37168-1jammy [356 kB] 2024-05-08T18:05:45.369 INFO:teuthology.orchestra.run.smithi053.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3525-g27d37168-1jammy [32.8 kB] 2024-05-08T18:05:45.381 INFO:teuthology.orchestra.run.smithi053.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3525-g27d37168-1jammy [180 kB] 2024-05-08T18:05:45.431 INFO:teuthology.orchestra.run.smithi053.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3525-g27d37168-1jammy [67.4 kB] 2024-05-08T18:05:45.458 INFO:teuthology.orchestra.run.smithi053.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3525-g27d37168-1jammy [330 kB] 2024-05-08T18:05:45.568 INFO:teuthology.orchestra.run.smithi053.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3525-g27d37168-1jammy [6,900 kB] 2024-05-08T18:05:45.918 INFO:teuthology.orchestra.run.smithi114.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3525-g27d37168-1jammy [5,095 kB] 2024-05-08T18:05:46.071 INFO:teuthology.orchestra.run.smithi053.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-08T18:05:46.192 INFO:teuthology.orchestra.run.smithi114.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3525-g27d37168-1jammy [244 kB] 2024-05-08T18:05:46.221 INFO:teuthology.orchestra.run.smithi114.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:05:46.225 INFO:teuthology.orchestra.run.smithi114.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3525-g27d37168-1jammy [1,544 kB] 2024-05-08T18:05:46.348 INFO:teuthology.orchestra.run.smithi114.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3525-g27d37168-1jammy [6,259 kB] 2024-05-08T18:05:46.486 INFO:teuthology.orchestra.run.smithi053.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-08T18:05:46.554 INFO:teuthology.orchestra.run.smithi053.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-08T18:05:46.641 INFO:teuthology.orchestra.run.smithi053.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-08T18:05:46.839 INFO:teuthology.orchestra.run.smithi114.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3525-g27d37168-1jammy [22.8 MB] 2024-05-08T18:05:47.446 INFO:teuthology.orchestra.run.smithi053.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-08T18:05:47.713 INFO:teuthology.orchestra.run.smithi053.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-08T18:05:48.121 INFO:teuthology.orchestra.run.smithi053.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-08T18:05:48.173 INFO:teuthology.orchestra.run.smithi053.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-08T18:05:48.178 INFO:teuthology.orchestra.run.smithi053.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-08T18:05:48.366 INFO:teuthology.orchestra.run.smithi053.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3525-g27d37168-1jammy [112 kB] 2024-05-08T18:05:48.432 INFO:teuthology.orchestra.run.smithi053.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3525-g27d37168-1jammy [466 kB] 2024-05-08T18:05:48.469 INFO:teuthology.orchestra.run.smithi053.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-08T18:05:48.642 INFO:teuthology.orchestra.run.smithi053.stdout:Get:28 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3525-g27d37168-1jammy [25.8 MB] 2024-05-08T18:05:48.644 INFO:teuthology.orchestra.run.smithi053.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-08T18:05:48.860 INFO:teuthology.orchestra.run.smithi053.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-08T18:05:48.902 INFO:teuthology.orchestra.run.smithi053.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-08T18:05:48.931 INFO:teuthology.orchestra.run.smithi053.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-08T18:05:49.049 INFO:teuthology.orchestra.run.smithi053.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-08T18:05:49.051 INFO:teuthology.orchestra.run.smithi053.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-08T18:05:49.232 INFO:teuthology.orchestra.run.smithi053.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-08T18:05:49.277 INFO:teuthology.orchestra.run.smithi114.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3525-g27d37168-1jammy [14.0 kB] 2024-05-08T18:05:49.278 INFO:teuthology.orchestra.run.smithi114.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3525-g27d37168-1jammy [870 kB] 2024-05-08T18:05:49.301 INFO:teuthology.orchestra.run.smithi114.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3525-g27d37168-1jammy [2,438 kB] 2024-05-08T18:05:49.316 INFO:teuthology.orchestra.run.smithi053.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-08T18:05:49.345 INFO:teuthology.orchestra.run.smithi053.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-08T18:05:49.363 INFO:teuthology.orchestra.run.smithi053.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-08T18:05:49.413 INFO:teuthology.orchestra.run.smithi053.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-08T18:05:49.569 INFO:teuthology.orchestra.run.smithi114.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3525-g27d37168-1jammy [792 kB] 2024-05-08T18:05:49.632 INFO:teuthology.orchestra.run.smithi053.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-08T18:05:49.648 INFO:teuthology.orchestra.run.smithi053.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-08T18:05:49.655 INFO:teuthology.orchestra.run.smithi053.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-08T18:05:49.661 INFO:teuthology.orchestra.run.smithi053.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-08T18:05:49.666 INFO:teuthology.orchestra.run.smithi114.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3525-g27d37168-1jammy [148 kB] 2024-05-08T18:05:49.672 INFO:teuthology.orchestra.run.smithi114.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3525-g27d37168-1jammy [2,279 kB] 2024-05-08T18:05:49.683 INFO:teuthology.orchestra.run.smithi053.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-08T18:05:49.689 INFO:teuthology.orchestra.run.smithi053.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-08T18:05:49.883 INFO:teuthology.orchestra.run.smithi053.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-08T18:05:49.904 INFO:teuthology.orchestra.run.smithi114.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3525-g27d37168-1jammy [8,625 kB] 2024-05-08T18:05:50.230 INFO:teuthology.orchestra.run.smithi053.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-08T18:05:50.262 INFO:teuthology.orchestra.run.smithi053.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-08T18:05:50.273 INFO:teuthology.orchestra.run.smithi053.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-08T18:05:50.490 INFO:teuthology.orchestra.run.smithi053.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-08T18:05:50.491 INFO:teuthology.orchestra.run.smithi053.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-08T18:05:50.496 INFO:teuthology.orchestra.run.smithi053.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-08T18:05:50.501 INFO:teuthology.orchestra.run.smithi053.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-08T18:05:50.516 INFO:teuthology.orchestra.run.smithi053.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-08T18:05:50.538 INFO:teuthology.orchestra.run.smithi053.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-08T18:05:50.545 INFO:teuthology.orchestra.run.smithi053.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-08T18:05:50.721 INFO:teuthology.orchestra.run.smithi053.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-08T18:05:50.977 INFO:teuthology.orchestra.run.smithi053.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-08T18:05:51.083 INFO:teuthology.orchestra.run.smithi114.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3525-g27d37168-1jammy [14.2 kB] 2024-05-08T18:05:51.084 INFO:teuthology.orchestra.run.smithi114.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3525-g27d37168-1jammy [51.7 MB] 2024-05-08T18:05:51.155 INFO:teuthology.orchestra.run.smithi053.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-08T18:05:51.169 INFO:teuthology.orchestra.run.smithi053.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-08T18:05:51.189 INFO:teuthology.orchestra.run.smithi053.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-08T18:05:51.254 INFO:teuthology.orchestra.run.smithi053.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-08T18:05:51.549 INFO:teuthology.orchestra.run.smithi053.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-08T18:05:51.551 INFO:teuthology.orchestra.run.smithi053.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-08T18:05:51.554 INFO:teuthology.orchestra.run.smithi053.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-08T18:05:51.554 INFO:teuthology.orchestra.run.smithi053.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-08T18:05:51.556 INFO:teuthology.orchestra.run.smithi053.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-08T18:05:51.776 INFO:teuthology.orchestra.run.smithi053.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-08T18:05:52.319 INFO:teuthology.orchestra.run.smithi053.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-08T18:05:52.329 INFO:teuthology.orchestra.run.smithi053.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-08T18:05:53.796 INFO:teuthology.orchestra.run.smithi053.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-08T18:05:53.798 INFO:teuthology.orchestra.run.smithi053.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-08T18:05:53.838 INFO:teuthology.orchestra.run.smithi053.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-08T18:05:53.858 INFO:teuthology.orchestra.run.smithi053.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-08T18:05:53.879 INFO:teuthology.orchestra.run.smithi053.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-08T18:05:53.911 INFO:teuthology.orchestra.run.smithi053.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-08T18:05:53.919 INFO:teuthology.orchestra.run.smithi053.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-08T18:05:53.937 INFO:teuthology.orchestra.run.smithi053.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-08T18:05:54.277 INFO:teuthology.orchestra.run.smithi053.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-08T18:05:54.712 INFO:teuthology.orchestra.run.smithi053.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-08T18:05:54.884 INFO:teuthology.orchestra.run.smithi053.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-08T18:05:54.957 INFO:teuthology.orchestra.run.smithi053.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-08T18:05:55.651 INFO:teuthology.orchestra.run.smithi053.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-08T18:05:55.975 INFO:teuthology.orchestra.run.smithi053.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-08T18:05:56.143 INFO:teuthology.orchestra.run.smithi053.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-08T18:05:56.166 INFO:teuthology.orchestra.run.smithi053.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-08T18:05:57.268 INFO:teuthology.orchestra.run.smithi053.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-08T18:05:57.348 INFO:teuthology.orchestra.run.smithi053.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-08T18:05:58.119 INFO:teuthology.orchestra.run.smithi053.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-08T18:05:58.347 INFO:teuthology.orchestra.run.smithi053.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-08T18:05:58.660 INFO:teuthology.orchestra.run.smithi053.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-08T18:05:58.679 INFO:teuthology.orchestra.run.smithi053.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-08T18:05:58.840 INFO:teuthology.orchestra.run.smithi053.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-08T18:05:58.874 INFO:teuthology.orchestra.run.smithi053.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-08T18:05:59.037 INFO:teuthology.orchestra.run.smithi053.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-08T18:05:59.040 INFO:teuthology.orchestra.run.smithi053.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-08T18:05:59.041 INFO:teuthology.orchestra.run.smithi053.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-08T18:05:59.061 INFO:teuthology.orchestra.run.smithi114.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:05:59.063 INFO:teuthology.orchestra.run.smithi114.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3525-g27d37168-1jammy [38.9 kB] 2024-05-08T18:05:59.065 INFO:teuthology.orchestra.run.smithi114.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3525-g27d37168-1jammy [13.7 MB] 2024-05-08T18:05:59.065 INFO:teuthology.orchestra.run.smithi053.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-08T18:05:59.069 INFO:teuthology.orchestra.run.smithi053.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-08T18:06:01.004 INFO:teuthology.orchestra.run.smithi053.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3525-g27d37168-1jammy [5,095 kB] 2024-05-08T18:06:01.336 INFO:teuthology.orchestra.run.smithi114.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3525-g27d37168-1jammy [91.2 kB] 2024-05-08T18:06:01.896 INFO:teuthology.orchestra.run.smithi114.stdout:Fetched 181 MB in 20s (9,250 kB/s) 2024-05-08T18:06:02.069 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T18:06:02.168 INFO:teuthology.orchestra.run.smithi114.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T18:06:02.173 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T18:06:02.259 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:06:02.596 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T18:06:02.622 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T18:06:02.662 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:06:02.791 INFO:teuthology.orchestra.run.smithi053.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3525-g27d37168-1jammy [244 kB] 2024-05-08T18:06:02.874 INFO:teuthology.orchestra.run.smithi053.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:06:02.934 INFO:teuthology.orchestra.run.smithi053.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3525-g27d37168-1jammy [1,544 kB] 2024-05-08T18:06:02.998 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T18:06:03.024 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T18:06:03.073 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:06:03.558 INFO:teuthology.orchestra.run.smithi053.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3525-g27d37168-1jammy [6,259 kB] 2024-05-08T18:06:03.644 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T18:06:03.670 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:06:03.727 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:06:04.147 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T18:06:04.173 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:06:04.213 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:06:04.566 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T18:06:04.592 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:06:04.641 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:06:05.053 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T18:06:05.079 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T18:06:05.128 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:06:05.464 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librados2. 2024-05-08T18:06:05.490 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../007-librados2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:05.530 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:05.552 INFO:teuthology.orchestra.run.smithi053.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3525-g27d37168-1jammy [22.8 MB] 2024-05-08T18:06:05.950 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librbd1. 2024-05-08T18:06:05.965 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../008-librbd1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:06.000 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:06.453 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T18:06:06.479 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:06.519 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:06.813 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rados. 2024-05-08T18:06:06.840 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:06.880 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:07.191 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T18:06:07.217 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:07.257 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:07.485 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T18:06:07.500 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:07.896 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T18:06:07.922 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:07.963 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:08.282 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T18:06:08.308 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T18:06:08.349 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:06:08.677 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T18:06:08.703 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T18:06:08.743 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T18:06:09.029 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T18:06:09.055 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:09.104 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:09.507 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T18:06:09.533 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T18:06:09.574 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:06:09.959 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T18:06:09.975 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T18:06:10.017 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:06:10.312 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T18:06:10.339 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T18:06:10.379 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:06:10.765 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua5.1. 2024-05-08T18:06:10.791 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T18:06:10.840 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:06:11.168 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-any. 2024-05-08T18:06:11.183 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T18:06:11.235 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T18:06:11.487 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package zip. 2024-05-08T18:06:11.504 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T18:06:11.546 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T18:06:11.957 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package unzip. 2024-05-08T18:06:11.984 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T18:06:12.032 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:06:12.307 INFO:teuthology.orchestra.run.smithi053.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3525-g27d37168-1jammy [14.0 kB] 2024-05-08T18:06:12.308 INFO:teuthology.orchestra.run.smithi053.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3525-g27d37168-1jammy [870 kB] 2024-05-08T18:06:12.371 INFO:teuthology.orchestra.run.smithi053.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3525-g27d37168-1jammy [2,438 kB] 2024-05-08T18:06:12.503 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package luarocks. 2024-05-08T18:06:12.529 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T18:06:12.578 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:06:12.720 INFO:teuthology.orchestra.run.smithi053.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3525-g27d37168-1jammy [792 kB] 2024-05-08T18:06:12.829 INFO:teuthology.orchestra.run.smithi053.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3525-g27d37168-1jammy [148 kB] 2024-05-08T18:06:12.861 INFO:teuthology.orchestra.run.smithi053.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3525-g27d37168-1jammy [2,279 kB] 2024-05-08T18:06:12.960 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package librgw2. 2024-05-08T18:06:12.986 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../025-librgw2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:13.026 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:13.170 INFO:teuthology.orchestra.run.smithi053.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3525-g27d37168-1jammy [8,625 kB] 2024-05-08T18:06:13.588 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T18:06:13.611 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:13.654 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:14.415 INFO:teuthology.orchestra.run.smithi053.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3525-g27d37168-1jammy [14.2 kB] 2024-05-08T18:06:14.416 INFO:teuthology.orchestra.run.smithi053.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3525-g27d37168-1jammy [51.7 MB] 2024-05-08T18:06:14.966 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T18:06:14.992 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T18:06:15.049 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:06:15.377 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T18:06:15.404 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:15.444 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:15.822 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-common. 2024-05-08T18:06:15.848 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:15.888 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:17.310 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-base. 2024-05-08T18:06:17.337 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:17.386 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:17.956 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T18:06:17.983 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T18:06:18.023 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:06:18.292 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T18:06:18.318 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T18:06:18.358 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:06:18.695 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T18:06:18.721 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T18:06:18.761 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:06:19.064 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T18:06:19.091 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T18:06:19.148 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:06:19.450 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T18:06:19.477 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T18:06:19.517 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:06:19.803 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T18:06:19.829 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T18:06:19.870 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T18:06:20.173 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-portend. 2024-05-08T18:06:20.199 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T18:06:20.239 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T18:06:20.542 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T18:06:20.568 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T18:06:20.608 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T18:06:20.903 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T18:06:20.929 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T18:06:20.970 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:06:21.282 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T18:06:21.308 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T18:06:21.348 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T18:06:21.659 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T18:06:21.686 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T18:06:21.726 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T18:06:22.029 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T18:06:22.055 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T18:06:22.095 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:06:22.373 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-mako. 2024-05-08T18:06:22.400 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T18:06:22.440 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:06:22.768 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T18:06:22.795 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T18:06:22.834 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:06:22.993 INFO:teuthology.orchestra.run.smithi053.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3525-g27d37168-1jammy [124 kB] 2024-05-08T18:06:22.995 INFO:teuthology.orchestra.run.smithi053.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3525-g27d37168-1jammy [38.9 kB] 2024-05-08T18:06:22.996 INFO:teuthology.orchestra.run.smithi053.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3525-g27d37168-1jammy [13.7 MB] 2024-05-08T18:06:23.137 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T18:06:23.164 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T18:06:23.204 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:06:23.465 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webob. 2024-05-08T18:06:23.480 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T18:06:23.514 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:06:23.809 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T18:06:23.836 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T18:06:23.870 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:06:24.179 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T18:06:24.206 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T18:06:24.245 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:06:24.548 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-paste. 2024-05-08T18:06:24.575 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T18:06:24.615 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:06:24.934 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T18:06:24.950 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T18:06:24.992 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:06:25.296 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T18:06:25.323 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T18:06:25.362 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:06:25.665 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T18:06:25.692 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T18:06:25.731 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T18:06:26.009 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T18:06:26.039 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T18:06:26.067 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:06:26.076 INFO:teuthology.orchestra.run.smithi053.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-eric-testing-1/27d371685027569bcfa4efc661d3d3186f3a1776/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3525-g27d37168-1jammy [91.2 kB] 2024-05-08T18:06:26.398 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T18:06:26.424 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T18:06:26.455 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T18:06:26.668 INFO:teuthology.orchestra.run.smithi053.stdout:Fetched 181 MB in 44s (4,099 kB/s) 2024-05-08T18:06:26.783 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-idna. 2024-05-08T18:06:26.810 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T18:06:26.831 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-08T18:06:26.850 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T18:06:26.934 INFO:teuthology.orchestra.run.smithi053.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-08T18:06:26.939 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-08T18:06:27.022 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:06:27.195 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T18:06:27.221 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T18:06:27.261 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:06:27.375 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-08T18:06:27.402 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-08T18:06:27.442 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:06:27.581 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests. 2024-05-08T18:06:27.608 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T18:06:27.647 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:06:27.753 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-08T18:06:27.780 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-08T18:06:27.820 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:06:27.925 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T18:06:27.941 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T18:06:27.975 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:06:28.278 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T18:06:28.282 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-08T18:06:28.305 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:28.309 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:06:28.345 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:28.357 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:06:28.727 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-08T18:06:28.753 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:06:28.758 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T18:06:28.785 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:28.785 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:06:28.824 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:29.161 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T18:06:29.188 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T18:06:29.227 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:06:29.280 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-08T18:06:29.307 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-08T18:06:29.347 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:06:29.705 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T18:06:29.708 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-08T18:06:29.731 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T18:06:29.735 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-08T18:06:29.763 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T18:06:29.775 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:06:30.066 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T18:06:30.070 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librados2. 2024-05-08T18:06:30.082 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:30.097 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../007-librados2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:30.116 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:30.128 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:30.477 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T18:06:30.504 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:30.544 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:30.564 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librbd1. 2024-05-08T18:06:30.591 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../008-librbd1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:30.631 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:31.084 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs2. 2024-05-08T18:06:31.111 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:31.150 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:31.158 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T18:06:31.184 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:31.224 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:31.461 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rados. 2024-05-08T18:06:31.477 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:31.511 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:31.781 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-08T18:06:31.807 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:31.847 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:32.100 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cephfs. 2024-05-08T18:06:32.116 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:32.158 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:32.252 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph. 2024-05-08T18:06:32.268 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../066-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:32.310 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:32.469 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-08T18:06:32.496 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:32.536 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:32.622 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T18:06:32.648 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:32.696 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:32.856 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-08T18:06:32.883 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-08T18:06:32.922 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:06:33.075 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T18:06:33.101 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:33.141 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:33.259 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-prettytable. 2024-05-08T18:06:33.286 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-05-08T18:06:33.326 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-08T18:06:33.544 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package cephadm. 2024-05-08T18:06:33.570 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rbd. 2024-05-08T18:06:33.570 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../069-cephadm_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:33.586 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:33.610 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:33.620 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:33.888 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T18:06:33.915 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T18:06:33.923 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-08T18:06:33.946 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T18:06:33.949 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-08T18:06:33.989 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:06:34.258 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T18:06:34.273 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:06:34.275 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-08T18:06:34.291 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-08T18:06:34.307 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:06:34.492 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:06:34.778 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-08T18:06:34.794 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-08T18:06:34.837 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:06:35.365 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua5.1. 2024-05-08T18:06:35.392 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-08T18:06:35.432 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:06:35.521 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-babel. 2024-05-08T18:06:35.548 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:06:35.587 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:06:35.752 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-any. 2024-05-08T18:06:35.779 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-05-08T18:06:35.818 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-08T18:06:35.898 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T18:06:35.914 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T18:06:35.948 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:06:36.071 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package zip. 2024-05-08T18:06:36.098 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-05-08T18:06:36.138 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking zip (3.0-12build2) ... 2024-05-08T18:06:36.235 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T18:06:36.262 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:36.293 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:36.466 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package unzip. 2024-05-08T18:06:36.493 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-08T18:06:36.533 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:06:36.596 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T18:06:36.623 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T18:06:36.654 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T18:06:36.949 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-routes. 2024-05-08T18:06:36.975 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T18:06:37.003 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package luarocks. 2024-05-08T18:06:37.015 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:06:37.030 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-08T18:06:37.078 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:06:37.335 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T18:06:37.362 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:37.401 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:37.528 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package librgw2. 2024-05-08T18:06:37.555 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../025-librgw2_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:37.594 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:38.147 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rgw. 2024-05-08T18:06:38.163 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:38.205 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:38.575 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-08T18:06:38.602 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-08T18:06:38.650 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:06:38.681 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T18:06:38.697 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T18:06:38.739 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:06:39.028 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libradosstriper1. 2024-05-08T18:06:39.055 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:39.103 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:39.243 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T18:06:39.270 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T18:06:39.309 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:06:39.548 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-common. 2024-05-08T18:06:39.575 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:39.615 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:39.680 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T18:06:39.707 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T18:06:39.746 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:06:40.032 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T18:06:40.059 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T18:06:40.099 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:06:40.799 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T18:06:40.826 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:40.906 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-base. 2024-05-08T18:06:40.932 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:40.950 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:40.982 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:41.568 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-08T18:06:41.595 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-08T18:06:41.643 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:06:41.929 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T18:06:41.956 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T18:06:41.987 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T18:06:42.012 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cheroot. 2024-05-08T18:06:42.040 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-08T18:06:42.088 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:06:42.248 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T18:06:42.276 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T18:06:42.315 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:06:42.474 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-08T18:06:42.501 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-08T18:06:42.548 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:06:42.668 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T18:06:42.695 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T18:06:42.735 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:06:42.902 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-08T18:06:42.928 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-08T18:06:42.976 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:06:43.004 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T18:06:43.031 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T18:06:43.062 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T18:06:43.280 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-08T18:06:43.306 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-08T18:06:43.346 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:06:43.391 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T18:06:43.419 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T18:06:43.458 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T18:06:43.732 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempora. 2024-05-08T18:06:43.759 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-05-08T18:06:43.777 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T18:06:43.804 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T18:06:43.807 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-08T18:06:43.844 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:06:44.163 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T18:06:44.168 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-portend. 2024-05-08T18:06:44.191 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T18:06:44.195 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-05-08T18:06:44.230 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T18:06:44.235 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-08T18:06:44.525 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T18:06:44.538 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-08T18:06:44.553 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T18:06:44.565 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-08T18:06:44.583 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:06:44.604 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-08T18:06:44.941 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-08T18:06:44.967 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-08T18:06:45.015 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:06:45.361 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-natsort. 2024-05-08T18:06:45.388 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-05-08T18:06:45.422 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T18:06:45.427 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-08T18:06:45.438 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:45.480 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:45.739 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-logutils. 2024-05-08T18:06:45.766 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-05-08T18:06:45.805 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-08T18:06:45.808 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T18:06:45.836 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T18:06:45.874 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:06:46.108 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-08T18:06:46.135 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-08T18:06:46.169 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T18:06:46.174 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:06:46.197 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:06:46.227 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:06:46.461 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-mako. 2024-05-08T18:06:46.477 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-08T18:06:46.513 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package jq. 2024-05-08T18:06:46.529 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:06:46.571 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T18:06:46.635 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:06:46.832 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package socat. 2024-05-08T18:06:46.848 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T18:06:46.891 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:06:46.981 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-08T18:06:47.008 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-08T18:06:47.047 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:06:47.219 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T18:06:47.246 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T18:06:47.285 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:06:47.341 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-08T18:06:47.368 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-08T18:06:47.408 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:06:47.631 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-test. 2024-05-08T18:06:47.644 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:47.681 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:47.711 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webob. 2024-05-08T18:06:47.738 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-08T18:06:47.769 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:06:48.064 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-waitress. 2024-05-08T18:06:48.079 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-08T18:06:48.116 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:06:48.400 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-tempita. 2024-05-08T18:06:48.427 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-08T18:06:48.466 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:06:48.753 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-paste. 2024-05-08T18:06:48.780 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-08T18:06:48.819 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:06:49.147 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-08T18:06:49.163 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-08T18:06:49.197 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:06:49.467 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-08T18:06:49.493 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-08T18:06:49.533 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:06:49.836 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-webtest. 2024-05-08T18:06:49.863 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-05-08T18:06:49.869 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T18:06:49.896 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:49.903 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-08T18:06:49.935 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:50.214 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pecan. 2024-05-08T18:06:50.241 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-08T18:06:50.264 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T18:06:50.280 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:06:50.292 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:50.330 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:50.644 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-certifi. 2024-05-08T18:06:50.650 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T18:06:50.670 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-05-08T18:06:50.678 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T18:06:50.710 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-08T18:06:50.716 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:06:51.063 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T18:06:51.088 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-idna. 2024-05-08T18:06:51.090 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T18:06:51.115 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-05-08T18:06:51.129 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:06:51.163 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-08T18:06:51.441 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T18:06:51.457 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T18:06:51.499 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-urllib3. 2024-05-08T18:06:51.500 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:06:51.526 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-08T18:06:51.566 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:06:51.888 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package pkg-config. 2024-05-08T18:06:51.916 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T18:06:51.927 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests. 2024-05-08T18:06:51.954 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:06:51.955 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-08T18:06:52.002 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:06:52.224 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T18:06:52.252 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T18:06:52.290 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:06:52.372 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-08T18:06:52.399 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-08T18:06:52.438 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:06:52.710 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T18:06:52.737 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T18:06:52.758 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-08T18:06:52.776 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T18:06:52.785 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:06:52.824 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:53.079 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T18:06:53.106 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T18:06:53.145 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T18:06:53.163 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-08T18:06:53.179 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:53.221 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:53.474 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T18:06:53.502 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T18:06:53.541 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:06:53.541 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-08T18:06:53.568 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-08T18:06:53.607 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:06:53.810 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T18:06:53.838 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T18:06:53.868 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T18:06:53.910 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-openssl. 2024-05-08T18:06:53.937 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-05-08T18:06:53.976 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-08T18:06:54.213 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-py. 2024-05-08T18:06:54.240 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T18:06:54.279 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T18:06:54.288 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr. 2024-05-08T18:06:54.315 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:54.346 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:54.583 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T18:06:54.607 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T18:06:54.641 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:06:54.691 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mon. 2024-05-08T18:06:54.718 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:54.748 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:55.095 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T18:06:55.123 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T18:06:55.161 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:06:55.361 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-osd. 2024-05-08T18:06:55.388 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:55.427 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:55.447 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-toml. 2024-05-08T18:06:55.475 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T18:06:55.505 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T18:06:55.784 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T18:06:55.811 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T18:06:55.866 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:06:56.170 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T18:06:56.197 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T18:06:56.236 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:06:56.497 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T18:06:56.525 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T18:06:56.555 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:06:56.631 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph. 2024-05-08T18:06:56.646 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../066-ceph_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:56.689 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:57.008 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-fuse. 2024-05-08T18:06:57.036 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:57.074 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:57.285 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package radosgw. 2024-05-08T18:06:57.312 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../116-radosgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:57.351 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:57.444 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mds. 2024-05-08T18:06:57.472 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:57.511 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:57.897 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package cephadm. 2024-05-08T18:06:57.925 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../069-cephadm_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:57.964 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:58.171 INFO:teuthology.orchestra.run.smithi114.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T18:06:58.186 INFO:teuthology.orchestra.run.smithi114.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:06:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:Unpacking rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:06:58.241 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-08T18:06:58.269 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-08T18:06:58.308 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-08T18:06:58.534 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T18:06:58.619 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-08T18:06:58.647 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:06:58.685 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:06:58.809 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:06:58.926 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:06:59.157 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T18:06:59.472 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T18:06:59.699 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-babel. 2024-05-08T18:06:59.727 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-08T18:06:59.757 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:06:59.896 INFO:teuthology.orchestra.run.smithi114.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T18:06:59.944 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:00.102 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-jinja2. 2024-05-08T18:07:00.130 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-08T18:07:00.315 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:07:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user cephadm....done 2024-05-08T18:07:00.559 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:07:00.755 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-08T18:07:00.782 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:07:00.821 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:00.902 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:07:01.158 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-08T18:07:01.169 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:07:01.185 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-05-08T18:07:01.224 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-08T18:07:01.296 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:07:01.544 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-routes. 2024-05-08T18:07:01.546 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T18:07:01.571 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-08T18:07:01.610 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:07:01.832 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:07:01.913 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-08T18:07:01.930 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:07:01.957 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T18:07:01.963 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:02.268 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:07:02.611 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T18:07:02.862 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T18:07:03.130 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:07:03.210 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-08T18:07:03.227 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-08T18:07:03.268 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:07:03.382 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:07:03.650 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:07:03.780 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-joblib. 2024-05-08T18:07:03.807 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-08T18:07:03.846 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:07:03.926 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:07:04.168 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:04.225 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-08T18:07:04.252 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-08T18:07:04.291 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:07:04.411 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:07:04.520 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:07:04.544 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-sklearn. 2024-05-08T18:07:04.571 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-08T18:07:04.610 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:07:04.646 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:07:04.772 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:07:05.048 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:07:05.344 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-08T18:07:05.373 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:07:05.474 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T18:07:05.504 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:05.520 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T18:07:05.585 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:07:05.694 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T18:07:06.053 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:07:06.180 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T18:07:06.447 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:07:06.533 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-cachetools. 2024-05-08T18:07:06.549 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-05-08T18:07:06.582 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-08T18:07:06.707 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:07:06.844 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-08T18:07:06.872 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-08T18:07:06.910 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:07:07.025 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T18:07:07.176 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:07:07.239 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-08T18:07:07.267 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-08T18:07:07.305 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:07:07.602 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-rsa. 2024-05-08T18:07:07.628 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-05-08T18:07:07.666 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-08T18:07:07.836 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:07:07.987 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-google-auth. 2024-05-08T18:07:08.015 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-05-08T18:07:08.062 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-08T18:07:08.079 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:07:08.205 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:07:08.331 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:07:08.448 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-08T18:07:08.476 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-08T18:07:08.523 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:07:08.624 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T18:07:08.901 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-websocket. 2024-05-08T18:07:08.929 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-05-08T18:07:08.976 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-08T18:07:09.033 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T18:07:09.330 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-08T18:07:09.342 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:07:09.357 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-08T18:07:09.395 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:07:09.711 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:07:09.995 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:07:10.093 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-08T18:07:10.121 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:07:10.159 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:10.347 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:07:10.496 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-08T18:07:10.523 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-08T18:07:10.562 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:07:10.606 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:07:10.757 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:10.865 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-08T18:07:10.881 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:07:10.915 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:07:11.084 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T18:07:11.201 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package jq. 2024-05-08T18:07:11.217 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-08T18:07:11.259 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-08T18:07:11.393 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:07:11.511 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package socat. 2024-05-08T18:07:11.528 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-08T18:07:11.570 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:07:11.881 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package xmlstarlet. 2024-05-08T18:07:11.898 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-08T18:07:11.940 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:07:12.327 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-test. 2024-05-08T18:07:12.344 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:07:12.385 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:12.515 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:07:12.808 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:07:12.968 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T18:07:13.236 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:07:13.353 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:07:13.479 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:07:13.764 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:07:14.015 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T18:07:14.274 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:07:14.426 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:07:14.698 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package ceph-volume. 2024-05-08T18:07:14.726 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3525-g27d37168-1jammy_all.deb ... 2024-05-08T18:07:14.743 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:07:14.764 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:14.995 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T18:07:15.077 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-08T18:07:15.105 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:07:15.143 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:15.245 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T18:07:15.479 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-08T18:07:15.496 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:07:15.507 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-08T18:07:15.546 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:07:15.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T18:07:15.859 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-08T18:07:15.887 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-05-08T18:07:15.917 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:07:16.268 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:07:16.338 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package nvme-cli. 2024-05-08T18:07:16.366 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-08T18:07:16.404 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:07:16.461 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T18:07:16.753 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:07:16.826 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package pkg-config. 2024-05-08T18:07:16.854 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-08T18:07:16.879 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:07:16.892 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:07:17.153 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-08T18:07:17.172 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:07:17.181 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-08T18:07:17.220 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:07:17.481 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:07:17.682 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-08T18:07:17.709 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-08T18:07:17.741 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:07:17.748 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-08T18:07:17.892 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:07:17.992 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pastescript. 2024-05-08T18:07:17.993 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:07:18.009 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-05-08T18:07:18.042 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-08T18:07:18.066 INFO:teuthology.orchestra.run.smithi114.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T18:07:18.303 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:07:18.345 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pluggy. 2024-05-08T18:07:18.373 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-08T18:07:18.412 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:07:18.429 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:07:18.725 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-psutil. 2024-05-08T18:07:18.753 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-08T18:07:18.791 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-08T18:07:18.814 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:07:19.073 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T18:07:19.153 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-py. 2024-05-08T18:07:19.181 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-05-08T18:07:19.216 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T18:07:19.227 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-08T18:07:19.484 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:07:19.556 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pygments. 2024-05-08T18:07:19.584 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-08T18:07:19.601 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:07:19.622 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:07:19.894 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:07:20.060 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-08T18:07:20.076 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-08T18:07:20.109 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:07:20.204 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:07:20.421 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-toml. 2024-05-08T18:07:20.449 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-05-08T18:07:20.482 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T18:07:20.487 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-08T18:07:20.606 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T18:07:20.799 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-pytest. 2024-05-08T18:07:20.827 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-08T18:07:20.865 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:07:20.882 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T18:07:21.167 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:07:21.185 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package python3-simplejson. 2024-05-08T18:07:21.213 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-08T18:07:21.251 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:07:21.512 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-08T18:07:21.520 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:07:21.529 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-08T18:07:21.570 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:07:21.914 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T18:07:22.207 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:07:22.525 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package radosgw. 2024-05-08T18:07:22.553 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../116-radosgw_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:07:22.559 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:07:22.591 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:22.660 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:22.770 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:22.887 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:07:23.240 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:23.366 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:23.501 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T18:07:23.585 INFO:teuthology.orchestra.run.smithi053.stdout:Selecting previously unselected package rbd-fuse. 2024-05-08T18:07:23.602 INFO:teuthology.orchestra.run.smithi053.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3525-g27d37168-1jammy_amd64.deb ... 2024-05-08T18:07:23.644 INFO:teuthology.orchestra.run.smithi053.stdout:Unpacking rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:23.769 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:23.895 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:23.932 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-08T18:07:24.021 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:24.182 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-08T18:07:24.236 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:07:24.236 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:07:24.308 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-08T18:07:24.577 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-08T18:07:24.748 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:24.890 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:25.000 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-08T18:07:25.041 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:25.201 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:07:25.435 INFO:teuthology.orchestra.run.smithi053.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-08T18:07:25.501 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:26.143 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user cephadm....done 2024-05-08T18:07:26.308 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-08T18:07:26.405 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:26.530 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:26.584 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-08T18:07:26.656 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:26.782 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:26.843 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-08T18:07:26.908 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:26.969 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-08T18:07:27.304 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-08T18:07:27.384 INFO:teuthology.orchestra.run.smithi114.stdout:Adding group ceph....done 2024-05-08T18:07:27.563 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-08T18:07:27.673 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-08T18:07:27.761 INFO:teuthology.orchestra.run.smithi114.stdout:Adding system user ceph....done 2024-05-08T18:07:27.921 INFO:teuthology.orchestra.run.smithi114.stdout:Setting system user ceph properties....done 2024-05-08T18:07:27.933 INFO:teuthology.orchestra.run.smithi114.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T18:07:27.982 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-08T18:07:28.063 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T18:07:28.351 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-08T18:07:28.365 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T18:07:28.644 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-08T18:07:28.859 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:28.920 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-08T18:07:28.960 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:29.155 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-08T18:07:29.390 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-08T18:07:29.419 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:07:29.419 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:07:29.741 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-08T18:07:29.937 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:30.008 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-argparse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:30.268 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-08T18:07:30.291 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T18:07:30.393 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-08T18:07:30.519 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-08T18:07:30.645 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-08T18:07:30.764 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:30.905 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-08T18:07:30.997 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:07:30.997 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:07:31.244 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-08T18:07:31.279 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-08T18:07:31.342 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-08T18:07:31.467 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-08T18:07:31.482 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:31.725 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:07:31.726 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:07:31.844 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-08T18:07:31.969 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-08T18:07:32.217 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:32.245 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-08T18:07:32.513 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-08T18:07:32.519 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:07:32.519 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:07:32.815 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up zip (3.0-12build2) ... 2024-05-08T18:07:32.941 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-08T18:07:33.002 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:33.112 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:33.263 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:33.472 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:07:33.472 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:07:33.609 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-08T18:07:33.869 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-08T18:07:33.948 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:33.994 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-08T18:07:34.090 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:34.120 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-08T18:07:34.216 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:34.384 INFO:teuthology.orchestra.run.smithi114.stdout:Setting up ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:34.413 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-08T18:07:34.729 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T18:07:34.806 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-08T18:07:34.821 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T18:07:34.957 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T18:07:35.057 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-08T18:07:35.467 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-08T18:07:35.777 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-08T18:07:36.128 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-08T18:07:36.224 INFO:teuthology.orchestra.run.smithi114.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T18:07:36.379 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-08T18:07:36.480 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:36.807 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-idna (3.3-1) ... 2024-05-08T18:07:36.863 INFO:teuthology.orchestra.run.smithi114.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T18:07:36.869 DEBUG:teuthology.parallel:result is None 2024-05-08T18:07:37.133 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-08T18:07:38.346 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-08T18:07:38.573 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:07:38.707 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-08T18:07:38.984 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-08T18:07:39.109 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-08T18:07:39.235 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-08T18:07:39.537 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-08T18:07:39.788 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-08T18:07:40.022 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:07:40.148 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-08T18:07:40.475 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-08T18:07:40.734 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-08T18:07:41.002 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-08T18:07:41.277 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-08T18:07:41.529 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-08T18:07:41.780 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-08T18:07:41.881 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-08T18:07:42.165 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-08T18:07:42.291 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-08T18:07:42.601 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-08T18:07:42.910 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-08T18:07:43.170 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-08T18:07:43.296 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-08T18:07:43.413 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-08T18:07:43.494 INFO:teuthology.orchestra.run.smithi053.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-08T18:07:43.723 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-08T18:07:43.841 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-08T18:07:44.243 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-08T18:07:44.485 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-08T18:07:44.620 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-08T18:07:44.879 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-08T18:07:45.038 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-08T18:07:45.389 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-08T18:07:45.699 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-08T18:07:45.967 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-08T18:07:46.068 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-08T18:07:46.327 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-08T18:07:46.586 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-08T18:07:46.948 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-08T18:07:47.350 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-08T18:07:47.635 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-08T18:07:47.970 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-08T18:07:48.096 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librados2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:48.222 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:48.349 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-08T18:07:48.660 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:48.761 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libradosstriper1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:48.878 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-08T18:07:49.172 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librbd1 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:49.298 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-modules-core (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:49.432 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:49.655 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:07:49.655 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-08T18:07:50.125 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up libcephfs-dev (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:50.226 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rados (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:50.327 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up librgw2 (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:50.453 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-08T18:07:51.748 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rbd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:51.874 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up rbd-fuse (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:51.992 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-rgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:52.093 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up python3-cephfs (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:52.194 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-common (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:53.288 INFO:teuthology.orchestra.run.smithi053.stdout:Adding group ceph....done 2024-05-08T18:07:53.580 INFO:teuthology.orchestra.run.smithi053.stdout:Adding system user ceph....done 2024-05-08T18:07:53.740 INFO:teuthology.orchestra.run.smithi053.stdout:Setting system user ceph properties....done 2024-05-08T18:07:53.751 INFO:teuthology.orchestra.run.smithi053.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-08T18:07:53.894 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-08T18:07:54.207 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-08T18:07:54.720 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-test (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:54.955 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up radosgw (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:55.422 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:07:55.422 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-08T18:07:55.857 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-base (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:56.217 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-08T18:07:56.658 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mds (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:56.884 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:07:56.885 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-08T18:07:57.346 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:57.569 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:07:57.569 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-08T18:07:58.024 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-osd (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:58.318 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:07:58.318 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-08T18:07:58.813 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:58.939 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:59.099 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mon (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:07:59.320 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:07:59.320 INFO:teuthology.orchestra.run.smithi053.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-08T18:07:59.891 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-cephadm (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:08:00.109 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:08:00.210 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-mgr-dashboard (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:08:00.352 INFO:teuthology.orchestra.run.smithi053.stdout:Setting up ceph-volume (19.0.0-3525-g27d37168-1jammy) ... 2024-05-08T18:08:00.722 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-08T18:08:00.831 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-08T18:08:00.984 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-08T18:08:02.018 INFO:teuthology.orchestra.run.smithi053.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-08T18:08:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-08T18:08:02.660 DEBUG:teuthology.parallel:result is None 2024-05-08T18:08:02.661 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:08:02.904 DEBUG:teuthology.orchestra.run.smithi053:> dpkg-query -W -f '${Version}' ceph 2024-05-08T18:08:02.924 INFO:teuthology.orchestra.run.smithi053.stdout:19.0.0-3525-g27d37168-1jammy 2024-05-08T18:08:02.924 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:08:02.925 INFO:teuthology.task.install:The correct ceph version 19.0.0-3525-g27d37168-1jammy is installed. 2024-05-08T18:08:02.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=27d371685027569bcfa4efc661d3d3186f3a1776 2024-05-08T18:08:03.141 DEBUG:teuthology.orchestra.run.smithi114:> dpkg-query -W -f '${Version}' ceph 2024-05-08T18:08:03.161 INFO:teuthology.orchestra.run.smithi114.stdout:19.0.0-3525-g27d37168-1jammy 2024-05-08T18:08:03.161 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3525-g27d37168-1jammy 2024-05-08T18:08:03.161 INFO:teuthology.task.install:The correct ceph version 19.0.0-3525-g27d37168-1jammy is installed. 2024-05-08T18:08:03.163 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T18:08:03.163 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:03.163 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:08:03.178 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:03.178 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T18:08:03.218 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T18:08:03.219 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:03.219 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:08:03.233 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:08:03.290 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:03.290 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T18:08:03.303 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T18:08:03.357 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T18:08:03.358 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:03.358 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:08:03.372 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:08:03.429 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:03.429 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T18:08:03.443 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T18:08:03.497 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T18:08:03.497 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:03.497 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:08:03.510 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:08:03.565 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:03.565 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T18:08:03.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T18:08:03.632 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T18:08:03.725 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T18:08:03.725 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /var/log/ceph 2024-05-08T18:08:03.728 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-05-08T18:08:03.741 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T18:08:03.741 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:08:03.783 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T18:08:03.801 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T18:08:03.801 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:08:03.843 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T18:08:03.866 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T18:08:03.866 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T18:08:03.866 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871', 'branch': 'wip-eric-testing-1', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}}', 'email': 'ivancich@redhat.com', 'first_in_suite': False, 'job_id': '7697871', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-eric-testing-1'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-eric-testing-1', 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776'}}, 'owner': 'scheduled_ivancich@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 831, 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'sleep_before_teardown': 0, 'subset': '1/50', 'suite': 'rgw', 'suite_branch': 'wip-eric-testing-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_27d371685027569bcfa4efc661d3d3186f3a1776/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'targets': {'smithi053.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOwmm6I245TvQ59NZRMOTHXVwqvvgvULEjNUr1dkfnzqVNkYDY4LXKlCk4ZaqZW5nQIv7dJtBU7umy1B45rSNo=', 'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBANeVtMQxjmk+TyFvG4+/feykSXJMHV3b8bffxQYMKtaeFB1r0Sd47fDeX+eJcxrGvxI+FUYooF/APAF6UXkg3k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '27d371685027569bcfa4efc661d3d3186f3a1776', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-08_17:43:43', 'tube': 'smithi', 'user': 'ivancich', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T18:08:03.867 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:08:03.899 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T18:08:03.906 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:08:03.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T18:08:03.961 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:03.962 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:08:04.006 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:08:04.006 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:02:08.592779466 +0000 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:02:08.324781859 +0000 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:02:08.324781859 +0000 2024-05-08T18:08:04.055 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-05-08T18:08:04.055 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:08:04.109 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:08:04.109 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:08:04.109 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000255079 s, 2.0 MB/s 2024-05-08T18:08:04.110 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:08:04.159 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 906 Links: 1 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:02:09.072775177 +0000 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:02:08.788777715 +0000 2024-05-08T18:08:04.206 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:02:08.788777715 +0000 2024-05-08T18:08:04.207 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-05-08T18:08:04.207 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:08:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:08:04.260 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:08:04.261 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000245664 s, 2.1 MB/s 2024-05-08T18:08:04.262 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:08:04.311 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2024-05-08T18:08:04.358 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:08:04.358 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.358 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-05-08T18:08:04.358 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.358 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:02:09.552770890 +0000 2024-05-08T18:08:04.359 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:02:09.288773248 +0000 2024-05-08T18:08:04.359 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:02:09.288773248 +0000 2024-05-08T18:08:04.359 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-05-08T18:08:04.359 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:08:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:08:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:08:04.412 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.00030957 s, 1.7 MB/s 2024-05-08T18:08:04.414 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:08:04.463 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2024-05-08T18:08:04.510 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:08:04.510 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.510 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 5h/5d Inode: 940 Links: 1 2024-05-08T18:08:04.511 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.511 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2024-05-08 18:02:10.072766246 +0000 2024-05-08T18:08:04.511 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2024-05-08 18:02:09.792768747 +0000 2024-05-08T18:08:04.511 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2024-05-08 18:02:09.792768747 +0000 2024-05-08T18:08:04.511 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2024-05-08T18:08:04.511 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:08:04.564 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2024-05-08T18:08:04.564 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2024-05-08T18:08:04.565 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000282445 s, 1.8 MB/s 2024-05-08T18:08:04.566 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:08:04.615 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T18:08:04.616 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:04.616 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T18:08:04.621 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T18:08:04.622 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 870 Links: 1 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-08 18:02:08.406097508 +0000 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-08 18:02:08.166099650 +0000 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-08 18:02:08.166099650 +0000 2024-05-08T18:08:04.670 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-05-08T18:08:04.671 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T18:08:04.724 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-08T18:08:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-08T18:08:04.725 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000386867 s, 1.3 MB/s 2024-05-08T18:08:04.726 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T18:08:04.775 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-05-08T18:08:04.822 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T18:08:04.822 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.822 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-05-08T18:08:04.823 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.823 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-08 18:02:08.938092763 +0000 2024-05-08T18:08:04.823 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-08 18:02:08.646095368 +0000 2024-05-08T18:08:04.823 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-08 18:02:08.646095368 +0000 2024-05-08T18:08:04.823 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-05-08T18:08:04.823 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T18:08:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-08T18:08:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-08T18:08:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000434211 s, 1.2 MB/s 2024-05-08T18:08:04.877 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T18:08:04.927 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-05-08T18:08:04.974 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T18:08:04.974 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:04.974 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-05-08T18:08:04.974 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:04.975 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-08 18:02:09.442088267 +0000 2024-05-08T18:08:04.975 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-08 18:02:09.170090694 +0000 2024-05-08T18:08:04.975 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-08 18:02:09.170090694 +0000 2024-05-08T18:08:04.975 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-05-08T18:08:04.975 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T18:08:05.028 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-08T18:08:05.028 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-08T18:08:05.028 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.00041465 s, 1.2 MB/s 2024-05-08T18:08:05.029 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T18:08:05.079 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-05-08T18:08:05.125 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T18:08:05.125 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T18:08:05.125 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-05-08T18:08:05.125 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T18:08:05.126 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-05-08 18:02:09.978083484 +0000 2024-05-08T18:08:05.126 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-05-08 18:02:09.694086019 +0000 2024-05-08T18:08:05.126 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-05-08 18:02:09.694086019 +0000 2024-05-08T18:08:05.126 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-05-08T18:08:05.126 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T18:08:05.179 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-05-08T18:08:05.179 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-05-08T18:08:05.179 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000282464 s, 1.8 MB/s 2024-05-08T18:08:05.180 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T18:08:05.227 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:08:05.227 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T18:08:05.227 INFO:tasks.ceph:Generating config... 2024-05-08T18:08:05.228 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T18:08:05.228 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-08T18:08:05.228 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-08T18:08:05.228 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-08T18:08:05.228 INFO:tasks.ceph:[client] setuser = ceph 2024-05-08T18:08:05.228 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T18:08:05.229 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T18:08:05.229 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T18:08:05.229 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T18:08:05.230 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T18:08:05.230 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T18:08:05.230 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T18:08:05.230 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T18:08:05.230 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T18:08:05.264 INFO:teuthology.orchestra.run.smithi053.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T18:08:05.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T18:08:05.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:08:05.433 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.53')] 2024-05-08T18:08:05.433 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.53'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-08T18:08:05.434 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:05.434 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:08:05.482 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.53 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: generated fsid a49ba316-612d-4e74-b7c0-c89e2b4be23c 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:setting min_mon_release = quincy 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:epoch 0 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:fsid a49ba316-612d-4e74-b7c0-c89e2b4be23c 2024-05-08T18:08:05.560 INFO:teuthology.orchestra.run.smithi053.stdout:last_changed 2024-05-08T18:08:05.564514+0000 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi053.stdout:created 2024-05-08T18:08:05.564514+0000 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi053.stdout:min_mon_release 17 (quincy) 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi053.stdout:election_strategy: 1 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi053.stdout:0: [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon.a 2024-05-08T18:08:05.561 INFO:teuthology.orchestra.run.smithi053.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-08T18:08:05.562 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T18:08:05.610 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a49ba316-612d-4e74-b7c0-c89e2b4be23c... 2024-05-08T18:08:05.611 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:08:05.655 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.684 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:08:05.685 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.686 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = 172.21.15.53 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = a49ba316-612d-4e74-b7c0-c89e2b4be23c 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-05-08T18:08:05.687 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.688 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: debug objclass = 20 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:08:05.689 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-05-08T18:08:05.690 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:08:05.691 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: rgw gc obj min wait = 15 2024-05-08T18:08:05.692 INFO:teuthology.orchestra.run.smithi114.stdout: debug rgw = 20 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi114.stdout: setgroup = ceph 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi114.stdout: setuser = ceph 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi053.stdout:[global] 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi053.stdout: chdir = "" 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi053.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi053.stdout: auth supported = cephx 2024-05-08T18:08:05.693 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: filestore xattr use omap = true 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: mon clock drift allowed = 1.000 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: osd crush chooseleaf type = 0 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: auth debug = true 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on old message = true 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: ms die on bug = true 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: mon pg warn max object skew = 0 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T18:08:05.694 INFO:teuthology.orchestra.run.smithi053.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default size = 2 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow primary affinity = true 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd allow pg remap = true 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on legacy crush tunables = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on crush straw calc version zero = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on no sortbitwise = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on osd down out interval zero = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon warn on too few osds = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: mon_allow_pool_size_one = true 2024-05-08T18:08:05.695 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: osd default data pool replay window = 5 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: mon allow pool delete = true 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: mon cluster log file level = debug 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: debug asserts on shutdown = true 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: mon health detail to clog = false 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: mon host = 172.21.15.53 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: fsid = a49ba316-612d-4e74-b7c0-c89e2b4be23c 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout:[osd] 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: osd journal size = 100 2024-05-08T18:08:05.696 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub load threshold = 5.0 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd scrub max interval = 600 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd mclock profile = high_recovery_ops 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd recover clone overlap = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd recovery max chunk = 1048576 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug shutdown = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug op order = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug verify stray on activate = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug trim objects = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd open classes on start = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug pg log writeout = true 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.697 INFO:teuthology.orchestra.run.smithi053.stdout: osd deep scrub update digest min age = 30 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: osd map max advance = 10 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: journal zero on create = true 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: filestore ondisk finisher threads = 3 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: filestore apply finisher threads = 3 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: bdev debug aio = true 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: osd debug misdirected ops = true 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: debug objclass = 20 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: bdev async discard = True 2024-05-08T18:08:05.698 INFO:teuthology.orchestra.run.smithi053.stdout: bdev enable discard = True 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore allocator = bitmap 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore block size = 96636764160 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: bluestore fsck on mount = True 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluefs = 1/20 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: debug bluestore = 1/20 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: debug osd = 20 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: debug rocksdb = 4/10 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd full ratio = 0.9 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd nearfull ratio = 0.8 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: osd failsafe full ratio = 0.95 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: osd objectstore = bluestore 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.699 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr] 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug mgr = 20 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: mgr/telemetry/nag = false 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout:[mon] 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug mon = 20 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug paxos = 20 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: debug auth = 20 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: mon data avail warn = 5 2024-05-08T18:08:05.700 INFO:teuthology.orchestra.run.smithi053.stdout: mon mgr mkfs grace = 240 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min pgs per osd = 4 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd reporter subtree level = osd 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: mon osd prime pg temp = true 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: mon reweight min bytes per osd = 10 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.701 INFO:teuthology.orchestra.run.smithi053.stdout: # 1m isn't quite enough 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: mon_down_mkfs_grace = 2m 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: mon_warn_on_filestore_osds = false 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout:[client] 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: rgw cache enabled = true 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable ops log = true 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: rgw enable usage log = true 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: debug ms = 1 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: rgw gc obj min wait = 15 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: debug rgw = 20 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: setgroup = ceph 2024-05-08T18:08:05.702 INFO:teuthology.orchestra.run.smithi053.stdout: setuser = ceph 2024-05-08T18:08:05.703 INFO:teuthology.orchestra.run.smithi053.stdout:[mon.a] 2024-05-08T18:08:05.704 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T18:08:05.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T18:08:05.795 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T18:08:05.795 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:05.795 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T18:08:05.801 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:05.801 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T18:08:05.845 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:08:05.845 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:05.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:08:05.845 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:08:05.911 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:05.911 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:05.962 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:08:05.962 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:05.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T18:08:05.962 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T18:08:05.985 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:05.985 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:06.033 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T18:08:06.034 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T18:08:06.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:08:06.118 INFO:teuthology.orchestra.run.smithi114.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T18:08:06.188 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T18:08:06.189 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T18:08:06.189 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T18:08:06.266 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T18:08:06.277 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T18:08:06.277 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi053.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi114.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T18:08:06.277 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T18:08:06.291 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T18:08:06.292 INFO:tasks.ceph:role: osd.0 2024-05-08T18:08:06.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:08:06.292 DEBUG:teuthology.orchestra.run.smithi053:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:08:06.346 INFO:teuthology.orchestra.run.smithi053.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:08:06.347 INFO:teuthology.orchestra.run.smithi053.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:08:06.347 INFO:teuthology.orchestra.run.smithi053.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:08:06.369 INFO:teuthology.orchestra.run.smithi053.stdout:Discarding blocks...Done. 2024-05-08T18:08:06.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi053.front.sepia.ceph.com -o noatime 2024-05-08T18:08:06.371 DEBUG:teuthology.orchestra.run.smithi053:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T18:08:06.429 DEBUG:teuthology.orchestra.run.smithi053:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T18:08:06.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:08:06.483 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:08:06.483 DEBUG:teuthology.orchestra.run.smithi053:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:06.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:06.595+0000 7fe0ce5157c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T18:08:06.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:06.595+0000 7fe0ce5157c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T18:08:06.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:06.595+0000 7fe0ce5157c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:08:06.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:06.595+0000 7fe0ce5157c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:08:06.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:06.595+0000 7fe0ce5157c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T18:08:06.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:06.595+0000 7fe0ce5157c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T18:08:09.578 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T18:08:09.593 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T18:08:09.608 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:08:09.608 INFO:tasks.ceph:role: osd.1 2024-05-08T18:08:09.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:08:09.608 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:08:09.669 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:08:09.670 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:08:09.670 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:08:09.670 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:08:09.670 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:08:10.131 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-08T18:08:10.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-08T18:08:10.133 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-08T18:08:10.239 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T18:08:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:08:10.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:08:10.251 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T18:08:10.305 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:08:10.305 INFO:tasks.ceph:role: osd.2 2024-05-08T18:08:10.305 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:08:10.306 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T18:08:10.369 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:08:10.370 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:08:10.838 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-08T18:08:10.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-08T18:08:10.840 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-08T18:08:10.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T18:08:11.000 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:08:11.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:08:11.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T18:08:11.061 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T18:08:11.061 INFO:tasks.ceph:role: osd.3 2024-05-08T18:08:11.061 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:08:11.061 DEBUG:teuthology.orchestra.run.smithi114:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout: = sunit=0 swidth=0 blks 2024-05-08T18:08:11.125 INFO:teuthology.orchestra.run.smithi114.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T18:08:11.126 INFO:teuthology.orchestra.run.smithi114.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-08T18:08:11.126 INFO:teuthology.orchestra.run.smithi114.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T18:08:11.126 INFO:teuthology.orchestra.run.smithi114.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T18:08:11.599 INFO:teuthology.orchestra.run.smithi114.stdout:Discarding blocks...Done. 2024-05-08T18:08:11.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi114.front.sepia.ceph.com -o noatime 2024-05-08T18:08:11.601 DEBUG:teuthology.orchestra.run.smithi114:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-08T18:08:11.747 DEBUG:teuthology.orchestra.run.smithi114:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T18:08:11.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:08:11.759 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: /sbin/restorecon: command not found 2024-05-08T18:08:11.759 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:12.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:12.165+0000 7f5b968427c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T18:08:12.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:12.165+0000 7f5b968427c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T18:08:12.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:12.165+0000 7f5b968427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:08:12.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:12.165+0000 7f5b968427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:08:12.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:12.165+0000 7f5b968427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T18:08:12.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:12.169+0000 7f5b968427c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T18:08:15.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T18:08:15.164 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:15.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:15.249+0000 7f318286e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T18:08:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:15.249+0000 7f318286e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T18:08:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:15.249+0000 7f318286e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:08:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:15.249+0000 7f318286e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:08:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:15.249+0000 7f318286e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T18:08:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:15.249+0000 7f318286e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T18:08:18.216 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T18:08:18.270 DEBUG:teuthology.orchestra.run.smithi114:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:18.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:18.353+0000 7f1dfbe5f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T18:08:18.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:18.353+0000 7f1dfbe5f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T18:08:18.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:18.353+0000 7f1dfbe5f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:08:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:18.353+0000 7f1dfbe5f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:08:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:18.353+0000 7f1dfbe5f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T18:08:18.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:18.353+0000 7f1dfbe5f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T18:08:21.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T18:08:21.385 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T18:08:21.385 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:21.385 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T18:08:21.400 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:21.401 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T18:08:21.440 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:21.440 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T18:08:21.493 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:21.493 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T18:08:21.549 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:21.549 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T18:08:21.604 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:21.604 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T18:08:21.649 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T18:08:21.650 DEBUG:teuthology.orchestra.run.smithi053:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.0] 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCGvztmLIykIxAAyatZfQGce6MCunvaDc1yOA== 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout:[mgr.x] 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCGvztm/olUBxAAdr5z1qmOT1Io2m2//59Xfw== 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.1] 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCMvztm3uwEChAAeIeu9z2UDldwlHJ8Sb4aoQ== 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.2] 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCPvztmOEgHDxAAS/6Ht8iqhvXVAHzgu6aZSg== 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout:[osd.3] 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCSvztmXtgtFRAA7nLKA1Z7hv2hCjA/9R+5Cg== 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout:[client.0] 2024-05-08T18:08:21.662 INFO:teuthology.orchestra.run.smithi053.stdout: key = AQCGvztmPfooEBAALX6M0aa7bW9hwjMJIbP9ag== 2024-05-08T18:08:21.663 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:08:21.752 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T18:08:21.797 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:08:21.887 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:08:21.970 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T18:08:22.054 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T18:08:22.141 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T18:08:22.141 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T18:08:22.152 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T18:08:22.240 DEBUG:teuthology.orchestra.run.smithi053:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T18:08:22.250 DEBUG:teuthology.orchestra.run.smithi053:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T18:08:22.296 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T18:08:22.297 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T18:08:22.297 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T18:08:22.342 INFO:tasks.ceph.mon.a:Started 2024-05-08T18:08:22.342 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T18:08:22.343 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T18:08:22.343 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T18:08:22.345 INFO:tasks.ceph.mgr.x:Started 2024-05-08T18:08:22.345 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T18:08:22.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T18:08:22.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcfa00f0640 1 Processor -- start 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcfa00f0640 1 -- start start 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcfa00f0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 0x7fcf980716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcfa00f0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf98072530 con 0x7fcf98071c30 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcfa00f0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcf98073f70 con 0x7fcf98071310 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9de8c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 0x7fcf980716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9d68b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcf98071c30 0x7fcf9812a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43270/0 (socket says 172.21.15.53:43270) 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9d68b640 1 -- 172.21.15.53:0/633723931 learned_addr learned my addr 172.21.15.53:0/633723931 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9de8c640 1 -- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 msgr2=0x7fcf980716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9de8c640 1 -- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 msgr2=0x7fcf980716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9de8c640 1 --2- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 0x7fcf980716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T18:08:22.464 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.463+0000 7fcf9de8c640 1 --2- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 0x7fcf980716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T18:08:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69851322 0 0) 0x7fcf98072530 con 0x7fcf98071c30 2024-05-08T18:08:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf84003530 con 0x7fcf98071c30 2024-05-08T18:08:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1834648812 0 0) 0x7fcf84003530 con 0x7fcf98071c30 2024-05-08T18:08:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 msgr2=0x7fcf980716f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T18:08:22.485 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 --2- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 0x7fcf980716f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf980735b0 con 0x7fcf98071c30 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3082790100 0 0) 0x7fcf88001630 con 0x7fcf98071c30 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 >> v1:172.21.15.53:6789/0 conn(0x7fcf98071c30 legacy=0x7fcf9812a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 --2- 172.21.15.53:0/633723931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf84003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98073f70 con 0x7fcf84003a60 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.483+0000 7fcf9de8c640 1 --2- 172.21.15.53:0/633723931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf84003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:22.486 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.487+0000 7fcf9de8c640 1 -- 172.21.15.53:0/633723931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf84003530 con 0x7fcf84003a60 2024-05-08T18:08:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.547+0000 7fcf9de8c640 1 --2- 172.21.15.53:0/633723931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf84003e60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400c7a0 tx=0x7fcf9401c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70af81bb62202e88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.547+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf9400f040 con 0x7fcf84003a60 2024-05-08T18:08:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.547+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940af070 con 0x7fcf84003a60 2024-05-08T18:08:22.548 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.547+0000 7fcf9ce8a640 1 -- 172.21.15.53:0/633723931 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf940aa690 con 0x7fcf84003a60 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 -- 172.21.15.53:0/633723931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 msgr2=0x7fcf84003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 --2- 172.21.15.53:0/633723931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf84003e60 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fcf9400c7a0 tx=0x7fcf9401c5d0 comp rx=0 tx=0).stop 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 -- 172.21.15.53:0/633723931 shutdown_connections 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 --2- 172.21.15.53:0/633723931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf84003e60 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 --2- 172.21.15.53:0/633723931 >> v2:172.21.15.53:3300/0 conn(0x7fcf98071310 0x7fcf980716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 -- 172.21.15.53:0/633723931 >> 172.21.15.53:0/633723931 conn(0x7fcf9809de70 msgr2=0x7fcf9809f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:22.550 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 -- 172.21.15.53:0/633723931 shutdown_connections 2024-05-08T18:08:22.551 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 -- 172.21.15.53:0/633723931 wait complete. 2024-05-08T18:08:22.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 Processor -- start 2024-05-08T18:08:22.552 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.551+0000 7fcfa00f0640 1 -- start start 2024-05-08T18:08:22.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcfa00f0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf981c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:22.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcfa00f0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98135c90 con 0x7fcf84003a60 2024-05-08T18:08:22.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf9de8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf981c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:22.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf9de8c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf981c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60004/0 (socket says 172.21.15.53:60004) 2024-05-08T18:08:22.554 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf9de8c640 1 -- 172.21.15.53:0/1164169839 learned_addr learned my addr 172.21.15.53:0/1164169839 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf9de8c640 1 -- 172.21.15.53:0/1164169839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9811e1a0 con 0x7fcf84003a60 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf9de8c640 1 --2- 172.21.15.53:0/1164169839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf981c6fc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcf940ac040 tx=0x7fcf84005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf940b47d0 con 0x7fcf84003a60 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf940b4970 con 0x7fcf84003a60 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcf940b4c90 con 0x7fcf84003a60 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9811c920 con 0x7fcf84003a60 2024-05-08T18:08:22.555 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf981c76d0 con 0x7fcf84003a60 2024-05-08T18:08:22.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcf940c5060 con 0x7fcf84003a60 2024-05-08T18:08:22.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcf940be670 con 0x7fcf84003a60 2024-05-08T18:08:22.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.555+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf9811dfa0 con 0x7fcf84003a60 2024-05-08T18:08:22.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.567+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcf940ddec0 con 0x7fcf84003a60 2024-05-08T18:08:22.631 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.631+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fcf98064150 con 0x7fcf84003a60 2024-05-08T18:08:22.632 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.631+0000 7fcf8e7fc640 1 -- 172.21.15.53:0/1164169839 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fcf940cc070 con 0x7fcf84003a60 2024-05-08T18:08:22.632 INFO:teuthology.orchestra.run.smithi053.stderr:adjusted tunables profile to default 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 msgr2=0x7fcf981c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 --2- 172.21.15.53:0/1164169839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf981c6fc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fcf940ac040 tx=0x7fcf84005840 comp rx=0 tx=0).stop 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 shutdown_connections 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 --2- 172.21.15.53:0/1164169839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf84003a60 0x7fcf981c6fc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 >> 172.21.15.53:0/1164169839 conn(0x7fcf9809de70 msgr2=0x7fcf9812d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 shutdown_connections 2024-05-08T18:08:22.634 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:22.635+0000 7fcfa00f0640 1 -- 172.21.15.53:0/1164169839 wait complete. 2024-05-08T18:08:22.651 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T18:08:22.651 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T18:08:22.651 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2024-05-08T18:08:22.651 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T18:08:22.663 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:22.663 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T18:08:22.677 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:22.677 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T18:08:22.733 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-05-08T18:08:22.733 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T18:08:22.779 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:22.781+0000 7f16d0953180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T18:08:22.788 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 9fc8bff0-a944-457e-8d30-69424c1dddd2 0 2024-05-08T18:08:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3f550d640 1 Processor -- start 2024-05-08T18:08:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3f550d640 1 -- start start 2024-05-08T18:08:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3f550d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3f0115c20 0x7fb3f0116000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3f550d640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3f0116660 con 0x7fb3f010fdb0 2024-05-08T18:08:22.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3f550d640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb3f0110970 con 0x7fb3f0115c20 2024-05-08T18:08:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3eeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3f0115c20 0x7fb3f0116000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3eeffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb3f0115c20 0x7fb3f0116000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40902/0 (socket says 172.21.15.114:40902) 2024-05-08T18:08:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3eeffd640 1 -- 172.21.15.114:0/1695548277 learned_addr learned my addr 172.21.15.114:0/1695548277 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3ee7fc640 1 --1- 172.21.15.114:0/1695548277 >> v1:172.21.15.53:6789/0 conn(0x7fb3f010fdb0 0x7fb3f0110260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:59980/0 (socket says 172.21.15.114:59980) 2024-05-08T18:08:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3eeffd640 1 -- 172.21.15.114:0/1695548277 >> v1:172.21.15.53:6789/0 conn(0x7fb3f010fdb0 legacy=0x7fb3f0110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:22.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.953+0000 7fb3eeffd640 1 -- 172.21.15.114:0/1695548277 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f0110b20 con 0x7fb3f0115c20 2024-05-08T18:08:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3eeffd640 1 --2- 172.21.15.114:0/1695548277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f0115c20 0x7fb3f0116000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80097f0 tx=0x7fb3d801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d70c19995aad8e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3edffb640 1 -- 172.21.15.114:0/1695548277 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d80ab580 con 0x7fb3f0115c20 2024-05-08T18:08:22.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3edffb640 1 -- 172.21.15.114:0/1695548277 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d80b0070 con 0x7fb3f0115c20 2024-05-08T18:08:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3edffb640 1 -- 172.21.15.114:0/1695548277 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d80ab870 con 0x7fb3f0115c20 2024-05-08T18:08:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- 172.21.15.114:0/1695548277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f0115c20 msgr2=0x7fb3f0116000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 --2- 172.21.15.114:0/1695548277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f0115c20 0x7fb3f0116000 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80097f0 tx=0x7fb3d801c430 comp rx=0 tx=0).stop 2024-05-08T18:08:22.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- 172.21.15.114:0/1695548277 shutdown_connections 2024-05-08T18:08:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 --2- 172.21.15.114:0/1695548277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f0115c20 0x7fb3f0116000 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- 172.21.15.114:0/1695548277 >> 172.21.15.114:0/1695548277 conn(0x7fb3f0071600 msgr2=0x7fb3f0073a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- 172.21.15.114:0/1695548277 shutdown_connections 2024-05-08T18:08:22.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- 172.21.15.114:0/1695548277 wait complete. 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 Processor -- start 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- start start 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 0x7fb3f01a6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3f550d640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb3f011e500 con 0x7fb3f010fdb0 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 0x7fb3f01a6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3eeffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 0x7fb3f01a6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40918/0 (socket says 172.21.15.114:40918) 2024-05-08T18:08:22.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3eeffd640 1 -- 172.21.15.114:0/1826609209 learned_addr learned my addr 172.21.15.114:0/1826609209 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.957+0000 7fb3eeffd640 1 -- 172.21.15.114:0/1826609209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f01a7410 con 0x7fb3f010fdb0 2024-05-08T18:08:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3eeffd640 1 --2- 172.21.15.114:0/1826609209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 0x7fb3f01a6ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8019040 tx=0x7fb3d801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:22.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d80abe50 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3f01a76a0 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3d80aa8f0 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3d80aabf0 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3f01ab590 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb3d80c77d0 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb3d80be990 con 0x7fb3f010fdb0 2024-05-08T18:08:22.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.961+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f0051030 con 0x7fb3f010fdb0 2024-05-08T18:08:22.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:22.965+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb3d80160b0 con 0x7fb3f010fdb0 2024-05-08T18:08:23.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.033+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9fc8bff0-a944-457e-8d30-69424c1dddd2", "id": 0} v 0) -- 0x7fb3f0115c20 con 0x7fb3f010fdb0 2024-05-08T18:08:23.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3e77fe640 1 -- 172.21.15.114:0/1826609209 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fc8bff0-a944-457e-8d30-69424c1dddd2", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb3d80aade0 con 0x7fb3f010fdb0 2024-05-08T18:08:23.035 INFO:teuthology.orchestra.run.smithi114.stdout:0 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 msgr2=0x7fb3f01a6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 --2- 172.21.15.114:0/1826609209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 0x7fb3f01a6ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8019040 tx=0x7fb3d801ac70 comp rx=0 tx=0).stop 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 shutdown_connections 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 --2- 172.21.15.114:0/1826609209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb3f010fdb0 0x7fb3f01a6ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 >> 172.21.15.114:0/1826609209 conn(0x7fb3f0071600 msgr2=0x7fb3f0111c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 shutdown_connections 2024-05-08T18:08:23.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.037+0000 7fb3f550d640 1 -- 172.21.15.114:0/1826609209 wait complete. 2024-05-08T18:08:23.052 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new b391052e-bf22-4b53-a6d1-ea15b159812a 1 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f9702602640 1 Processor -- start 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f9702602640 1 -- start start 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f9702602640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96fc115a50 0x7f96fc115e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f9702602640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96fc110970 con 0x7f96fc10fdb0 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f9702602640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f96fc1164f0 con 0x7f96fc115a50 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f96fbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96fc115a50 0x7f96fc115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f96fbfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96fc115a50 0x7f96fc115e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40932/0 (socket says 172.21.15.114:40932) 2024-05-08T18:08:23.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f96fbfff640 1 -- 172.21.15.114:0/2742467361 learned_addr learned my addr 172.21.15.114:0/2742467361 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:23.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f96fbfff640 1 -- 172.21.15.114:0/2742467361 >> v1:172.21.15.53:6789/0 conn(0x7f96fc10fdb0 legacy=0x7f96fc110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.177+0000 7f96fbfff640 1 -- 172.21.15.114:0/2742467361 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc110b40 con 0x7f96fc115a50 2024-05-08T18:08:23.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f96fbfff640 1 --2- 172.21.15.114:0/2742467361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc115a50 0x7f96fc115e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097f0 tx=0x7f96ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97bb482eb240251 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f96fb7fe640 1 -- 172.21.15.114:0/2742467361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec0ab580 con 0x7f96fc115a50 2024-05-08T18:08:23.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f96fb7fe640 1 -- 172.21.15.114:0/2742467361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec0b0070 con 0x7f96fc115a50 2024-05-08T18:08:23.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f96fb7fe640 1 -- 172.21.15.114:0/2742467361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec0ab870 con 0x7f96fc115a50 2024-05-08T18:08:23.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- 172.21.15.114:0/2742467361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc115a50 msgr2=0x7f96fc115e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 --2- 172.21.15.114:0/2742467361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc115a50 0x7f96fc115e30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0097f0 tx=0x7f96ec01c430 comp rx=0 tx=0).stop 2024-05-08T18:08:23.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- 172.21.15.114:0/2742467361 shutdown_connections 2024-05-08T18:08:23.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 --2- 172.21.15.114:0/2742467361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc115a50 0x7f96fc115e30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- 172.21.15.114:0/2742467361 >> 172.21.15.114:0/2742467361 conn(0x7f96fc071630 msgr2=0x7f96fc073a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- 172.21.15.114:0/2742467361 shutdown_connections 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- 172.21.15.114:0/2742467361 wait complete. 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 Processor -- start 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- start start 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 0x7f96fc111550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.181+0000 7f9702602640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc11c4b0 con 0x7f96fc10fdb0 2024-05-08T18:08:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 0x7f96fc111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96fbfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 0x7f96fc111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40942/0 (socket says 172.21.15.114:40942) 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96fbfff640 1 -- 172.21.15.114:0/753496819 learned_addr learned my addr 172.21.15.114:0/753496819 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96fbfff640 1 -- 172.21.15.114:0/753496819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc111a90 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96fbfff640 1 --2- 172.21.15.114:0/753496819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 0x7f96fc111550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96ec019040 tx=0x7f96ec01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec0abe10 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96ec0aa8f0 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96fc111cc0 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96ec0aac10 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc112200 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96ec0c77d0 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f96ec0be940 con 0x7f96fc10fdb0 2024-05-08T18:08:23.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.185+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96fc051030 con 0x7f96fc10fdb0 2024-05-08T18:08:23.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.193+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f96ec0ddec0 con 0x7f96fc10fdb0 2024-05-08T18:08:23.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b391052e-bf22-4b53-a6d1-ea15b159812a", "id": 1} v 0) -- 0x7f96fc119ed0 con 0x7f96fc10fdb0 2024-05-08T18:08:23.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f96f97fa640 1 -- 172.21.15.114:0/753496819 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b391052e-bf22-4b53-a6d1-ea15b159812a", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f96ec0cc030 con 0x7f96fc10fdb0 2024-05-08T18:08:23.259 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-05-08T18:08:23.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 msgr2=0x7f96fc111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 --2- 172.21.15.114:0/753496819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 0x7f96fc111550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96ec019040 tx=0x7f96ec01ac70 comp rx=0 tx=0).stop 2024-05-08T18:08:23.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 shutdown_connections 2024-05-08T18:08:23.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 --2- 172.21.15.114:0/753496819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96fc10fdb0 0x7f96fc111550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 >> 172.21.15.114:0/753496819 conn(0x7f96fc071630 msgr2=0x7f96fc06cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 shutdown_connections 2024-05-08T18:08:23.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.261+0000 7f9702602640 1 -- 172.21.15.114:0/753496819 wait complete. 2024-05-08T18:08:23.276 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new f30bc26d-7677-4fe9-a0bb-fe3c27e63079 2 2024-05-08T18:08:23.289 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:23.293+0000 7f16d0953180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T18:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f8315890640 1 Processor -- start 2024-05-08T18:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f8315890640 1 -- start start 2024-05-08T18:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f8315890640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8310119970 0x7f831011bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f8315890640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f831011c2a0 con 0x7f8310110ce0 2024-05-08T18:08:23.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f8315890640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f831011d4a0 con 0x7f8310119970 2024-05-08T18:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f830e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8310119970 0x7f831011bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f830e7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8310119970 0x7f831011bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40956/0 (socket says 172.21.15.114:40956) 2024-05-08T18:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f830e7fc640 1 -- 172.21.15.114:0/3669447921 learned_addr learned my addr 172.21.15.114:0/3669447921 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:23.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f830e7fc640 1 -- 172.21.15.114:0/3669447921 >> v1:172.21.15.53:6789/0 conn(0x7f8310110ce0 legacy=0x7f83101110c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f830e7fc640 1 -- 172.21.15.114:0/3669447921 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f831011d650 con 0x7f8310119970 2024-05-08T18:08:23.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.389+0000 7f830dffb640 1 -- 172.21.15.114:0/3669447921 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72728750 0 0) 0x7f831011c2a0 con 0x7f8310110ce0 2024-05-08T18:08:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f830e7fc640 1 --2- 172.21.15.114:0/3669447921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310119970 0x7f831011bd60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f83040097f0 tx=0x7f830401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6fec75485ce780 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f830dffb640 1 -- 172.21.15.114:0/3669447921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83040ab580 con 0x7f8310119970 2024-05-08T18:08:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f830dffb640 1 -- 172.21.15.114:0/3669447921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83040b0070 con 0x7f8310119970 2024-05-08T18:08:23.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f830dffb640 1 -- 172.21.15.114:0/3669447921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83040ab870 con 0x7f8310119970 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 -- 172.21.15.114:0/3669447921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310119970 msgr2=0x7f831011bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 --2- 172.21.15.114:0/3669447921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310119970 0x7f831011bd60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f83040097f0 tx=0x7f830401c430 comp rx=0 tx=0).stop 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 -- 172.21.15.114:0/3669447921 shutdown_connections 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 --2- 172.21.15.114:0/3669447921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310119970 0x7f831011bd60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 -- 172.21.15.114:0/3669447921 >> 172.21.15.114:0/3669447921 conn(0x7f83100723c0 msgr2=0x7f831010eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 -- 172.21.15.114:0/3669447921 shutdown_connections 2024-05-08T18:08:23.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 -- 172.21.15.114:0/3669447921 wait complete. 2024-05-08T18:08:23.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 Processor -- start 2024-05-08T18:08:23.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.393+0000 7f8315890640 1 -- start start 2024-05-08T18:08:23.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f8315890640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 0x7f83101a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f8315890640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f831011d160 con 0x7f8310110ce0 2024-05-08T18:08:23.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f830effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 0x7f83101a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f830effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 0x7f83101a7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40970/0 (socket says 172.21.15.114:40970) 2024-05-08T18:08:23.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f830effd640 1 -- 172.21.15.114:0/2392058817 learned_addr learned my addr 172.21.15.114:0/2392058817 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f830effd640 1 -- 172.21.15.114:0/2392058817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83101a8360 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f830effd640 1 --2- 172.21.15.114:0/2392058817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 0x7f83101a7e20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f830000c3a0 tx=0x7f830000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300017070 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8300005410 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8300003770 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83101a8650 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83101ac6a0 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f830001a070 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8300012820 con 0x7f8310110ce0 2024-05-08T18:08:23.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.397+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8310051030 con 0x7f8310110ce0 2024-05-08T18:08:23.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.405+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8300021070 con 0x7f8310110ce0 2024-05-08T18:08:23.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.473+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f30bc26d-7677-4fe9-a0bb-fe3c27e63079", "id": 2} v 0) -- 0x7f83100507e0 con 0x7f8310110ce0 2024-05-08T18:08:23.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.473+0000 7f82f7fff640 1 -- 172.21.15.114:0/2392058817 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f30bc26d-7677-4fe9-a0bb-fe3c27e63079", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8300012510 con 0x7f8310110ce0 2024-05-08T18:08:23.472 INFO:teuthology.orchestra.run.smithi114.stdout:2 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.473+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 msgr2=0x7f83101a7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.473+0000 7f8315890640 1 --2- 172.21.15.114:0/2392058817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 0x7f83101a7e20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f830000c3a0 tx=0x7f830000c860 comp rx=0 tx=0).stop 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.473+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 shutdown_connections 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.473+0000 7f8315890640 1 --2- 172.21.15.114:0/2392058817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8310110ce0 0x7f83101a7e20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.477+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 >> 172.21.15.114:0/2392058817 conn(0x7f83100723c0 msgr2=0x7f8310072840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.477+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 shutdown_connections 2024-05-08T18:08:23.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.477+0000 7f8315890640 1 -- 172.21.15.114:0/2392058817 wait complete. 2024-05-08T18:08:23.488 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --cluster ceph osd new 68ac195b-11be-4780-bf64-166127513b1a 3 2024-05-08T18:08:23.562 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:23.565+0000 7f16d0953180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T18:08:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5b26ab640 1 Processor -- start 2024-05-08T18:08:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5b26ab640 1 -- start start 2024-05-08T18:08:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5b26ab640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5ac118880 0x7fb5ac11ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5b26ab640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5ac11b240 con 0x7fb5ac115ae0 2024-05-08T18:08:23.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5b26ab640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb5ac11c420 con 0x7fb5ac118880 2024-05-08T18:08:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5ab7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5ac118880 0x7fb5ac11ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5ab7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb5ac118880 0x7fb5ac11ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40974/0 (socket says 172.21.15.114:40974) 2024-05-08T18:08:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5abfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb5ac115ae0 0x7fb5ac115ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:60014/0 (socket says 172.21.15.114:60014) 2024-05-08T18:08:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5ab7fe640 1 -- 172.21.15.114:0/3315461744 learned_addr learned my addr 172.21.15.114:0/3315461744 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:23.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5ab7fe640 1 -- 172.21.15.114:0/3315461744 >> v1:172.21.15.53:6789/0 conn(0x7fb5ac115ae0 legacy=0x7fb5ac115ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.649+0000 7fb5ab7fe640 1 -- 172.21.15.114:0/3315461744 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac11c5a0 con 0x7fb5ac118880 2024-05-08T18:08:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5ab7fe640 1 --2- 172.21.15.114:0/3315461744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac118880 0x7fb5ac11ac70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb5940097f0 tx=0x7fb59401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2d58fa63a73a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5aaffd640 1 -- 172.21.15.114:0/3315461744 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940ab580 con 0x7fb5ac118880 2024-05-08T18:08:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5aaffd640 1 -- 172.21.15.114:0/3315461744 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940b0070 con 0x7fb5ac118880 2024-05-08T18:08:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5aaffd640 1 -- 172.21.15.114:0/3315461744 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5940ab870 con 0x7fb5ac118880 2024-05-08T18:08:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 -- 172.21.15.114:0/3315461744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac118880 msgr2=0x7fb5ac11ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 --2- 172.21.15.114:0/3315461744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac118880 0x7fb5ac11ac70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb5940097f0 tx=0x7fb59401c430 comp rx=0 tx=0).stop 2024-05-08T18:08:23.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 -- 172.21.15.114:0/3315461744 shutdown_connections 2024-05-08T18:08:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 --2- 172.21.15.114:0/3315461744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac118880 0x7fb5ac11ac70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 -- 172.21.15.114:0/3315461744 >> 172.21.15.114:0/3315461744 conn(0x7fb5ac070d80 msgr2=0x7fb5ac0731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 -- 172.21.15.114:0/3315461744 shutdown_connections 2024-05-08T18:08:23.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.653+0000 7fb5b26ab640 1 -- 172.21.15.114:0/3315461744 wait complete. 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 Processor -- start 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 -- start start 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 0x7fb5ac1a8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac11c0d0 con 0x7fb5ac115ae0 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 0x7fb5ac1a8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5abfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 0x7fb5ac1a8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:40982/0 (socket says 172.21.15.114:40982) 2024-05-08T18:08:23.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5abfff640 1 -- 172.21.15.114:0/4270847261 learned_addr learned my addr 172.21.15.114:0/4270847261 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5abfff640 1 -- 172.21.15.114:0/4270847261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac1a91d0 con 0x7fb5ac115ae0 2024-05-08T18:08:23.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5abfff640 1 --2- 172.21.15.114:0/4270847261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 0x7fb5ac1a8c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c450 tx=0x7fb59c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb59c007410 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59c0075b0 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac1a9460 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb59c004960 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac1a99a0 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb59c01a020 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb59c012880 con 0x7fb5ac115ae0 2024-05-08T18:08:23.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.657+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ac051030 con 0x7fb5ac115ae0 2024-05-08T18:08:23.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.665+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb59c021070 con 0x7fb5ac115ae0 2024-05-08T18:08:23.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.729+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd new", "uuid": "68ac195b-11be-4780-bf64-166127513b1a", "id": 3} v 0) -- 0x7fb5ac112cd0 con 0x7fb5ac115ae0 2024-05-08T18:08:23.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5a8ff9640 1 -- 172.21.15.114:0/4270847261 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68ac195b-11be-4780-bf64-166127513b1a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb59c012630 con 0x7fb5ac115ae0 2024-05-08T18:08:23.731 INFO:teuthology.orchestra.run.smithi114.stdout:3 2024-05-08T18:08:23.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 msgr2=0x7fb5ac1a8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 --2- 172.21.15.114:0/4270847261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 0x7fb5ac1a8c90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00c450 tx=0x7fb59c00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:23.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 shutdown_connections 2024-05-08T18:08:23.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 --2- 172.21.15.114:0/4270847261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb5ac115ae0 0x7fb5ac1a8c90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 >> 172.21.15.114:0/4270847261 conn(0x7fb5ac070d80 msgr2=0x7fb5ac119030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 shutdown_connections 2024-05-08T18:08:23.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:23.733+0000 7fb5b26ab640 1 -- 172.21.15.114:0/4270847261 wait complete. 2024-05-08T18:08:23.747 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T18:08:23.747 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T18:08:23.750 INFO:tasks.ceph.osd.0:Started 2024-05-08T18:08:23.750 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T18:08:23.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T18:08:23.790 INFO:tasks.ceph.osd.1:Started 2024-05-08T18:08:23.790 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T18:08:23.791 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T18:08:23.793 INFO:tasks.ceph.osd.2:Started 2024-05-08T18:08:23.793 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T18:08:23.793 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T18:08:23.796 INFO:tasks.ceph.osd.3:Started 2024-05-08T18:08:23.796 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84595d9640 1 Processor -- start 2024-05-08T18:08:23.916 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84595d9640 1 -- start start 2024-05-08T18:08:23.917 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84595d9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8454132730 0x7f8454134b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84595d9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845412cfb0 con 0x7f845412c4c0 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84595d9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f84540721f0 con 0x7f8454132730 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84527fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8454132730 0x7f8454134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84527fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8454132730 0x7f8454134b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60018/0 (socket says 172.21.15.53:60018) 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f8452ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f845412c4c0 0x7f845412c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43288/0 (socket says 172.21.15.53:43288) 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.915+0000 7f84527fc640 1 -- 172.21.15.53:0/1903490980 learned_addr learned my addr 172.21.15.53:0/1903490980 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84527fc640 1 -- 172.21.15.53:0/1903490980 >> v1:172.21.15.53:6789/0 conn(0x7f845412c4c0 legacy=0x7f845412c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.918 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84527fc640 1 -- 172.21.15.53:0/1903490980 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8454073b00 con 0x7f8454132730 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84527fc640 1 --2- 172.21.15.53:0/1903490980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8454132730 0x7f8454134b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84440097f0 tx=0x7f844401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0dbd1463bae653 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f8451ffb640 1 -- 172.21.15.53:0/1903490980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84440b0070 con 0x7f8454132730 2024-05-08T18:08:23.919 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f8451ffb640 1 -- 172.21.15.53:0/1903490980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84440ab530 con 0x7f8454132730 2024-05-08T18:08:23.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f8451ffb640 1 -- 172.21.15.53:0/1903490980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84440ab830 con 0x7f8454132730 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 -- 172.21.15.53:0/1903490980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8454132730 msgr2=0x7f8454134b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 --2- 172.21.15.53:0/1903490980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8454132730 0x7f8454134b20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f84440097f0 tx=0x7f844401c430 comp rx=0 tx=0).stop 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 -- 172.21.15.53:0/1903490980 shutdown_connections 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 --2- 172.21.15.53:0/1903490980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8454132730 0x7f8454134b20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 -- 172.21.15.53:0/1903490980 >> 172.21.15.53:0/1903490980 conn(0x7f845409e030 msgr2=0x7f845409e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 -- 172.21.15.53:0/1903490980 shutdown_connections 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 -- 172.21.15.53:0/1903490980 wait complete. 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 Processor -- start 2024-05-08T18:08:23.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.919+0000 7f84595d9640 1 -- start start 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f84595d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 0x7f845412ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f84595d9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8454137c10 con 0x7f845412c4c0 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f8452ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 0x7f845412ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:23.923 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f8452ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 0x7f845412ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60032/0 (socket says 172.21.15.53:60032) 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f8452ffd640 1 -- 172.21.15.53:0/1464983983 learned_addr learned my addr 172.21.15.53:0/1464983983 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f8452ffd640 1 -- 172.21.15.53:0/1464983983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f845411d7e0 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f8452ffd640 1 --2- 172.21.15.53:0/1464983983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 0x7f845412ab50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c3b0 tx=0x7f843c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f843c007410 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f843c0075b0 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f845411d9b0 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f845412b260 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f843c004920 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f843c01a020 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f843c012900 con 0x7f845412c4c0 2024-05-08T18:08:23.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.923+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8438005090 con 0x7f845412c4c0 2024-05-08T18:08:23.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.927+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f843c021070 con 0x7f845412c4c0 2024-05-08T18:08:23.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.983+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8438005650 con 0x7f845412c4c0 2024-05-08T18:08:23.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.983+0000 7f844b7fe640 1 -- 172.21.15.53:0/1464983983 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f843c012bb0 con 0x7f845412c4c0 2024-05-08T18:08:23.985 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:23.985 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":6,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:08:23.733990+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 msgr2=0x7f845412ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 --2- 172.21.15.53:0/1464983983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 0x7f845412ab50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f843c00c3b0 tx=0x7f843c00c870 comp rx=0 tx=0).stop 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 shutdown_connections 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 --2- 172.21.15.53:0/1464983983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f845412c4c0 0x7f845412ab50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 >> 172.21.15.53:0/1464983983 conn(0x7f845409e030 msgr2=0x7f845406dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 shutdown_connections 2024-05-08T18:08:23.986 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:23.987+0000 7f84595d9640 1 -- 172.21.15.53:0/1464983983 wait complete. 2024-05-08T18:08:24.002 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T18:08:24.003 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T18:08:24.127 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.129+0000 7f16d0953180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T18:08:24.181 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.185+0000 7f16d0953180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T18:08:24.233 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.237+0000 7f16d0953180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T18:08:24.309 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.313+0000 7f16d0953180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T18:08:24.361 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.361+0000 7f16d0953180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T18:08:24.363 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:08:24.363+0000 7f42c356e7c0 -1 Falling back to public interface 2024-05-08T18:08:24.398 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-08T18:08:24.401+0000 7f5252b7c7c0 -1 Falling back to public interface 2024-05-08T18:08:24.407 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:08:24.410 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-08T18:08:24.413+0000 7fa6724917c0 -1 Falling back to public interface 2024-05-08T18:08:24.410 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-08T18:08:24.413+0000 7f843b1c77c0 -1 Falling back to public interface 2024-05-08T18:08:24.439 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.441+0000 7f16d0953180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T18:08:24.492 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.493+0000 7f16d0953180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T18:08:24.529 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f397c640 1 Processor -- start 2024-05-08T18:08:24.529 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f397c640 1 -- start start 2024-05-08T18:08:24.530 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f397c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9ec12d4a0 0x7fa9ec12d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:24.530 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f397c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9ec072ea0 con 0x7fa9ec12ddc0 2024-05-08T18:08:24.530 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f397c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fa9ec0735e0 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.531 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f1718640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fa9ec12d4a0 0x7fa9ec12d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:24.531 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f0f17640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fa9ec12ddc0 0x7fa9ec129d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:43296/0 (socket says 172.21.15.53:43296) 2024-05-08T18:08:24.531 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f0f17640 1 -- 172.21.15.53:0/1707996798 learned_addr learned my addr 172.21.15.53:0/1707996798 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:24.531 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f1718640 1 -- 172.21.15.53:0/1707996798 >> v1:172.21.15.53:6789/0 conn(0x7fa9ec12ddc0 legacy=0x7fa9ec129d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:24.531 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9e3fff640 1 -- 172.21.15.53:0/1707996798 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3953447011 0 0) 0x7fa9ec072ea0 con 0x7fa9ec12ddc0 2024-05-08T18:08:24.531 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f1718640 1 -- 172.21.15.53:0/1707996798 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec071ff0 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.533 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9f1718640 1 --2- 172.21.15.53:0/1707996798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec12d880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009740 tx=0x7fa9e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d9e02ab8b23d87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:24.533 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9e3fff640 1 -- 172.21.15.53:0/1707996798 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e80b0070 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.533 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9e3fff640 1 -- 172.21.15.53:0/1707996798 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e80ab530 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.533 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.531+0000 7fa9e3fff640 1 -- 172.21.15.53:0/1707996798 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e80ab830 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/1707996798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 msgr2=0x7fa9ec12d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 --2- 172.21.15.53:0/1707996798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec12d880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009740 tx=0x7fa9e801c370 comp rx=0 tx=0).stop 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/1707996798 shutdown_connections 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 --2- 172.21.15.53:0/1707996798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec12d880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/1707996798 >> 172.21.15.53:0/1707996798 conn(0x7fa9ec09d8e0 msgr2=0x7fa9ec09dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/1707996798 shutdown_connections 2024-05-08T18:08:24.534 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/1707996798 wait complete. 2024-05-08T18:08:24.536 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 Processor -- start 2024-05-08T18:08:24.536 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- start start 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec136180 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f1718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f1718640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60050/0 (socket says 172.21.15.53:60050) 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f1718640 1 -- 172.21.15.53:0/2850232972 learned_addr learned my addr 172.21.15.53:0/2850232972 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f1718640 1 -- 172.21.15.53:0/2850232972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec071690 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f1718640 1 --2- 172.21.15.53:0/2850232972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec070040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8019fa0 tx=0x7fa9e801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e80b0050 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e80b1040 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ec099da0 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e80aab40 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ec08bac0 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.537 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa9e80be030 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.538 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fa9e80bc070 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.538 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.535+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9ec064150 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.539 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.539+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa9e80c5020 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.597 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.595+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9ec069800 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.598 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9e1ffb640 1 -- 172.21.15.53:0/2850232972 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fa9e8015ff0 con 0x7fa9ec12d4a0 2024-05-08T18:08:24.598 INFO:teuthology.misc.health.smithi053.stdout: 2024-05-08T18:08:24.598 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":6,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:08:23.733990+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 msgr2=0x7fa9ec070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 --2- 172.21.15.53:0/2850232972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec070040 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8019fa0 tx=0x7fa9e801abb0 comp rx=0 tx=0).stop 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 shutdown_connections 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 --2- 172.21.15.53:0/2850232972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa9ec12d4a0 0x7fa9ec070040 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 >> 172.21.15.53:0/2850232972 conn(0x7fa9ec09d8e0 msgr2=0x7fa9ec0982e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 shutdown_connections 2024-05-08T18:08:24.599 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:24.599+0000 7fa9f397c640 1 -- 172.21.15.53:0/2850232972 wait complete. 2024-05-08T18:08:24.614 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-08T18:08:24.640 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.641+0000 7f16d0953180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T18:08:24.700 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:24.701+0000 7f16d0953180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T18:08:25.359 INFO:tasks.ceph.mgr.x.smithi114.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-08T18:08:25.359 INFO:tasks.ceph.mgr.x.smithi114.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-08T18:08:25.359 INFO:tasks.ceph.mgr.x.smithi114.stderr: from numpy import show_config as show_numpy_config 2024-05-08T18:08:25.418 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:25.421+0000 7f16d0953180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T18:08:25.589 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:25.593+0000 7f16d0953180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:08:25.758 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:25.761+0000 7f16d0953180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T18:08:25.822 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:25.825+0000 7f16d0953180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T18:08:25.956 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:25.957+0000 7f16d0953180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T18:08:26.587 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:26.589+0000 7f16d0953180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T18:08:26.661 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:26.665+0000 7f16d0953180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T18:08:26.842 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:26.845+0000 7f16d0953180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T18:08:26.915 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:26.917+0000 7f16d0953180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T18:08:27.207 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:27.209+0000 7f16d0953180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T18:08:27.269 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:27.269+0000 7f16d0953180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T18:08:28.042 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:08:28.043+0000 7f42c356e7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T18:08:28.214 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-08T18:08:28.217+0000 7f843b1c77c0 -1 osd.2 0 log_to_monitors true 2024-05-08T18:08:28.283 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-08T18:08:28.285+0000 7fa6724917c0 -1 osd.3 0 log_to_monitors true 2024-05-08T18:08:28.305 INFO:tasks.ceph.mgr.x.smithi114.stderr:2024-05-08T18:08:28.309+0000 7f1677498640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-08T18:08:28.323 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-08T18:08:28.325+0000 7f5252b7c7c0 -1 osd.1 0 log_to_monitors true 2024-05-08T18:08:30.321 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:08:30.319+0000 7f42bf517640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T18:08:30.334 INFO:tasks.ceph.osd.0.smithi053.stderr:2024-05-08T18:08:30.335+0000 7f42b734b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:08:31.018 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:08:31.086 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-08T18:08:31.089+0000 7fa66e43a640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T18:08:31.097 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-08T18:08:31.101+0000 7f524f337640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T18:08:31.109 INFO:tasks.ceph.osd.3.smithi114.stderr:2024-05-08T18:08:31.113+0000 7fa66626e640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:08:31.113 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-08T18:08:31.117+0000 7f8437170640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T18:08:31.129 INFO:tasks.ceph.osd.1.smithi114.stderr:2024-05-08T18:08:31.133+0000 7f5246959640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:08:31.144 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.143+0000 7fb2ef5d1640 1 Processor -- start 2024-05-08T18:08:31.144 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.143+0000 7fb2ef5d1640 1 -- start start 2024-05-08T18:08:31.145 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.143+0000 7fb2ef5d1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2e81305b0 0x7fb2e81329a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:31.145 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.143+0000 7fb2ef5d1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2e8072ea0 con 0x7fb2e812d4a0 2024-05-08T18:08:31.145 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.143+0000 7fb2ef5d1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb2e80735e0 con 0x7fb2e81305b0 2024-05-08T18:08:31.145 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ecb6c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb2e81305b0 0x7fb2e81329a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:31.145 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ed36d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb2e812d4a0 0x7fb2e812d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52912/0 (socket says 172.21.15.53:52912) 2024-05-08T18:08:31.146 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ed36d640 1 -- 172.21.15.53:0/2783654757 learned_addr learned my addr 172.21.15.53:0/2783654757 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:31.146 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ecb6c640 1 -- 172.21.15.53:0/2783654757 >> v1:172.21.15.53:6789/0 conn(0x7fb2e812d4a0 legacy=0x7fb2e812d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:31.146 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ecb6c640 1 -- 172.21.15.53:0/2783654757 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e812df90 con 0x7fb2e81305b0 2024-05-08T18:08:31.147 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ecb6c640 1 --2- 172.21.15.53:0/2783654757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e81305b0 0x7fb2e81329a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009740 tx=0x7fb2e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89bec81871c62ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:31.148 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2dbfff640 1 -- 172.21.15.53:0/2783654757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e40b0070 con 0x7fb2e81305b0 2024-05-08T18:08:31.148 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2dbfff640 1 -- 172.21.15.53:0/2783654757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e40ab530 con 0x7fb2e81305b0 2024-05-08T18:08:31.148 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2dbfff640 1 -- 172.21.15.53:0/2783654757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2e40ab830 con 0x7fb2e81305b0 2024-05-08T18:08:31.148 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2783654757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e81305b0 msgr2=0x7fb2e81329a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:31.148 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 --2- 172.21.15.53:0/2783654757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e81305b0 0x7fb2e81329a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009740 tx=0x7fb2e401c370 comp rx=0 tx=0).stop 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2783654757 shutdown_connections 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 --2- 172.21.15.53:0/2783654757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e81305b0 0x7fb2e81329a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2783654757 >> 172.21.15.53:0/2783654757 conn(0x7fb2e809d8e0 msgr2=0x7fb2e809dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2783654757 shutdown_connections 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.147+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2783654757 wait complete. 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 Processor -- start 2024-05-08T18:08:31.149 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 -- start start 2024-05-08T18:08:31.150 INFO:tasks.ceph.osd.2.smithi114.stderr:2024-05-08T18:08:31.153+0000 7f842efa4640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T18:08:31.151 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 0x7fb2e8070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:31.151 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e8135a90 con 0x7fb2e812d4a0 2024-05-08T18:08:31.151 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ed36d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 0x7fb2e8070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:31.151 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ed36d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 0x7fb2e8070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52624/0 (socket says 172.21.15.53:52624) 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ed36d640 1 -- 172.21.15.53:0/2595539130 learned_addr learned my addr 172.21.15.53:0/2595539130 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ed36d640 1 -- 172.21.15.53:0/2595539130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e812cee0 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ed36d640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 0x7fb2e8070040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c450 tx=0x7fb2dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc017070 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2dc005c20 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e808bfa0 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2dc0070d0 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e808bae0 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 4) ==== 46878+0+0 (secure 0 0 0) 0x7fb2dc01a070 con 0x7fb2e812d4a0 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2d9ffb640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:31.152 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2e808b390 con 0x7fb2e812d4a0 2024-05-08T18:08:31.153 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1623+0+0 (secure 0 0 0) 0x7fb2dc04bc30 con 0x7fb2e812d4a0 2024-05-08T18:08:31.153 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ecb6c640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:31.153 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.151+0000 7fb2ecb6c640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ad000 tx=0x7fb2e4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:31.157 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.155+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb2e808b390 con 0x7fb2e812d4a0 2024-05-08T18:08:31.320 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.319+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2e8064150 con 0x7fb2e812d4a0 2024-05-08T18:08:31.321 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2d9ffb640 1 -- 172.21.15.53:0/2595539130 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7fb2dc007270 con 0x7fb2e812d4a0 2024-05-08T18:08:31.321 INFO:teuthology.misc.health.smithi053.stdout: 2024-05-08T18:08:31.321 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":8,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:08:29.375734+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2cc039ac0 msgr2=0x7fb2cc03bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2e40ad000 tx=0x7fb2e4008040 comp rx=0 tx=0).stop 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 msgr2=0x7fb2e8070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 0x7fb2e8070040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c450 tx=0x7fb2dc00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 shutdown_connections 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2cc039ac0 0x7fb2cc03bf80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 --2- 172.21.15.53:0/2595539130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb2e812d4a0 0x7fb2e8070040 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc00c450 tx=0x7fb2dc00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 >> 172.21.15.53:0/2595539130 conn(0x7fb2e809d8e0 msgr2=0x7fb2e812bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 shutdown_connections 2024-05-08T18:08:31.324 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:31.323+0000 7fb2ef5d1640 1 -- 172.21.15.53:0/2595539130 wait complete. 2024-05-08T18:08:31.341 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-08T18:08:37.745 DEBUG:teuthology.orchestra.run.smithi053:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T18:08:37.873 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.871+0000 7f8e29bd6640 1 Processor -- start 2024-05-08T18:08:37.873 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.871+0000 7f8e29bd6640 1 -- start start 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e29bd6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e2412d4a0 0x7f8e2412d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e29bd6640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e24072ea0 con 0x7f8e2412ddc0 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e29bd6640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8e240735e0 con 0x7f8e2412d4a0 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e237fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8e2412d4a0 0x7f8e2412d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e22ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f8e2412ddc0 0x7f8e24129d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52914/0 (socket says 172.21.15.53:52914) 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e22ffd640 1 -- 172.21.15.53:0/1322054812 learned_addr learned my addr 172.21.15.53:0/1322054812 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e227fc640 1 -- 172.21.15.53:0/1322054812 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344767415 0 0) 0x7f8e24072ea0 con 0x7f8e2412ddc0 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e227fc640 1 -- 172.21.15.53:0/1322054812 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e10003530 con 0x7f8e2412ddc0 2024-05-08T18:08:37.874 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e237fe640 1 -- 172.21.15.53:0/1322054812 >> v1:172.21.15.53:6789/0 conn(0x7f8e2412ddc0 legacy=0x7f8e24129d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:37.875 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e237fe640 1 -- 172.21.15.53:0/1322054812 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e24071ff0 con 0x7f8e2412d4a0 2024-05-08T18:08:37.876 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e237fe640 1 --2- 172.21.15.53:0/1322054812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e2412d880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009740 tx=0x7f8e1401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e98ddc311ac8ca5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:37.877 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e227fc640 1 -- 172.21.15.53:0/1322054812 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e140b0070 con 0x7f8e2412d4a0 2024-05-08T18:08:37.877 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e227fc640 1 -- 172.21.15.53:0/1322054812 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e140ab530 con 0x7f8e2412d4a0 2024-05-08T18:08:37.877 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.875+0000 7f8e227fc640 1 -- 172.21.15.53:0/1322054812 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e140ab810 con 0x7f8e2412d4a0 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1322054812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 msgr2=0x7f8e2412d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 --2- 172.21.15.53:0/1322054812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e2412d880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8e14009740 tx=0x7f8e1401c370 comp rx=0 tx=0).stop 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1322054812 shutdown_connections 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 --2- 172.21.15.53:0/1322054812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e2412d880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1322054812 >> 172.21.15.53:0/1322054812 conn(0x7f8e2409d8e0 msgr2=0x7f8e2409dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1322054812 shutdown_connections 2024-05-08T18:08:37.878 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1322054812 wait complete. 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 Processor -- start 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- start start 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e240976a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8e24136180 con 0x7f8e2412d4a0 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e240976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e237fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e240976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52644/0 (socket says 172.21.15.53:52644) 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e237fe640 1 -- 172.21.15.53:0/1341534893 learned_addr learned my addr 172.21.15.53:0/1341534893 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:37.879 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e237fe640 1 -- 172.21.15.53:0/1341534893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e24071bb0 con 0x7f8e2412d4a0 2024-05-08T18:08:37.880 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e237fe640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e240976a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e14018f80 tx=0x7f8e14019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e140b9070 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e140abc20 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e24126430 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e140b0040 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e24097be0 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e24125c90 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8e140bc070 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.879+0000 7f8e1bfff640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8e04039b50 0x7f8e0403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.883+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7f8e140a4e00 con 0x7f8e2412d4a0 2024-05-08T18:08:37.881 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.883+0000 7f8e22ffd640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8e04039b50 0x7f8e0403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:37.882 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.883+0000 7f8e22ffd640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8e04039b50 0x7f8e0403c010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005c10 tx=0x7f8e0c001720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:37.886 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:37.887+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8e14015ff0 con 0x7f8e2412d4a0 2024-05-08T18:08:38.046 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.047+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e24064150 con 0x7f8e2412d4a0 2024-05-08T18:08:38.047 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.047+0000 7f8e1bfff640 1 -- 172.21.15.53:0/1341534893 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7975 (secure 0 0 0) 0x7f8e140b3360 con 0x7f8e2412d4a0 2024-05-08T18:08:38.047 INFO:teuthology.misc.health.smithi053.stdout: 2024-05-08T18:08:38.048 INFO:teuthology.misc.health.smithi053.stdout:{"epoch":12,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:08:34.401405+0000","last_up_change":"2024-05-08T18:08:31.326207+0000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:08:31.348047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6801","nonce":803213352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6803","nonce":803213352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6807","nonce":803213352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6805","nonce":803213352}]},"public_addr":"172.21.15.53:6801/803213352","cluster_addr":"172.21.15.53:6803/803213352","heartbeat_back_addr":"172.21.15.53:6807/803213352","heartbeat_front_addr":"172.21.15.53:6805/803213352","state":["exists","up"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6801","nonce":1559856467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6803","nonce":1559856467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6807","nonce":1559856467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6805","nonce":1559856467}]},"public_addr":"172.21.15.114:6801/1559856467","cluster_addr":"172.21.15.114:6803/1559856467","heartbeat_back_addr":"172.21.15.114:6807/1559856467","heartbeat_front_addr":"172.21.15.114:6805/1559856467","state":["exists","up"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6811","nonce":2279342404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6815","nonce":2279342404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6821","nonce":2279342404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6818","nonce":2279342404}]},"public_addr":"172.21.15.114:6811/2279342404","cluster_addr":"172.21.15.114:6815/2279342404","heartbeat_back_addr":"172.21.15.114:6821/2279342404","heartbeat_front_addr":"172.21.15.114:6818/2279342404","state":["exists","up"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6809","nonce":3988457904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6814","nonce":3988457904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6823","nonce":3988457904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6817","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6820","nonce":3988457904}]},"public_addr":"172.21.15.114:6809/3988457904","cluster_addr":"172.21.15.114:6814/3988457904","heartbeat_back_addr":"172.21.15.114:6823/3988457904","heartbeat_front_addr":"172.21.15.114:6820/3988457904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.014179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.335559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.226745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.273527+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8e04039b50 msgr2=0x7f8e0403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8e04039b50 0x7f8e0403c010 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005c10 tx=0x7f8e0c001720 comp rx=0 tx=0).stop 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 msgr2=0x7f8e240976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e240976a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8e14018f80 tx=0x7f8e14019110 comp rx=0 tx=0).stop 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 shutdown_connections 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8e04039b50 0x7f8e0403c010 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 --2- 172.21.15.53:0/1341534893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e2412d4a0 0x7f8e240976a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 >> 172.21.15.53:0/1341534893 conn(0x7f8e2409d8e0 msgr2=0x7f8e2412baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 shutdown_connections 2024-05-08T18:08:38.050 INFO:teuthology.misc.health.smithi053.stderr:2024-05-08T18:08:38.051+0000 7f8e29bd6640 1 -- 172.21.15.53:0/1341534893 wait complete. 2024-05-08T18:08:38.064 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-08T18:08:38.064 INFO:tasks.ceph:Creating RBD pool 2024-05-08T18:08:38.064 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T18:08:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.187+0000 7fc061b14640 1 Processor -- start 2024-05-08T18:08:38.188 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.187+0000 7fc061b14640 1 -- start start 2024-05-08T18:08:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.187+0000 7fc061b14640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc05c09df80 0x7fc05c12c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.187+0000 7fc061b14640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc05c073630 con 0x7fc05c12ccf0 2024-05-08T18:08:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.187+0000 7fc061b14640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc05c12c0c0 con 0x7fc05c09df80 2024-05-08T18:08:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05b7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc05c09df80 0x7fc05c12c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc05c12ccf0 0x7fc05c071df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52924/0 (socket says 172.21.15.53:52924) 2024-05-08T18:08:38.189 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05affd640 1 -- 172.21.15.53:0/4167006640 learned_addr learned my addr 172.21.15.53:0/4167006640 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:38.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05b7fe640 1 -- 172.21.15.53:0/4167006640 >> v1:172.21.15.53:6789/0 conn(0x7fc05c12ccf0 legacy=0x7fc05c071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.190 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05b7fe640 1 -- 172.21.15.53:0/4167006640 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c12c360 con 0x7fc05c09df80 2024-05-08T18:08:38.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05b7fe640 1 --2- 172.21.15.53:0/4167006640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c12c7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009740 tx=0x7fc04c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b15f3930fff0c1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05a7fc640 1 -- 172.21.15.53:0/4167006640 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04c0b1070 con 0x7fc05c09df80 2024-05-08T18:08:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05a7fc640 1 -- 172.21.15.53:0/4167006640 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c0ac570 con 0x7fc05c09df80 2024-05-08T18:08:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc05a7fc640 1 -- 172.21.15.53:0/4167006640 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04c0ac870 con 0x7fc05c09df80 2024-05-08T18:08:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 -- 172.21.15.53:0/4167006640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 msgr2=0x7fc05c12c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 --2- 172.21.15.53:0/4167006640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c12c7b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009740 tx=0x7fc04c01c3d0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 -- 172.21.15.53:0/4167006640 shutdown_connections 2024-05-08T18:08:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 --2- 172.21.15.53:0/4167006640 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c12c7b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 -- 172.21.15.53:0/4167006640 >> 172.21.15.53:0/4167006640 conn(0x7fc05c09be90 msgr2=0x7fc05c09d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 -- 172.21.15.53:0/4167006640 shutdown_connections 2024-05-08T18:08:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.191+0000 7fc061b14640 1 -- 172.21.15.53:0/4167006640 wait complete. 2024-05-08T18:08:38.193 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 Processor -- start 2024-05-08T18:08:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 -- start start 2024-05-08T18:08:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c1c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c1347f0 con 0x7fc05c09df80 2024-05-08T18:08:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc05b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c1c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc05b7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c1c7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52648/0 (socket says 172.21.15.53:52648) 2024-05-08T18:08:38.194 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc05b7fe640 1 -- 172.21.15.53:0/1013532827 learned_addr learned my addr 172.21.15.53:0/1013532827 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc05b7fe640 1 -- 172.21.15.53:0/1013532827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c117660 con 0x7fc05c09df80 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc05b7fe640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c1c7390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc04c01a000 tx=0x7fc04c01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04c0b1050 con 0x7fc05c09df80 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc04c0b2040 con 0x7fc05c09df80 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c1169f0 con 0x7fc05c09df80 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc04c0b6740 con 0x7fc05c09df80 2024-05-08T18:08:38.195 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c118290 con 0x7fc05c09df80 2024-05-08T18:08:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c064150 con 0x7fc05c09df80 2024-05-08T18:08:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc04c0bf030 con 0x7fc05c09df80 2024-05-08T18:08:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc043fff640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc048039b50 0x7fc04803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3129+0+0 (secure 0 0 0) 0x7fc04c0bd070 con 0x7fc05c09df80 2024-05-08T18:08:38.196 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.195+0000 7fc05affd640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc048039b50 0x7fc04803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:38.197 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.199+0000 7fc05affd640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc048039b50 0x7fc04803c010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc050001670 tx=0x7fc050007ad0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:38.200 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.199+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc04c0c6020 con 0x7fc05c09df80 2024-05-08T18:08:38.363 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.363+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fc05c069bb0 con 0x7fc05c09df80 2024-05-08T18:08:38.412 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.411+0000 7fc043fff640 1 -- 172.21.15.53:0/1013532827 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (secure 0 0 0) 0x7fc05c117660 con 0x7fc05c09df80 2024-05-08T18:08:38.412 INFO:teuthology.orchestra.run.smithi053.stderr:pool 'rbd' created 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc048039b50 msgr2=0x7fc04803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc048039b50 0x7fc04803c010 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc050001670 tx=0x7fc050007ad0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 msgr2=0x7fc05c1c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c1c7390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc04c01a000 tx=0x7fc04c01ac10 comp rx=0 tx=0).stop 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 shutdown_connections 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc048039b50 0x7fc04803c010 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 --2- 172.21.15.53:0/1013532827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc05c09df80 0x7fc05c1c7390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 >> 172.21.15.53:0/1013532827 conn(0x7fc05c09be90 msgr2=0x7fc05c1235e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 shutdown_connections 2024-05-08T18:08:38.415 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.415+0000 7fc061b14640 1 -- 172.21.15.53:0/1013532827 wait complete. 2024-05-08T18:08:38.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T18:08:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.555+0000 7f1bf8711640 1 Processor -- start 2024-05-08T18:08:38.556 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.555+0000 7f1bf8711640 1 -- start start 2024-05-08T18:08:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.555+0000 7f1bf8711640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1bf0130510 0x7f1bf0132900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.555+0000 7f1bf8711640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf012d320 con 0x7f1bf0073b40 2024-05-08T18:08:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.555+0000 7f1bf8711640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf0114d60 con 0x7f1bf0130510 2024-05-08T18:08:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.555+0000 7f1bf5cac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1bf0130510 0x7f1bf0132900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:38.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf64ad640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f1bf0073b40 0x7f1bf012d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:52926/0 (socket says 172.21.15.53:52926) 2024-05-08T18:08:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf64ad640 1 -- 172.21.15.53:0/136576165 learned_addr learned my addr 172.21.15.53:0/136576165 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf5cac640 1 -- 172.21.15.53:0/136576165 >> v1:172.21.15.53:6789/0 conn(0x7f1bf0073b40 legacy=0x7f1bf012d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf5cac640 1 -- 172.21.15.53:0/136576165 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf0114490 con 0x7f1bf0130510 2024-05-08T18:08:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf5cac640 1 --2- 172.21.15.53:0/136576165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0130510 0x7f1bf0132900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009740 tx=0x7f1be001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e6a3a5f26d0a40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf54ab640 1 -- 172.21.15.53:0/136576165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be00b1070 con 0x7f1bf0130510 2024-05-08T18:08:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf54ab640 1 -- 172.21.15.53:0/136576165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be00ac570 con 0x7f1bf0130510 2024-05-08T18:08:38.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf54ab640 1 -- 172.21.15.53:0/136576165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1be00ac870 con 0x7f1bf0130510 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf8711640 1 -- 172.21.15.53:0/136576165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0130510 msgr2=0x7f1bf0132900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.559+0000 7f1bf8711640 1 --2- 172.21.15.53:0/136576165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0130510 0x7f1bf0132900 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009740 tx=0x7f1be001c400 comp rx=0 tx=0).stop 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/136576165 shutdown_connections 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 --2- 172.21.15.53:0/136576165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0130510 0x7f1bf0132900 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/136576165 >> 172.21.15.53:0/136576165 conn(0x7f1bf009b5b0 msgr2=0x7f1bf009b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/136576165 shutdown_connections 2024-05-08T18:08:38.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/136576165 wait complete. 2024-05-08T18:08:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 Processor -- start 2024-05-08T18:08:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- start start 2024-05-08T18:08:38.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 0x7f1bf01c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf0135870 con 0x7f1bf0073b40 2024-05-08T18:08:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf64ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 0x7f1bf01c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf64ad640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 0x7f1bf01c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52670/0 (socket says 172.21.15.53:52670) 2024-05-08T18:08:38.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf64ad640 1 -- 172.21.15.53:0/1127636973 learned_addr learned my addr 172.21.15.53:0/1127636973 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf64ad640 1 -- 172.21.15.53:0/1127636973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf01161e0 con 0x7f1bf0073b40 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf64ad640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 0x7f1bf01c4c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c450 tx=0x7f1bec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec017070 con 0x7f1bf0073b40 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bec005c20 con 0x7f1bf0073b40 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf0127010 con 0x7f1bf0073b40 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bec0070d0 con 0x7f1bf0073b40 2024-05-08T18:08:38.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf0116510 con 0x7f1bf0073b40 2024-05-08T18:08:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf0064150 con 0x7f1bf0073b40 2024-05-08T18:08:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.563+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f1bec01a070 con 0x7f1bf0073b40 2024-05-08T18:08:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.567+0000 7f1be6ffd640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1bd4039b50 0x7f1bd403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.567+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3471+0+0 (secure 0 0 0) 0x7f1bec04c370 con 0x7f1bf0073b40 2024-05-08T18:08:38.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.567+0000 7f1bf5cac640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1bd4039b50 0x7f1bd403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:38.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.567+0000 7f1bf5cac640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1bd4039b50 0x7f1bd403c010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009740 tx=0x7f1be00a6070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:38.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.571+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1bec019cd0 con 0x7f1bf0073b40 2024-05-08T18:08:38.728 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:38.727+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f1bf0069bb0 con 0x7f1bf0073b40 2024-05-08T18:08:39.417 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.415+0000 7f1be6ffd640 1 -- 172.21.15.53:0/1127636973 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 173+0+0 (secure 0 0 0) 0x7f1bec010be0 con 0x7f1bf0073b40 2024-05-08T18:08:39.417 INFO:teuthology.orchestra.run.smithi053.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1bd4039b50 msgr2=0x7f1bd403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1bd4039b50 0x7f1bd403c010 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009740 tx=0x7f1be00a6070 comp rx=0 tx=0).stop 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 msgr2=0x7f1bf01c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 0x7f1bf01c4c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c450 tx=0x7f1bec00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 shutdown_connections 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1bd4039b50 0x7f1bd403c010 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 --2- 172.21.15.53:0/1127636973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bf0073b40 0x7f1bf01c4c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 >> 172.21.15.53:0/1127636973 conn(0x7f1bf009b5b0 msgr2=0x7f1bf01278d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 shutdown_connections 2024-05-08T18:08:39.420 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.419+0000 7f1bf8711640 1 -- 172.21.15.53:0/1127636973 wait complete. 2024-05-08T18:08:39.444 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T18:08:39.444 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T18:08:39.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T18:08:39.444 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T18:08:39.445 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T18:08:39.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.571+0000 7fdd1e84b640 1 Processor -- start 2024-05-08T18:08:39.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.571+0000 7fdd1e84b640 1 -- start start 2024-05-08T18:08:39.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd181326b0 0x7fdd18134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd18071290 con 0x7fdd18070220 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdd18073ae0 con 0x7fdd181326b0 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd177fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdd181326b0 0x7fdd18134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd17fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdd18070220 0x7fdd18070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56968/0 (socket says 172.21.15.53:56968) 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd17fff640 1 -- 172.21.15.53:0/45508492 learned_addr learned my addr 172.21.15.53:0/45508492 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd177fe640 1 -- 172.21.15.53:0/45508492 >> v1:172.21.15.53:6789/0 conn(0x7fdd18070220 legacy=0x7fdd18070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd177fe640 1 -- 172.21.15.53:0/45508492 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd18073330 con 0x7fdd181326b0 2024-05-08T18:08:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd177fe640 1 --2- 172.21.15.53:0/45508492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd181326b0 0x7fdd18134aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009740 tx=0x7fdd0001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b86100c2f2f5ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd16ffd640 1 -- 172.21.15.53:0/45508492 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd000b0070 con 0x7fdd181326b0 2024-05-08T18:08:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd16ffd640 1 -- 172.21.15.53:0/45508492 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd000ab530 con 0x7fdd181326b0 2024-05-08T18:08:39.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd16ffd640 1 -- 172.21.15.53:0/45508492 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd000ab830 con 0x7fdd181326b0 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- 172.21.15.53:0/45508492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd181326b0 msgr2=0x7fdd18134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 --2- 172.21.15.53:0/45508492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd181326b0 0x7fdd18134aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd00009740 tx=0x7fdd0001c370 comp rx=0 tx=0).stop 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- 172.21.15.53:0/45508492 shutdown_connections 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 --2- 172.21.15.53:0/45508492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd181326b0 0x7fdd18134aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- 172.21.15.53:0/45508492 >> 172.21.15.53:0/45508492 conn(0x7fdd180a1c20 msgr2=0x7fdd180a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- 172.21.15.53:0/45508492 shutdown_connections 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.575+0000 7fdd1e84b640 1 -- 172.21.15.53:0/45508492 wait complete. 2024-05-08T18:08:39.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 Processor -- start 2024-05-08T18:08:39.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 -- start start 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 0x7fdd1811f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdd18137a10 con 0x7fdd18070220 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 0x7fdd1811f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd17fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 0x7fdd1811f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51904/0 (socket says 172.21.15.53:51904) 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd17fff640 1 -- 172.21.15.53:0/534851097 learned_addr learned my addr 172.21.15.53:0/534851097 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd17fff640 1 -- 172.21.15.53:0/534851097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd18134ab0 con 0x7fdd18070220 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd17fff640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 0x7fdd1811f2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800cb40 tx=0x7fdd0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd08017070 con 0x7fdd18070220 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd0800aba0 con 0x7fdd18070220 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd18121b20 con 0x7fdd18070220 2024-05-08T18:08:39.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdd08012400 con 0x7fdd18070220 2024-05-08T18:08:39.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1811f9c0 con 0x7fdd18070220 2024-05-08T18:08:39.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd181204b0 con 0x7fdd18070220 2024-05-08T18:08:39.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fdd0801a070 con 0x7fdd18070220 2024-05-08T18:08:39.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd14ff9640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcf8039b00 0x7fdcf803bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:39.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7fdd0804cee0 con 0x7fdd18070220 2024-05-08T18:08:39.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.579+0000 7fdd177fe640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcf8039b00 0x7fdcf803bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:39.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.583+0000 7fdd177fe640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcf8039b00 0x7fdcf803bfc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdd000ad000 tx=0x7fdd000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:39.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.583+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdd18071290 con 0x7fdd18070220 2024-05-08T18:08:39.778 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.779+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fdd18064150 con 0x7fdd18070220 2024-05-08T18:08:39.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.783+0000 7fdd14ff9640 1 -- 172.21.15.53:0/534851097 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+90510 (secure 0 0 0) 0x7fdd080371a0 con 0x7fdd18070220 2024-05-08T18:08:39.785 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcf8039b00 msgr2=0x7fdcf803bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcf8039b00 0x7fdcf803bfc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdd000ad000 tx=0x7fdd000a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 msgr2=0x7fdd1811f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 0x7fdd1811f2b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800cb40 tx=0x7fdd0800a060 comp rx=0 tx=0).stop 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 shutdown_connections 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcf8039b00 0x7fdcf803bfc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 --2- 172.21.15.53:0/534851097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd18070220 0x7fdd1811f2b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 >> 172.21.15.53:0/534851097 conn(0x7fdd180a1c20 msgr2=0x7fdd181312b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 shutdown_connections 2024-05-08T18:08:39.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.787+0000 7fdd1e84b640 1 -- 172.21.15.53:0/534851097 wait complete. 2024-05-08T18:08:39.801 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":1414075515},{"type":"v1","addr":"172.21.15.114:6825","nonce":1414075515}]},"active_addr":"172.21.15.114:6825/1414075515","active_change":"2024-05-08T18:08:27.295631+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":4075638302}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":2845375983}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3493138104}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.114:0","nonce":3319086030}]}]} 2024-05-08T18:08:39.803 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T18:08:39.803 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T18:08:39.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:08:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.923+0000 7fcfb800b640 1 Processor -- start 2024-05-08T18:08:39.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.923+0000 7fcfb800b640 1 -- start start 2024-05-08T18:08:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb800b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcfb0070fd0 0x7fcfb00713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb800b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfb0073360 con 0x7fcfb00718f0 2024-05-08T18:08:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb800b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fcfb0073670 con 0x7fcfb0070fd0 2024-05-08T18:08:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb5da7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fcfb0070fd0 0x7fcfb00713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:39.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb55a6640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fcfb00718f0 0x7fcfb012f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56980/0 (socket says 172.21.15.53:56980) 2024-05-08T18:08:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb55a6640 1 -- 172.21.15.53:0/220037903 learned_addr learned my addr 172.21.15.53:0/220037903 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb4da5640 1 -- 172.21.15.53:0/220037903 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041950263 0 0) 0x7fcfb0073360 con 0x7fcfb00718f0 2024-05-08T18:08:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb4da5640 1 -- 172.21.15.53:0/220037903 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf9c003530 con 0x7fcfb00718f0 2024-05-08T18:08:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb5da7640 1 -- 172.21.15.53:0/220037903 >> v1:172.21.15.53:6789/0 conn(0x7fcfb00718f0 legacy=0x7fcfb012f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb5da7640 1 -- 172.21.15.53:0/220037903 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb0072f40 con 0x7fcfb0070fd0 2024-05-08T18:08:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb5da7640 1 --2- 172.21.15.53:0/220037903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb00713b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009740 tx=0x7fcfac01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165dad2a66b12661 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb4da5640 1 -- 172.21.15.53:0/220037903 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac0b0070 con 0x7fcfb0070fd0 2024-05-08T18:08:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb4da5640 1 -- 172.21.15.53:0/220037903 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0ab530 con 0x7fcfb0070fd0 2024-05-08T18:08:39.928 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.927+0000 7fcfb4da5640 1 -- 172.21.15.53:0/220037903 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac0ab830 con 0x7fcfb0070fd0 2024-05-08T18:08:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/220037903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 msgr2=0x7fcfb00713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 --2- 172.21.15.53:0/220037903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb00713b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009740 tx=0x7fcfac01c370 comp rx=0 tx=0).stop 2024-05-08T18:08:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/220037903 shutdown_connections 2024-05-08T18:08:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 --2- 172.21.15.53:0/220037903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb00713b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:39.929 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/220037903 >> 172.21.15.53:0/220037903 conn(0x7fcfb009e030 msgr2=0x7fcfb009e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:39.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/220037903 shutdown_connections 2024-05-08T18:08:39.930 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/220037903 wait complete. 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 Processor -- start 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- start start 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb012b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb0137cd0 con 0x7fcfb0070fd0 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb5da7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb012b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb5da7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb012b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51922/0 (socket says 172.21.15.53:51922) 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb5da7640 1 -- 172.21.15.53:0/2240771793 learned_addr learned my addr 172.21.15.53:0/2240771793 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:39.931 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb5da7640 1 -- 172.21.15.53:0/2240771793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb011da60 con 0x7fcfb0070fd0 2024-05-08T18:08:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb5da7640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb012b940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0ae040 tx=0x7fcfac01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac0b0050 con 0x7fcfb0070fd0 2024-05-08T18:08:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfac0b1040 con 0x7fcfb0070fd0 2024-05-08T18:08:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfac0b75a0 con 0x7fcfb0070fd0 2024-05-08T18:08:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb011e6f0 con 0x7fcfb0070fd0 2024-05-08T18:08:39.932 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb012be80 con 0x7fcfb0070fd0 2024-05-08T18:08:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb0064150 con 0x7fcfb0070fd0 2024-05-08T18:08:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.931+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcfac0be030 con 0x7fcfb0070fd0 2024-05-08T18:08:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.935+0000 7fcfa67fc640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcf94039b50 0x7fcf9403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.935+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7fcfac0bc070 con 0x7fcfb0070fd0 2024-05-08T18:08:39.933 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.935+0000 7fcfb55a6640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcf94039b50 0x7fcf9403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:39.934 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.935+0000 7fcfb55a6640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcf94039b50 0x7fcf9403c010 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007fd0 tx=0x7fcfa0007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:39.938 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:39.939+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcfac0eb070 con 0x7fcfb0070fd0 2024-05-08T18:08:40.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.103+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfb011e230 con 0x7fcfb0070fd0 2024-05-08T18:08:40.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.103+0000 7fcfa67fc640 1 -- 172.21.15.53:0/2240771793 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9756 (secure 0 0 0) 0x7fcfac0c5060 con 0x7fcfb0070fd0 2024-05-08T18:08:40.104 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:40.104 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":14,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:08:39.416435+0000","last_up_change":"2024-05-08T18:08:31.326207+0000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:08:31.348047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:08:38.372481+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6801","nonce":803213352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6803","nonce":803213352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6807","nonce":803213352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6805","nonce":803213352}]},"public_addr":"172.21.15.53:6801/803213352","cluster_addr":"172.21.15.53:6803/803213352","heartbeat_back_addr":"172.21.15.53:6807/803213352","heartbeat_front_addr":"172.21.15.53:6805/803213352","state":["exists","up"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6801","nonce":1559856467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6803","nonce":1559856467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6807","nonce":1559856467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6805","nonce":1559856467}]},"public_addr":"172.21.15.114:6801/1559856467","cluster_addr":"172.21.15.114:6803/1559856467","heartbeat_back_addr":"172.21.15.114:6807/1559856467","heartbeat_front_addr":"172.21.15.114:6805/1559856467","state":["exists","up"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6811","nonce":2279342404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6815","nonce":2279342404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6821","nonce":2279342404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6818","nonce":2279342404}]},"public_addr":"172.21.15.114:6811/2279342404","cluster_addr":"172.21.15.114:6815/2279342404","heartbeat_back_addr":"172.21.15.114:6821/2279342404","heartbeat_front_addr":"172.21.15.114:6818/2279342404","state":["exists","up"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6809","nonce":3988457904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6814","nonce":3988457904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6823","nonce":3988457904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6817","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6820","nonce":3988457904}]},"public_addr":"172.21.15.114:6809/3988457904","cluster_addr":"172.21.15.114:6814/3988457904","heartbeat_back_addr":"172.21.15.114:6823/3988457904","heartbeat_front_addr":"172.21.15.114:6820/3988457904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.014179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.335559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.226745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.273527+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:08:40.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcf94039b50 msgr2=0x7fcf9403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcf94039b50 0x7fcf9403c010 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcfa0007fd0 tx=0x7fcfa0007900 comp rx=0 tx=0).stop 2024-05-08T18:08:40.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 msgr2=0x7fcfb012b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb012b940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcfac0ae040 tx=0x7fcfac01abb0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 shutdown_connections 2024-05-08T18:08:40.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcf94039b50 0x7fcf9403c010 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 --2- 172.21.15.53:0/2240771793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcfb0070fd0 0x7fcfb012b940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 >> 172.21.15.53:0/2240771793 conn(0x7fcfb009e030 msgr2=0x7fcfb0132700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 shutdown_connections 2024-05-08T18:08:40.107 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.107+0000 7fcfb800b640 1 -- 172.21.15.53:0/2240771793 wait complete. 2024-05-08T18:08:40.123 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T18:08:40.123 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.247+0000 7f9f4d75f640 1 Processor -- start 2024-05-08T18:08:40.249 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f4d75f640 1 -- start start 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f4d75f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f48070220 0x7f9f48070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f4d75f640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f48071290 con 0x7f9f48070b40 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f4d75f640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9f48073ae0 con 0x7f9f48070220 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f46ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9f48070220 0x7f9f48070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f3ffff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9f48070b40 0x7f9f4812f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56988/0 (socket says 172.21.15.53:56988) 2024-05-08T18:08:40.250 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f3ffff640 1 -- 172.21.15.53:0/1196338053 learned_addr learned my addr 172.21.15.53:0/1196338053 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f46ffd640 1 -- 172.21.15.53:0/1196338053 >> v1:172.21.15.53:6789/0 conn(0x7f9f48070b40 legacy=0x7f9f4812f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.251 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f46ffd640 1 -- 172.21.15.53:0/1196338053 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f48073330 con 0x7f9f48070220 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f46ffd640 1 --2- 172.21.15.53:0/1196338053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f48070600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009740 tx=0x7f9f3801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c94f4257c002f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f467fc640 1 -- 172.21.15.53:0/1196338053 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f380b0070 con 0x7f9f48070220 2024-05-08T18:08:40.252 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f467fc640 1 -- 172.21.15.53:0/1196338053 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f380ab530 con 0x7f9f48070220 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.251+0000 7f9f467fc640 1 -- 172.21.15.53:0/1196338053 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f380ab830 con 0x7f9f48070220 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/1196338053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 msgr2=0x7f9f48070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 --2- 172.21.15.53:0/1196338053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f48070600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009740 tx=0x7f9f3801c370 comp rx=0 tx=0).stop 2024-05-08T18:08:40.253 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/1196338053 shutdown_connections 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 --2- 172.21.15.53:0/1196338053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f48070600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/1196338053 >> 172.21.15.53:0/1196338053 conn(0x7f9f480a1c20 msgr2=0x7f9f480a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/1196338053 shutdown_connections 2024-05-08T18:08:40.254 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/1196338053 wait complete. 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 Processor -- start 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- start start 2024-05-08T18:08:40.255 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f4811c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48138100 con 0x7f9f48070220 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f4811c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f46ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f4811c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51934/0 (socket says 172.21.15.53:51934) 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f46ffd640 1 -- 172.21.15.53:0/3537815407 learned_addr learned my addr 172.21.15.53:0/3537815407 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f46ffd640 1 -- 172.21.15.53:0/3537815407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4812d310 con 0x7f9f48070220 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f46ffd640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f4811c050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f380ae040 tx=0x7f9f3801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f380b0050 con 0x7f9f48070220 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f380b1040 con 0x7f9f48070220 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4811ee10 con 0x7f9f48070220 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f380b5930 con 0x7f9f48070220 2024-05-08T18:08:40.256 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f4811f2a0 con 0x7f9f48070220 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f9f380be030 con 0x7f9f48070220 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f48064150 con 0x7f9f48070220 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f3f7fe640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9f28039b50 0x7f9f2803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.255+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3482+0+0 (secure 0 0 0) 0x7f9f380bc070 con 0x7f9f48070220 2024-05-08T18:08:40.257 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.259+0000 7f9f3ffff640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9f28039b50 0x7f9f2803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.258 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.259+0000 7f9f3ffff640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9f28039b50 0x7f9f2803c010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9f30005890 tx=0x7f9f30007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.261 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.263+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9f380c5020 con 0x7f9f48070220 2024-05-08T18:08:40.426 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.427+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f4811da00 con 0x7f9f48070220 2024-05-08T18:08:40.427 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.427+0000 7f9f3f7fe640 1 -- 172.21.15.53:0/3537815407 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+9743 (secure 0 0 0) 0x7f9f38015ff0 con 0x7f9f48070220 2024-05-08T18:08:40.427 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:40.428 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":15,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:08:40.421090+0000","last_up_change":"2024-05-08T18:08:31.326207+0000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:08:31.348047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:08:38.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6801","nonce":803213352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6803","nonce":803213352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6807","nonce":803213352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6805","nonce":803213352}]},"public_addr":"172.21.15.53:6801/803213352","cluster_addr":"172.21.15.53:6803/803213352","heartbeat_back_addr":"172.21.15.53:6807/803213352","heartbeat_front_addr":"172.21.15.53:6805/803213352","state":["exists","up"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6801","nonce":1559856467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6803","nonce":1559856467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6807","nonce":1559856467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6805","nonce":1559856467}]},"public_addr":"172.21.15.114:6801/1559856467","cluster_addr":"172.21.15.114:6803/1559856467","heartbeat_back_addr":"172.21.15.114:6807/1559856467","heartbeat_front_addr":"172.21.15.114:6805/1559856467","state":["exists","up"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6811","nonce":2279342404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6815","nonce":2279342404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6821","nonce":2279342404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6818","nonce":2279342404}]},"public_addr":"172.21.15.114:6811/2279342404","cluster_addr":"172.21.15.114:6815/2279342404","heartbeat_back_addr":"172.21.15.114:6821/2279342404","heartbeat_front_addr":"172.21.15.114:6818/2279342404","state":["exists","up"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6809","nonce":3988457904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6814","nonce":3988457904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6823","nonce":3988457904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6817","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6820","nonce":3988457904}]},"public_addr":"172.21.15.114:6809/3988457904","cluster_addr":"172.21.15.114:6814/3988457904","heartbeat_back_addr":"172.21.15.114:6823/3988457904","heartbeat_front_addr":"172.21.15.114:6820/3988457904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.014179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.335559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.226745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.273527+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9f28039b50 msgr2=0x7f9f2803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9f28039b50 0x7f9f2803c010 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9f30005890 tx=0x7f9f30007ab0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 msgr2=0x7f9f4811c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f4811c050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f380ae040 tx=0x7f9f3801abb0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 shutdown_connections 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9f28039b50 0x7f9f2803c010 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 --2- 172.21.15.53:0/3537815407 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f48070220 0x7f9f4811c050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 >> 172.21.15.53:0/3537815407 conn(0x7f9f480a1c20 msgr2=0x7f9f48132200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 shutdown_connections 2024-05-08T18:08:40.430 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.431+0000 7f9f4d75f640 1 -- 172.21.15.53:0/3537815407 wait complete. 2024-05-08T18:08:40.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T18:08:40.448 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T18:08:40.448 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T18:08:40.449 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T18:08:40.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff1528a2640 1 Processor -- start 2024-05-08T18:08:40.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff1528a2640 1 -- start start 2024-05-08T18:08:40.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff1528a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff14c1286a0 0x7ff14c128a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff1528a2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff14c097ee0 con 0x7ff14c128fc0 2024-05-08T18:08:40.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff1528a2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff14c096e60 con 0x7ff14c1286a0 2024-05-08T18:08:40.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff14bfff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff14c1286a0 0x7ff14c128a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff14b7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff14c128fc0 0x7ff14c12b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:56994/0 (socket says 172.21.15.53:56994) 2024-05-08T18:08:40.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff14b7fe640 1 -- 172.21.15.53:0/2166956173 learned_addr learned my addr 172.21.15.53:0/2166956173 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff14affd640 1 -- 172.21.15.53:0/2166956173 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752442372 0 0) 0x7ff14c097ee0 con 0x7ff14c128fc0 2024-05-08T18:08:40.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff14bfff640 1 -- 172.21.15.53:0/2166956173 >> v1:172.21.15.53:6789/0 conn(0x7ff14c128fc0 legacy=0x7ff14c12b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7ff14bfff640 1 -- 172.21.15.53:0/2166956173 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c097480 con 0x7ff14c1286a0 2024-05-08T18:08:40.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2affcac640 1 Processor -- start 2024-05-08T18:08:40.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2affcac640 1 -- start start 2024-05-08T18:08:40.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2affcac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2af8070110 0x7f2af80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2affcac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2af80719f0 con 0x7f2af8070a30 2024-05-08T18:08:40.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2affcac640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2af80716e0 con 0x7f2af8070110 2024-05-08T18:08:40.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2afda48640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2af8070110 0x7f2af80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2afd247640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2af8070a30 0x7f2af812f8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57000/0 (socket says 172.21.15.53:57000) 2024-05-08T18:08:40.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f2afd247640 1 -- 172.21.15.53:0/3810114521 learned_addr learned my addr 172.21.15.53:0/3810114521 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.563+0000 7f9b75e53640 1 Processor -- start 2024-05-08T18:08:40.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b75e53640 1 -- start start 2024-05-08T18:08:40.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afca46640 1 -- 172.21.15.53:0/3810114521 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095774261 0 0) 0x7f2af80719f0 con 0x7f2af8070a30 2024-05-08T18:08:40.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afca46640 1 -- 172.21.15.53:0/3810114521 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ae4003530 con 0x7f2af8070a30 2024-05-08T18:08:40.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afda48640 1 -- 172.21.15.53:0/3810114521 >> v1:172.21.15.53:6789/0 conn(0x7f2af8070a30 legacy=0x7f2af812f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.567 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afda48640 1 -- 172.21.15.53:0/3810114521 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af806e250 con 0x7f2af8070110 2024-05-08T18:08:40.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7cb9e640 1 Processor -- start 2024-05-08T18:08:40.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b75e53640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b70094430 0x7f9b70094810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b75e53640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b70097c20 con 0x7f9b7012d240 2024-05-08T18:08:40.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b75e53640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9b700760e0 con 0x7f9b70094430 2024-05-08T18:08:40.568 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b6f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b70094430 0x7f9b70094810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7cb9e640 1 -- start start 2024-05-08T18:08:40.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b6f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9b70094430 0x7f9b70094810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51952/0 (socket says 172.21.15.53:51952) 2024-05-08T18:08:40.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b6effd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f9b7012d240 0x7f9b7012d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57006/0 (socket says 172.21.15.53:57006) 2024-05-08T18:08:40.569 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b6f7fe640 1 -- 172.21.15.53:0/2789922589 learned_addr learned my addr 172.21.15.53:0/2789922589 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff14bfff640 1 --2- 172.21.15.53:0/2166956173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c1286a0 0x7ff14c128a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009740 tx=0x7ff13c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad0d594dda9bbb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b6f7fe640 1 -- 172.21.15.53:0/2789922589 >> v1:172.21.15.53:6789/0 conn(0x7f9b7012d240 legacy=0x7f9b7012d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f9b6f7fe640 1 -- 172.21.15.53:0/2789922589 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b70097790 con 0x7f9b70094430 2024-05-08T18:08:40.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff14affd640 1 -- 172.21.15.53:0/2166956173 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c0b0070 con 0x7ff14c1286a0 2024-05-08T18:08:40.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff14affd640 1 -- 172.21.15.53:0/2166956173 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c0ab530 con 0x7ff14c1286a0 2024-05-08T18:08:40.571 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff14affd640 1 -- 172.21.15.53:0/2166956173 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c0ab830 con 0x7ff14c1286a0 2024-05-08T18:08:40.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7cb9e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6c7812ff90 0x7f6c78070680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7cb9e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c78071fd0 con 0x7f6c7812fbb0 2024-05-08T18:08:40.572 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7cb9e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6c780713e0 con 0x7f6c7812ff90 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7659c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6c7812fbb0 0x7f6c7806ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57018/0 (socket says 172.21.15.53:57018) 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7659c640 1 -- 172.21.15.53:0/2323580554 learned_addr learned my addr 172.21.15.53:0/2323580554 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104115512 0 0) 0x7f6c78071fd0 con 0x7f6c7812fbb0 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c64003530 con 0x7f6c7812fbb0 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 <== mon.0 v1:172.21.15.53:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4089442461 0 0) 0x7f6c64003530 con 0x7f6c7812fbb0 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 >> v2:172.21.15.53:3300/0 conn(0x7f6c7812ff90 msgr2=0x7f6c78070680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 --2- 172.21.15.53:0/2323580554 >> v2:172.21.15.53:3300/0 conn(0x7f6c7812ff90 0x7f6c78070680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 --> v1:172.21.15.53:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7812f760 con 0x7f6c7812fbb0 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 <== mon.0 v1:172.21.15.53:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3082790100 0 0) 0x7f6c68001630 con 0x7f6c7812fbb0 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 >> v1:172.21.15.53:6789/0 conn(0x7f6c7812fbb0 legacy=0x7f6c7806ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 --2- 172.21.15.53:0/2323580554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c64003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.573 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c780713e0 con 0x7f6c64003a60 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 -- 172.21.15.53:0/2166956173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c1286a0 msgr2=0x7ff14c128a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 --2- 172.21.15.53:0/2166956173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c1286a0 0x7ff14c128a80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009740 tx=0x7ff13c01c400 comp rx=0 tx=0).stop 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 -- 172.21.15.53:0/2166956173 shutdown_connections 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 --2- 172.21.15.53:0/2166956173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c1286a0 0x7ff14c128a80 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009740 tx=0x7ff13c01c400 comp rx=0 tx=0).stop 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 -- 172.21.15.53:0/2166956173 >> 172.21.15.53:0/2166956173 conn(0x7ff14c09bee0 msgr2=0x7ff14c09c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7659c640 1 --2- 172.21.15.53:0/2323580554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c64003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.574 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 -- 172.21.15.53:0/2166956173 shutdown_connections 2024-05-08T18:08:40.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 -- 172.21.15.53:0/2166956173 wait complete. 2024-05-08T18:08:40.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f6c7659c640 1 -- 172.21.15.53:0/2323580554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c64003530 con 0x7f6c64003a60 2024-05-08T18:08:40.575 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afda48640 1 --2- 172.21.15.53:0/3810114521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af80704f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009740 tx=0x7f2af401c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eadc16628690ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afca46640 1 -- 172.21.15.53:0/3810114521 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af40b0070 con 0x7f2af8070110 2024-05-08T18:08:40.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afca46640 1 -- 172.21.15.53:0/3810114521 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af40ab530 con 0x7f2af8070110 2024-05-08T18:08:40.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2afca46640 1 -- 172.21.15.53:0/3810114521 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af40ab830 con 0x7f2af8070110 2024-05-08T18:08:40.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7ff1528a2640 1 Processor -- start 2024-05-08T18:08:40.576 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2affcac640 1 -- 172.21.15.53:0/3810114521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 msgr2=0x7f2af80704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.567+0000 7f2affcac640 1 --2- 172.21.15.53:0/3810114521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af80704f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009740 tx=0x7f2af401c2b0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- 172.21.15.53:0/3810114521 shutdown_connections 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 --2- 172.21.15.53:0/3810114521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af80704f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- 172.21.15.53:0/3810114521 >> 172.21.15.53:0/3810114521 conn(0x7f2af809b420 msgr2=0x7f2af809b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff1528a2640 1 -- start start 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- 172.21.15.53:0/3810114521 shutdown_connections 2024-05-08T18:08:40.577 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- 172.21.15.53:0/3810114521 wait complete. 2024-05-08T18:08:40.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b6f7fe640 1 --2- 172.21.15.53:0/2789922589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b70094810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b600097f0 tx=0x7f9b6001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b016d95097e5004 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b6e7fc640 1 -- 172.21.15.53:0/2789922589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b600b0070 con 0x7f9b70094430 2024-05-08T18:08:40.578 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b6e7fc640 1 -- 172.21.15.53:0/2789922589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b600ab530 con 0x7f9b70094430 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff1528a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 0x7ff14c1c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff1528a2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c06cf20 con 0x7ff14c128fc0 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 0x7ff14c1c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff14bfff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 0x7ff14c1c3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51978/0 (socket says 172.21.15.53:51978) 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff14bfff640 1 -- 172.21.15.53:0/3658682179 learned_addr learned my addr 172.21.15.53:0/3658682179 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff14bfff640 1 -- 172.21.15.53:0/3658682179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c131300 con 0x7ff14c128fc0 2024-05-08T18:08:40.579 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7659c640 1 --2- 172.21.15.53:0/2323580554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c64003e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c110 tx=0x7f6c6801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a38a036ae5ae1dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 Processor -- start 2024-05-08T18:08:40.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff14bfff640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 0x7ff14c1c3ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff13c01a030 tx=0x7ff13c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- start start 2024-05-08T18:08:40.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c0b0040 con 0x7ff14c128fc0 2024-05-08T18:08:40.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff13c004030 con 0x7ff14c128fc0 2024-05-08T18:08:40.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c1c4020 con 0x7ff14c128fc0 2024-05-08T18:08:40.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c68007cb0 con 0x7f6c64003a60 2024-05-08T18:08:40.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c680a9020 con 0x7f6c64003a60 2024-05-08T18:08:40.581 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7559a640 1 -- 172.21.15.53:0/2323580554 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c68005ba0 con 0x7f6c64003a60 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af81c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2af8137d40 con 0x7f2af8070110 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2afda48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af81c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2afda48640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af81c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51980/0 (socket says 172.21.15.53:51980) 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2afda48640 1 -- 172.21.15.53:0/1945834646 learned_addr learned my addr 172.21.15.53:0/1945834646 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c004330 con 0x7ff14c128fc0 2024-05-08T18:08:40.582 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c1c44e0 con 0x7ff14c128fc0 2024-05-08T18:08:40.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/2323580554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 msgr2=0x7f6c64003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 --2- 172.21.15.53:0/2323580554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c64003e60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c110 tx=0x7f6c6801ccc0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.583 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b6e7fc640 1 -- 172.21.15.53:0/2789922589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b600ab830 con 0x7f9b70094430 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 -- 172.21.15.53:0/2789922589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 msgr2=0x7f9b70094810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 --2- 172.21.15.53:0/2789922589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b70094810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9b600097f0 tx=0x7f9b6001c430 comp rx=0 tx=0).stop 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 -- 172.21.15.53:0/2789922589 shutdown_connections 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 --2- 172.21.15.53:0/2789922589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b70094810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 -- 172.21.15.53:0/2789922589 >> 172.21.15.53:0/2789922589 conn(0x7f9b7009e500 msgr2=0x7f9b7009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/2323580554 shutdown_connections 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 --2- 172.21.15.53:0/2323580554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c64003e60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 --2- 172.21.15.53:0/2323580554 >> v2:172.21.15.53:3300/0 conn(0x7f6c7812ff90 0x7f6c78070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.584 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/2323580554 >> 172.21.15.53:0/2323580554 conn(0x7f6c780a1c20 msgr2=0x7f6c780a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff13c003620 con 0x7ff14c128fc0 2024-05-08T18:08:40.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/2323580554 shutdown_connections 2024-05-08T18:08:40.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff138039ae0 0x7ff13803bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.585 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/2323580554 wait complete. 2024-05-08T18:08:40.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2afda48640 1 -- 172.21.15.53:0/1945834646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af80958d0 con 0x7f2af8070110 2024-05-08T18:08:40.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff14c06ff00 con 0x7ff14c128fc0 2024-05-08T18:08:40.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2afda48640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af81c70e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2af40ae040 tx=0x7f2af401aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.586 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 -- 172.21.15.53:0/2789922589 shutdown_connections 2024-05-08T18:08:40.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7ff13c0e61f0 con 0x7ff14c128fc0 2024-05-08T18:08:40.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff14b7fe640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff138039ae0 0x7ff13803bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff13803f260 0x7ff1380416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff13c0ab530 con 0x7ff13803f260 2024-05-08T18:08:40.587 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f9b75e53640 1 -- 172.21.15.53:0/2789922589 wait complete. 2024-05-08T18:08:40.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ff13c0ed060 con 0x7ff14c128fc0 2024-05-08T18:08:40.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af40b0050 con 0x7f2af8070110 2024-05-08T18:08:40.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af40b1040 con 0x7f2af8070110 2024-05-08T18:08:40.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2af40aa8e0 con 0x7f2af8070110 2024-05-08T18:08:40.588 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7ff150e3f640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff13803f260 0x7ff1380416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af8093b80 con 0x7f2af8070110 2024-05-08T18:08:40.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.571+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af81c7620 con 0x7f2af8070110 2024-05-08T18:08:40.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7cb9e640 1 Processor -- start 2024-05-08T18:08:40.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2af80947f0 con 0x7f2af8070110 2024-05-08T18:08:40.589 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7ff14b7fe640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff138039ae0 0x7ff13803bfa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff140007fd0 tx=0x7ff1400078e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 Processor -- start 2024-05-08T18:08:40.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 -- start start 2024-05-08T18:08:40.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2af40be030 con 0x7f2af8070110 2024-05-08T18:08:40.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7cb9e640 1 -- start start 2024-05-08T18:08:40.590 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7ff150e3f640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff13803f260 0x7ff1380416a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2aee7fc640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2adc039b50 0x7f2adc03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f2af40bc070 con 0x7f2af8070110 2024-05-08T18:08:40.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2aee7fc640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f2adc03f2d0 0x7f2adc041710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2af40ade90 con 0x7f2adc03f2d0 2024-05-08T18:08:40.591 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2af40e8270 con 0x7f2af8070110 2024-05-08T18:08:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b7012b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9b70135fc0 con 0x7f9b70094430 2024-05-08T18:08:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b6f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b7012b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b6f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b7012b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52002/0 (socket says 172.21.15.53:52002) 2024-05-08T18:08:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b6f7fe640 1 -- 172.21.15.53:0/3063313345 learned_addr learned my addr 172.21.15.53:0/3063313345 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.592 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7cb9e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c7808b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7cb9e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6c78070bc0 con 0x7f6c64003a60 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c7808b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7659c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c7808b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:51994/0 (socket says 172.21.15.53:51994) 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7659c640 1 -- 172.21.15.53:0/1374546644 learned_addr learned my addr 172.21.15.53:0/1374546644 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2afd247640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2adc039b50 0x7f2adc03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff13c0ab530 con 0x7ff13803f260 2024-05-08T18:08:40.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7659c640 1 -- 172.21.15.53:0/1374546644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7806f5e0 con 0x7f6c64003a60 2024-05-08T18:08:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b6f7fe640 1 -- 172.21.15.53:0/3063313345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b7006fdf0 con 0x7f9b70094430 2024-05-08T18:08:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7659c640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c7808b010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c110 tx=0x7f6c64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b6f7fe640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b7012b7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b6001a060 tx=0x7f9b600191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f2afd247640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2adc039b50 0x7f2adc03c010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007fd0 tx=0x7f2ae8007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c68001bf0 con 0x7f6c64003a60 2024-05-08T18:08:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b600b0040 con 0x7f9b70094430 2024-05-08T18:08:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b600b4430 con 0x7f9b70094430 2024-05-08T18:08:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b600b4710 con 0x7f9b70094430 2024-05-08T18:08:40.595 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c68001030 con 0x7f6c64003a60 2024-05-08T18:08:40.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/1374546644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c7808d800 con 0x7f6c64003a60 2024-05-08T18:08:40.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c68001610 con 0x7f6c64003a60 2024-05-08T18:08:40.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b70070fb0 con 0x7f9b70094430 2024-05-08T18:08:40.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b7012bd10 con 0x7f9b70094430 2024-05-08T18:08:40.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c7cb9e640 1 -- 172.21.15.53:0/1374546644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c7812c870 con 0x7f6c64003a60 2024-05-08T18:08:40.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c50000f90 con 0x7f6c64003a60 2024-05-08T18:08:40.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.575+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b70064150 con 0x7f9b70094430 2024-05-08T18:08:40.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f9b600b48b0 con 0x7f9b70094430 2024-05-08T18:08:40.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b57fff640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9b5c039ba0 0x7f9b5c03c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f9b600e7e90 con 0x7f9b70094430 2024-05-08T18:08:40.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b57fff640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f9b5c03f320 0x7f9b5c041760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b60006800 con 0x7f9b5c03f320 2024-05-08T18:08:40.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f9b600e8250 con 0x7f9b70094430 2024-05-08T18:08:40.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f6c68007130 con 0x7f6c64003a60 2024-05-08T18:08:40.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b6effd640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9b5c039ba0 0x7f9b5c03c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c6effd640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6c58039bf0 0x7f6c5803c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b6ffff640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f9b5c03f320 0x7f9b5c041760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.599 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f6c680aa030 con 0x7f6c64003a60 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c6effd640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6c5803f3f0 0x7f6c58041830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c680c0ec0 con 0x7f6c5803f3f0 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6c680e7070 con 0x7f6c64003a60 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c75d9b640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6c58039bf0 0x7f6c5803c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c76d9d640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6c5803f3f0 0x7f6c58041830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b6ffff640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f9b5c03f320 0x7f9b5c041760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f9b6effd640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9b5c039ba0 0x7f9b5c03c060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b64001660 tx=0x7f9b64007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c75d9b640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6c58039bf0 0x7f6c5803c0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009710 tx=0x7f6c60006c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.579+0000 7f6c76d9d640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6c5803f3f0 0x7f6c58041830 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.583+0000 7f2afe249640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f2adc03f2d0 0x7f2adc041710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.583+0000 7f2afe249640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f2adc03f2d0 0x7f2adc041710 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.583+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b60006800 con 0x7f9b5c03f320 2024-05-08T18:08:40.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.583+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c680c0ec0 con 0x7f6c5803f3f0 2024-05-08T18:08:40.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.583+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2af40ade90 con 0x7f2adc03f2d0 2024-05-08T18:08:40.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff14c130ef0 con 0x7ff13803f260 2024-05-08T18:08:40.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff148ff9640 1 -- 172.21.15.53:0/3658682179 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff14c130ef0 con 0x7ff13803f260 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff13803f260 msgr2=0x7ff1380416a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff13803f260 0x7ff1380416a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff138039ae0 msgr2=0x7ff13803bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff138039ae0 0x7ff13803bfa0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff140007fd0 tx=0x7ff1400078e0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 msgr2=0x7ff14c1c3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 0x7ff14c1c3ae0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff13c01a030 tx=0x7ff13c01ac40 comp rx=0 tx=0).stop 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 shutdown_connections 2024-05-08T18:08:40.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff13803f260 0x7ff1380416a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff138039ae0 0x7ff13803bfa0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 --2- 172.21.15.53:0/3658682179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff14c128fc0 0x7ff14c1c3ae0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 >> 172.21.15.53:0/3658682179 conn(0x7ff14c09bee0 msgr2=0x7ff14c1230a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 shutdown_connections 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.591+0000 7ff1528a2640 1 -- 172.21.15.53:0/3658682179 wait complete. 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.595+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b7012d1f0 con 0x7f9b5c03f320 2024-05-08T18:08:40.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b57fff640 1 -- 172.21.15.53:0/3063313345 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b7012d1f0 con 0x7f9b5c03f320 2024-05-08T18:08:40.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c50002c80 con 0x7f6c5803f3f0 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f9b5c03f320 msgr2=0x7f9b5c041760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f9b5c03f320 0x7f9b5c041760 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9b5c039ba0 msgr2=0x7f9b5c03c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9b5c039ba0 0x7f9b5c03c060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b64001660 tx=0x7f9b64007a50 comp rx=0 tx=0).stop 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 msgr2=0x7f9b7012b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b7012b7d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b6001a060 tx=0x7f9b600191d0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 shutdown_connections 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f9b5c03f320 0x7f9b5c041760 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.607 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9b5c039ba0 0x7f9b5c03c060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 --2- 172.21.15.53:0/3063313345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b70094430 0x7f9b7012b7d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 >> 172.21.15.53:0/3063313345 conn(0x7f9b7009e500 msgr2=0x7f9b7012e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 shutdown_connections 2024-05-08T18:08:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f9b75e53640 1 -- 172.21.15.53:0/3063313345 wait complete. 2024-05-08T18:08:40.608 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6effd640 1 -- 172.21.15.53:0/1374546644 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c50002c80 con 0x7f6c5803f3f0 2024-05-08T18:08:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6c5803f3f0 msgr2=0x7f6c58041830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6c5803f3f0 0x7f6c58041830 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6c58039bf0 msgr2=0x7f6c5803c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6c58039bf0 0x7f6c5803c0b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009710 tx=0x7f6c60006c60 comp rx=0 tx=0).stop 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 msgr2=0x7f6c7808b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c7808b010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800c110 tx=0x7f6c64005840 comp rx=0 tx=0).stop 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 shutdown_connections 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6c5803f3f0 0x7f6c58041830 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6c58039bf0 0x7f6c5803c0b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 --2- 172.21.15.53:0/1374546644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c64003a60 0x7f6c7808b010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 >> 172.21.15.53:0/1374546644 conn(0x7f6c780a1c20 msgr2=0x7f6c78132660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 shutdown_connections 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.599+0000 7f6c6cff9640 1 -- 172.21.15.53:0/1374546644 wait complete. 2024-05-08T18:08:40.610 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.603+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2af8094260 con 0x7f2adc03f2d0 2024-05-08T18:08:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2aee7fc640 1 -- 172.21.15.53:0/1945834646 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2af8094260 con 0x7f2adc03f2d0 2024-05-08T18:08:40.611 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f2adc03f2d0 msgr2=0x7f2adc041710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f2adc03f2d0 0x7f2adc041710 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2adc039b50 msgr2=0x7f2adc03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2adc039b50 0x7f2adc03c010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8007fd0 tx=0x7f2ae8007900 comp rx=0 tx=0).stop 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 msgr2=0x7f2af81c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af81c70e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2af40ae040 tx=0x7f2af401aaf0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 shutdown_connections 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f2adc03f2d0 0x7f2adc041710 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2adc039b50 0x7f2adc03c010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 --2- 172.21.15.53:0/1945834646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2af8070110 0x7f2af81c70e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 >> 172.21.15.53:0/1945834646 conn(0x7f2af809b420 msgr2=0x7f2af812ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 shutdown_connections 2024-05-08T18:08:40.612 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.607+0000 7f2affcac640 1 -- 172.21.15.53:0/1945834646 wait complete. 2024-05-08T18:08:40.618 INFO:teuthology.orchestra.run.smithi053.stdout:38654705669 2024-05-08T18:08:40.618 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:08:40.622 INFO:teuthology.orchestra.run.smithi053.stdout:38654705669 2024-05-08T18:08:40.622 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:08:40.627 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:08:40.627 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:08:40.628 INFO:teuthology.orchestra.run.smithi053.stdout:38654705669 2024-05-08T18:08:40.628 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:08:40.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaff08b640 1 Processor -- start 2024-05-08T18:08:40.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaff08b640 1 -- start start 2024-05-08T18:08:40.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaff08b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdaf8070110 0x7fdaf80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.732 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaff08b640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaf806e1c0 con 0x7fdaf806ec50 2024-05-08T18:08:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaff08b640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fdaf80740a0 con 0x7fdaf8070110 2024-05-08T18:08:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdafce27640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fdaf8070110 0x7fdaf80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaf7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fdaf806ec50 0x7fdaf812f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57024/0 (socket says 172.21.15.53:57024) 2024-05-08T18:08:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.731+0000 7fdaf7fff640 1 -- 172.21.15.53:0/3506349736 learned_addr learned my addr 172.21.15.53:0/3506349736 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdafce27640 1 -- 172.21.15.53:0/3506349736 >> v1:172.21.15.53:6789/0 conn(0x7fdaf806ec50 legacy=0x7fdaf812f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.733 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdafce27640 1 -- 172.21.15.53:0/3506349736 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf8070a30 con 0x7fdaf8070110 2024-05-08T18:08:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdafce27640 1 --2- 172.21.15.53:0/3506349736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf8070110 0x7fdaf80704f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009740 tx=0x7fdaec01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a33e50d815d652 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaf77fe640 1 -- 172.21.15.53:0/3506349736 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaec0b0070 con 0x7fdaf8070110 2024-05-08T18:08:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaf77fe640 1 -- 172.21.15.53:0/3506349736 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaec0ab530 con 0x7fdaf8070110 2024-05-08T18:08:40.735 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaf77fe640 1 -- 172.21.15.53:0/3506349736 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaec0ab830 con 0x7fdaf8070110 2024-05-08T18:08:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 -- 172.21.15.53:0/3506349736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf8070110 msgr2=0x7fdaf80704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 --2- 172.21.15.53:0/3506349736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf8070110 0x7fdaf80704f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdaec009740 tx=0x7fdaec01c400 comp rx=0 tx=0).stop 2024-05-08T18:08:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 -- 172.21.15.53:0/3506349736 shutdown_connections 2024-05-08T18:08:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 --2- 172.21.15.53:0/3506349736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf8070110 0x7fdaf80704f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.736 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 -- 172.21.15.53:0/3506349736 >> 172.21.15.53:0/3506349736 conn(0x7fdaf8099390 msgr2=0x7fdaf809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 -- 172.21.15.53:0/3506349736 shutdown_connections 2024-05-08T18:08:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.735+0000 7fdaff08b640 1 -- 172.21.15.53:0/3506349736 wait complete. 2024-05-08T18:08:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 Processor -- start 2024-05-08T18:08:40.737 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 -- start start 2024-05-08T18:08:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 0x7fdaf8091270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf8137e50 con 0x7fdaf806ec50 2024-05-08T18:08:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdafce27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 0x7fdaf8091270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdafce27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 0x7fdaf8091270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52022/0 (socket says 172.21.15.53:52022) 2024-05-08T18:08:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdafce27640 1 -- 172.21.15.53:0/1046982147 learned_addr learned my addr 172.21.15.53:0/1046982147 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.738 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdafce27640 1 -- 172.21.15.53:0/1046982147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf80946e0 con 0x7fdaf806ec50 2024-05-08T18:08:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdafce27640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 0x7fdaf8091270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0ae040 tx=0x7fdaec0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaec0b8020 con 0x7fdaf806ec50 2024-05-08T18:08:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaec0aa6d0 con 0x7fdaf806ec50 2024-05-08T18:08:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf8092d10 con 0x7fdaf806ec50 2024-05-08T18:08:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdaec0b0040 con 0x7fdaf806ec50 2024-05-08T18:08:40.739 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf80949f0 con 0x7fdaf806ec50 2024-05-08T18:08:40.740 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.739+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf8094500 con 0x7fdaf806ec50 2024-05-08T18:08:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.743+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fdaec0bb020 con 0x7fdaf806ec50 2024-05-08T18:08:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.743+0000 7fdaf57fa640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdadc039b50 0x7fdadc03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.743+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fdaec0e75b0 con 0x7fdaf806ec50 2024-05-08T18:08:40.741 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.743+0000 7fdaf7fff640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdadc039b50 0x7fdadc03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.742 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.743+0000 7fdaf7fff640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdadc039b50 0x7fdadc03c010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdae4005890 tx=0x7fdae4007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.745 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.747+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdaf8094500 con 0x7fdaf806ec50 2024-05-08T18:08:40.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.787+0000 7fe8152b1640 1 Processor -- start 2024-05-08T18:08:40.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.787+0000 7fe8152b1640 1 -- start start 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe8152b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe810070110 0x7fe8100704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe8152b1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81006e250 con 0x7fe810070a30 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe8152b1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe810071680 con 0x7fe810070110 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe810070110 0x7fe8100704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80e7fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe810070a30 0x7fe81012fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57028/0 (socket says 172.21.15.53:57028) 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80e7fc640 1 -- 172.21.15.53:0/2177554236 learned_addr learned my addr 172.21.15.53:0/2177554236 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80effd640 1 -- 172.21.15.53:0/2177554236 >> v1:172.21.15.53:6789/0 conn(0x7fe810070a30 legacy=0x7fe81012fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80dffb640 1 -- 172.21.15.53:0/2177554236 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219827578 0 0) 0x7fe81006e250 con 0x7fe810070a30 2024-05-08T18:08:40.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80effd640 1 -- 172.21.15.53:0/2177554236 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810071240 con 0x7fe810070110 2024-05-08T18:08:40.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f881d8640 1 Processor -- start 2024-05-08T18:08:40.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f881d8640 1 -- start start 2024-05-08T18:08:40.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f881d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f80130520 0x7f2f80132910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f881d8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f80072a70 con 0x7f2f8012a4e0 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f881d8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2f80074440 con 0x7f2f80130520 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f85773640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f80130520 0x7f2f80132910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f85f74640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2f8012a4e0 0x7f2f8012a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57044/0 (socket says 172.21.15.53:57044) 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f85f74640 1 -- 172.21.15.53:0/2631068743 learned_addr learned my addr 172.21.15.53:0/2631068743 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f85773640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2f80130520 0x7f2f80132910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52040/0 (socket says 172.21.15.53:52040) 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f85773640 1 -- 172.21.15.53:0/2631068743 >> v1:172.21.15.53:6789/0 conn(0x7f2f8012a4e0 legacy=0x7f2f8012a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.792 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7f2f85773640 1 -- 172.21.15.53:0/2631068743 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f80072720 con 0x7f2f80130520 2024-05-08T18:08:40.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80effd640 1 --2- 172.21.15.53:0/2177554236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070110 0x7fe8100704f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe800009740 tx=0x7fe80001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9908b34a30455b8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80dffb640 1 -- 172.21.15.53:0/2177554236 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8000b0070 con 0x7fe810070110 2024-05-08T18:08:40.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80dffb640 1 -- 172.21.15.53:0/2177554236 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8000ab530 con 0x7fe810070110 2024-05-08T18:08:40.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.791+0000 7fe80dffb640 1 -- 172.21.15.53:0/2177554236 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8000ab830 con 0x7fe810070110 2024-05-08T18:08:40.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/2177554236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070110 msgr2=0x7fe8100704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.793 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 --2- 172.21.15.53:0/2177554236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070110 0x7fe8100704f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe800009740 tx=0x7fe80001c370 comp rx=0 tx=0).stop 2024-05-08T18:08:40.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f85773640 1 --2- 172.21.15.53:0/2631068743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80130520 0x7f2f80132910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009740 tx=0x7f2f7001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183558a1cbc6df50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/2177554236 shutdown_connections 2024-05-08T18:08:40.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 --2- 172.21.15.53:0/2177554236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070110 0x7fe8100704f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/2177554236 >> 172.21.15.53:0/2177554236 conn(0x7fe81009b3d0 msgr2=0x7fe81009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.794 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/2177554236 shutdown_connections 2024-05-08T18:08:40.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/2177554236 wait complete. 2024-05-08T18:08:40.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f84f72640 1 -- 172.21.15.53:0/2631068743 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f700b0070 con 0x7f2f80130520 2024-05-08T18:08:40.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f84f72640 1 -- 172.21.15.53:0/2631068743 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f700ab530 con 0x7f2f80130520 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f84f72640 1 -- 172.21.15.53:0/2631068743 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f700ab830 con 0x7f2f80130520 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- 172.21.15.53:0/2631068743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80130520 msgr2=0x7f2f80132910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 --2- 172.21.15.53:0/2631068743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80130520 0x7f2f80132910 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009740 tx=0x7f2f7001c370 comp rx=0 tx=0).stop 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- 172.21.15.53:0/2631068743 shutdown_connections 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 --2- 172.21.15.53:0/2631068743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f80130520 0x7f2f80132910 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- 172.21.15.53:0/2631068743 >> 172.21.15.53:0/2631068743 conn(0x7f2f8009c970 msgr2=0x7f2f8009d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 Processor -- start 2024-05-08T18:08:40.796 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- start start 2024-05-08T18:08:40.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- 172.21.15.53:0/2631068743 shutdown_connections 2024-05-08T18:08:40.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- 172.21.15.53:0/2631068743 wait complete. 2024-05-08T18:08:40.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 0x7fe810093360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe81006e680 con 0x7fe810070a30 2024-05-08T18:08:40.797 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe80effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 0x7fe810093360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe80effd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 0x7fe810093360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52044/0 (socket says 172.21.15.53:52044) 2024-05-08T18:08:40.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe80effd640 1 -- 172.21.15.53:0/1146511889 learned_addr learned my addr 172.21.15.53:0/1146511889 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 Processor -- start 2024-05-08T18:08:40.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- start start 2024-05-08T18:08:40.798 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe80effd640 1 -- 172.21.15.53:0/1146511889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810094ee0 con 0x7fe810070a30 2024-05-08T18:08:40.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe80effd640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 0x7fe810093360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe800019fa0 tx=0x7fe80001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 0x7f2f8006f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f881d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2f80135a00 con 0x7f2f8012a4e0 2024-05-08T18:08:40.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8000b0040 con 0x7fe810070a30 2024-05-08T18:08:40.799 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8000abe40 con 0x7fe810070a30 2024-05-08T18:08:40.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe810095c10 con 0x7fe810070a30 2024-05-08T18:08:40.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe810095670 con 0x7fe810070a30 2024-05-08T18:08:40.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f85f74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 0x7f2f8006f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f85f74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 0x7f2f8006f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52056/0 (socket says 172.21.15.53:52056) 2024-05-08T18:08:40.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.795+0000 7f2f85f74640 1 -- 172.21.15.53:0/10694704 learned_addr learned my addr 172.21.15.53:0/10694704 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.800 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe800004030 con 0x7fe810070a30 2024-05-08T18:08:40.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f85f74640 1 -- 172.21.15.53:0/10694704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f8012fb20 con 0x7f2f8012a4e0 2024-05-08T18:08:40.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f85f74640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 0x7f2f8006f190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c450 tx=0x7f2f7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7c017070 con 0x7f2f8012a4e0 2024-05-08T18:08:40.801 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c005c20 con 0x7f2f8012a4e0 2024-05-08T18:08:40.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f8011cb30 con 0x7f2f8012a4e0 2024-05-08T18:08:40.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f7c0070d0 con 0x7f2f8012a4e0 2024-05-08T18:08:40.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f8011d2a0 con 0x7f2f8012a4e0 2024-05-08T18:08:40.802 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f0005090 con 0x7fe810070a30 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2f7c01a070 con 0x7f2f8012a4e0 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f767fc640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2f64039b50 0x7f2f6403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f2f7c04c4b0 con 0x7f2f8012a4e0 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f8011c690 con 0x7f2f8012a4e0 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f85773640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2f64039b50 0x7f2f6403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe8000041d0 con 0x7fe810070a30 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe7f77fe640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7fc039ba0 0x7fe7fc03c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fe8000e7d90 con 0x7fe810070a30 2024-05-08T18:08:40.803 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe80e7fc640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7fc039ba0 0x7fe7fc03c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7f2f85773640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2f64039b50 0x7f2f6403c010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2f700ad000 tx=0x7f2f700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.799+0000 7fe80e7fc640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7fc039ba0 0x7fe7fc03c060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe804007fd0 tx=0x7fe8040078e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.804 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.803+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe800015ff0 con 0x7fe810070a30 2024-05-08T18:08:40.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad43f9640 1 Processor -- start 2024-05-08T18:08:40.805 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad43f9640 1 -- start start 2024-05-08T18:08:40.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad43f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1acc12ff40 0x7f1acc134770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad43f9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc071610 con 0x7f1acc12f450 2024-05-08T18:08:40.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad43f9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f1acc1303b0 con 0x7f1acc12ff40 2024-05-08T18:08:40.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1994640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1acc12ff40 0x7f1acc134770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.806 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1994640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f1acc12ff40 0x7f1acc134770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52068/0 (socket says 172.21.15.53:52068) 2024-05-08T18:08:40.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1994640 1 -- 172.21.15.53:0/4088314948 learned_addr learned my addr 172.21.15.53:0/4088314948 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1994640 1 -- 172.21.15.53:0/4088314948 >> v1:172.21.15.53:6789/0 conn(0x7f1acc12f450 legacy=0x7f1acc12f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.807 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1994640 1 -- 172.21.15.53:0/4088314948 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc071a10 con 0x7f1acc12ff40 2024-05-08T18:08:40.808 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1994640 1 --2- 172.21.15.53:0/4088314948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12ff40 0x7f1acc134770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0097f0 tx=0x7f1abc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=677c2a82f3a70543 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2f7c007270 con 0x7f2f8012a4e0 2024-05-08T18:08:40.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.807+0000 7f1ad1193640 1 -- 172.21.15.53:0/4088314948 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1abc0b0070 con 0x7f1acc12ff40 2024-05-08T18:08:40.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad1193640 1 -- 172.21.15.53:0/4088314948 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1abc0ab530 con 0x7f1acc12ff40 2024-05-08T18:08:40.809 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad1193640 1 -- 172.21.15.53:0/4088314948 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1abc0ab830 con 0x7f1acc12ff40 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- 172.21.15.53:0/4088314948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12ff40 msgr2=0x7f1acc134770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 --2- 172.21.15.53:0/4088314948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12ff40 0x7f1acc134770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0097f0 tx=0x7f1abc01c430 comp rx=0 tx=0).stop 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- 172.21.15.53:0/4088314948 shutdown_connections 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 --2- 172.21.15.53:0/4088314948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12ff40 0x7f1acc134770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- 172.21.15.53:0/4088314948 >> 172.21.15.53:0/4088314948 conn(0x7f1acc09ea50 msgr2=0x7f1acc09ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- 172.21.15.53:0/4088314948 shutdown_connections 2024-05-08T18:08:40.810 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- 172.21.15.53:0/4088314948 wait complete. 2024-05-08T18:08:40.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 Processor -- start 2024-05-08T18:08:40.811 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- start start 2024-05-08T18:08:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 0x7f1acc09b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad43f9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc137860 con 0x7f1acc12f450 2024-05-08T18:08:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad2195640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 0x7f1acc09b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad2195640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 0x7f1acc09b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52078/0 (socket says 172.21.15.53:52078) 2024-05-08T18:08:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad2195640 1 -- 172.21.15.53:0/3067949599 learned_addr learned my addr 172.21.15.53:0/3067949599 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:40.812 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad2195640 1 -- 172.21.15.53:0/3067949599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc09e3a0 con 0x7f1acc12f450 2024-05-08T18:08:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.811+0000 7f1ad2195640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 0x7f1acc09b710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c430 tx=0x7f1ac800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac8017070 con 0x7f1acc12f450 2024-05-08T18:08:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc12c4d0 con 0x7f1acc12f450 2024-05-08T18:08:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac8005200 con 0x7f1acc12f450 2024-05-08T18:08:40.813 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc09bc50 con 0x7f1acc12f450 2024-05-08T18:08:40.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ac8003600 con 0x7f1acc12f450 2024-05-08T18:08:40.814 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab4005090 con 0x7f1acc12f450 2024-05-08T18:08:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f1ac801a070 con 0x7f1acc12f450 2024-05-08T18:08:40.815 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ac2ffd640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ab0039b00 0x7f1ab003bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:40.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f1ac801bda0 con 0x7f1acc12f450 2024-05-08T18:08:40.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ad1994640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ab0039b00 0x7f1ab003bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:40.816 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.815+0000 7f1ad1994640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ab0039b00 0x7f1ab003bfc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1acc06d530 tx=0x7f1abc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:40.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.823+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1ac8021020 con 0x7f1acc12f450 2024-05-08T18:08:40.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdaf8064150 con 0x7fdaf806ec50 2024-05-08T18:08:40.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaf57fa640 1 -- 172.21.15.53:0/1046982147 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdaec0c2030 con 0x7fdaf806ec50 2024-05-08T18:08:40.958 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:08:40.959 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdadc039b50 msgr2=0x7fdadc03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdadc039b50 0x7fdadc03c010 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdae4005890 tx=0x7fdae4007ab0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 msgr2=0x7fdaf8091270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 0x7fdaf8091270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdaec0ae040 tx=0x7fdaec0191a0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 shutdown_connections 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdadc039b50 0x7fdadc03c010 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 --2- 172.21.15.53:0/1046982147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdaf806ec50 0x7fdaf8091270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 >> 172.21.15.53:0/1046982147 conn(0x7fdaf8099390 msgr2=0x7fdaf8130870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 shutdown_connections 2024-05-08T18:08:40.960 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.959+0000 7fdaff08b640 1 -- 172.21.15.53:0/1046982147 wait complete. 2024-05-08T18:08:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe7f0005380 con 0x7fe810070a30 2024-05-08T18:08:40.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe7f77fe640 1 -- 172.21.15.53:0/1146511889 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe800003620 con 0x7fe810070a30 2024-05-08T18:08:40.966 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7fc039ba0 msgr2=0x7fe7fc03c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7fc039ba0 0x7fe7fc03c060 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe804007fd0 tx=0x7fe8040078e0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 msgr2=0x7fe810093360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 0x7fe810093360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe800019fa0 tx=0x7fe80001abb0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 shutdown_connections 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7fc039ba0 0x7fe7fc03c060 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 --2- 172.21.15.53:0/1146511889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe810070a30 0x7fe810093360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 >> 172.21.15.53:0/1146511889 conn(0x7fe81009b3d0 msgr2=0x7fe8100992d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 shutdown_connections 2024-05-08T18:08:40.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.967+0000 7fe8152b1640 1 -- 172.21.15.53:0/1146511889 wait complete. 2024-05-08T18:08:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.971+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2f80064150 con 0x7f2f8012a4e0 2024-05-08T18:08:40.970 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.971+0000 7f2f767fc640 1 -- 172.21.15.53:0/10694704 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f7c019cd0 con 0x7f2f8012a4e0 2024-05-08T18:08:40.970 INFO:teuthology.orchestra.run.smithi053.stdout:38654705667 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2f64039b50 msgr2=0x7f2f6403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2f64039b50 0x7f2f6403c010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2f700ad000 tx=0x7f2f700a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 msgr2=0x7f2f8006f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 0x7f2f8006f190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c450 tx=0x7f2f7c00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 shutdown_connections 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2f64039b50 0x7f2f6403c010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 --2- 172.21.15.53:0/10694704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f8012a4e0 0x7f2f8006f190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:40.974 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 >> 172.21.15.53:0/10694704 conn(0x7f2f8009c970 msgr2=0x7f2f8012aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 shutdown_connections 2024-05-08T18:08:40.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.975+0000 7f2f881d8640 1 -- 172.21.15.53:0/10694704 wait complete. 2024-05-08T18:08:40.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-05-08T18:08:40.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.2 2024-05-08T18:08:40.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.1 2024-05-08T18:08:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.999+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1ab4005650 con 0x7f1acc12f450 2024-05-08T18:08:40.999 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:40.999+0000 7f1ac2ffd640 1 -- 172.21.15.53:0/3067949599 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ac8021020 con 0x7f1acc12f450 2024-05-08T18:08:40.999 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:08:41.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ab0039b00 msgr2=0x7f1ab003bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:41.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ab0039b00 0x7f1ab003bfc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1acc06d530 tx=0x7f1abc0a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:41.001 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 msgr2=0x7f1acc09b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 0x7f1acc09b710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c430 tx=0x7f1ac800c8f0 comp rx=0 tx=0).stop 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 shutdown_connections 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ab0039b00 0x7f1ab003bfc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 --2- 172.21.15.53:0/3067949599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1acc12f450 0x7f1acc09b710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 >> 172.21.15.53:0/3067949599 conn(0x7f1acc09ea50 msgr2=0x7f1acc09cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 shutdown_connections 2024-05-08T18:08:41.002 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:41.003+0000 7f1ad43f9640 1 -- 172.21.15.53:0/3067949599 wait complete. 2024-05-08T18:08:41.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-05-08T18:08:41.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T18:08:41.987 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T18:08:41.993 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T18:08:42.017 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T18:08:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d82ed640 1 Processor -- start 2024-05-08T18:08:42.111 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d82ed640 1 -- start start 2024-05-08T18:08:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d82ed640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41d012ff80 0x7f41d0134a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d82ed640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41d0070df0 con 0x7f41d012f490 2024-05-08T18:08:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d82ed640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f41d00738f0 con 0x7f41d012ff80 2024-05-08T18:08:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d5888640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f41d012ff80 0x7f41d0134a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d6089640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f41d012f490 0x7f41d012f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57064/0 (socket says 172.21.15.53:57064) 2024-05-08T18:08:42.112 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d6089640 1 -- 172.21.15.53:0/966056380 learned_addr learned my addr 172.21.15.53:0/966056380 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d5888640 1 -- 172.21.15.53:0/966056380 >> v1:172.21.15.53:6789/0 conn(0x7f41d012f490 legacy=0x7f41d012f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.111+0000 7f41d5888640 1 -- 172.21.15.53:0/966056380 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d00706a0 con 0x7f41d012ff80 2024-05-08T18:08:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d5888640 1 --2- 172.21.15.53:0/966056380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012ff80 0x7f41d0134a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009740 tx=0x7f41c001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248fb78d1c78de8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.114 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d5087640 1 -- 172.21.15.53:0/966056380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c00b0070 con 0x7f41d012ff80 2024-05-08T18:08:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d5087640 1 -- 172.21.15.53:0/966056380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41c00ab530 con 0x7f41d012ff80 2024-05-08T18:08:42.115 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d5087640 1 -- 172.21.15.53:0/966056380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41c00ab830 con 0x7f41d012ff80 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 -- 172.21.15.53:0/966056380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012ff80 msgr2=0x7f41d0134a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 --2- 172.21.15.53:0/966056380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012ff80 0x7f41d0134a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009740 tx=0x7f41c001c370 comp rx=0 tx=0).stop 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 -- 172.21.15.53:0/966056380 shutdown_connections 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 --2- 172.21.15.53:0/966056380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012ff80 0x7f41d0134a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 -- 172.21.15.53:0/966056380 >> 172.21.15.53:0/966056380 conn(0x7f41d009c970 msgr2=0x7f41d009d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 -- 172.21.15.53:0/966056380 shutdown_connections 2024-05-08T18:08:42.116 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.115+0000 7f41d82ed640 1 -- 172.21.15.53:0/966056380 wait complete. 2024-05-08T18:08:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 Processor -- start 2024-05-08T18:08:42.117 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 -- start start 2024-05-08T18:08:42.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 0x7f41d012e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0137910 con 0x7f41d012f490 2024-05-08T18:08:42.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d6089640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 0x7f41d012e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d6089640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 0x7f41d012e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52090/0 (socket says 172.21.15.53:52090) 2024-05-08T18:08:42.118 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d6089640 1 -- 172.21.15.53:0/3725530914 learned_addr learned my addr 172.21.15.53:0/3725530914 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d6089640 1 -- 172.21.15.53:0/3725530914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0134990 con 0x7f41d012f490 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d6089640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 0x7f41d012e020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c450 tx=0x7f41cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc017070 con 0x7f41d012f490 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc005c20 con 0x7f41d012f490 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d0120d20 con 0x7f41d012f490 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0070d0 con 0x7f41d012f490 2024-05-08T18:08:42.119 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d012e730 con 0x7f41d012f490 2024-05-08T18:08:42.120 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.119+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d0064150 con 0x7f41d012f490 2024-05-08T18:08:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.123+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f41cc01a070 con 0x7f41d012f490 2024-05-08T18:08:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.123+0000 7f41c6ffd640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41b4039b50 0x7f41b403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.121 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.123+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f41cc04c940 con 0x7f41d012f490 2024-05-08T18:08:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.123+0000 7f41d5888640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41b4039b50 0x7f41b403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.122 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.123+0000 7f41d5888640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41b4039b50 0x7f41b403c010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f41c00ad000 tx=0x7f41c00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.129 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.131+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f41d0134990 con 0x7f41d012f490 2024-05-08T18:08:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952c361640 1 Processor -- start 2024-05-08T18:08:42.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952c361640 1 -- start start 2024-05-08T18:08:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952c361640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f952412a9a0 0x7f952412da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952c361640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95240730c0 con 0x7f952412a5c0 2024-05-08T18:08:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952c361640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f952409b550 con 0x7f952412a9a0 2024-05-08T18:08:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f95298fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f952412a9a0 0x7f952412da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952a0fd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f952412a5c0 0x7f952412d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57070/0 (socket says 172.21.15.53:57070) 2024-05-08T18:08:42.144 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f952a0fd640 1 -- 172.21.15.53:0/3573145395 learned_addr learned my addr 172.21.15.53:0/3573145395 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f95298fc640 1 -- 172.21.15.53:0/3573145395 >> v1:172.21.15.53:6789/0 conn(0x7f952412a5c0 legacy=0x7f952412d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.145 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.143+0000 7f95298fc640 1 -- 172.21.15.53:0/3573145395 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9524073690 con 0x7f952412a9a0 2024-05-08T18:08:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f04a5cac640 1 Processor -- start 2024-05-08T18:08:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f04a5cac640 1 -- start start 2024-05-08T18:08:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78f068640 1 Processor -- start 2024-05-08T18:08:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78f068640 1 -- start start 2024-05-08T18:08:42.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f95298fc640 1 --2- 172.21.15.53:0/3573145395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a9a0 0x7f952412da30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9514009740 tx=0x7f951401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49da89d02de6e8d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f04a5cac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04a0070110 0x7f04a00704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04a0070110 0x7f04a00704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f04a5cac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a006e1c0 con 0x7f04a006ec50 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f04a5cac640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f04a00740a0 con 0x7f04a0070110 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f95290fb640 1 -- 172.21.15.53:0/3573145395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95140b0070 con 0x7f952412a9a0 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f95290fb640 1 -- 172.21.15.53:0/3573145395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95140ab530 con 0x7f952412a9a0 2024-05-08T18:08:42.148 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f95290fb640 1 -- 172.21.15.53:0/3573145395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95140ab830 con 0x7f952412a9a0 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049f7fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f04a0070110 0x7f04a00704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52116/0 (socket says 172.21.15.53:52116) 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049f7fe640 1 -- 172.21.15.53:0/2210225598 learned_addr learned my addr 172.21.15.53:0/2210225598 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78f068640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb78812f480 0x7fb788131870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78f068640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb788072060 con 0x7fb788128c30 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78f068640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb788071520 con 0x7fb78812f480 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb787fff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb78812f480 0x7fb788131870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78ce04640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb788128c30 0x7fb788129350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57086/0 (socket says 172.21.15.53:57086) 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb78ce04640 1 -- 172.21.15.53:0/2356618166 learned_addr learned my addr 172.21.15.53:0/2356618166 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049e7fc640 1 -- 172.21.15.53:0/2210225598 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250870670 0 0) 0x7f04a006e1c0 con 0x7f04a006ec50 2024-05-08T18:08:42.149 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049e7fc640 1 -- 172.21.15.53:0/2210225598 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0488003530 con 0x7f04a006ec50 2024-05-08T18:08:42.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb787fff640 1 -- 172.21.15.53:0/2356618166 >> v1:172.21.15.53:6789/0 conn(0x7fb788128c30 legacy=0x7fb788129350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7fb787fff640 1 -- 172.21.15.53:0/2356618166 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb788129010 con 0x7fb78812f480 2024-05-08T18:08:42.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049f7fe640 1 -- 172.21.15.53:0/2210225598 >> v1:172.21.15.53:6789/0 conn(0x7f04a006ec50 legacy=0x7f04a012f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.150 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f049f7fe640 1 -- 172.21.15.53:0/2210225598 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a0070a30 con 0x7f04a0070110 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 -- 172.21.15.53:0/3573145395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a9a0 msgr2=0x7f952412da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 --2- 172.21.15.53:0/3573145395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a9a0 0x7f952412da30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9514009740 tx=0x7f951401c370 comp rx=0 tx=0).stop 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 -- 172.21.15.53:0/3573145395 shutdown_connections 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 --2- 172.21.15.53:0/3573145395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a9a0 0x7f952412da30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 -- 172.21.15.53:0/3573145395 >> 172.21.15.53:0/3573145395 conn(0x7f952409c5b0 msgr2=0x7f952409c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 -- 172.21.15.53:0/3573145395 shutdown_connections 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.147+0000 7f952c361640 1 -- 172.21.15.53:0/3573145395 wait complete. 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952c361640 1 Processor -- start 2024-05-08T18:08:42.151 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952c361640 1 -- start start 2024-05-08T18:08:42.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f049f7fe640 1 --2- 172.21.15.53:0/2210225598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a0070110 0x7f04a00704f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04900097f0 tx=0x7f049001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4df5544715a65 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952c361640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 0x7f9524116fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952c361640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f952412e0f0 con 0x7f952412a5c0 2024-05-08T18:08:42.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f049e7fc640 1 -- 172.21.15.53:0/2210225598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04900b0070 con 0x7f04a0070110 2024-05-08T18:08:42.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f049e7fc640 1 -- 172.21.15.53:0/2210225598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900ab530 con 0x7f04a0070110 2024-05-08T18:08:42.152 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f049e7fc640 1 -- 172.21.15.53:0/2210225598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04900ab810 con 0x7f04a0070110 2024-05-08T18:08:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952a0fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 0x7f9524116fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952a0fd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 0x7f9524116fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52136/0 (socket says 172.21.15.53:52136) 2024-05-08T18:08:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952a0fd640 1 -- 172.21.15.53:0/508510191 learned_addr learned my addr 172.21.15.53:0/508510191 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952a0fd640 1 -- 172.21.15.53:0/508510191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9524129b90 con 0x7f952412a5c0 2024-05-08T18:08:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb787fff640 1 --2- 172.21.15.53:0/2356618166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb78812f480 0x7fb788131870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb774009740 tx=0x7fb77401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0c51b65360b3c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952a0fd640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 0x7f9524116fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f952000c450 tx=0x7f952000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb7877fe640 1 -- 172.21.15.53:0/2356618166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740b1070 con 0x7fb78812f480 2024-05-08T18:08:42.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb7877fe640 1 -- 172.21.15.53:0/2356618166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7740ac520 con 0x7fb78812f480 2024-05-08T18:08:42.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb7877fe640 1 -- 172.21.15.53:0/2356618166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7740ac820 con 0x7fb78812f480 2024-05-08T18:08:42.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520017070 con 0x7f952412a5c0 2024-05-08T18:08:42.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520005c20 con 0x7f952412a5c0 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952411a280 con 0x7f952412a5c0 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 -- 172.21.15.53:0/2210225598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a0070110 msgr2=0x7f04a00704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 --2- 172.21.15.53:0/2210225598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a0070110 0x7f04a00704f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f04900097f0 tx=0x7f049001c4c0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200070d0 con 0x7f952412a5c0 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 -- 172.21.15.53:0/2210225598 shutdown_connections 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 --2- 172.21.15.53:0/2210225598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a0070110 0x7f04a00704f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 -- 172.21.15.53:0/2210225598 >> 172.21.15.53:0/2210225598 conn(0x7f04a0099390 msgr2=0x7f04a009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9524119d50 con 0x7f952412a5c0 2024-05-08T18:08:42.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 -- 172.21.15.53:0/2210225598 shutdown_connections 2024-05-08T18:08:42.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f04a5cac640 1 -- 172.21.15.53:0/2210225598 wait complete. 2024-05-08T18:08:42.156 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb78f068640 1 -- 172.21.15.53:0/2356618166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb78812f480 msgr2=0x7fb788131870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb78f068640 1 --2- 172.21.15.53:0/2356618166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb78812f480 0x7fb788131870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb774009740 tx=0x7fb77401c370 comp rx=0 tx=0).stop 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb78f068640 1 -- 172.21.15.53:0/2356618166 shutdown_connections 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb78f068640 1 --2- 172.21.15.53:0/2356618166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb78812f480 0x7fb788131870 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb774009740 tx=0x7fb77401c370 comp rx=0 tx=0).stop 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7fb78f068640 1 -- 172.21.15.53:0/2356618166 >> 172.21.15.53:0/2356618166 conn(0x7fb788099390 msgr2=0x7fb78809b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.151+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f952001a070 con 0x7f952412a5c0 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 Processor -- start 2024-05-08T18:08:42.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 -- 172.21.15.53:0/2356618166 shutdown_connections 2024-05-08T18:08:42.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 -- start start 2024-05-08T18:08:42.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f951affd640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9508039ba0 0x7f950803c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f952004c420 con 0x7f952412a5c0 2024-05-08T18:08:42.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 0x7f04a0097ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f04a0137e50 con 0x7f04a006ec50 2024-05-08T18:08:42.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 0x7f04a0097ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f049f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 0x7f04a0097ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52142/0 (socket says 172.21.15.53:52142) 2024-05-08T18:08:42.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f049f7fe640 1 -- 172.21.15.53:0/3889657104 learned_addr learned my addr 172.21.15.53:0/3889657104 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:42.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f95298fc640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9508039ba0 0x7f950803c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.159 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f049f7fe640 1 -- 172.21.15.53:0/3889657104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a012fa40 con 0x7f04a006ec50 2024-05-08T18:08:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 -- 172.21.15.53:0/2356618166 wait complete. 2024-05-08T18:08:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 Processor -- start 2024-05-08T18:08:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f049f7fe640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 0x7f04a0097ae0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f04900190d0 tx=0x7f049001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04900ba020 con 0x7f04a006ec50 2024-05-08T18:08:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04900044e0 con 0x7f04a006ec50 2024-05-08T18:08:42.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a012ee60 con 0x7f04a006ec50 2024-05-08T18:08:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04900b0040 con 0x7f04a006ec50 2024-05-08T18:08:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a00981f0 con 0x7f04a006ec50 2024-05-08T18:08:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 -- start start 2024-05-08T18:08:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 0x7fb78806e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb788134750 con 0x7fb788128c30 2024-05-08T18:08:42.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78ce04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 0x7fb78806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78ce04640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 0x7fb78806e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52144/0 (socket says 172.21.15.53:52144) 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78ce04640 1 -- 172.21.15.53:0/2790525633 learned_addr learned my addr 172.21.15.53:0/2790525633 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78ce04640 1 -- 172.21.15.53:0/2790525633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7880707c0 con 0x7fb788128c30 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78ce04640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 0x7fb78806e820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c450 tx=0x7fb77c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb77c017070 con 0x7fb788128c30 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9524128350 con 0x7f952412a5c0 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb77c005c20 con 0x7fb788128c30 2024-05-08T18:08:42.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb77c0070d0 con 0x7fb788128c30 2024-05-08T18:08:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a012da50 con 0x7f04a006ec50 2024-05-08T18:08:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f04900bd020 con 0x7f04a006ec50 2024-05-08T18:08:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78806ed60 con 0x7fb788128c30 2024-05-08T18:08:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78806f220 con 0x7fb788128c30 2024-05-08T18:08:42.163 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f0487fff640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f048c039b50 0x7f048c03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f04900e7680 con 0x7f04a006ec50 2024-05-08T18:08:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f049effd640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f048c039b50 0x7f048c03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.155+0000 7f95298fc640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9508039ba0 0x7f950803c060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f95140ad000 tx=0x7f95140a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.159+0000 7f049effd640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f048c039b50 0x7f048c03c010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04a006f050 tx=0x7f04940078f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.164 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.159+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78812ce00 con 0x7fb788128c30 2024-05-08T18:08:42.165 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.163+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9520007270 con 0x7f952412a5c0 2024-05-08T18:08:42.173 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.175+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f04900c4030 con 0x7f04a006ec50 2024-05-08T18:08:42.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.175+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb77c01a070 con 0x7fb788128c30 2024-05-08T18:08:42.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.175+0000 7fb7857fa640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb76c039bf0 0x7fb76c03c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.175+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fb77c04ca00 con 0x7fb788128c30 2024-05-08T18:08:42.174 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.175+0000 7fb787fff640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb76c039bf0 0x7fb76c03c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.175 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.175+0000 7fb787fff640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb76c039bf0 0x7fb76c03c0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7740ae000 tx=0x7fb7740a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.182 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.183+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb77c007270 con 0x7fb788128c30 2024-05-08T18:08:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.323+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f95241189e0 con 0x7f952412a5c0 2024-05-08T18:08:42.324 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.323+0000 7f951affd640 1 -- 172.21.15.53:0/508510191 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9520019cd0 con 0x7f952412a5c0 2024-05-08T18:08:42.324 INFO:teuthology.orchestra.run.smithi053.stdout:38654705669 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9508039ba0 msgr2=0x7f950803c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9508039ba0 0x7f950803c060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f95140ad000 tx=0x7f95140a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 msgr2=0x7f9524116fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 0x7f9524116fa0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f952000c450 tx=0x7f952000c910 comp rx=0 tx=0).stop 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 shutdown_connections 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9508039ba0 0x7f950803c060 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 --2- 172.21.15.53:0/508510191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f952412a5c0 0x7f9524116fa0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 >> 172.21.15.53:0/508510191 conn(0x7f952409c5b0 msgr2=0x7f95241288f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 shutdown_connections 2024-05-08T18:08:42.327 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.327+0000 7f952c361640 1 -- 172.21.15.53:0/508510191 wait complete. 2024-05-08T18:08:42.330 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.331+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f41d00763b0 con 0x7f41d012f490 2024-05-08T18:08:42.331 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.331+0000 7f41c6ffd640 1 -- 172.21.15.53:0/3725530914 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41cc007270 con 0x7f41d012f490 2024-05-08T18:08:42.331 INFO:teuthology.orchestra.run.smithi053.stdout:38654705669 2024-05-08T18:08:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41b4039b50 msgr2=0x7f41b403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41b4039b50 0x7f41b403c010 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f41c00ad000 tx=0x7f41c00a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 msgr2=0x7f41d012e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 0x7f41d012e020 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00c450 tx=0x7f41cc00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 shutdown_connections 2024-05-08T18:08:42.334 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41b4039b50 0x7f41b403c010 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 --2- 172.21.15.53:0/3725530914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41d012f490 0x7f41d012e020 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 >> 172.21.15.53:0/3725530914 conn(0x7f41d009c970 msgr2=0x7f41d009af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 shutdown_connections 2024-05-08T18:08:42.335 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.335+0000 7f41d82ed640 1 -- 172.21.15.53:0/3725530914 wait complete. 2024-05-08T18:08:42.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f04a0064150 con 0x7f04a006ec50 2024-05-08T18:08:42.337 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f0487fff640 1 -- 172.21.15.53:0/3889657104 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04900160b0 con 0x7f04a006ec50 2024-05-08T18:08:42.338 INFO:teuthology.orchestra.run.smithi053.stdout:38654705669 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f048c039b50 msgr2=0x7f048c03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f048c039b50 0x7f048c03c010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04a006f050 tx=0x7f04940078f0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 msgr2=0x7f04a0097ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 0x7f04a0097ae0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f04900190d0 tx=0x7f049001ad00 comp rx=0 tx=0).stop 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 shutdown_connections 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f048c039b50 0x7f048c03c010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 --2- 172.21.15.53:0/3889657104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a006ec50 0x7f04a0097ae0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 >> 172.21.15.53:0/3889657104 conn(0x7f04a0099390 msgr2=0x7f04a0132880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 shutdown_connections 2024-05-08T18:08:42.340 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.339+0000 7f04a5cac640 1 -- 172.21.15.53:0/3889657104 wait complete. 2024-05-08T18:08:42.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-05-08T18:08:42.344 DEBUG:teuthology.parallel:result is None 2024-05-08T18:08:42.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-05-08T18:08:42.354 DEBUG:teuthology.parallel:result is None 2024-05-08T18:08:42.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.2 2024-05-08T18:08:42.357 DEBUG:teuthology.parallel:result is None 2024-05-08T18:08:42.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb788064150 con 0x7fb788128c30 2024-05-08T18:08:42.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb7857fa640 1 -- 172.21.15.53:0/2790525633 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb77c04a920 con 0x7fb788128c30 2024-05-08T18:08:42.362 INFO:teuthology.orchestra.run.smithi053.stdout:38654705668 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb76c039bf0 msgr2=0x7fb76c03c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb76c039bf0 0x7fb76c03c0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7740ae000 tx=0x7fb7740a7000 comp rx=0 tx=0).stop 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 msgr2=0x7fb78806e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 0x7fb78806e820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c450 tx=0x7fb77c00c910 comp rx=0 tx=0).stop 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 shutdown_connections 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb76c039bf0 0x7fb76c03c0b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 --2- 172.21.15.53:0/2790525633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb788128c30 0x7fb78806e820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 >> 172.21.15.53:0/2790525633 conn(0x7fb788099390 msgr2=0x7fb7881c25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 shutdown_connections 2024-05-08T18:08:42.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.363+0000 7fb78f068640 1 -- 172.21.15.53:0/2790525633 wait complete. 2024-05-08T18:08:42.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.1 2024-05-08T18:08:42.378 DEBUG:teuthology.parallel:result is None 2024-05-08T18:08:42.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:08:42.378 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:08:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd96dcf0640 1 Processor -- start 2024-05-08T18:08:42.531 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd96dcf0640 1 -- start start 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd96dcf0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fd968130550 0x7fd968132940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd96dcf0640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd96809e250 con 0x7fd96812a0b0 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd96dcf0640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fd96812aba0 con 0x7fd968130550 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd9677fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fd96812a0b0 0x7fd96812a490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57092/0 (socket says 172.21.15.53:57092) 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd9677fe640 1 -- 172.21.15.53:0/733676793 learned_addr learned my addr 172.21.15.53:0/733676793 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd966ffd640 1 --2- 172.21.15.53:0/733676793 >> v2:172.21.15.53:3300/0 conn(0x7fd968130550 0x7fd968132940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.532 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd9667fc640 1 -- 172.21.15.53:0/733676793 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633226791 0 0) 0x7fd96809e250 con 0x7fd96812a0b0 2024-05-08T18:08:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd9667fc640 1 -- 172.21.15.53:0/733676793 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd950003530 con 0x7fd96812a0b0 2024-05-08T18:08:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd966ffd640 1 -- 172.21.15.53:0/733676793 >> v1:172.21.15.53:6789/0 conn(0x7fd96812a0b0 legacy=0x7fd96812a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.533 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.531+0000 7fd966ffd640 1 -- 172.21.15.53:0/733676793 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd968129e90 con 0x7fd968130550 2024-05-08T18:08:42.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd966ffd640 1 --2- 172.21.15.53:0/733676793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd968130550 0x7fd968132940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009740 tx=0x7fd95c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a0bd39bf4d76cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9667fc640 1 -- 172.21.15.53:0/733676793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95c0b0070 con 0x7fd968130550 2024-05-08T18:08:42.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9667fc640 1 -- 172.21.15.53:0/733676793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95c0ab530 con 0x7fd968130550 2024-05-08T18:08:42.534 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9667fc640 1 -- 172.21.15.53:0/733676793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95c0ab830 con 0x7fd968130550 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- 172.21.15.53:0/733676793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd968130550 msgr2=0x7fd968132940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 --2- 172.21.15.53:0/733676793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd968130550 0x7fd968132940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd95c009740 tx=0x7fd95c01c370 comp rx=0 tx=0).stop 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- 172.21.15.53:0/733676793 shutdown_connections 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 --2- 172.21.15.53:0/733676793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd968130550 0x7fd968132940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- 172.21.15.53:0/733676793 >> 172.21.15.53:0/733676793 conn(0x7fd96809be60 msgr2=0x7fd96809d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- 172.21.15.53:0/733676793 shutdown_connections 2024-05-08T18:08:42.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- 172.21.15.53:0/733676793 wait complete. 2024-05-08T18:08:42.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 Processor -- start 2024-05-08T18:08:42.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- start start 2024-05-08T18:08:42.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 0x7fd968123770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd96dcf0640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fd968135a30 con 0x7fd96812a0b0 2024-05-08T18:08:42.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 0x7fd968123770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.536 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9677fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 0x7fd968123770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52162/0 (socket says 172.21.15.53:52162) 2024-05-08T18:08:42.537 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9677fe640 1 -- 172.21.15.53:0/633438390 learned_addr learned my addr 172.21.15.53:0/633438390 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9677fe640 1 -- 172.21.15.53:0/633438390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd968073dc0 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.535+0000 7fd9677fe640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 0x7fd968123770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c450 tx=0x7fd95800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd958017070 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd958005ce0 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96812d5f0 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd958007200 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd968123cb0 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd968064150 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd95801a070 con 0x7fd96812a0b0 2024-05-08T18:08:42.538 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd94ffff640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd954039b50 0x7fd95403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:42.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fd95804c470 con 0x7fd96812a0b0 2024-05-08T18:08:42.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd966ffd640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd954039b50 0x7fd95403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:42.539 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.539+0000 7fd966ffd640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd954039b50 0x7fd95403c010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0ad000 tx=0x7fd95c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:42.542 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.543+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd95801ae30 con 0x7fd96812a0b0 2024-05-08T18:08:42.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.699+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd968068ae0 con 0x7fd954039b50 2024-05-08T18:08:42.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd94ffff640 1 -- 172.21.15.53:0/633438390 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31847 (secure 0 0 0) 0x7fd968068ae0 con 0x7fd954039b50 2024-05-08T18:08:42.702 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:42.702 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:08:42.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd954039b50 msgr2=0x7fd95403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd954039b50 0x7fd95403c010 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0ad000 tx=0x7fd95c0a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 msgr2=0x7fd968123770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 0x7fd968123770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd95800c450 tx=0x7fd95800c910 comp rx=0 tx=0).stop 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 shutdown_connections 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd954039b50 0x7fd95403c010 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 --2- 172.21.15.53:0/633438390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd96812a0b0 0x7fd968123770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 >> 172.21.15.53:0/633438390 conn(0x7fd96809be60 msgr2=0x7fd968124720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 shutdown_connections 2024-05-08T18:08:42.704 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.703+0000 7fd96dcf0640 1 -- 172.21.15.53:0/633438390 wait complete. 2024-05-08T18:08:42.719 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T18:08:41.307582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118052,"kb_used_data":1640,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369308,"statfs":{"total":386547056640,"available":386426171392,"internally_reserved":0,"allocated":1679360,"data_stored":1328808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001300"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.487164+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:08:39.487164+0000","last_peered":"2024-05-08T18:08:39.487164+0000","last_clean":"2024-05-08T18:08:39.487164+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:08:39.487164+0000","last_undegraded":"2024-05-08T18:08:39.487164+0000","last_fullsized":"2024-05-08T18:08:39.487164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:20.229382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.434848+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:08:39.434848+0000","last_peered":"2024-05-08T18:08:39.434848+0000","last_clean":"2024-05-08T18:08:39.434848+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:08:39.434848+0000","last_undegraded":"2024-05-08T18:08:39.434848+0000","last_fullsized":"2024-05-08T18:08:39.434848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:52.281253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435917+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:08:39.435917+0000","last_peered":"2024-05-08T18:08:39.435917+0000","last_clean":"2024-05-08T18:08:39.435917+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:08:39.435917+0000","last_undegraded":"2024-05-08T18:08:39.435917+0000","last_fullsized":"2024-05-08T18:08:39.435917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:37.747046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435066+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:08:39.435066+0000","last_peered":"2024-05-08T18:08:39.435066+0000","last_clean":"2024-05-08T18:08:39.435066+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:08:39.435066+0000","last_undegraded":"2024-05-08T18:08:39.435066+0000","last_fullsized":"2024-05-08T18:08:39.435066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435841+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:08:39.435841+0000","last_peered":"2024-05-08T18:08:39.435841+0000","last_clean":"2024-05-08T18:08:39.435841+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:08:39.435841+0000","last_undegraded":"2024-05-08T18:08:39.435841+0000","last_fullsized":"2024-05-08T18:08:39.435841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-08T18:08:40.425667+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:08:40.425667+0000","last_peered":"2024-05-08T18:08:40.425667+0000","last_clean":"2024-05-08T18:08:40.425667+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:08:40.425667+0000","last_undegraded":"2024-05-08T18:08:40.425667+0000","last_fullsized":"2024-05-08T18:08:40.425667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435873+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:08:39.435873+0000","last_peered":"2024-05-08T18:08:39.435873+0000","last_clean":"2024-05-08T18:08:39.435873+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:08:39.435873+0000","last_undegraded":"2024-05-08T18:08:39.435873+0000","last_fullsized":"2024-05-08T18:08:39.435873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:02.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.438353+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:08:39.438353+0000","last_peered":"2024-05-08T18:08:39.438353+0000","last_clean":"2024-05-08T18:08:39.438353+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:08:39.438353+0000","last_undegraded":"2024-05-08T18:08:39.438353+0000","last_fullsized":"2024-05-08T18:08:39.438353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:15:31.792994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":106,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.478433+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:08:39.478433+0000","last_peered":"2024-05-08T18:08:39.478433+0000","last_clean":"2024-05-08T18:08:39.478433+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:08:39.478433+0000","last_undegraded":"2024-05-08T18:08:39.478433+0000","last_fullsized":"2024-05-08T18:08:39.478433+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:09.321105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35464,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336376,"statfs":{"total":96636764160,"available":96600449024,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:08:42.719 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:08:42.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.827+0000 7f7d76f09640 1 Processor -- start 2024-05-08T18:08:43.127 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.827+0000 7f7d76f09640 1 -- start start 2024-05-08T18:08:43.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d76f09640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d701326b0 0x7f7d70134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d76f09640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d70071290 con 0x7f7d70070220 2024-05-08T18:08:43.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d76f09640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7d70073ae0 con 0x7f7d701326b0 2024-05-08T18:08:43.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d74ca5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7d70070220 0x7f7d70070600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57102/0 (socket says 172.21.15.53:57102) 2024-05-08T18:08:43.131 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d74ca5640 1 -- 172.21.15.53:0/2644636556 learned_addr learned my addr 172.21.15.53:0/2644636556 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7d701326b0 0x7f7d70134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6f7fe640 1 -- 172.21.15.53:0/2644636556 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2132125418 0 0) 0x7f7d60001120 con 0x7f7d70070220 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6f7fe640 1 -- 172.21.15.53:0/2644636556 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d58003530 con 0x7f7d70070220 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6ffff640 1 -- 172.21.15.53:0/2644636556 >> v1:172.21.15.53:6789/0 conn(0x7f7d70070220 legacy=0x7f7d70070600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6ffff640 1 -- 172.21.15.53:0/2644636556 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d70073330 con 0x7f7d701326b0 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/2644636556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d701326b0 0x7f7d70134aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009740 tx=0x7f7d6401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f955b77f6fb11b3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6f7fe640 1 -- 172.21.15.53:0/2644636556 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d640b0070 con 0x7f7d701326b0 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6f7fe640 1 -- 172.21.15.53:0/2644636556 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d640ab530 con 0x7f7d701326b0 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.831+0000 7f7d6f7fe640 1 -- 172.21.15.53:0/2644636556 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d640ab830 con 0x7f7d701326b0 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/2644636556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d701326b0 msgr2=0x7f7d70134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 --2- 172.21.15.53:0/2644636556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d701326b0 0x7f7d70134aa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009740 tx=0x7f7d6401c370 comp rx=0 tx=0).stop 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/2644636556 shutdown_connections 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 --2- 172.21.15.53:0/2644636556 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d701326b0 0x7f7d70134aa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/2644636556 >> 172.21.15.53:0/2644636556 conn(0x7f7d700a1c20 msgr2=0x7f7d700a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:43.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/2644636556 shutdown_connections 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/2644636556 wait complete. 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 Processor -- start 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- start start 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 0x7f7d7011f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7d70137a10 con 0x7f7d70070220 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d74ca5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 0x7f7d7011f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d74ca5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 0x7f7d7011f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52170/0 (socket says 172.21.15.53:52170) 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d74ca5640 1 -- 172.21.15.53:0/3593780580 learned_addr learned my addr 172.21.15.53:0/3593780580 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d74ca5640 1 -- 172.21.15.53:0/3593780580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7006e520 con 0x7f7d70070220 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d74ca5640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 0x7f7d7011f1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c680 tx=0x7f7d6000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d600058c0 con 0x7f7d70070220 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d60005a60 con 0x7f7d70070220 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d70121f60 con 0x7f7d70070220 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d60005dc0 con 0x7f7d70070220 2024-05-08T18:08:43.133 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d701223f0 con 0x7f7d70070220 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d70064150 con 0x7f7d70070220 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7d60007070 con 0x7f7d70070220 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d6d7fa640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7d5c039b00 0x7f7d5c03bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.835+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f7d6004cd40 con 0x7f7d70070220 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.839+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7d5c039b00 0x7f7d5c03bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.839+0000 7f7d6ffff640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7d5c039b00 0x7f7d5c03bfc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d640ad000 tx=0x7f7d640a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.843+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7d70071290 con 0x7f7d70070220 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.995+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d70120b50 con 0x7f7d5c039b00 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d6d7fa640 1 -- 172.21.15.53:0/3593780580 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31847 (secure 0 0 0) 0x7f7d70120b50 con 0x7f7d5c039b00 2024-05-08T18:08:43.134 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7d5c039b00 msgr2=0x7f7d5c03bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7d5c039b00 0x7f7d5c03bfc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d640ad000 tx=0x7f7d640a6000 comp rx=0 tx=0).stop 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 msgr2=0x7f7d7011f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 0x7f7d7011f1f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c680 tx=0x7f7d6000cb40 comp rx=0 tx=0).stop 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 shutdown_connections 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7d5c039b00 0x7f7d5c03bfc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 --2- 172.21.15.53:0/3593780580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d70070220 0x7f7d7011f1f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 >> 172.21.15.53:0/3593780580 conn(0x7f7d700a1c20 msgr2=0x7f7d701312b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 shutdown_connections 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:42.999+0000 7f7d76f09640 1 -- 172.21.15.53:0/3593780580 wait complete. 2024-05-08T18:08:43.136 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-05-08T18:08:41.307582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118052,"kb_used_data":1640,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369308,"statfs":{"total":386547056640,"available":386426171392,"internally_reserved":0,"allocated":1679360,"data_stored":1328808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":119138070},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001300"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.487164+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:08:39.487164+0000","last_peered":"2024-05-08T18:08:39.487164+0000","last_clean":"2024-05-08T18:08:39.487164+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:08:39.487164+0000","last_undegraded":"2024-05-08T18:08:39.487164+0000","last_fullsized":"2024-05-08T18:08:39.487164+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:35:20.229382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.434848+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:08:39.434848+0000","last_peered":"2024-05-08T18:08:39.434848+0000","last_clean":"2024-05-08T18:08:39.434848+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:08:39.434848+0000","last_undegraded":"2024-05-08T18:08:39.434848+0000","last_fullsized":"2024-05-08T18:08:39.434848+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:25:52.281253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435917+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:08:39.435917+0000","last_peered":"2024-05-08T18:08:39.435917+0000","last_clean":"2024-05-08T18:08:39.435917+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:08:39.435917+0000","last_undegraded":"2024-05-08T18:08:39.435917+0000","last_fullsized":"2024-05-08T18:08:39.435917+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:37.747046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435066+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:08:39.435066+0000","last_peered":"2024-05-08T18:08:39.435066+0000","last_clean":"2024-05-08T18:08:39.435066+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:08:39.435066+0000","last_undegraded":"2024-05-08T18:08:39.435066+0000","last_fullsized":"2024-05-08T18:08:39.435066+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435841+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:08:39.435841+0000","last_peered":"2024-05-08T18:08:39.435841+0000","last_clean":"2024-05-08T18:08:39.435841+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:08:39.435841+0000","last_undegraded":"2024-05-08T18:08:39.435841+0000","last_fullsized":"2024-05-08T18:08:39.435841+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-05-08T18:08:40.425667+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:08:40.425667+0000","last_peered":"2024-05-08T18:08:40.425667+0000","last_clean":"2024-05-08T18:08:40.425667+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:08:40.425667+0000","last_undegraded":"2024-05-08T18:08:40.425667+0000","last_fullsized":"2024-05-08T18:08:40.425667+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.435873+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:08:39.435873+0000","last_peered":"2024-05-08T18:08:39.435873+0000","last_clean":"2024-05-08T18:08:39.435873+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:08:39.435873+0000","last_undegraded":"2024-05-08T18:08:39.435873+0000","last_fullsized":"2024-05-08T18:08:39.435873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:02.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.438353+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:08:39.438353+0000","last_peered":"2024-05-08T18:08:39.438353+0000","last_clean":"2024-05-08T18:08:39.438353+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:08:39.438353+0000","last_undegraded":"2024-05-08T18:08:39.438353+0000","last_fullsized":"2024-05-08T18:08:39.438353+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:15:31.792994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":106,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-05-08T18:08:39.478433+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:08:39.478433+0000","last_peered":"2024-05-08T18:08:39.478433+0000","last_clean":"2024-05-08T18:08:39.478433+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:08:39.478433+0000","last_undegraded":"2024-05-08T18:08:39.478433+0000","last_fullsized":"2024-05-08T18:08:39.478433+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:09.321105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":627386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35464,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336376,"statfs":{"total":96636764160,"available":96600449024,"internally_reserved":0,"allocated":122880,"data_stored":37018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:08:43.137 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:08:43.137 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T18:08:43.137 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T18:08:43.137 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T18:08:43.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f0477c32640 1 Processor -- start 2024-05-08T18:08:43.263 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f0477c32640 1 -- start start 2024-05-08T18:08:43.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f0477c32640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f047012ff50 0x7f0470134990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f0477c32640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047009e250 con 0x7f047012f460 2024-05-08T18:08:43.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f0477c32640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f04700726b0 con 0x7f047012ff50 2024-05-08T18:08:43.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f04751cd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f047012ff50 0x7f0470134990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f04759ce640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f047012f460 0x7f047012f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:57104/0 (socket says 172.21.15.53:57104) 2024-05-08T18:08:43.264 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f04759ce640 1 -- 172.21.15.53:0/3612717525 learned_addr learned my addr 172.21.15.53:0/3612717525 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:08:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f04751cd640 1 -- 172.21.15.53:0/3612717525 >> v1:172.21.15.53:6789/0 conn(0x7f047012f460 legacy=0x7f047012f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.265 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.263+0000 7f04751cd640 1 -- 172.21.15.53:0/3612717525 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0470071e00 con 0x7f047012ff50 2024-05-08T18:08:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.267+0000 7f04751cd640 1 --2- 172.21.15.53:0/3612717525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012ff50 0x7f0470134990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0460009740 tx=0x7f046001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254833abb9505b9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.267+0000 7f04749cc640 1 -- 172.21.15.53:0/3612717525 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04600b0070 con 0x7f047012ff50 2024-05-08T18:08:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.267+0000 7f04749cc640 1 -- 172.21.15.53:0/3612717525 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04600ab530 con 0x7f047012ff50 2024-05-08T18:08:43.268 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.267+0000 7f04749cc640 1 -- 172.21.15.53:0/3612717525 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04600ab830 con 0x7f047012ff50 2024-05-08T18:08:43.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/3612717525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012ff50 msgr2=0x7f0470134990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 --2- 172.21.15.53:0/3612717525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012ff50 0x7f0470134990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0460009740 tx=0x7f046001c370 comp rx=0 tx=0).stop 2024-05-08T18:08:43.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/3612717525 shutdown_connections 2024-05-08T18:08:43.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 --2- 172.21.15.53:0/3612717525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012ff50 0x7f0470134990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/3612717525 >> 172.21.15.53:0/3612717525 conn(0x7f047009be60 msgr2=0x7f047009d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:43.269 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/3612717525 shutdown_connections 2024-05-08T18:08:43.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/3612717525 wait complete. 2024-05-08T18:08:43.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 Processor -- start 2024-05-08T18:08:43.270 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- start start 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 0x7f047011e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0470072470 con 0x7f047012f460 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04759ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 0x7f047011e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04759ce640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 0x7f047011e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:52178/0 (socket says 172.21.15.53:52178) 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04759ce640 1 -- 172.21.15.53:0/403792980 learned_addr learned my addr 172.21.15.53:0/403792980 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04759ce640 1 -- 172.21.15.53:0/403792980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0470134900 con 0x7f047012f460 2024-05-08T18:08:43.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04759ce640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 0x7f047011e1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f046c00cbd0 tx=0x7f046c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f046c017070 con 0x7f047012f460 2024-05-08T18:08:43.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c00abc0 con 0x7f047012f460 2024-05-08T18:08:43.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f046c012400 con 0x7f047012f460 2024-05-08T18:08:43.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04701213f0 con 0x7f047012f460 2024-05-08T18:08:43.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0470120f30 con 0x7f047012f460 2024-05-08T18:08:43.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f046c01a070 con 0x7f047012f460 2024-05-08T18:08:43.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0470064150 con 0x7f047012f460 2024-05-08T18:08:43.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04667fc640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0454039b50 0x7f045403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.271+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7f046c04d130 con 0x7f047012f460 2024-05-08T18:08:43.273 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.275+0000 7f04751cd640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0454039b50 0x7f045403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.275+0000 7f04751cd640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0454039b50 0x7f045403c010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04600ad000 tx=0x7f0460008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.279+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f046c0078c0 con 0x7f047012f460 2024-05-08T18:08:43.471 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.471+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f047011f3a0 con 0x7f047012f460 2024-05-08T18:08:43.472 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.471+0000 7f04667fc640 1 -- 172.21.15.53:0/403792980 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f046c007aa0 con 0x7f047012f460 2024-05-08T18:08:43.472 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:08:43.472 INFO:teuthology.orchestra.run.smithi053.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T18:08:43.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0454039b50 msgr2=0x7f045403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0454039b50 0x7f045403c010 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f04600ad000 tx=0x7f0460008040 comp rx=0 tx=0).stop 2024-05-08T18:08:43.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 msgr2=0x7f047011e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.474 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 0x7f047011e1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f046c00cbd0 tx=0x7f046c00a430 comp rx=0 tx=0).stop 2024-05-08T18:08:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 shutdown_connections 2024-05-08T18:08:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0454039b50 0x7f045403c010 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 --2- 172.21.15.53:0/403792980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f047012f460 0x7f047011e1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 >> 172.21.15.53:0/403792980 conn(0x7f047009be60 msgr2=0x7f0470133280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 shutdown_connections 2024-05-08T18:08:43.475 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:08:43.475+0000 7f0477c32640 1 -- 172.21.15.53:0/403792980 wait complete. 2024-05-08T18:08:43.489 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T18:08:43.489 INFO:teuthology.run_tasks:Running task rgw... 2024-05-08T18:08:43.502 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-08T18:08:43.502 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-08T18:08:43.502 INFO:tasks.rgw:Creating data pools 2024-05-08T18:08:43.503 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-08T18:08:43.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-05-08T18:08:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0914e640 1 Processor -- start 2024-05-08T18:08:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0914e640 1 -- start start 2024-05-08T18:08:43.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0914e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca0411bda0 0x7fca0411e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0914e640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca0410fb80 con 0x7fca0410f000 2024-05-08T18:08:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0914e640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fca0411f6e0 con 0x7fca0411bda0 2024-05-08T18:08:43.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca0411bda0 0x7fca0411e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0259c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fca0411bda0 0x7fca0411e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44290/0 (socket says 172.21.15.114:44290) 2024-05-08T18:08:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.636+0000 7fca0259c640 1 -- 172.21.15.114:0/128101593 learned_addr learned my addr 172.21.15.114:0/128101593 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0259c640 1 -- 172.21.15.114:0/128101593 >> v1:172.21.15.53:6789/0 conn(0x7fca0410f000 legacy=0x7fca0410f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0259c640 1 -- 172.21.15.114:0/128101593 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0411f860 con 0x7fca0411bda0 2024-05-08T18:08:43.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca01d9b640 1 -- 172.21.15.114:0/128101593 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3551465650 0 0) 0x7fca0410fb80 con 0x7fca0410f000 2024-05-08T18:08:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0259c640 1 --2- 172.21.15.114:0/128101593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0411bda0 0x7fca0411e190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0097f0 tx=0x7fc9ec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aa79db17a50dbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca01d9b640 1 -- 172.21.15.114:0/128101593 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec0ab580 con 0x7fca0411bda0 2024-05-08T18:08:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca01d9b640 1 -- 172.21.15.114:0/128101593 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9ec0b0070 con 0x7fca0411bda0 2024-05-08T18:08:43.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca01d9b640 1 -- 172.21.15.114:0/128101593 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ec0ab870 con 0x7fca0411bda0 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 -- 172.21.15.114:0/128101593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0411bda0 msgr2=0x7fca0411e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 --2- 172.21.15.114:0/128101593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0411bda0 0x7fca0411e190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0097f0 tx=0x7fc9ec01c430 comp rx=0 tx=0).stop 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 -- 172.21.15.114:0/128101593 shutdown_connections 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 --2- 172.21.15.114:0/128101593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0411bda0 0x7fca0411e190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 -- 172.21.15.114:0/128101593 >> 172.21.15.114:0/128101593 conn(0x7fca04070980 msgr2=0x7fca04072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 -- 172.21.15.114:0/128101593 shutdown_connections 2024-05-08T18:08:43.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.640+0000 7fca0914e640 1 -- 172.21.15.114:0/128101593 wait complete. 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 Processor -- start 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 -- start start 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 0x7fca041afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fca0411f390 con 0x7fca0410f000 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca02d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 0x7fca041afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca02d9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 0x7fca041afc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44304/0 (socket says 172.21.15.114:44304) 2024-05-08T18:08:43.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca02d9d640 1 -- 172.21.15.114:0/315404986 learned_addr learned my addr 172.21.15.114:0/315404986 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca02d9d640 1 -- 172.21.15.114:0/315404986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca041b01e0 con 0x7fca0410f000 2024-05-08T18:08:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca02d9d640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 0x7fca041afc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c6f0 tx=0x7fc9fc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc003bb0 con 0x7fca0410f000 2024-05-08T18:08:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca041b0470 con 0x7fca0410f000 2024-05-08T18:08:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9fc003d50 con 0x7fca0410f000 2024-05-08T18:08:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9fc0051e0 con 0x7fca0410f000 2024-05-08T18:08:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca041a9e80 con 0x7fca0410f000 2024-05-08T18:08:43.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca04051030 con 0x7fca0410f000 2024-05-08T18:08:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc9fc005490 con 0x7fca0410f000 2024-05-08T18:08:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fc9fb7fe640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc9e4039b00 0x7fc9e403bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3482+0+0 (secure 0 0 0) 0x7fc9fc04d370 con 0x7fca0410f000 2024-05-08T18:08:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.644+0000 7fca0259c640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc9e4039b00 0x7fc9e403bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:43.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.648+0000 7fca0259c640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc9e4039b00 0x7fc9e403bfc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0af000 tx=0x7fc9ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:43.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.656+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc9fc005780 con 0x7fca0410f000 2024-05-08T18:08:43.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:43.824+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) -- 0x7fca041b06a0 con 0x7fca0410f000 2024-05-08T18:08:44.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.436+0000 7fc9fb7fe640 1 -- 172.21.15.114:0/315404986 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v16) ==== 151+0+0 (secure 0 0 0) 0x7fc9fc04b290 con 0x7fca0410f000 2024-05-08T18:08:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc9e4039b00 msgr2=0x7fc9e403bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc9e4039b00 0x7fc9e403bfc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0af000 tx=0x7fc9ec008040 comp rx=0 tx=0).stop 2024-05-08T18:08:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 msgr2=0x7fca041afc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 0x7fca041afc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00c6f0 tx=0x7fc9fc00cbb0 comp rx=0 tx=0).stop 2024-05-08T18:08:44.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 shutdown_connections 2024-05-08T18:08:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc9e4039b00 0x7fc9e403bfc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 --2- 172.21.15.114:0/315404986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca0410f000 0x7fca041afc10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 >> 172.21.15.114:0/315404986 conn(0x7fca04070980 msgr2=0x7fca04073010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 shutdown_connections 2024-05-08T18:08:44.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.440+0000 7fca0914e640 1 -- 172.21.15.114:0/315404986 wait complete. 2024-05-08T18:08:44.462 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-05-08T18:08:44.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c3ded5640 1 Processor -- start 2024-05-08T18:08:44.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c3ded5640 1 -- start start 2024-05-08T18:08:44.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c3ded5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c38116ca0 0x7f8c38117080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:44.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c3ded5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c3810fb30 con 0x7f8c3810ef70 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c3ded5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8c38117740 con 0x7f8c38116ca0 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c377fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c38116ca0 0x7f8c38117080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c377fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8c38116ca0 0x7f8c38117080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44320/0 (socket says 172.21.15.114:44320) 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c377fe640 1 -- 172.21.15.114:0/800688067 learned_addr learned my addr 172.21.15.114:0/800688067 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c36ffd640 1 --1- 172.21.15.114:0/800688067 >> v1:172.21.15.53:6789/0 conn(0x7f8c3810ef70 0x7f8c3810f420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43244/0 (socket says 172.21.15.114:43244) 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c377fe640 1 -- 172.21.15.114:0/800688067 >> v1:172.21.15.53:6789/0 conn(0x7f8c3810ef70 legacy=0x7f8c3810f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:44.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.596+0000 7f8c377fe640 1 -- 172.21.15.114:0/800688067 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3810fd00 con 0x7f8c38116ca0 2024-05-08T18:08:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c377fe640 1 --2- 172.21.15.114:0/800688067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c38116ca0 0x7f8c38117080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097f0 tx=0x7f8c2801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a031d5434e8b9fe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c367fc640 1 -- 172.21.15.114:0/800688067 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c280ab580 con 0x7f8c38116ca0 2024-05-08T18:08:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c367fc640 1 -- 172.21.15.114:0/800688067 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c280b0070 con 0x7f8c38116ca0 2024-05-08T18:08:44.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c367fc640 1 -- 172.21.15.114:0/800688067 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c280ab870 con 0x7f8c38116ca0 2024-05-08T18:08:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- 172.21.15.114:0/800688067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c38116ca0 msgr2=0x7f8c38117080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 --2- 172.21.15.114:0/800688067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c38116ca0 0x7f8c38117080 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c280097f0 tx=0x7f8c2801c430 comp rx=0 tx=0).stop 2024-05-08T18:08:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- 172.21.15.114:0/800688067 shutdown_connections 2024-05-08T18:08:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 --2- 172.21.15.114:0/800688067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c38116ca0 0x7f8c38117080 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- 172.21.15.114:0/800688067 >> 172.21.15.114:0/800688067 conn(0x7f8c38070d80 msgr2=0x7f8c380731a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:44.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- 172.21.15.114:0/800688067 shutdown_connections 2024-05-08T18:08:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- 172.21.15.114:0/800688067 wait complete. 2024-05-08T18:08:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 Processor -- start 2024-05-08T18:08:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- start start 2024-05-08T18:08:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 0x7f8c381adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:44.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c3ded5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8c3811f5c0 con 0x7f8c3810ef70 2024-05-08T18:08:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 0x7f8c381adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c377fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 0x7f8c381adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44322/0 (socket says 172.21.15.114:44322) 2024-05-08T18:08:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c377fe640 1 -- 172.21.15.114:0/2287557017 learned_addr learned my addr 172.21.15.114:0/2287557017 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:44.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c377fe640 1 -- 172.21.15.114:0/2287557017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c381ae0f0 con 0x7f8c3810ef70 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.600+0000 7f8c377fe640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 0x7f8c381adb20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c2801a060 tx=0x7f8c2801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c280aa8f0 con 0x7f8c3810ef70 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c381ae320 con 0x7f8c3810ef70 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c280aaa90 con 0x7f8c3810ef70 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c280aadb0 con 0x7f8c3810ef70 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c381a7bc0 con 0x7f8c3810ef70 2024-05-08T18:08:44.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c38051030 con 0x7f8c3810ef70 2024-05-08T18:08:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8c280c7440 con 0x7f8c3810ef70 2024-05-08T18:08:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c1ffff640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c24039b00 0x7f8c2403bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3774+0+0 (secure 0 0 0) 0x7f8c280e8370 con 0x7f8c3810ef70 2024-05-08T18:08:44.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c36ffd640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c24039b00 0x7f8c2403bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:44.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.604+0000 7f8c36ffd640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c24039b00 0x7f8c2403bfc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c001640 tx=0x7f8c2c007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:44.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.616+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8c280160b0 con 0x7f8c3810ef70 2024-05-08T18:08:44.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:44.772+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f8c38116ca0 con 0x7f8c3810ef70 2024-05-08T18:08:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.444+0000 7f8c1ffff640 1 -- 172.21.15.114:0/2287557017 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v18) ==== 227+0+0 (secure 0 0 0) 0x7f8c280bcd50 con 0x7f8c3810ef70 2024-05-08T18:08:46.443 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'default.rgw.buckets.data' created 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c24039b00 msgr2=0x7f8c2403bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c24039b00 0x7f8c2403bfc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c001640 tx=0x7f8c2c007a30 comp rx=0 tx=0).stop 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 msgr2=0x7f8c381adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 0x7f8c381adb20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8c2801a060 tx=0x7f8c2801ac70 comp rx=0 tx=0).stop 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 shutdown_connections 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c24039b00 0x7f8c2403bfc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 --2- 172.21.15.114:0/2287557017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c3810ef70 0x7f8c381adb20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 >> 172.21.15.114:0/2287557017 conn(0x7f8c38070d80 msgr2=0x7f8c38112cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:46.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 shutdown_connections 2024-05-08T18:08:46.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.448+0000 7f8c3ded5640 1 -- 172.21.15.114:0/2287557017 wait complete. 2024-05-08T18:08:46.475 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-08T18:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d863c640 1 Processor -- start 2024-05-08T18:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d863c640 1 -- start start 2024-05-08T18:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d863c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f38d0115230 0x7f38d0115610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d863c640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38d0115cd0 con 0x7f38d010f630 2024-05-08T18:08:46.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d863c640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f38d01101f0 con 0x7f38d0115230 2024-05-08T18:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d63d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f38d0115230 0x7f38d0115610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d63d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f38d0115230 0x7f38d0115610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44336/0 (socket says 172.21.15.114:44336) 2024-05-08T18:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d63d8640 1 -- 172.21.15.114:0/3274785939 learned_addr learned my addr 172.21.15.114:0/3274785939 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d63d8640 1 -- 172.21.15.114:0/3274785939 >> v1:172.21.15.53:6789/0 conn(0x7f38d010f630 legacy=0x7f38d010fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:46.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.596+0000 7f38d63d8640 1 -- 172.21.15.114:0/3274785939 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d01103a0 con 0x7f38d0115230 2024-05-08T18:08:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d63d8640 1 --2- 172.21.15.114:0/3274785939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d0115230 0x7f38d0115610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38c0006fd0 tx=0x7f38c001e8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f372c5201a29070 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d53d6640 1 -- 172.21.15.114:0/3274785939 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c00ad070 con 0x7f38d0115230 2024-05-08T18:08:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d53d6640 1 -- 172.21.15.114:0/3274785939 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c0004160 con 0x7f38d0115230 2024-05-08T18:08:46.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d53d6640 1 -- 172.21.15.114:0/3274785939 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c00044c0 con 0x7f38d0115230 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 -- 172.21.15.114:0/3274785939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d0115230 msgr2=0x7f38d0115610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 --2- 172.21.15.114:0/3274785939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d0115230 0x7f38d0115610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f38c0006fd0 tx=0x7f38c001e8e0 comp rx=0 tx=0).stop 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 -- 172.21.15.114:0/3274785939 shutdown_connections 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 --2- 172.21.15.114:0/3274785939 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d0115230 0x7f38d0115610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 -- 172.21.15.114:0/3274785939 >> 172.21.15.114:0/3274785939 conn(0x7f38d0070980 msgr2=0x7f38d0072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 -- 172.21.15.114:0/3274785939 shutdown_connections 2024-05-08T18:08:46.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.600+0000 7f38d863c640 1 -- 172.21.15.114:0/3274785939 wait complete. 2024-05-08T18:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 Processor -- start 2024-05-08T18:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 -- start start 2024-05-08T18:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 0x7f38d01ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:46.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f38d011dc10 con 0x7f38d010f630 2024-05-08T18:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d63d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 0x7f38d01ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d63d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 0x7f38d01ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44348/0 (socket says 172.21.15.114:44348) 2024-05-08T18:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d63d8640 1 -- 172.21.15.114:0/2724345378 learned_addr learned my addr 172.21.15.114:0/2724345378 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:46.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d63d8640 1 -- 172.21.15.114:0/2724345378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d01ac7e0 con 0x7f38d010f630 2024-05-08T18:08:46.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d63d8640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 0x7f38d01ac210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38c0000c10 tx=0x7f38c001b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:46.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c00ad040 con 0x7f38d010f630 2024-05-08T18:08:46.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c0003960 con 0x7f38d010f630 2024-05-08T18:08:46.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d01aca70 con 0x7f38d010f630 2024-05-08T18:08:46.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38c0003c60 con 0x7f38d010f630 2024-05-08T18:08:46.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d01a6480 con 0x7f38d010f630 2024-05-08T18:08:46.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.604+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d0051030 con 0x7f38d010f630 2024-05-08T18:08:46.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.608+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f38c00ce430 con 0x7f38d010f630 2024-05-08T18:08:46.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.608+0000 7f38c6ffd640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38b4039b00 0x7f38b403bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:46.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.608+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4249+0+0 (secure 0 0 0) 0x7f38c00b6070 con 0x7f38d010f630 2024-05-08T18:08:46.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.608+0000 7f38d5bd7640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38b4039b00 0x7f38b403bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:46.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.608+0000 7f38d5bd7640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38b4039b00 0x7f38b403bfc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38cc001630 tx=0x7f38cc007a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:46.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.620+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f38c0018560 con 0x7f38d010f630 2024-05-08T18:08:46.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:46.780+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f38d01acca0 con 0x7f38d010f630 2024-05-08T18:08:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.456+0000 7f38c6ffd640 1 -- 172.21.15.114:0/2724345378 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) ==== 185+0+0 (secure 0 0 0) 0x7f38c00e8db0 con 0x7f38d010f630 2024-05-08T18:08:47.454 INFO:teuthology.orchestra.run.smithi114.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38b4039b00 msgr2=0x7f38b403bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38b4039b00 0x7f38b403bfc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38cc001630 tx=0x7f38cc007a00 comp rx=0 tx=0).stop 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 msgr2=0x7f38d01ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 0x7f38d01ac210 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38c0000c10 tx=0x7f38c001b680 comp rx=0 tx=0).stop 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 shutdown_connections 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38b4039b00 0x7f38b403bfc0 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38cc001630 tx=0x7f38cc007a00 comp rx=0 tx=0).stop 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 --2- 172.21.15.114:0/2724345378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38d010f630 0x7f38d01ac210 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:47.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 >> 172.21.15.114:0/2724345378 conn(0x7f38d0070980 msgr2=0x7f38d0111420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:47.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.460+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 shutdown_connections 2024-05-08T18:08:47.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.464+0000 7f38d863c640 1 -- 172.21.15.114:0/2724345378 wait complete. 2024-05-08T18:08:47.503 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-08T18:08:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8aa5bc1640 1 Processor -- start 2024-05-08T18:08:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8aa5bc1640 1 -- start start 2024-05-08T18:08:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8aa5bc1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8aa011bda0 0x7f8aa011e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8aa5bc1640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aa010fb80 con 0x7f8aa010f000 2024-05-08T18:08:47.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8aa5bc1640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f8aa011f6e0 con 0x7f8aa011bda0 2024-05-08T18:08:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8a9effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8aa011bda0 0x7f8aa011e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8a9effd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f8aa011bda0 0x7f8aa011e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44360/0 (socket says 172.21.15.114:44360) 2024-05-08T18:08:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8a9effd640 1 -- 172.21.15.114:0/3490680517 learned_addr learned my addr 172.21.15.114:0/3490680517 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8a9effd640 1 -- 172.21.15.114:0/3490680517 >> v1:172.21.15.53:6789/0 conn(0x7f8aa010f000 legacy=0x7f8aa010f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:47.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.628+0000 7f8a9effd640 1 -- 172.21.15.114:0/3490680517 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa011f860 con 0x7f8aa011bda0 2024-05-08T18:08:47.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9effd640 1 --2- 172.21.15.114:0/3490680517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa011bda0 0x7f8aa011e190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a900097f0 tx=0x7f8a9001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4343f9dd3ab03b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:47.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9e7fc640 1 -- 172.21.15.114:0/3490680517 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a900ab580 con 0x7f8aa011bda0 2024-05-08T18:08:47.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9e7fc640 1 -- 172.21.15.114:0/3490680517 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a900b0070 con 0x7f8aa011bda0 2024-05-08T18:08:47.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9e7fc640 1 -- 172.21.15.114:0/3490680517 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a900ab870 con 0x7f8aa011bda0 2024-05-08T18:08:47.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/3490680517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa011bda0 msgr2=0x7f8aa011e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:47.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 --2- 172.21.15.114:0/3490680517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa011bda0 0x7f8aa011e190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a900097f0 tx=0x7f8a9001c430 comp rx=0 tx=0).stop 2024-05-08T18:08:47.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/3490680517 shutdown_connections 2024-05-08T18:08:47.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 --2- 172.21.15.114:0/3490680517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa011bda0 0x7f8aa011e190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:47.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/3490680517 >> 172.21.15.114:0/3490680517 conn(0x7f8aa0070980 msgr2=0x7f8aa0072da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:47.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/3490680517 shutdown_connections 2024-05-08T18:08:47.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/3490680517 wait complete. 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 Processor -- start 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- start start 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 0x7f8aa01afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8aa5bc1640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa011f390 con 0x7f8aa010f000 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 0x7f8aa01afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9f7fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 0x7f8aa01afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44366/0 (socket says 172.21.15.114:44366) 2024-05-08T18:08:47.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9f7fe640 1 -- 172.21.15.114:0/2564263481 learned_addr learned my addr 172.21.15.114:0/2564263481 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:47.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.632+0000 7f8a9f7fe640 1 -- 172.21.15.114:0/2564263481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa01b0350 con 0x7f8aa010f000 2024-05-08T18:08:47.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a9f7fe640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 0x7f8aa01afd80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c380 tx=0x7f8a9400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:47.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a94017070 con 0x7f8aa010f000 2024-05-08T18:08:47.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a94005200 con 0x7f8aa010f000 2024-05-08T18:08:47.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a94003600 con 0x7f8aa010f000 2024-05-08T18:08:47.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa01b05e0 con 0x7f8aa010f000 2024-05-08T18:08:47.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa01aa0c0 con 0x7f8aa010f000 2024-05-08T18:08:47.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aa0051030 con 0x7f8aa010f000 2024-05-08T18:08:47.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8a9401a070 con 0x7f8aa010f000 2024-05-08T18:08:47.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a87fff640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8a8c039b50 0x7f8a8c03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:47.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4260+0+0 (secure 0 0 0) 0x7f8a9404cc70 con 0x7f8aa010f000 2024-05-08T18:08:47.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a9effd640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8a8c039b50 0x7f8a8c03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:47.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.636+0000 7f8a9effd640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8a8c039b50 0x7f8a8c03c010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8a900af000 tx=0x7f8a900a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:47.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.648+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8a94021020 con 0x7f8aa010f000 2024-05-08T18:08:47.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:47.820+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f8aa01b07b0 con 0x7f8aa010f000 2024-05-08T18:08:48.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.456+0000 7f8a87fff640 1 -- 172.21.15.114:0/2564263481 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) ==== 169+0+0 (secure 0 0 0) 0x7f8a9404a880 con 0x7f8aa010f000 2024-05-08T18:08:48.457 INFO:teuthology.orchestra.run.smithi114.stderr:pool 'default.rgw.buckets.index' created 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8a8c039b50 msgr2=0x7f8a8c03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8a8c039b50 0x7f8a8c03c010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8a900af000 tx=0x7f8a900a7000 comp rx=0 tx=0).stop 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 msgr2=0x7f8aa01afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 0x7f8aa01afd80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a9400c380 tx=0x7f8a9400c840 comp rx=0 tx=0).stop 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 shutdown_connections 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8a8c039b50 0x7f8a8c03c010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 --2- 172.21.15.114:0/2564263481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8aa010f000 0x7f8aa01afd80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 >> 172.21.15.114:0/2564263481 conn(0x7f8aa0070980 msgr2=0x7f8aa011ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 shutdown_connections 2024-05-08T18:08:48.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.460+0000 7f8aa5bc1640 1 -- 172.21.15.114:0/2564263481 wait complete. 2024-05-08T18:08:48.491 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-08T18:08:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9ded509640 1 Processor -- start 2024-05-08T18:08:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9ded509640 1 -- start start 2024-05-08T18:08:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9ded509640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9de811bc10 0x7f9de811e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:48.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9ded509640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9de811e5d0 con 0x7f9de8118e70 2024-05-08T18:08:48.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9ded509640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f9de811f7b0 con 0x7f9de811bc10 2024-05-08T18:08:48.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9de67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9de811bc10 0x7f9de811e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:48.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9de67fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f9de811bc10 0x7f9de811e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44378/0 (socket says 172.21.15.114:44378) 2024-05-08T18:08:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9de67fc640 1 -- 172.21.15.114:0/1952710330 learned_addr learned my addr 172.21.15.114:0/1952710330 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9de6ffd640 1 --1- 172.21.15.114:0/1952710330 >> v1:172.21.15.53:6789/0 conn(0x7f9de8118e70 0x7f9de8119250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43280/0 (socket says 172.21.15.114:43280) 2024-05-08T18:08:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9de67fc640 1 -- 172.21.15.114:0/1952710330 >> v1:172.21.15.53:6789/0 conn(0x7f9de8118e70 legacy=0x7f9de8119250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:48.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.620+0000 7f9de67fc640 1 -- 172.21.15.114:0/1952710330 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de811f930 con 0x7f9de811bc10 2024-05-08T18:08:48.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de67fc640 1 --2- 172.21.15.114:0/1952710330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de811bc10 0x7f9de811e000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0097f0 tx=0x7f9ddc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0895949f06eae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de5ffb640 1 -- 172.21.15.114:0/1952710330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0ab580 con 0x7f9de811bc10 2024-05-08T18:08:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de5ffb640 1 -- 172.21.15.114:0/1952710330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0b0070 con 0x7f9de811bc10 2024-05-08T18:08:48.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de5ffb640 1 -- 172.21.15.114:0/1952710330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9ddc0ab870 con 0x7f9de811bc10 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- 172.21.15.114:0/1952710330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de811bc10 msgr2=0x7f9de811e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 --2- 172.21.15.114:0/1952710330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de811bc10 0x7f9de811e000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0097f0 tx=0x7f9ddc01c430 comp rx=0 tx=0).stop 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- 172.21.15.114:0/1952710330 shutdown_connections 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 --2- 172.21.15.114:0/1952710330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de811bc10 0x7f9de811e000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- 172.21.15.114:0/1952710330 >> 172.21.15.114:0/1952710330 conn(0x7f9de806fc70 msgr2=0x7f9de8110db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- 172.21.15.114:0/1952710330 shutdown_connections 2024-05-08T18:08:48.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- 172.21.15.114:0/1952710330 wait complete. 2024-05-08T18:08:48.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 Processor -- start 2024-05-08T18:08:48.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- start start 2024-05-08T18:08:48.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 0x7f9de81afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:48.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9ded509640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f9de811f460 con 0x7f9de8118e70 2024-05-08T18:08:48.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 0x7f9de81afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de6ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 0x7f9de81afdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44382/0 (socket says 172.21.15.114:44382) 2024-05-08T18:08:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de6ffd640 1 -- 172.21.15.114:0/1688789081 learned_addr learned my addr 172.21.15.114:0/1688789081 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:08:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de6ffd640 1 -- 172.21.15.114:0/1688789081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de81b0390 con 0x7f9de8118e70 2024-05-08T18:08:48.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.624+0000 7f9de6ffd640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 0x7f9de81afdc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800c480 tx=0x7f9dd800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd8007410 con 0x7f9de8118e70 2024-05-08T18:08:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de81b05c0 con 0x7f9de8118e70 2024-05-08T18:08:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de81a9e60 con 0x7f9de8118e70 2024-05-08T18:08:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd80075b0 con 0x7f9de8118e70 2024-05-08T18:08:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dd8004920 con 0x7f9de8118e70 2024-05-08T18:08:48.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de8051030 con 0x7f9de8118e70 2024-05-08T18:08:48.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f9dd801a020 con 0x7f9de8118e70 2024-05-08T18:08:48.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9dcf7fe640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9dd4039b00 0x7f9dd403bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:08:48.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4624+0+0 (secure 0 0 0) 0x7f9dd804d540 con 0x7f9de8118e70 2024-05-08T18:08:48.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9de67fc640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9dd4039b00 0x7f9dd403bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:08:48.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.628+0000 7f9de67fc640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9dd4039b00 0x7f9dd403bfc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0af000 tx=0x7f9ddc0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:08:48.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.640+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9dd8021070 con 0x7f9de8118e70 2024-05-08T18:08:48.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:48.804+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f9de811bc10 con 0x7f9de8118e70 2024-05-08T18:08:49.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.468+0000 7f9dcf7fe640 1 -- 172.21.15.114:0/1688789081 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) ==== 187+0+0 (secure 0 0 0) 0x7f9dd801b3a0 con 0x7f9de8118e70 2024-05-08T18:08:49.468 INFO:teuthology.orchestra.run.smithi114.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-08T18:08:49.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9dd4039b00 msgr2=0x7f9dd403bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:49.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9dd4039b00 0x7f9dd403bfc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0af000 tx=0x7f9ddc0a7000 comp rx=0 tx=0).stop 2024-05-08T18:08:49.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 msgr2=0x7f9de81afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 0x7f9de81afdc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800c480 tx=0x7f9dd800c940 comp rx=0 tx=0).stop 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 shutdown_connections 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9dd4039b00 0x7f9dd403bfc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 --2- 172.21.15.114:0/1688789081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de8118e70 0x7f9de81afdc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 >> 172.21.15.114:0/1688789081 conn(0x7f9de806fc70 msgr2=0x7f9de811c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 shutdown_connections 2024-05-08T18:08:49.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:08:49.472+0000 7f9ded509640 1 -- 172.21.15.114:0/1688789081 wait complete. 2024-05-08T18:08:49.504 DEBUG:tasks.rgw:Pools created 2024-05-08T18:08:49.504 INFO:tasks.rgw:Starting rgw... 2024-05-08T18:08:49.505 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-08T18:08:49.505 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-08T18:08:49.505 DEBUG:teuthology.orchestra.run.smithi114:> sudo echo -n http://smithi114.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-08T18:08:49.525 INFO:teuthology.orchestra.run.smithi114.stdout:http://smithi114.front.sepia.ceph.com:80 2024-05-08T18:08:49.525 DEBUG:teuthology.orchestra.run.smithi114:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-08T18:08:49.579 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-08T18:08:49.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-08T18:08:49.622 INFO:tasks.rgw.client.0:Started 2024-05-08T18:08:49.622 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi114.front.sepia.ceph.com:80/ 2024-05-08T18:08:49.623 DEBUG:teuthology.orchestra.run.smithi114:> curl http://smithi114.front.sepia.ceph.com:80/ 2024-05-08T18:08:49.658 INFO:teuthology.orchestra.run.smithi114.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:08:49.658 INFO:teuthology.orchestra.run.smithi114.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:08:49.662 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:08:49.663 INFO:teuthology.orchestra.run.smithi114.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:08:49.663 INFO:teuthology.orchestra.run.smithi114.stderr:curl: (7) Failed to connect to smithi114.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:08:50.664 DEBUG:teuthology.orchestra.run.smithi114:> curl http://smithi114.front.sepia.ceph.com:80/ 2024-05-08T18:08:50.675 INFO:teuthology.orchestra.run.smithi114.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:08:50.675 INFO:teuthology.orchestra.run.smithi114.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:08:50.675 INFO:teuthology.orchestra.run.smithi114.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:08:50.675 INFO:teuthology.orchestra.run.smithi114.stderr:curl: (7) Failed to connect to smithi114.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:08:50.676 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:08:52.677 DEBUG:teuthology.orchestra.run.smithi114:> curl http://smithi114.front.sepia.ceph.com:80/ 2024-05-08T18:08:52.689 INFO:teuthology.orchestra.run.smithi114.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:08:52.689 INFO:teuthology.orchestra.run.smithi114.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:08:52.689 INFO:teuthology.orchestra.run.smithi114.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:08:52.690 INFO:teuthology.orchestra.run.smithi114.stderr:curl: (7) Failed to connect to smithi114.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:08:52.690 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:08:56.692 DEBUG:teuthology.orchestra.run.smithi114:> curl http://smithi114.front.sepia.ceph.com:80/ 2024-05-08T18:08:56.703 INFO:teuthology.orchestra.run.smithi114.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:08:56.703 INFO:teuthology.orchestra.run.smithi114.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:08:56.703 INFO:teuthology.orchestra.run.smithi114.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T18:08:56.703 INFO:teuthology.orchestra.run.smithi114.stderr:curl: (7) Failed to connect to smithi114.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-05-08T18:08:56.704 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T18:09:04.705 DEBUG:teuthology.orchestra.run.smithi114:> curl http://smithi114.front.sepia.ceph.com:80/ 2024-05-08T18:09:04.716 INFO:teuthology.orchestra.run.smithi114.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T18:09:04.716 INFO:teuthology.orchestra.run.smithi114.stderr: Dload Upload Total Spent Left Speed 2024-05-08T18:09:04.720 INFO:teuthology.orchestra.run.smithi114.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 52220 0 --:--:-- --:--:-- --:--:-- 62333 2024-05-08T18:09:04.720 INFO:teuthology.orchestra.run.smithi114.stdout:anonymous 2024-05-08T18:09:04.721 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-08T18:09:04.807 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-08T18:09:04.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T18:09:04.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T18:09:04.807 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T18:09:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:04.844 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.843+0000 7f81abdc6980 1 Processor -- start 2024-05-08T18:09:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.843+0000 7f81abdc6980 1 -- start start 2024-05-08T18:09:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.843+0000 7f81abdc6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560a8d59c630 0x560a8d59ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.843+0000 7f81abdc6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a8d441710 con 0x560a8d509f80 2024-05-08T18:09:04.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.843+0000 7f81abdc6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560a8d455f00 con 0x560a8d59c630 2024-05-08T18:09:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a90d9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560a8d59c630 0x560a8d59ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a90d9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560a8d59c630 0x560a8d59ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51956/0 (socket says 172.21.15.114:51956) 2024-05-08T18:09:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a98da640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560a8d509f80 0x560a8d59af10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50878/0 (socket says 172.21.15.114:50878) 2024-05-08T18:09:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a90d9640 1 -- 172.21.15.114:0/116046884 learned_addr learned my addr 172.21.15.114:0/116046884 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a90d9640 1 -- 172.21.15.114:0/116046884 >> v1:172.21.15.53:6789/0 conn(0x560a8d509f80 legacy=0x560a8d59af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a90d9640 1 -- 172.21.15.114:0/116046884 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d41dae0 con 0x560a8d59c630 2024-05-08T18:09:04.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a90d9640 1 --2- 172.21.15.114:0/116046884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d59c630 0x560a8d59ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f819400a4e0 tx=0x7f819401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d4e15e12df08ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a88d8640 1 -- 172.21.15.114:0/116046884 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940aa540 con 0x560a8d59c630 2024-05-08T18:09:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a88d8640 1 -- 172.21.15.114:0/116046884 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81940aa6e0 con 0x560a8d59c630 2024-05-08T18:09:04.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.847+0000 7f81a88d8640 1 -- 172.21.15.114:0/116046884 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940aaa40 con 0x560a8d59c630 2024-05-08T18:09:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 -- 172.21.15.114:0/116046884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d59c630 msgr2=0x560a8d59ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 --2- 172.21.15.114:0/116046884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d59c630 0x560a8d59ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f819400a4e0 tx=0x7f819401b090 comp rx=0 tx=0).stop 2024-05-08T18:09:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 -- 172.21.15.114:0/116046884 shutdown_connections 2024-05-08T18:09:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 --2- 172.21.15.114:0/116046884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d59c630 0x560a8d59ea20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 -- 172.21.15.114:0/116046884 >> 172.21.15.114:0/116046884 conn(0x560a8d590630 msgr2=0x560a8d592a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:04.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 -- 172.21.15.114:0/116046884 shutdown_connections 2024-05-08T18:09:04.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.851+0000 7f81abdc6980 1 -- 172.21.15.114:0/116046884 wait complete. 2024-05-08T18:09:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 Processor -- start 2024-05-08T18:09:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- start start 2024-05-08T18:09:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d6831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a8d499f80 con 0x560a8d509f80 2024-05-08T18:09:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81a98da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d6831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81a98da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d6831e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51958/0 (socket says 172.21.15.114:51958) 2024-05-08T18:09:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81a98da640 1 -- 172.21.15.114:0/2950861041 learned_addr learned my addr 172.21.15.114:0/2950861041 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:04.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81a98da640 1 -- 172.21.15.114:0/2950861041 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d461da0 con 0x560a8d509f80 2024-05-08T18:09:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81a98da640 1 --2- 172.21.15.114:0/2950861041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d6831e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f819c001ec0 tx=0x7f819c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65296b8f700535fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f8097e07640 1 -- 172.21.15.114:0/2950861041 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819c00e5d0 con 0x560a8d509f80 2024-05-08T18:09:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f8097e07640 1 -- 172.21.15.114:0/2950861041 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819c00e770 con 0x560a8d509f80 2024-05-08T18:09:04.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f8097e07640 1 -- 172.21.15.114:0/2950861041 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819c00ea70 con 0x560a8d509f80 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- 172.21.15.114:0/2950861041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 msgr2=0x560a8d6831e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2950861041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d6831e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f819c001ec0 tx=0x7f819c00b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- 172.21.15.114:0/2950861041 shutdown_connections 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2950861041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d6831e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- 172.21.15.114:0/2950861041 >> 172.21.15.114:0/2950861041 conn(0x560a8d590630 msgr2=0x560a8d67ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- 172.21.15.114:0/2950861041 shutdown_connections 2024-05-08T18:09:04.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.867+0000 7f81abdc6980 1 -- 172.21.15.114:0/2950861041 wait complete. 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81abdc6980 1 Processor -- start 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81abdc6980 1 -- start start 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81abdc6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d68a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81abdc6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a8d5a1a20 con 0x560a8d509f80 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81a98da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d68a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81a98da640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d68a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51970/0 (socket says 172.21.15.114:51970) 2024-05-08T18:09:04.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81a98da640 1 -- 172.21.15.114:0/2847386394 learned_addr learned my addr 172.21.15.114:0/2847386394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81a98da640 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d68ab40 con 0x560a8d509f80 2024-05-08T18:09:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81a98da640 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d68a600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x560a8d684070 tx=0x7f819c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f8096604640 1 -- 172.21.15.114:0/2847386394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819c00f8a0 con 0x560a8d509f80 2024-05-08T18:09:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f8096604640 1 -- 172.21.15.114:0/2847386394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f819c00fa40 con 0x560a8d509f80 2024-05-08T18:09:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a8d68add0 con 0x560a8d509f80 2024-05-08T18:09:04.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f8096604640 1 -- 172.21.15.114:0/2847386394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f819c00fd20 con 0x560a8d509f80 2024-05-08T18:09:04.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8d68da60 con 0x560a8d509f80 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f8096604640 1 -- 172.21.15.114:0/2847386394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f819c017070 con 0x560a8d509f80 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.871+0000 7f8096604640 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8090038440 0x7f809003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f8096604640 1 -- 172.21.15.114:0/2847386394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f819c015020 con 0x560a8d509f80 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81a90d9640 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8090038440 0x7f809003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d59c630 0x560a8d691580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d691bf0 con 0x560a8d59c630 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d59c630 0x560a8d691580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81a90d9640 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8090038440 0x7f809003a900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81940ab000 tx=0x7f81940a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d59c630 0x560a8d691580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 -- 172.21.15.114:0/2847386394 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f81a40083f0 con 0x560a8d59c630 2024-05-08T18:09:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d68ec80 con 0x560a8d59c630 2024-05-08T18:09:04.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 -- 172.21.15.114:0/2847386394 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f81a40083f0 con 0x560a8d59c630 2024-05-08T18:09:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d693a10 con 0x560a8d59c630 2024-05-08T18:09:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 -- 172.21.15.114:0/2847386394 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f81a40083f0 con 0x560a8d59c630 2024-05-08T18:09:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d692b80 con 0x560a8d59c630 2024-05-08T18:09:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 -- 172.21.15.114:0/2847386394 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f81a40083f0 con 0x560a8d59c630 2024-05-08T18:09:04.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d692fd0 con 0x560a8d59c630 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81aa0db640 1 -- 172.21.15.114:0/2847386394 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f81a40083f0 con 0x560a8d59c630 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 Processor -- start 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- start start 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 0x560a8d6a2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81abdc6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a8d49dfc0 con 0x560a8d6a2340 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81a90d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 0x560a8d6a2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81a90d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 0x560a8d6a2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51976/0 (socket says 172.21.15.114:51976) 2024-05-08T18:09:04.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.875+0000 7f81a90d9640 1 -- 172.21.15.114:0/3540569255 learned_addr learned my addr 172.21.15.114:0/3540569255 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81a90d9640 1 -- 172.21.15.114:0/3540569255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d6a2ca0 con 0x560a8d6a2340 2024-05-08T18:09:04.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81a90d9640 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 0x560a8d6a2760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81940ac040 tx=0x7f8194017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f808f7fe640 1 -- 172.21.15.114:0/3540569255 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940c4020 con 0x560a8d6a2340 2024-05-08T18:09:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f808f7fe640 1 -- 172.21.15.114:0/3540569255 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81940c0560 con 0x560a8d6a2340 2024-05-08T18:09:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a8d6a3740 con 0x560a8d6a2340 2024-05-08T18:09:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f808f7fe640 1 -- 172.21.15.114:0/3540569255 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940b9030 con 0x560a8d6a2340 2024-05-08T18:09:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8d6a3bb0 con 0x560a8d6a2340 2024-05-08T18:09:04.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f808f7fe640 1 -- 172.21.15.114:0/3540569255 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f81940c7020 con 0x560a8d6a2340 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f808f7fe640 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80840383f0 0x7f808403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f808f7fe640 1 -- 172.21.15.114:0/3540569255 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f81940ba070 con 0x560a8d6a2340 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81aa0db640 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80840383f0 0x7f808403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81abdc6980 1 Processor -- start 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81abdc6980 1 -- start start 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81aa0db640 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80840383f0 0x7f808403a8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x560a8d6926a0 tx=0x7f81a4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81abdc6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81abdc6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a8d683930 con 0x560a8d6af390 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81a90d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81a90d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51978/0 (socket says 172.21.15.114:51978) 2024-05-08T18:09:04.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.879+0000 7f81a90d9640 1 -- 172.21.15.114:0/835084468 learned_addr learned my addr 172.21.15.114:0/835084468 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 -- 172.21.15.114:0/835084468 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d6afd80 con 0x560a8d6af390 2024-05-08T18:09:04.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 --2- 172.21.15.114:0/835084468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6af7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f81940e9a00 tx=0x7f81940b3a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafe4412ca58858e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f808d7fa640 1 -- 172.21.15.114:0/835084468 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940d6020 con 0x560a8d6af390 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f808d7fa640 1 -- 172.21.15.114:0/835084468 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81940b44d0 con 0x560a8d6af390 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f808d7fa640 1 -- 172.21.15.114:0/835084468 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940b3460 con 0x560a8d6af390 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/835084468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 msgr2=0x560a8d6af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 --2- 172.21.15.114:0/835084468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6af7b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f81940e9a00 tx=0x7f81940b3a80 comp rx=0 tx=0).stop 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/835084468 shutdown_connections 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 --2- 172.21.15.114:0/835084468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6af7b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/835084468 >> 172.21.15.114:0/835084468 conn(0x560a8d6ab720 msgr2=0x560a8d6a9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/835084468 shutdown_connections 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/835084468 wait complete. 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 Processor -- start 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- start start 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6b6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a8d6b0490 con 0x560a8d6af390 2024-05-08T18:09:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6b6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6b6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51982/0 (socket says 172.21.15.114:51982) 2024-05-08T18:09:04.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 learned_addr learned my addr 172.21.15.114:0/1461016296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a8d6b6e80 con 0x560a8d6af390 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81a90d9640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6b6940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81940b5b70 tx=0x7f81940e9990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f807b7fe640 1 -- 172.21.15.114:0/1461016296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940e2070 con 0x560a8d6af390 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f807b7fe640 1 -- 172.21.15.114:0/1461016296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8194005020 con 0x560a8d6af390 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a8d6b7110 con 0x560a8d6af390 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f807b7fe640 1 -- 172.21.15.114:0/1461016296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81940d6040 con 0x560a8d6af390 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.883+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a8d6b7520 con 0x560a8d6af390 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f807b7fe640 1 -- 172.21.15.114:0/1461016296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f81940f2060 con 0x560a8d6af390 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f807b7fe640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80740383f0 0x7f807403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f807b7fe640 1 -- 172.21.15.114:0/1461016296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f81940e40a0 con 0x560a8d6af390 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81aa0db640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80740383f0 0x7f807403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d6c1da0 0x560a8d6c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c4990 con 0x560a8d6c1da0 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d6c1da0 0x560a8d6c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81aa0db640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80740383f0 0x7f807403a8b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81a4008fd0 tx=0x7f81a401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d6c1da0 0x560a8d6c4240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 realm 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c4da0 con 0x560a8d6c1da0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c5670 con 0x560a8d6c1da0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c5a10 con 0x560a8d6c1da0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c52c0 con 0x560a8d6c1da0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 20 searching for the correct realm 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a8d6c7e30 0x560a8d6ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c7e30 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.887+0000 7f81a90d9640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a8d6c7e30 0x560a8d6ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a90d9640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a8d6c7e30 0x560a8d6ca220 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a90d9640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f81940f4070 0x7f81940c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81940f4070 2024-05-08T18:09:04.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81aa0db640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f81940f4070 0x7f81940c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81aa0db640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f81940f4070 0x7f81940c9400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81aa0db640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f81a4019040 0x7f81a4019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81a4019040 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f81a4019040 0x7f81a4019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f81a4019040 0x7f81a4019930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x7f81a4019040 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c1da0 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c1da0 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.891+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81a4019040 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x7f81a4019040 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81a4019040 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x7f81a4019040 2024-05-08T18:09:04.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81940f4070 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c7e30 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c1da0 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81a4019040 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x7f81a4019040 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c1da0 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x7f81940f4070 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c7e30 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ca8a0 con 0x560a8d6c7e30 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.895+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81a4019040 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x7f81a4019040 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c7e30 2024-05-08T18:09:04.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c7e30 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c1da0 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c1da0 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f819c02e070 con 0x560a8d6c1da0 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81a4019040 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c7e30 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81940f4070 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c1da0 2024-05-08T18:09:04.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81a4019040 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c7e30 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.899+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81a4019040 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81940f4070 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c7e30 2024-05-08T18:09:04.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81a4019040 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x560a8d6c1da0 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f8194104040 con 0x7f81940f4070 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:04.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c68d0 con 0x560a8d6c1da0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c7170 con 0x560a8d6c1da0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c6510 con 0x560a8d6c1da0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 zone default found 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 4 Realm: () 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 zonegroup default 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.903+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cb1d0 con 0x7f81a4019040 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ccc70 con 0x560a8d6c7e30 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cd100 con 0x560a8d6c7e30 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 started sync module instance, tier type = 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:04.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81940f4070 2024-05-08T18:09:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94603322377264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cda10 con 0x7f81940f4070 2024-05-08T18:09:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.907+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ce260 con 0x560a8d6c1da0 2024-05-08T18:09:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94603322377264] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94603322381664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cde30 con 0x560a8d6c1da0 2024-05-08T18:09:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6ce930 con 0x560a8d6c7e30 2024-05-08T18:09:04.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94603322381664] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94603322382720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cdda0 con 0x560a8d6c7e30 2024-05-08T18:09:04.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.911+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cf680 con 0x7f81940f4070 2024-05-08T18:09:04.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.915+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94603322382720] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.919+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.919+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94603322388016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cfa70 con 0x7f81940f4070 2024-05-08T18:09:04.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.919+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d0430 con 0x560a8d6c1da0 2024-05-08T18:09:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.919+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.919+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94603322392448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d03a0 con 0x560a8d6c1da0 2024-05-08T18:09:04.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.919+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d1350 con 0x7f81a4019040 2024-05-08T18:09:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.923+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94603322388016] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.923+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94603322392448] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.923+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.923+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94603322396224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d1310 con 0x7f81a4019040 2024-05-08T18:09:04.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.923+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d1740 con 0x7f81a4019040 2024-05-08T18:09:04.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.927+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94603322396224] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.927+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.927+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94603322394576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d1740 con 0x7f81a4019040 2024-05-08T18:09:04.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.927+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d2100 con 0x7f81a4019040 2024-05-08T18:09:04.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94603322394576] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94603322389168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d2100 con 0x7f81a4019040 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=0 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=1 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=2 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=3 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=4 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=5 2024-05-08T18:09:04.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=6 2024-05-08T18:09:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94603322389168] v30'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 20 add_watcher() i=7 2024-05-08T18:09:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:04.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.931+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d5500 con 0x560a8d6c1da0 2024-05-08T18:09:04.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94603322400288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d2a20 con 0x560a8d6c1da0 2024-05-08T18:09:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94603322400288] v30'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f805b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 5 note: GC not initialized 2024-05-08T18:09:04.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f805a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 20 Filter name: none 2024-05-08T18:09:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f7fcbfff640 20 reqs_thread_entry: start 2024-05-08T18:09:04.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6f8450 con 0x560a8d6c7e30 2024-05-08T18:09:04.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6f8450 con 0x560a8d6c7e30 2024-05-08T18:09:04.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.935+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6f8450 con 0x560a8d6c1da0 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c6510 con 0x560a8d6c1da0 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c6510 con 0x7f81940f4070 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c1da0 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81940f4070 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c1da0 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.939+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81940f4070 2024-05-08T18:09:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.943+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c1da0 2024-05-08T18:09:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c1da0 2024-05-08T18:09:04.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81940f4070 2024-05-08T18:09:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c1da0 2024-05-08T18:09:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81940f4070 2024-05-08T18:09:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.947+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81a4019040 2024-05-08T18:09:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c1da0 2024-05-08T18:09:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x560a8d6c7e30 2024-05-08T18:09:04.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc040 con 0x7f81940f4070 2024-05-08T18:09:04.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f805b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:04.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94603322400288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6c6510 con 0x560a8d6c1da0 2024-05-08T18:09:04.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94603322400288] v30'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.951+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94603322377264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6f8410 con 0x7f81940f4070 2024-05-08T18:09:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.955+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94603322377264] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.955+0000 7f81abdc6980 20 remove_watcher() i=0 2024-05-08T18:09:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.955+0000 7f81abdc6980 2 removed watcher, disabling cache 2024-05-08T18:09:04.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.955+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94603322381664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc430 con 0x560a8d6c1da0 2024-05-08T18:09:04.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.959+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94603322381664] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.959+0000 7f81abdc6980 20 remove_watcher() i=1 2024-05-08T18:09:04.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.959+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94603322382720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cc430 con 0x560a8d6c7e30 2024-05-08T18:09:04.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.959+0000 7f81a90d9640 1 -- 172.21.15.114:0/1461016296 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94603322382720] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81940d8030 con 0x560a8d6c7e30 2024-05-08T18:09:04.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.959+0000 7f81abdc6980 20 remove_watcher() i=2 2024-05-08T18:09:04.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.959+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94603322388016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6f8410 con 0x7f81940f4070 2024-05-08T18:09:04.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.963+0000 7f81aa0db640 1 -- 172.21.15.114:0/1461016296 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94603322388016] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f81a402f040 con 0x7f81940f4070 2024-05-08T18:09:04.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.963+0000 7f81abdc6980 20 remove_watcher() i=3 2024-05-08T18:09:04.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.963+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94603322392448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cee30 con 0x560a8d6c1da0 2024-05-08T18:09:04.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.963+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94603322392448] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x560a8d6c1da0 2024-05-08T18:09:04.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.963+0000 7f81abdc6980 20 remove_watcher() i=4 2024-05-08T18:09:04.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.963+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94603322396224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cee30 con 0x7f81a4019040 2024-05-08T18:09:04.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.967+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94603322396224] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.967+0000 7f81abdc6980 20 remove_watcher() i=5 2024-05-08T18:09:04.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.967+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94603322394576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6d0e40 con 0x7f81a4019040 2024-05-08T18:09:04.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94603322394576] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 20 remove_watcher() i=6 2024-05-08T18:09:04.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94603322389168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560a8d6cee30 con 0x7f81a4019040 2024-05-08T18:09:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94603322389168] v30'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f819c055040 con 0x7f81a4019040 2024-05-08T18:09:04.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 20 remove_watcher() i=7 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f81a4019040 msgr2=0x7f81a4019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f81a4019040 0x7f81a4019930 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d6c1da0 msgr2=0x560a8d6c4240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d6c1da0 0x560a8d6c4240 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f81940f4070 msgr2=0x7f81940c9400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f81940f4070 0x7f81940c9400 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a8d6c7e30 msgr2=0x560a8d6ca220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a8d6c7e30 0x560a8d6ca220 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80740383f0 msgr2=0x7f807403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80740383f0 0x7f807403a8b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f81a4008fd0 tx=0x7f81a401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 msgr2=0x560a8d6b6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6b6940 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81940b5b70 tx=0x7f81940e9990 comp rx=0 tx=0).stop 2024-05-08T18:09:04.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81a98da640 1 -- 172.21.15.114:0/1461016296 reap_dead start 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 shutdown_connections 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 --2- 172.21.15.114:0/1461016296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6af390 0x560a8d6b6940 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 >> 172.21.15.114:0/1461016296 conn(0x560a8d6ab720 msgr2=0x560a8d6a8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 shutdown_connections 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.971+0000 7f81abdc6980 1 -- 172.21.15.114:0/1461016296 wait complete. 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80840383f0 msgr2=0x7f808403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80840383f0 0x7f808403a8b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x560a8d6926a0 tx=0x7f81a4003070 comp rx=0 tx=0).stop 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 msgr2=0x560a8d6a2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 0x560a8d6a2760 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81940ac040 tx=0x7f8194017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 shutdown_connections 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f80840383f0 0x7f808403a8b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/3540569255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d6a2340 0x560a8d6a2760 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 >> 172.21.15.114:0/3540569255 conn(0x560a8d697150 msgr2=0x560a8d697c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 shutdown_connections 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/3540569255 wait complete. 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d59c630 msgr2=0x560a8d691580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d59c630 0x560a8d691580 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8090038440 msgr2=0x7f809003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8090038440 0x7f809003a900 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f81940ab000 tx=0x7f81940a5000 comp rx=0 tx=0).stop 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 msgr2=0x560a8d68a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d68a600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x560a8d684070 tx=0x7f819c000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 shutdown_connections 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a8d59c630 0x560a8d691580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8090038440 0x7f809003a900 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 --2- 172.21.15.114:0/2847386394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a8d509f80 0x560a8d68a600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 >> 172.21.15.114:0/2847386394 conn(0x560a8d590630 msgr2=0x560a8d67d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 shutdown_connections 2024-05-08T18:09:04.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:04.975+0000 7f81abdc6980 1 -- 172.21.15.114:0/2847386394 wait complete. 2024-05-08T18:09:04.986 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-05-08T18:09:04.986 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:09:04.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-08T18:09:04.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-08T18:09:04.987 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-08T18:09:05.064 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:05.065 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:05.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa113848980 1 Processor -- start 2024-05-08T18:09:05.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa113848980 1 -- start start 2024-05-08T18:09:05.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa113848980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564312c9b840 0x564312c99e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa113848980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564312bd0710 con 0x564312c9a380 2024-05-08T18:09:05.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa113848980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564312be4f00 con 0x564312c9b840 2024-05-08T18:09:05.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa11135c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564312c9b840 0x564312c99e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa11135c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564312c9b840 0x564312c99e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51990/0 (socket says 172.21.15.114:51990) 2024-05-08T18:09:05.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa11135c640 1 -- 172.21.15.114:0/3814899522 learned_addr learned my addr 172.21.15.114:0/3814899522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa11135c640 1 -- 172.21.15.114:0/3814899522 >> v1:172.21.15.53:6789/0 conn(0x564312c9a380 legacy=0x564312d2cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa11135c640 1 -- 172.21.15.114:0/3814899522 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312bacae0 con 0x564312c9b840 2024-05-08T18:09:05.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.067+0000 7fa11135c640 1 --2- 172.21.15.114:0/3814899522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9b840 0x564312c99e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa10400a5c0 tx=0x7fa10401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88220b2d45919930 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa103fff640 1 -- 172.21.15.114:0/3814899522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040a6070 con 0x564312c9b840 2024-05-08T18:09:05.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa103fff640 1 -- 172.21.15.114:0/3814899522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1040af070 con 0x564312c9b840 2024-05-08T18:09:05.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa103fff640 1 -- 172.21.15.114:0/3814899522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040aa5c0 con 0x564312c9b840 2024-05-08T18:09:05.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 -- 172.21.15.114:0/3814899522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9b840 msgr2=0x564312c99e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 --2- 172.21.15.114:0/3814899522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9b840 0x564312c99e40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa10400a5c0 tx=0x7fa10401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:05.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 -- 172.21.15.114:0/3814899522 shutdown_connections 2024-05-08T18:09:05.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 --2- 172.21.15.114:0/3814899522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9b840 0x564312c99e40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 -- 172.21.15.114:0/3814899522 >> 172.21.15.114:0/3814899522 conn(0x564312d207d0 msgr2=0x564312d22bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 -- 172.21.15.114:0/3814899522 shutdown_connections 2024-05-08T18:09:05.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.071+0000 7fa113848980 1 -- 172.21.15.114:0/3814899522 wait complete. 2024-05-08T18:09:05.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 Processor -- start 2024-05-08T18:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- start start 2024-05-08T18:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e12820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564312c28f80 con 0x564312c9a380 2024-05-08T18:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa11135c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e12820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa11135c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e12820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:51992/0 (socket says 172.21.15.114:51992) 2024-05-08T18:09:05.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa11135c640 1 -- 172.21.15.114:0/945036603 learned_addr learned my addr 172.21.15.114:0/945036603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa11135c640 1 -- 172.21.15.114:0/945036603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312bf0da0 con 0x564312c9a380 2024-05-08T18:09:05.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa11135c640 1 --2- 172.21.15.114:0/945036603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e12820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1040199f0 tx=0x7fa104003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711c79da44994ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7f9fff606640 1 -- 172.21.15.114:0/945036603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040aaa00 con 0x564312c9a380 2024-05-08T18:09:05.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7f9fff606640 1 -- 172.21.15.114:0/945036603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1040aaba0 con 0x564312c9a380 2024-05-08T18:09:05.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7f9fff606640 1 -- 172.21.15.114:0/945036603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040bd3f0 con 0x564312c9a380 2024-05-08T18:09:05.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- 172.21.15.114:0/945036603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 msgr2=0x564312e12820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 --2- 172.21.15.114:0/945036603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e12820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1040199f0 tx=0x7fa104003030 comp rx=0 tx=0).stop 2024-05-08T18:09:05.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- 172.21.15.114:0/945036603 shutdown_connections 2024-05-08T18:09:05.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 --2- 172.21.15.114:0/945036603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e12820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- 172.21.15.114:0/945036603 >> 172.21.15.114:0/945036603 conn(0x564312d207d0 msgr2=0x564312e0e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- 172.21.15.114:0/945036603 shutdown_connections 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- 172.21.15.114:0/945036603 wait complete. 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 Processor -- start 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- start start 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e19b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa113848980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564312d31080 con 0x564312c9a380 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.087+0000 7fa11135c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e19b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa11135c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e19b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52004/0 (socket says 172.21.15.114:52004) 2024-05-08T18:09:05.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa11135c640 1 -- 172.21.15.114:0/361113210 learned_addr learned my addr 172.21.15.114:0/361113210 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa11135c640 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312e1a080 con 0x564312c9a380 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa11135c640 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e19b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa10401b170 tx=0x7fa1040180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7f9ffde03640 1 -- 172.21.15.114:0/361113210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040bd7c0 con 0x564312c9a380 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7f9ffde03640 1 -- 172.21.15.114:0/361113210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1040bd960 con 0x564312c9a380 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564312e1a310 con 0x564312c9a380 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7f9ffde03640 1 -- 172.21.15.114:0/361113210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1040bdc40 con 0x564312c9a380 2024-05-08T18:09:05.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564312e1cfa0 con 0x564312c9a380 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7f9ffde03640 1 -- 172.21.15.114:0/361113210 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa1040ce020 con 0x564312c9a380 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7f9ffde03640 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9ff80383f0 0x7f9ff803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7f9ffde03640 1 -- 172.21.15.114:0/361113210 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fa1040cc020 con 0x564312c9a380 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa110b5b640 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9ff80383f0 0x7f9ff803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312c9b840 0x564312e20bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e21130 con 0x564312c9b840 2024-05-08T18:09:05.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa111b5d640 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312c9b840 0x564312e20bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa110b5b640 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9ff80383f0 0x7f9ff803a8b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa108001e60 tx=0x7fa1080013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.091+0000 7fa111b5d640 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312c9b840 0x564312e20bf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa111b5d640 1 -- 172.21.15.114:0/361113210 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa10c00a4d0 con 0x564312c9b840 2024-05-08T18:09:05.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e1e1c0 con 0x564312c9b840 2024-05-08T18:09:05.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa111b5d640 1 -- 172.21.15.114:0/361113210 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa10c00a4d0 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e22f10 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa111b5d640 1 -- 172.21.15.114:0/361113210 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa10c00a4d0 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e22140 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa111b5d640 1 -- 172.21.15.114:0/361113210 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa10c00a4d0 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e22560 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa111b5d640 1 -- 172.21.15.114:0/361113210 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa10c00a4d0 con 0x564312c9b840 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 Processor -- start 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- start start 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 0x564312e31cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564312c2cfc0 con 0x564312e31890 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa110b5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 0x564312e31cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa110b5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 0x564312e31cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52014/0 (socket says 172.21.15.114:52014) 2024-05-08T18:09:05.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa110b5b640 1 -- 172.21.15.114:0/3367390748 learned_addr learned my addr 172.21.15.114:0/3367390748 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa110b5b640 1 -- 172.21.15.114:0/3367390748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312e321f0 con 0x564312e31890 2024-05-08T18:09:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa110b5b640 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 0x564312e31cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa108010f90 tx=0x7fa10800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7f9ff6ffd640 1 -- 172.21.15.114:0/3367390748 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10800a040 con 0x564312e31890 2024-05-08T18:09:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7f9ff6ffd640 1 -- 172.21.15.114:0/3367390748 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa108017050 con 0x564312e31890 2024-05-08T18:09:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7f9ff6ffd640 1 -- 172.21.15.114:0/3367390748 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10800e7e0 con 0x564312e31890 2024-05-08T18:09:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564312e32c90 con 0x564312e31890 2024-05-08T18:09:05.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.095+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564312e33160 con 0x564312e31890 2024-05-08T18:09:05.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7f9ff6ffd640 1 -- 172.21.15.114:0/3367390748 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa10800e9d0 con 0x564312e31890 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7f9ff6ffd640 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fe8038440 0x7f9fe803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7f9ff6ffd640 1 -- 172.21.15.114:0/3367390748 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fa1080506c0 con 0x564312e31890 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fe8038440 0x7f9fe803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa113848980 1 Processor -- start 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa113848980 1 -- start start 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fe8038440 0x7f9fe803a900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x564312e224e0 tx=0x7fa10c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa113848980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e3eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa113848980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564312e12eb0 con 0x564312e3eab0 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa110b5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e3eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa110b5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e3eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52018/0 (socket says 172.21.15.114:52018) 2024-05-08T18:09:05.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa110b5b640 1 -- 172.21.15.114:0/1691047589 learned_addr learned my addr 172.21.15.114:0/1691047589 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa110b5b640 1 -- 172.21.15.114:0/1691047589 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312e3f4a0 con 0x564312e3eab0 2024-05-08T18:09:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7fa110b5b640 1 --2- 172.21.15.114:0/1691047589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e3eed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa10801cfd0 tx=0x7fa10804ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745a112238cf5b11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7f9ff4ff9640 1 -- 172.21.15.114:0/1691047589 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa108043070 con 0x564312e3eab0 2024-05-08T18:09:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7f9ff4ff9640 1 -- 172.21.15.114:0/1691047589 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10800ecc0 con 0x564312e3eab0 2024-05-08T18:09:05.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.099+0000 7f9ff4ff9640 1 -- 172.21.15.114:0/1691047589 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa10801a310 con 0x564312e3eab0 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/1691047589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 msgr2=0x564312e3eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 --2- 172.21.15.114:0/1691047589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e3eed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa10801cfd0 tx=0x7fa10804ef20 comp rx=0 tx=0).stop 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/1691047589 shutdown_connections 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 --2- 172.21.15.114:0/1691047589 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e3eed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/1691047589 >> 172.21.15.114:0/1691047589 conn(0x564312e3ae40 msgr2=0x564312e38ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/1691047589 shutdown_connections 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/1691047589 wait complete. 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 Processor -- start 2024-05-08T18:09:05.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- start start 2024-05-08T18:09:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e46060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564312e3fbf0 con 0x564312e3eab0 2024-05-08T18:09:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa110b5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e46060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa110b5b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e46060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52034/0 (socket says 172.21.15.114:52034) 2024-05-08T18:09:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 learned_addr learned my addr 172.21.15.114:0/3913291781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564312e465a0 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa110b5b640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e46060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa10804d930 tx=0x7fa10804e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7f9fe6ffd640 1 -- 172.21.15.114:0/3913291781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa108034070 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564312e46830 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7f9fe6ffd640 1 -- 172.21.15.114:0/3913291781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa108044040 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7f9fe6ffd640 1 -- 172.21.15.114:0/3913291781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa108043070 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564312e49510 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7f9fe6ffd640 1 -- 172.21.15.114:0/3913291781 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa108037070 con 0x564312e3eab0 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.103+0000 7f9fe6ffd640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fdc0383a0 0x7f9fdc03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7f9fe6ffd640 1 -- 172.21.15.114:0/3913291781 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fa10803aca0 con 0x564312e3eab0 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fdc0383a0 0x7f9fdc03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312e51550 0x564312e53a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e54160 con 0x564312e51550 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312e51550 0x564312e53a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fdc0383a0 0x7f9fdc03a860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x564312e21c60 tx=0x7fa10c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312e51550 0x564312e53a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 realm 2024-05-08T18:09:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e54570 con 0x564312e51550 2024-05-08T18:09:05.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e54e40 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e551e0 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e55a30 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:05.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 20 searching for the correct realm 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564312e577a0 0x564312e59b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e577a0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa110b5b640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564312e577a0 0x564312e59b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa110b5b640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564312e577a0 0x564312e59b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa110b5b640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa108039060 0x7fa10804d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa108039060 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa108039060 0x7fa10804d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.107+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa108039060 0x7fa10804d290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c01f070 con 0x7fa108039060 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa111b5d640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa10c031040 0x7fa10c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa10c031040 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa10c031040 0x7fa10c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa10c031040 0x7fa10c032940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e51550 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e51550 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa10c031040 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa10c031040 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa108039060 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c01f070 con 0x7fa108039060 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.111+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e577a0 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e51550 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa10c031040 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e51550 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa108039060 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa10c01f070 con 0x7fa108039060 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e577a0 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e577a0 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x7fa10c031040 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e577a0 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e577a0 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564312e5a0d0 con 0x564312e51550 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.115+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x564312e51550 2024-05-08T18:09:05.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa10c031040 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x564312e577a0 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa108039060 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c01f070 con 0x7fa108039060 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x564312e51550 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa10c031040 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x564312e577a0 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa10c031040 2024-05-08T18:09:05.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa108039060 2024-05-08T18:09:05.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c01f070 con 0x7fa108039060 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.119+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x564312e577a0 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa10c031040 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x564312e51550 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fa1040f3040 con 0x7fa108039060 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa10c01f070 con 0x7fa108039060 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:05.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e56280 con 0x564312e51550 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e56670 con 0x564312e51550 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e56670 con 0x564312e51550 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:05.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 zone default found 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 4 Realm: () 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 zonegroup default 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e55ee0 con 0x7fa10c031040 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e55ee0 con 0x564312e577a0 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e5bff0 con 0x564312e577a0 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 started sync module instance, tier type = 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.123+0000 7fa113848980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.127+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5b380 con 0x7fa108039060 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.127+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.127+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846079842160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5afe0 con 0x7fa108039060 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.127+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5cf20 con 0x564312e51550 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.127+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.127+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846079847024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5d340 con 0x564312e51550 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.131+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5ddb0 con 0x564312e577a0 2024-05-08T18:09:05.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.131+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846079842160] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.131+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846079847024] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.131+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.131+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846079845456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5d340 con 0x564312e577a0 2024-05-08T18:09:05.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.131+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5e650 con 0x7fa108039060 2024-05-08T18:09:05.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.135+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846079845456] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.135+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.135+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846079852960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5ea70 con 0x7fa108039060 2024-05-08T18:09:05.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.135+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5f300 con 0x564312e51550 2024-05-08T18:09:05.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846079855216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5ee90 con 0x564312e51550 2024-05-08T18:09:05.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e601c0 con 0x7fa10c031040 2024-05-08T18:09:05.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846079859984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e60130 con 0x7fa10c031040 2024-05-08T18:09:05.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e610c0 con 0x7fa10c031040 2024-05-08T18:09:05.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.139+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846079852960] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.143+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846079859984] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.143+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846079855216] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846079862192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5f6c0 con 0x7fa10c031040 2024-05-08T18:09:05.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e61080 con 0x7fa10c031040 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846079863760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e614a0 con 0x7fa10c031040 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=0 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=1 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=2 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=3 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=4 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=5 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846079862192] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.147+0000 7fa113848980 20 add_watcher() i=6 2024-05-08T18:09:05.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846079863760] v30'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa113848980 20 add_watcher() i=7 2024-05-08T18:09:05.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa113848980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:05.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e614a0 con 0x564312e51550 2024-05-08T18:09:05.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846079864816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e61410 con 0x564312e51550 2024-05-08T18:09:05.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846079864816] v30'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7f9fc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa113848980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:05.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.151+0000 7fa113848980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:05.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.155+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ce70 con 0x564312e51550 2024-05-08T18:09:05.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.155+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.155+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6d4c0 con 0x7fa10c031040 2024-05-08T18:09:05.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.159+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.159+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6d4c0 con 0x564312e577a0 2024-05-08T18:09:05.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.159+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.159+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6d860 con 0x564312e51550 2024-05-08T18:09:05.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.167+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.167+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6c6d0 con 0x7fa108039060 2024-05-08T18:09:05.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.167+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.167+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6c6d0 con 0x564312e577a0 2024-05-08T18:09:05.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.171+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.171+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6e130 con 0x564312e51550 2024-05-08T18:09:05.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.171+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.171+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6e130 con 0x7fa10c031040 2024-05-08T18:09:05.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.175+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.175+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6e130 con 0x7fa108039060 2024-05-08T18:09:05.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.179+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.179+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6e6a0 con 0x564312e577a0 2024-05-08T18:09:05.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.179+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.179+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ea60 con 0x7fa108039060 2024-05-08T18:09:05.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.183+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.183+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ee70 con 0x7fa10c031040 2024-05-08T18:09:05.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.187+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.187+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ee70 con 0x7fa108039060 2024-05-08T18:09:05.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.187+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.187+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ee70 con 0x7fa10c031040 2024-05-08T18:09:05.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.191+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.191+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef00 con 0x564312e51550 2024-05-08T18:09:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.191+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.191+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef00 con 0x564312e577a0 2024-05-08T18:09:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.195+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.195+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x7fa108039060 2024-05-08T18:09:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.199+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.199+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.203+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.203+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e51550 2024-05-08T18:09:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.203+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.203+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e51550 2024-05-08T18:09:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.207+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.207+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.207+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.207+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x7fa108039060 2024-05-08T18:09:05.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.211+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.211+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.211+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.211+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.215+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.215+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.215+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.215+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.219+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.219+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x7fa10c031040 2024-05-08T18:09:05.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.219+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.219+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x564312e577a0 2024-05-08T18:09:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.223+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.223+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6efc0 con 0x7fa10c031040 2024-05-08T18:09:05.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.223+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.223+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6efc0 con 0x564312e577a0 2024-05-08T18:09:05.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.227+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.227+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x7fa10c031040 2024-05-08T18:09:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e6ef90 con 0x7fa108039060 2024-05-08T18:09:05.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7f9fc6fe5640 20 reqs_thread_entry: start 2024-05-08T18:09:05.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa113848980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa113848980 20 Filter name: none 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7f9fc4fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa113848980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa113848980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.231+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564312e8a670 con 0x7fa108039060 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa113848980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa113848980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa113848980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:09:05.234 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:09:05.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7f9fc7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846079864816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e67b10 con 0x564312e51550 2024-05-08T18:09:05.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94846079864816] v30'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.235+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846079842160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e60ff0 con 0x7fa108039060 2024-05-08T18:09:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94846079842160] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa113848980 20 remove_watcher() i=0 2024-05-08T18:09:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa113848980 2 removed watcher, disabling cache 2024-05-08T18:09:05.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846079847024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e60ff0 con 0x564312e51550 2024-05-08T18:09:05.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94846079847024] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa113848980 20 remove_watcher() i=1 2024-05-08T18:09:05.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.239+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846079845456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5ca70 con 0x564312e577a0 2024-05-08T18:09:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.243+0000 7fa110b5b640 1 -- 172.21.15.114:0/3913291781 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94846079845456] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa108036030 con 0x564312e577a0 2024-05-08T18:09:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.243+0000 7fa113848980 20 remove_watcher() i=2 2024-05-08T18:09:05.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.243+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846079852960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e60ff0 con 0x7fa108039060 2024-05-08T18:09:05.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.247+0000 7fa111b5d640 1 -- 172.21.15.114:0/3913291781 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94846079852960] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa10c040040 con 0x7fa108039060 2024-05-08T18:09:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.247+0000 7fa113848980 20 remove_watcher() i=3 2024-05-08T18:09:05.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.247+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846079855216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5c450 con 0x564312e51550 2024-05-08T18:09:05.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.247+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94846079855216] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x564312e51550 2024-05-08T18:09:05.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.247+0000 7fa113848980 20 remove_watcher() i=4 2024-05-08T18:09:05.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.247+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846079859984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5ca70 con 0x7fa10c031040 2024-05-08T18:09:05.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.251+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94846079859984] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.251+0000 7fa113848980 20 remove_watcher() i=5 2024-05-08T18:09:05.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.251+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846079862192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e5e1a0 con 0x7fa10c031040 2024-05-08T18:09:05.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.255+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94846079862192] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.255+0000 7fa113848980 20 remove_watcher() i=6 2024-05-08T18:09:05.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.255+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846079863760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564312e60ff0 con 0x7fa10c031040 2024-05-08T18:09:05.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.255+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94846079863760] v30'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa1040c5d00 con 0x7fa10c031040 2024-05-08T18:09:05.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.255+0000 7fa113848980 20 remove_watcher() i=7 2024-05-08T18:09:05.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa10c031040 msgr2=0x7fa10c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa10c031040 0x7fa10c032940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312e51550 msgr2=0x564312e53a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312e51550 0x564312e53a10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa108039060 msgr2=0x7fa10804d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa108039060 0x7fa10804d290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564312e577a0 msgr2=0x564312e59b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564312e577a0 0x564312e59b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fdc0383a0 msgr2=0x7f9fdc03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fdc0383a0 0x7f9fdc03a860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x564312e21c60 tx=0x7fa10c01f000 comp rx=0 tx=0).stop 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 msgr2=0x564312e46060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e46060 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa10804d930 tx=0x7fa10804e9a0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 shutdown_connections 2024-05-08T18:09:05.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa10c031040 0x7fa10c032940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa108039060 0x7fa10804d290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564312e577a0 0x564312e59b90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312e51550 0x564312e53a10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fdc0383a0 0x7f9fdc03a860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3913291781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e3eab0 0x564312e46060 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 >> 172.21.15.114:0/3913291781 conn(0x564312e3ae40 msgr2=0x564312e40310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa11135c640 1 -- 172.21.15.114:0/3913291781 reap_dead start 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 shutdown_connections 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3913291781 wait complete. 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fe8038440 msgr2=0x7f9fe803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fe8038440 0x7f9fe803a900 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x564312e224e0 tx=0x7fa10c005850 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 msgr2=0x564312e31cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 0x564312e31cb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa108010f90 tx=0x7fa10800f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 shutdown_connections 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9fe8038440 0x7f9fe803a900 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/3367390748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312e31890 0x564312e31cb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 >> 172.21.15.114:0/3367390748 conn(0x564312e266a0 msgr2=0x564312e271b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 shutdown_connections 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/3367390748 wait complete. 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312c9b840 msgr2=0x564312e20bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312c9b840 0x564312e20bf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9ff80383f0 msgr2=0x7f9ff803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9ff80383f0 0x7f9ff803a8b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa108001e60 tx=0x7fa1080013e0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 msgr2=0x564312e19b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e19b40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa10401b170 tx=0x7fa1040180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 shutdown_connections 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564312c9b840 0x564312e20bf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f9ff80383f0 0x7f9ff803a8b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 --2- 172.21.15.114:0/361113210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564312c9a380 0x564312e19b40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 >> 172.21.15.114:0/361113210 conn(0x564312d207d0 msgr2=0x564312e0cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 shutdown_connections 2024-05-08T18:09:05.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.259+0000 7fa113848980 1 -- 172.21.15.114:0/361113210 wait complete. 2024-05-08T18:09:05.271 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:09:05.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-08T18:09:05.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-08T18:09:05.272 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-08T18:09:05.353 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:05.353 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:05.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3f10a5980 1 Processor -- start 2024-05-08T18:09:05.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3f10a5980 1 -- start start 2024-05-08T18:09:05.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3f10a5980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b08fa33640 0x55b08fa35a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3f10a5980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b08f8d8710 con 0x55b08f9a0f90 2024-05-08T18:09:05.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3f10a5980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b08f8ecf00 con 0x55b08fa33640 2024-05-08T18:09:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3ee3b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b08fa33640 0x55b08fa35a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3ee3b8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b08fa33640 0x55b08fa35a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52038/0 (socket says 172.21.15.114:52038) 2024-05-08T18:09:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/440947847 learned_addr learned my addr 172.21.15.114:0/440947847 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/440947847 >> v1:172.21.15.53:6789/0 conn(0x55b08f9a0f90 legacy=0x55b08fa31f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.355+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/440947847 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08f8b4ae0 con 0x55b08fa33640 2024-05-08T18:09:05.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/440947847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fa33640 0x55b08fa35a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800a5c0 tx=0x7fe3d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601ac4fbfa8b4e05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3edbb7640 1 -- 172.21.15.114:0/440947847 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80a6070 con 0x55b08fa33640 2024-05-08T18:09:05.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3edbb7640 1 -- 172.21.15.114:0/440947847 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d80af070 con 0x55b08fa33640 2024-05-08T18:09:05.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3edbb7640 1 -- 172.21.15.114:0/440947847 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80aa5c0 con 0x55b08fa33640 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 -- 172.21.15.114:0/440947847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fa33640 msgr2=0x55b08fa35a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/440947847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fa33640 0x55b08fa35a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3d800a5c0 tx=0x7fe3d801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 -- 172.21.15.114:0/440947847 shutdown_connections 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/440947847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fa33640 0x55b08fa35a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 -- 172.21.15.114:0/440947847 >> 172.21.15.114:0/440947847 conn(0x55b08fa27640 msgr2=0x55b08fa29a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 -- 172.21.15.114:0/440947847 shutdown_connections 2024-05-08T18:09:05.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.359+0000 7fe3f10a5980 1 -- 172.21.15.114:0/440947847 wait complete. 2024-05-08T18:09:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 Processor -- start 2024-05-08T18:09:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- start start 2024-05-08T18:09:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb1a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b08f930f80 con 0x55b08f9a0f90 2024-05-08T18:09:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3eebb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb1a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3eebb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb1a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52042/0 (socket says 172.21.15.114:52042) 2024-05-08T18:09:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3eebb9640 1 -- 172.21.15.114:0/3204970249 learned_addr learned my addr 172.21.15.114:0/3204970249 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3eebb9640 1 -- 172.21.15.114:0/3204970249 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08f8f8da0 con 0x55b08f9a0f90 2024-05-08T18:09:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3eebb9640 1 --2- 172.21.15.114:0/3204970249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb1a1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0001690 tx=0x7fe3e0001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a2720999532a5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe2dce09640 1 -- 172.21.15.114:0/3204970249 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0016070 con 0x55b08f9a0f90 2024-05-08T18:09:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe2dce09640 1 -- 172.21.15.114:0/3204970249 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e000f640 con 0x55b08f9a0f90 2024-05-08T18:09:05.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe2dce09640 1 -- 172.21.15.114:0/3204970249 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e000f960 con 0x55b08f9a0f90 2024-05-08T18:09:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- 172.21.15.114:0/3204970249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 msgr2=0x55b08fb1a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/3204970249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb1a1f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0001690 tx=0x7fe3e0001b50 comp rx=0 tx=0).stop 2024-05-08T18:09:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- 172.21.15.114:0/3204970249 shutdown_connections 2024-05-08T18:09:05.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/3204970249 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb1a1f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- 172.21.15.114:0/3204970249 >> 172.21.15.114:0/3204970249 conn(0x55b08fa27640 msgr2=0x55b08fb15d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- 172.21.15.114:0/3204970249 shutdown_connections 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- 172.21.15.114:0/3204970249 wait complete. 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 Processor -- start 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- start start 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb21630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.375+0000 7fe3f10a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b08fa38a30 con 0x55b08f9a0f90 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3eebb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb21630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3eebb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb21630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52054/0 (socket says 172.21.15.114:52054) 2024-05-08T18:09:05.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3eebb9640 1 -- 172.21.15.114:0/760906940 learned_addr learned my addr 172.21.15.114:0/760906940 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3eebb9640 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08fb21b70 con 0x55b08f9a0f90 2024-05-08T18:09:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3eebb9640 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb21630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000f610 tx=0x7fe3e0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe2db606640 1 -- 172.21.15.114:0/760906940 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0021020 con 0x55b08f9a0f90 2024-05-08T18:09:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe2db606640 1 -- 172.21.15.114:0/760906940 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3e00116c0 con 0x55b08f9a0f90 2024-05-08T18:09:05.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b08fb21e00 con 0x55b08f9a0f90 2024-05-08T18:09:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe2db606640 1 -- 172.21.15.114:0/760906940 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3e0016040 con 0x55b08f9a0f90 2024-05-08T18:09:05.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b08fb24a90 con 0x55b08f9a0f90 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe2db606640 1 -- 172.21.15.114:0/760906940 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe3e0024020 con 0x55b08f9a0f90 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe2db606640 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2d40383f0 0x7fe2d403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe2db606640 1 -- 172.21.15.114:0/760906940 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fe3e004e1a0 con 0x55b08f9a0f90 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2d40383f0 0x7fe2d403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fa33640 0x55b08fb285b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb28c20 con 0x55b08fa33640 2024-05-08T18:09:05.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fa33640 0x55b08fb285b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2d40383f0 0x7fe2d403a8b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ae000 tx=0x7fe3d80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fa33640 0x55b08fb285b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.379+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/760906940 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3e80083f0 con 0x55b08fa33640 2024-05-08T18:09:05.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb25cb0 con 0x55b08fa33640 2024-05-08T18:09:05.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/760906940 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3e80083f0 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb2aa60 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/760906940 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3e80083f0 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb29bd0 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/760906940 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3e80083f0 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb2a020 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/760906940 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe3e80083f0 con 0x55b08fa33640 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 Processor -- start 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- start start 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 0x55b08fb397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b08f934fc0 con 0x55b08fb39390 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ee3b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 0x55b08fb397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ee3b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 0x55b08fb397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52060/0 (socket says 172.21.15.114:52060) 2024-05-08T18:09:05.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/579604899 learned_addr learned my addr 172.21.15.114:0/579604899 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/579604899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08fb39cf0 con 0x55b08fb39390 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 0x55b08fb397b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ac040 tx=0x7fe3d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe2d8e01640 1 -- 172.21.15.114:0/579604899 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80b3b90 con 0x55b08fb39390 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b08fb3a790 con 0x55b08fb39390 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe2d8e01640 1 -- 172.21.15.114:0/579604899 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d80b3d30 con 0x55b08fb39390 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe2d8e01640 1 -- 172.21.15.114:0/579604899 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80c8560 con 0x55b08fb39390 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.383+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b08fb3ac00 con 0x55b08fb39390 2024-05-08T18:09:05.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe2d8e01640 1 -- 172.21.15.114:0/579604899 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe3d80c8700 con 0x55b08fb39390 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe2d8e01640 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2c80383f0 0x7fe2c803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe2d8e01640 1 -- 172.21.15.114:0/579604899 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fe3d80ec1e0 con 0x55b08fb39390 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2c80383f0 0x7fe2c803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 Processor -- start 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- start start 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2c80383f0 0x7fe2c803a8b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55b08fb296f0 tx=0x7fe3e8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb46880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b08fb1a940 con 0x55b08fb46460 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ee3b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb46880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ee3b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb46880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52064/0 (socket says 172.21.15.114:52064) 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1978010176 learned_addr learned my addr 172.21.15.114:0/1978010176 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1978010176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08fb46e50 con 0x55b08fb46460 2024-05-08T18:09:05.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/1978010176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb46880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80bdd90 tx=0x7fe3d80e3f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638ec320551f759d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe2d27fc640 1 -- 172.21.15.114:0/1978010176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80bde00 con 0x55b08fb46460 2024-05-08T18:09:05.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe2d27fc640 1 -- 172.21.15.114:0/1978010176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d80be410 con 0x55b08fb46460 2024-05-08T18:09:05.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe2d27fc640 1 -- 172.21.15.114:0/1978010176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80bd390 con 0x55b08fb46460 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1978010176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 msgr2=0x55b08fb46880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1978010176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb46880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80bdd90 tx=0x7fe3d80e3f50 comp rx=0 tx=0).stop 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1978010176 shutdown_connections 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1978010176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb46880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1978010176 >> 172.21.15.114:0/1978010176 conn(0x55b08fb427f0 msgr2=0x55b08fb40850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1978010176 shutdown_connections 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.387+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1978010176 wait complete. 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 Processor -- start 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 -- start start 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb4d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b08fb475a0 con 0x55b08fb46460 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3ee3b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb4d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3ee3b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb4d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52078/0 (socket says 172.21.15.114:52078) 2024-05-08T18:09:05.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 learned_addr learned my addr 172.21.15.114:0/1638658594 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08fb4def0 con 0x55b08fb46460 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb4d9b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ec150 tx=0x7fe3d80ea4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe2d0ff9640 1 -- 172.21.15.114:0/1638658594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80bec10 con 0x55b08fb46460 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe2d0ff9640 1 -- 172.21.15.114:0/1638658594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d80e9250 con 0x55b08fb46460 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b08fb4e180 con 0x55b08fb46460 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe2d0ff9640 1 -- 172.21.15.114:0/1638658594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3d80c8ca0 con 0x55b08fb46460 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b08fb4e590 con 0x55b08fb46460 2024-05-08T18:09:05.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe2d0ff9640 1 -- 172.21.15.114:0/1638658594 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe3d80f3060 con 0x55b08fb46460 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe2d0ff9640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2b8038590 0x7fe2b803aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe2d0ff9640 1 -- 172.21.15.114:0/1638658594 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fe3d80e9050 con 0x55b08fb46460 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2b8038590 0x7fe2b803aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fb58ea0 0x55b08fb5b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5bab0 con 0x55b08fb58ea0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.391+0000 7fe3eebb9640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fb58ea0 0x55b08fb5b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2b8038590 0x7fe2b803aa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8008fd0 tx=0x7fe3e801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3eebb9640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fb58ea0 0x55b08fb5b360 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 realm 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5bec0 con 0x55b08fb58ea0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5c790 con 0x55b08fb58ea0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5cb30 con 0x55b08fb58ea0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5d380 con 0x55b08fb58ea0 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 20 searching for the correct realm 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b08fb5f0f0 0x55b08fb614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b08fb5f0f0 0x55b08fb614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b08fb5f0f0 0x55b08fb614e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ee3b8640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe3d8009040 0x7fe3d80dca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3d8009040 2024-05-08T18:09:05.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe3d8009040 0x7fe3d80dca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe3d8009040 0x7fe3d80dca50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ef3ba640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe3e8019040 0x7fe3e8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.395+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe3e8019040 0x7fe3e8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe3e8019040 0x7fe3e8019930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x7fe3e8019040 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x7fe3e8019040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x7fe3e8019040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3d8009040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.399+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x7fe3e8019040 2024-05-08T18:09:05.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3d8009040 2024-05-08T18:09:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x7fe3e8019040 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.403+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e000f070 con 0x7fe3e8019040 2024-05-08T18:09:05.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3d8009040 2024-05-08T18:09:05.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe3e000f070 con 0x55b08fb58ea0 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3d8009040 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.407+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3e8019040 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x55b08fb58ea0 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61a20 con 0x7fe3d8009040 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:05.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5dcd0 con 0x55b08fb58ea0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5e570 con 0x55b08fb58ea0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb61e50 con 0x55b08fb58ea0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:05.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 zone default found 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 4 Realm: () 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 zonegroup default 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb5e1c0 con 0x7fe3e8019040 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb64230 con 0x55b08fb5f0f0 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb645d0 con 0x55b08fb5f0f0 2024-05-08T18:09:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 started sync module instance, tier type = 2024-05-08T18:09:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:05.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.411+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb63670 con 0x7fe3d8009040 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94216813689440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb63e80 con 0x7fe3d8009040 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb65310 con 0x55b08fb58ea0 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94216813694496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb65bb0 con 0x55b08fb58ea0 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb665b0 con 0x55b08fb5f0f0 2024-05-08T18:09:05.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.415+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94216813689440] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.419+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.419+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94216813693296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb669d0 con 0x55b08fb5f0f0 2024-05-08T18:09:05.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.419+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb67390 con 0x7fe3d8009040 2024-05-08T18:09:05.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.419+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94216813694496] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.419+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94216813693296] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.423+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.423+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94216813696768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb67390 con 0x7fe3d8009040 2024-05-08T18:09:05.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.423+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb67be0 con 0x55b08fb58ea0 2024-05-08T18:09:05.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.423+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94216813696768] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94216813703152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb67940 con 0x55b08fb58ea0 2024-05-08T18:09:05.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb68460 con 0x7fe3e8019040 2024-05-08T18:09:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94216813703152] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94216813707056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb68420 con 0x7fe3e8019040 2024-05-08T18:09:05.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.427+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb68e70 con 0x7fe3e8019040 2024-05-08T18:09:05.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94216813709760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb69290 con 0x7fe3e8019040 2024-05-08T18:09:05.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb69ce0 con 0x7fe3e8019040 2024-05-08T18:09:05.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94216813707056] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94216813713360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb69ca0 con 0x7fe3e8019040 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=0 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=1 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=2 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=3 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=4 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=5 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94216813709760] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.431+0000 7fe3f10a5980 20 add_watcher() i=6 2024-05-08T18:09:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94216813713360] v30'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 20 add_watcher() i=7 2024-05-08T18:09:05.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:05.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb68de0 con 0x55b08fb58ea0 2024-05-08T18:09:05.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94216813710816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb6a120 con 0x55b08fb58ea0 2024-05-08T18:09:05.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94216813710816] v30'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe2a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:05.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.435+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb75680 con 0x55b08fb58ea0 2024-05-08T18:09:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.439+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.439+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb75cd0 con 0x7fe3e8019040 2024-05-08T18:09:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.439+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.439+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb75cd0 con 0x55b08fb5f0f0 2024-05-08T18:09:05.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.443+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.443+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb76090 con 0x55b08fb58ea0 2024-05-08T18:09:05.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.443+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.443+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb761a0 con 0x7fe3d8009040 2024-05-08T18:09:05.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.443+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.443+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb767f0 con 0x55b08fb5f0f0 2024-05-08T18:09:05.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.447+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.447+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb76bd0 con 0x55b08fb58ea0 2024-05-08T18:09:05.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.447+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.447+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb76c90 con 0x7fe3e8019040 2024-05-08T18:09:05.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.451+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.451+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb76c90 con 0x7fe3d8009040 2024-05-08T18:09:05.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.455+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.455+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77390 con 0x55b08fb5f0f0 2024-05-08T18:09:05.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.455+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.455+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77390 con 0x7fe3d8009040 2024-05-08T18:09:05.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.455+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.455+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77900 con 0x7fe3e8019040 2024-05-08T18:09:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.459+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.459+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77900 con 0x7fe3d8009040 2024-05-08T18:09:05.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.459+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.459+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77840 con 0x7fe3e8019040 2024-05-08T18:09:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.463+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.463+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77840 con 0x55b08fb58ea0 2024-05-08T18:09:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.463+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.463+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.467+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.467+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x7fe3d8009040 2024-05-08T18:09:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.467+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.467+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.471+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.471+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb58ea0 2024-05-08T18:09:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.471+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.471+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb58ea0 2024-05-08T18:09:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.475+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.475+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.475+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.475+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x7fe3d8009040 2024-05-08T18:09:05.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.479+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.479+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.479+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.479+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.483+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.483+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.483+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.483+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.483+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.483+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x7fe3e8019040 2024-05-08T18:09:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.487+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.487+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.487+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.487+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x7fe3e8019040 2024-05-08T18:09:05.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.491+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.491+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x55b08fb5f0f0 2024-05-08T18:09:05.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.491+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.491+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x7fe3e8019040 2024-05-08T18:09:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.495+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.495+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb77d20 con 0x7fe3d8009040 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.495+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe21ffff640 20 reqs_thread_entry: start 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 20 Filter name: none 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe21dffb640 20 reqs_thread_entry: start 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb93390 con 0x7fe3e8019040 2024-05-08T18:09:05.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T18:09:05.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:09:05.499 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:09:05.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe2a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.499+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94216813710816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb723a0 con 0x55b08fb58ea0 2024-05-08T18:09:05.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94216813710816] v30'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94216813689440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb68de0 con 0x7fe3d8009040 2024-05-08T18:09:05.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94216813689440] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3f10a5980 20 remove_watcher() i=0 2024-05-08T18:09:05.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3f10a5980 2 removed watcher, disabling cache 2024-05-08T18:09:05.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94216813694496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb63a60 con 0x55b08fb58ea0 2024-05-08T18:09:05.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94216813694496] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3f10a5980 20 remove_watcher() i=1 2024-05-08T18:09:05.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.503+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94216813693296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb63a60 con 0x55b08fb5f0f0 2024-05-08T18:09:05.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.507+0000 7fe3ee3b8640 1 -- 172.21.15.114:0/1638658594 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94216813693296] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3d80ce020 con 0x55b08fb5f0f0 2024-05-08T18:09:05.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.507+0000 7fe3f10a5980 20 remove_watcher() i=2 2024-05-08T18:09:05.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.507+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94216813696768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb63a60 con 0x7fe3d8009040 2024-05-08T18:09:05.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.507+0000 7fe3ef3ba640 1 -- 172.21.15.114:0/1638658594 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94216813696768] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e802f040 con 0x7fe3d8009040 2024-05-08T18:09:05.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.507+0000 7fe3f10a5980 20 remove_watcher() i=3 2024-05-08T18:09:05.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.507+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94216813703152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb65700 con 0x55b08fb58ea0 2024-05-08T18:09:05.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.511+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94216813703152] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x55b08fb58ea0 2024-05-08T18:09:05.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.511+0000 7fe3f10a5980 20 remove_watcher() i=4 2024-05-08T18:09:05.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.511+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94216813707056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb63a60 con 0x7fe3e8019040 2024-05-08T18:09:05.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.515+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94216813707056] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.515+0000 7fe3f10a5980 20 remove_watcher() i=5 2024-05-08T18:09:05.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.515+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94216813709760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb66ff0 con 0x7fe3e8019040 2024-05-08T18:09:05.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.515+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94216813709760] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.515+0000 7fe3f10a5980 20 remove_watcher() i=6 2024-05-08T18:09:05.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.515+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94216813713360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b08fb65700 con 0x7fe3e8019040 2024-05-08T18:09:05.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94216813713360] v30'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3e0054040 con 0x7fe3e8019040 2024-05-08T18:09:05.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 20 remove_watcher() i=7 2024-05-08T18:09:05.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe3e8019040 msgr2=0x7fe3e8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe3e8019040 0x7fe3e8019930 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fb58ea0 msgr2=0x55b08fb5b360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fb58ea0 0x55b08fb5b360 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe3d8009040 msgr2=0x7fe3d80dca50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe3d8009040 0x7fe3d80dca50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b08fb5f0f0 msgr2=0x55b08fb614e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b08fb5f0f0 0x55b08fb614e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2b8038590 msgr2=0x7fe2b803aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2b8038590 0x7fe2b803aa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8008fd0 tx=0x7fe3e801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 msgr2=0x55b08fb4d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/1638658594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb46460 0x55b08fb4d9b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ec150 tx=0x7fe3d80ea4c0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 reap_dead start 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 shutdown_connections 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3eebb9640 1 -- 172.21.15.114:0/1638658594 reap_dead start 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 >> 172.21.15.114:0/1638658594 conn(0x55b08fb427f0 msgr2=0x55b08fb47cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 shutdown_connections 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/1638658594 wait complete. 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2c80383f0 msgr2=0x7fe2c803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2c80383f0 0x7fe2c803a8b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55b08fb296f0 tx=0x7fe3e8003070 comp rx=0 tx=0).stop 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 msgr2=0x55b08fb397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 0x55b08fb397b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ac040 tx=0x7fe3d80180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 shutdown_connections 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2c80383f0 0x7fe2c803a8b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/579604899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08fb39390 0x55b08fb397b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 >> 172.21.15.114:0/579604899 conn(0x55b08fb2e1a0 msgr2=0x55b08fb2ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 shutdown_connections 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/579604899 wait complete. 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fa33640 msgr2=0x55b08fb285b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fa33640 0x55b08fb285b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2d40383f0 msgr2=0x7fe2d403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2d40383f0 0x7fe2d403a8b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe3d80ae000 tx=0x7fe3d80a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 msgr2=0x55b08fb21630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb21630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe3e000f610 tx=0x7fe3e0001260 comp rx=0 tx=0).stop 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 shutdown_connections 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b08fa33640 0x55b08fb285b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe2d40383f0 0x7fe2d403a8b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 --2- 172.21.15.114:0/760906940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b08f9a0f90 0x55b08fb21630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 >> 172.21.15.114:0/760906940 conn(0x55b08fa27640 msgr2=0x55b08fb14890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 shutdown_connections 2024-05-08T18:09:05.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.519+0000 7fe3f10a5980 1 -- 172.21.15.114:0/760906940 wait complete. 2024-05-08T18:09:05.531 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:09:05.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:09:05.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:09:05.531 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:09:05.604 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:05.605 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:05.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb40be3e980 1 Processor -- start 2024-05-08T18:09:05.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb40be3e980 1 -- start start 2024-05-08T18:09:05.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb40be3e980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56318cf6f550 0x56318d002f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb40be3e980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56318cea5710 con 0x56318cf70840 2024-05-08T18:09:05.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb40be3e980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56318ceb9f00 con 0x56318cf6f550 2024-05-08T18:09:05.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb401151640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56318cf6f550 0x56318d002f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb409952640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56318cf70840 0x56318cf6ee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50896/0 (socket says 172.21.15.114:50896) 2024-05-08T18:09:05.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb401151640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56318cf6f550 0x56318d002f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52080/0 (socket says 172.21.15.114:52080) 2024-05-08T18:09:05.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb409952640 1 -- 172.21.15.114:0/316039152 learned_addr learned my addr 172.21.15.114:0/316039152 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:05.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb401151640 1 -- 172.21.15.114:0/316039152 >> v1:172.21.15.53:6789/0 conn(0x56318cf70840 legacy=0x56318cf6ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.607+0000 7fb401151640 1 -- 172.21.15.114:0/316039152 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318ce81ae0 con 0x56318cf6f550 2024-05-08T18:09:05.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb401151640 1 --2- 172.21.15.114:0/316039152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d002f10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400a480 tx=0x7fb3f401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1de29ed19af2925 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb409151640 1 -- 172.21.15.114:0/316039152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40b0070 con 0x56318cf6f550 2024-05-08T18:09:05.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb409151640 1 -- 172.21.15.114:0/316039152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40ab540 con 0x56318cf6f550 2024-05-08T18:09:05.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb409151640 1 -- 172.21.15.114:0/316039152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40ab840 con 0x56318cf6f550 2024-05-08T18:09:05.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 -- 172.21.15.114:0/316039152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 msgr2=0x56318d002f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 --2- 172.21.15.114:0/316039152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d002f10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400a480 tx=0x7fb3f401b280 comp rx=0 tx=0).stop 2024-05-08T18:09:05.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 -- 172.21.15.114:0/316039152 shutdown_connections 2024-05-08T18:09:05.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 --2- 172.21.15.114:0/316039152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d002f10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 -- 172.21.15.114:0/316039152 >> 172.21.15.114:0/316039152 conn(0x56318cff57d0 msgr2=0x56318cff7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 -- 172.21.15.114:0/316039152 shutdown_connections 2024-05-08T18:09:05.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.611+0000 7fb40be3e980 1 -- 172.21.15.114:0/316039152 wait complete. 2024-05-08T18:09:05.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 Processor -- start 2024-05-08T18:09:05.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- start start 2024-05-08T18:09:05.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0e7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56318cefdf80 con 0x56318cf6f550 2024-05-08T18:09:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb409952640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb409952640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0e7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52086/0 (socket says 172.21.15.114:52086) 2024-05-08T18:09:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb409952640 1 -- 172.21.15.114:0/1491922543 learned_addr learned my addr 172.21.15.114:0/1491922543 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb409952640 1 -- 172.21.15.114:0/1491922543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318cec5da0 con 0x56318cf6f550 2024-05-08T18:09:05.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb409952640 1 --2- 172.21.15.114:0/1491922543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0e7660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0017b0 tx=0x7fb3fc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d567accbc0ff5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb2f7e07640 1 -- 172.21.15.114:0/1491922543 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3fc0044f0 con 0x56318cf6f550 2024-05-08T18:09:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb2f7e07640 1 -- 172.21.15.114:0/1491922543 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0046b0 con 0x56318cf6f550 2024-05-08T18:09:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb2f7e07640 1 -- 172.21.15.114:0/1491922543 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3fc004a10 con 0x56318cf6f550 2024-05-08T18:09:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- 172.21.15.114:0/1491922543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 msgr2=0x56318d0e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 --2- 172.21.15.114:0/1491922543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0e7660 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0017b0 tx=0x7fb3fc001c70 comp rx=0 tx=0).stop 2024-05-08T18:09:05.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- 172.21.15.114:0/1491922543 shutdown_connections 2024-05-08T18:09:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 --2- 172.21.15.114:0/1491922543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0e7660 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- 172.21.15.114:0/1491922543 >> 172.21.15.114:0/1491922543 conn(0x56318cff57d0 msgr2=0x56318d0e31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- 172.21.15.114:0/1491922543 shutdown_connections 2024-05-08T18:09:05.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- 172.21.15.114:0/1491922543 wait complete. 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 Processor -- start 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.627+0000 7fb40be3e980 1 -- start start 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40be3e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40be3e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56318d005eb0 con 0x56318cf6f550 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb409952640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb409952640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0eeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52098/0 (socket says 172.21.15.114:52098) 2024-05-08T18:09:05.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb409952640 1 -- 172.21.15.114:0/3230483410 learned_addr learned my addr 172.21.15.114:0/3230483410 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb409952640 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318d0ef070 con 0x56318cf6f550 2024-05-08T18:09:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb409952640 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0eeb30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001cb0 tx=0x7fb3fc000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb2f6604640 1 -- 172.21.15.114:0/3230483410 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3fc022020 con 0x56318cf6f550 2024-05-08T18:09:05.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56318d0ef300 con 0x56318cf6f550 2024-05-08T18:09:05.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb2f6604640 1 -- 172.21.15.114:0/3230483410 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0148b0 con 0x56318cf6f550 2024-05-08T18:09:05.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb2f6604640 1 -- 172.21.15.114:0/3230483410 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3fc014bd0 con 0x56318cf6f550 2024-05-08T18:09:05.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56318d0f1f40 con 0x56318cf6f550 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb2f6604640 1 -- 172.21.15.114:0/3230483410 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb3fc025020 con 0x56318cf6f550 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb2f6604640 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2f0038440 0x7fb2f003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb2f6604640 1 -- 172.21.15.114:0/3230483410 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb3fc018030 con 0x56318cf6f550 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb401151640 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2f0038440 0x7fb2f003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318cf70840 0x56318d0f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d0f60d0 con 0x56318cf70840 2024-05-08T18:09:05.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.631+0000 7fb40a153640 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318cf70840 0x56318d0f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb401151640 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2f0038440 0x7fb2f003a900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40ad000 tx=0x7fb3f40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40a153640 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318cf70840 0x56318d0f5b90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40a153640 1 -- 172.21.15.114:0/3230483410 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4040083f0 con 0x56318cf70840 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d0f3160 con 0x56318cf70840 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40a153640 1 -- 172.21.15.114:0/3230483410 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4040083f0 con 0x56318cf70840 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d0f7ef0 con 0x56318cf70840 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40a153640 1 -- 172.21.15.114:0/3230483410 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb4040083f0 con 0x56318cf70840 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d0f7120 con 0x56318cf70840 2024-05-08T18:09:05.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40a153640 1 -- 172.21.15.114:0/3230483410 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4040083f0 con 0x56318cf70840 2024-05-08T18:09:05.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d0f7540 con 0x56318cf70840 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40a153640 1 -- 172.21.15.114:0/3230483410 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb4040083f0 con 0x56318cf70840 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 Processor -- start 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 -- start start 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 0x56318d106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb40be3e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56318cf01fc0 con 0x56318d106870 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb401151640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 0x56318d106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb401151640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 0x56318d106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52114/0 (socket says 172.21.15.114:52114) 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb401151640 1 -- 172.21.15.114:0/1174890630 learned_addr learned my addr 172.21.15.114:0/1174890630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.635+0000 7fb401151640 1 -- 172.21.15.114:0/1174890630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318d1071d0 con 0x56318d106870 2024-05-08T18:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb401151640 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 0x56318d106c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40ae040 tx=0x7fb3f4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb2ef7fe640 1 -- 172.21.15.114:0/1174890630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40c6070 con 0x56318d106870 2024-05-08T18:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb2ef7fe640 1 -- 172.21.15.114:0/1174890630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40c1540 con 0x56318d106870 2024-05-08T18:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56318d107c70 con 0x56318d106870 2024-05-08T18:09:05.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb2ef7fe640 1 -- 172.21.15.114:0/1174890630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40b0040 con 0x56318d106870 2024-05-08T18:09:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56318d1080e0 con 0x56318d106870 2024-05-08T18:09:05.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb2ef7fe640 1 -- 172.21.15.114:0/1174890630 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb3f40c9070 con 0x56318d106870 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb2ef7fe640 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2e4038490 0x7fb2e403a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb2ef7fe640 1 -- 172.21.15.114:0/1174890630 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb3f40be030 con 0x56318d106870 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40a153640 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2e4038490 0x7fb2e403a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40be3e980 1 Processor -- start 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40be3e980 1 -- start start 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40a153640 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2e4038490 0x7fb2e403a950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x56318d0f74c0 tx=0x7fb404003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40be3e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d113d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb40be3e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56318d0e7db0 con 0x56318d1138e0 2024-05-08T18:09:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb401151640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d113d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb401151640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d113d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52118/0 (socket says 172.21.15.114:52118) 2024-05-08T18:09:05.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.639+0000 7fb401151640 1 -- 172.21.15.114:0/3202850838 learned_addr learned my addr 172.21.15.114:0/3202850838 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 -- 172.21.15.114:0/3202850838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318d1142d0 con 0x56318d1138e0 2024-05-08T18:09:05.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 --2- 172.21.15.114:0/3202850838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d113d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40068c0 tx=0x7fb3f40b7f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc7160cc7d6de7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb2ed7fa640 1 -- 172.21.15.114:0/3202850838 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f4006e60 con 0x56318d1138e0 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb2ed7fa640 1 -- 172.21.15.114:0/3202850838 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40c9360 con 0x56318d1138e0 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb2ed7fa640 1 -- 172.21.15.114:0/3202850838 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40c9c80 con 0x56318d1138e0 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/3202850838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 msgr2=0x56318d113d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3202850838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d113d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40068c0 tx=0x7fb3f40b7f80 comp rx=0 tx=0).stop 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/3202850838 shutdown_connections 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3202850838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d113d00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/3202850838 >> 172.21.15.114:0/3202850838 conn(0x56318d10fc70 msgr2=0x56318d10dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/3202850838 shutdown_connections 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/3202850838 wait complete. 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 Processor -- start 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- start start 2024-05-08T18:09:05.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d11adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56318d114a20 con 0x56318d1138e0 2024-05-08T18:09:05.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d11adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d11adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52124/0 (socket says 172.21.15.114:52124) 2024-05-08T18:09:05.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 learned_addr learned my addr 172.21.15.114:0/119276276 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56318d11b2f0 con 0x56318d1138e0 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb401151640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d11adb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40e7ee0 tx=0x7fb3f40e8f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb2db7fe640 1 -- 172.21.15.114:0/119276276 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f40c9510 con 0x56318d1138e0 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb2db7fe640 1 -- 172.21.15.114:0/119276276 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3f40da040 con 0x56318d1138e0 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56318d11b580 con 0x56318d1138e0 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb2db7fe640 1 -- 172.21.15.114:0/119276276 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3f4006e60 con 0x56318d1138e0 2024-05-08T18:09:05.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.643+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56318d11e260 con 0x56318d1138e0 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb2db7fe640 1 -- 172.21.15.114:0/119276276 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb3f40f1060 con 0x56318d1138e0 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb2db7fe640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2d40383f0 0x7fb2d403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb2db7fe640 1 -- 172.21.15.114:0/119276276 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb3f40a8070 con 0x56318d1138e0 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40a153640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2d40383f0 0x7fb2d403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318d1262d0 0x56318d128790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d128ee0 con 0x56318d1262d0 2024-05-08T18:09:05.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318d1262d0 0x56318d128790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40a153640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2d40383f0 0x7fb2d403a8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb40400f010 tx=0x7fb40401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318d1262d0 0x56318d128790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 realm 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d1292f0 con 0x56318d1262d0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d129bc0 con 0x56318d1262d0 2024-05-08T18:09:05.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d129f60 con 0x56318d1262d0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d12a7b0 con 0x56318d1262d0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.647+0000 7fb40be3e980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40be3e980 20 searching for the correct realm 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56318d12c200 0x56318d12e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb401151640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56318d12c200 0x56318d12e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb401151640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56318d12c200 0x56318d12e6c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb401151640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb3f40cb060 0x7fb3f40aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb3f40cb060 2024-05-08T18:09:05.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40a153640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb3f40cb060 0x7fb3f40aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40a153640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb3f40cb060 0x7fb3f40aa940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40a153640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb404019040 0x7fb404019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb404019040 0x7fb404019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb404019040 0x7fb404019930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x7fb404019040 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.651+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x7fb404019040 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x7fb404019040 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb3f40cb060 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x7fb404019040 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb3f40cb060 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.655+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x7fb404019040 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc01b070 con 0x7fb404019040 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb3f40cb060 2024-05-08T18:09:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3fc01b070 con 0x56318d1262d0 2024-05-08T18:09:05.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.659+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb3f40cb060 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d12c200 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb404019040 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x56318d1262d0 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56318d12ed90 con 0x7fb3f40cb060 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:05.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d12a400 con 0x56318d1262d0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d12b500 con 0x56318d1262d0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.663+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d12f210 con 0x56318d1262d0 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 zone default found 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 4 Realm: () 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 zonegroup default 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d12b120 con 0x7fb404019040 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d131120 con 0x56318d12c200 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d1314c0 con 0x56318d12c200 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 started sync module instance, tier type = 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1305c0 con 0x7fb3f40cb060 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94770820221408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d130220 con 0x7fb3f40cb060 2024-05-08T18:09:05.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.667+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1323c0 con 0x56318d1262d0 2024-05-08T18:09:05.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.671+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94770820221408] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.671+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.671+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94770820225264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1323c0 con 0x56318d1262d0 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.671+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d132d80 con 0x56318d12c200 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.671+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94770820225264] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94770820226832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d132330 con 0x56318d12c200 2024-05-08T18:09:05.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d133a80 con 0x7fb3f40cb060 2024-05-08T18:09:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94770820232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d134320 con 0x7fb3f40cb060 2024-05-08T18:09:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d134d20 con 0x56318d1262d0 2024-05-08T18:09:05.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.675+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94770820226832] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94770820231456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d134ce0 con 0x56318d1262d0 2024-05-08T18:09:05.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d135730 con 0x7fb404019040 2024-05-08T18:09:05.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94770820232928] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94770820234864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d135730 con 0x7fb404019040 2024-05-08T18:09:05.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.679+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d135fc0 con 0x7fb404019040 2024-05-08T18:09:05.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.683+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94770820231456] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.687+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94770820234864] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.687+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.687+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94770820237360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d135770 con 0x7fb404019040 2024-05-08T18:09:05.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.687+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d136650 con 0x7fb404019040 2024-05-08T18:09:05.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.687+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94770820237360] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94770820240000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d136650 con 0x7fb404019040 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=0 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=1 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=2 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=3 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=4 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=5 2024-05-08T18:09:05.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=6 2024-05-08T18:09:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94770820240000] v30'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 20 add_watcher() i=7 2024-05-08T18:09:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d1397d0 con 0x56318d1262d0 2024-05-08T18:09:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.691+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94770820243872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d136a70 con 0x56318d1262d0 2024-05-08T18:09:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94770820243872] v30'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb2bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb40be3e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb40be3e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:05.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d139120 con 0x56318d1262d0 2024-05-08T18:09:05.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.695+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d142a60 con 0x7fb404019040 2024-05-08T18:09:05.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.699+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.699+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d142890 con 0x56318d12c200 2024-05-08T18:09:05.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.703+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.703+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d142e40 con 0x56318d1262d0 2024-05-08T18:09:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.707+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.707+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d142e20 con 0x7fb3f40cb060 2024-05-08T18:09:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.707+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.707+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d143410 con 0x56318d12c200 2024-05-08T18:09:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.707+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.707+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1438c0 con 0x56318d1262d0 2024-05-08T18:09:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.711+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.711+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1438c0 con 0x7fb404019040 2024-05-08T18:09:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.715+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.715+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1438c0 con 0x7fb3f40cb060 2024-05-08T18:09:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.715+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.715+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d142000 con 0x56318d12c200 2024-05-08T18:09:05.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.719+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.719+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d142000 con 0x7fb3f40cb060 2024-05-08T18:09:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.719+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.719+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x7fb404019040 2024-05-08T18:09:05.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.723+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.723+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x7fb3f40cb060 2024-05-08T18:09:05.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.723+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.723+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x7fb404019040 2024-05-08T18:09:05.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.727+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.727+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d1262d0 2024-05-08T18:09:05.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.731+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.731+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d12c200 2024-05-08T18:09:05.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.731+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.731+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x7fb3f40cb060 2024-05-08T18:09:05.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.735+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.735+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d12c200 2024-05-08T18:09:05.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.739+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.739+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d1262d0 2024-05-08T18:09:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.739+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.739+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d1262d0 2024-05-08T18:09:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.743+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.743+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d12c200 2024-05-08T18:09:05.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.743+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.743+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x7fb3f40cb060 2024-05-08T18:09:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.747+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.747+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d144420 con 0x56318d12c200 2024-05-08T18:09:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.751+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.751+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x56318d12c200 2024-05-08T18:09:05.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.751+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.751+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x56318d12c200 2024-05-08T18:09:05.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.755+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.755+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x56318d12c200 2024-05-08T18:09:05.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.755+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.755+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x7fb404019040 2024-05-08T18:09:05.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.759+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.759+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x56318d12c200 2024-05-08T18:09:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.763+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.763+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x7fb404019040 2024-05-08T18:09:05.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.767+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.767+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x56318d12c200 2024-05-08T18:09:05.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.771+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.771+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x7fb404019040 2024-05-08T18:09:05.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.775+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.775+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1449d0 con 0x7fb3f40cb060 2024-05-08T18:09:05.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.775+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.775+0000 7fb2ba7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:05.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.775+0000 7fb40be3e980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:05.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 20 Filter name: none 2024-05-08T18:09:05.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb22bfff640 20 reqs_thread_entry: start 2024-05-08T18:09:05.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:05.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56318d15fa00 con 0x7fb404019040 2024-05-08T18:09:05.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:09:05.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:05.779 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:09:05.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb2bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.779+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94770820243872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d141720 con 0x56318d1262d0 2024-05-08T18:09:05.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.783+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94770820243872] v30'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.783+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94770820221408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1361a0 con 0x7fb3f40cb060 2024-05-08T18:09:05.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.783+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94770820221408] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.783+0000 7fb40be3e980 20 remove_watcher() i=0 2024-05-08T18:09:05.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.783+0000 7fb40be3e980 2 removed watcher, disabling cache 2024-05-08T18:09:05.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.783+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94770820225264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1361a0 con 0x56318d1262d0 2024-05-08T18:09:05.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.787+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94770820225264] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.787+0000 7fb40be3e980 20 remove_watcher() i=1 2024-05-08T18:09:05.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.787+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94770820226832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1318f0 con 0x56318d12c200 2024-05-08T18:09:05.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.787+0000 7fb401151640 1 -- 172.21.15.114:0/119276276 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94770820226832] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3f40c8030 con 0x56318d12c200 2024-05-08T18:09:05.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.787+0000 7fb40be3e980 20 remove_watcher() i=2 2024-05-08T18:09:05.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.787+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94770820232928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1361a0 con 0x7fb3f40cb060 2024-05-08T18:09:05.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.795+0000 7fb40a153640 1 -- 172.21.15.114:0/119276276 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94770820232928] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb40402f040 con 0x7fb3f40cb060 2024-05-08T18:09:05.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.795+0000 7fb40be3e980 20 remove_watcher() i=3 2024-05-08T18:09:05.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.795+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94770820231456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d131f10 con 0x56318d1262d0 2024-05-08T18:09:05.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.795+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94770820231456] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x56318d1262d0 2024-05-08T18:09:05.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.795+0000 7fb40be3e980 20 remove_watcher() i=4 2024-05-08T18:09:05.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.795+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94770820234864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d1361a0 con 0x7fb404019040 2024-05-08T18:09:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.799+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94770820234864] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.799+0000 7fb40be3e980 20 remove_watcher() i=5 2024-05-08T18:09:05.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.799+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94770820237360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d131f10 con 0x7fb404019040 2024-05-08T18:09:05.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94770820237360] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 20 remove_watcher() i=6 2024-05-08T18:09:05.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94770820240000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56318d133e70 con 0x7fb404019040 2024-05-08T18:09:05.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94770820240000] v30'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3fc054040 con 0x7fb404019040 2024-05-08T18:09:05.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 20 remove_watcher() i=7 2024-05-08T18:09:05.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb404019040 msgr2=0x7fb404019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb404019040 0x7fb404019930 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318d1262d0 msgr2=0x56318d128790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318d1262d0 0x56318d128790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb3f40cb060 msgr2=0x7fb3f40aa940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb3f40cb060 0x7fb3f40aa940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56318d12c200 msgr2=0x56318d12e6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56318d12c200 0x56318d12e6c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2d40383f0 msgr2=0x7fb2d403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2d40383f0 0x7fb2d403a8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb40400f010 tx=0x7fb40401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 msgr2=0x56318d11adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/119276276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d1138e0 0x56318d11adb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40e7ee0 tx=0x7fb3f40e8f00 comp rx=0 tx=0).stop 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 reap_dead start 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb409952640 1 -- 172.21.15.114:0/119276276 reap_dead start 2024-05-08T18:09:05.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 shutdown_connections 2024-05-08T18:09:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 >> 172.21.15.114:0/119276276 conn(0x56318d10fc70 msgr2=0x56318d115140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 shutdown_connections 2024-05-08T18:09:05.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/119276276 wait complete. 2024-05-08T18:09:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2e4038490 msgr2=0x7fb2e403a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2e4038490 0x7fb2e403a950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x56318d0f74c0 tx=0x7fb404003070 comp rx=0 tx=0).stop 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 msgr2=0x56318d106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 0x56318d106c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40ae040 tx=0x7fb3f4018020 comp rx=0 tx=0).stop 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 shutdown_connections 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2e4038490 0x7fb2e403a950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 --2- 172.21.15.114:0/1174890630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318d106870 0x56318d106c90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 >> 172.21.15.114:0/1174890630 conn(0x56318d0fb680 msgr2=0x56318d0fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 shutdown_connections 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.803+0000 7fb40be3e980 1 -- 172.21.15.114:0/1174890630 wait complete. 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318cf70840 msgr2=0x56318d0f5b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318cf70840 0x56318d0f5b90 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2f0038440 msgr2=0x7fb2f003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2f0038440 0x7fb2f003a900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb3f40ad000 tx=0x7fb3f40a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 msgr2=0x56318d0eeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0eeb30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001cb0 tx=0x7fb3fc000f50 comp rx=0 tx=0).stop 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 shutdown_connections 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56318cf70840 0x56318d0f5b90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2f0038440 0x7fb2f003a900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 --2- 172.21.15.114:0/3230483410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56318cf6f550 0x56318d0eeb30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 >> 172.21.15.114:0/3230483410 conn(0x56318cff57d0 msgr2=0x56318d0e1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 shutdown_connections 2024-05-08T18:09:05.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.807+0000 7fb40be3e980 1 -- 172.21.15.114:0/3230483410 wait complete. 2024-05-08T18:09:05.818 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:09:05.818 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:09:05.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:09:05.819 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:09:05.898 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:05.898 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff54b194980 1 Processor -- start 2024-05-08T18:09:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff54b194980 1 -- start start 2024-05-08T18:09:05.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff54b194980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556e0ef60390 0x556e0ef60770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff54b194980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e0ee09710 con 0x556e0ef60cb0 2024-05-08T18:09:05.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff54b194980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556e0ee1df00 con 0x556e0ef60390 2024-05-08T18:09:05.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff548ca8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556e0ef60390 0x556e0ef60770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff548ca8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556e0ef60390 0x556e0ef60770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52128/0 (socket says 172.21.15.114:52128) 2024-05-08T18:09:05.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff548ca8640 1 -- 172.21.15.114:0/2146794305 learned_addr learned my addr 172.21.15.114:0/2146794305 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff5484a7640 1 --1- 172.21.15.114:0/2146794305 >> v1:172.21.15.53:6789/0 conn(0x556e0ef60cb0 0x556e0ef61370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50912/0 (socket says 172.21.15.114:50912) 2024-05-08T18:09:05.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff548ca8640 1 -- 172.21.15.114:0/2146794305 >> v1:172.21.15.53:6789/0 conn(0x556e0ef60cb0 legacy=0x556e0ef61370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.899+0000 7ff548ca8640 1 -- 172.21.15.114:0/2146794305 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0ede5ae0 con 0x556e0ef60390 2024-05-08T18:09:05.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff548ca8640 1 --2- 172.21.15.114:0/2146794305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0ef60770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff53800a4e0 tx=0x7ff53801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e38573b70ef0720 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff547ca6640 1 -- 172.21.15.114:0/2146794305 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5380aa540 con 0x556e0ef60390 2024-05-08T18:09:05.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff547ca6640 1 -- 172.21.15.114:0/2146794305 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5380aa6e0 con 0x556e0ef60390 2024-05-08T18:09:05.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff547ca6640 1 -- 172.21.15.114:0/2146794305 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5380aaa40 con 0x556e0ef60390 2024-05-08T18:09:05.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 -- 172.21.15.114:0/2146794305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 msgr2=0x556e0ef60770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 --2- 172.21.15.114:0/2146794305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0ef60770 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff53800a4e0 tx=0x7ff53801b090 comp rx=0 tx=0).stop 2024-05-08T18:09:05.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 -- 172.21.15.114:0/2146794305 shutdown_connections 2024-05-08T18:09:05.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 --2- 172.21.15.114:0/2146794305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0ef60770 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 -- 172.21.15.114:0/2146794305 >> 172.21.15.114:0/2146794305 conn(0x556e0eed37e0 msgr2=0x556e0eed3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 -- 172.21.15.114:0/2146794305 shutdown_connections 2024-05-08T18:09:05.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.903+0000 7ff54b194980 1 -- 172.21.15.114:0/2146794305 wait complete. 2024-05-08T18:09:05.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff54b194980 1 Processor -- start 2024-05-08T18:09:05.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff54b194980 1 -- start start 2024-05-08T18:09:05.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff54b194980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f04b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff54b194980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e0ee61f80 con 0x556e0ef60390 2024-05-08T18:09:05.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff548ca8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f04b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff548ca8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f04b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52140/0 (socket says 172.21.15.114:52140) 2024-05-08T18:09:05.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff548ca8640 1 -- 172.21.15.114:0/1802502100 learned_addr learned my addr 172.21.15.114:0/1802502100 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff548ca8640 1 -- 172.21.15.114:0/1802502100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0ee29da0 con 0x556e0ef60390 2024-05-08T18:09:05.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.919+0000 7ff548ca8640 1 --2- 172.21.15.114:0/1802502100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f04b800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff538017ca0 tx=0x7ff5380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da99d800ea046402 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff436e0d640 1 -- 172.21.15.114:0/1802502100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5380b9030 con 0x556e0ef60390 2024-05-08T18:09:05.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff436e0d640 1 -- 172.21.15.114:0/1802502100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5380aaac0 con 0x556e0ef60390 2024-05-08T18:09:05.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff436e0d640 1 -- 172.21.15.114:0/1802502100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5380aada0 con 0x556e0ef60390 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/1802502100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 msgr2=0x556e0f04b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 --2- 172.21.15.114:0/1802502100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f04b800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff538017ca0 tx=0x7ff5380033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/1802502100 shutdown_connections 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 --2- 172.21.15.114:0/1802502100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f04b800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/1802502100 >> 172.21.15.114:0/1802502100 conn(0x556e0eed37e0 msgr2=0x556e0f047390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/1802502100 shutdown_connections 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/1802502100 wait complete. 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 Processor -- start 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- start start 2024-05-08T18:09:05.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f052ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e0ef6a0e0 con 0x556e0ef60390 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff548ca8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f052ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff548ca8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f052ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52150/0 (socket says 172.21.15.114:52150) 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff548ca8640 1 -- 172.21.15.114:0/2683704713 learned_addr learned my addr 172.21.15.114:0/2683704713 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff548ca8640 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0f052ff0 con 0x556e0ef60390 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff548ca8640 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f052ab0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff53801b0d0 tx=0x7ff538017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff43560a640 1 -- 172.21.15.114:0/2683704713 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5380b9030 con 0x556e0ef60390 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e0f053280 con 0x556e0ef60390 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff43560a640 1 -- 172.21.15.114:0/2683704713 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5380c3070 con 0x556e0ef60390 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e0f055f60 con 0x556e0ef60390 2024-05-08T18:09:05.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.923+0000 7ff43560a640 1 -- 172.21.15.114:0/2683704713 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5380cc060 con 0x556e0ef60390 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff43560a640 1 -- 172.21.15.114:0/2683704713 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff5380c5030 con 0x556e0ef60390 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff43560a640 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4300383f0 0x7ff43003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff43560a640 1 -- 172.21.15.114:0/2683704713 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ff5380ba070 con 0x556e0ef60390 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5484a7640 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4300383f0 0x7ff43003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0ef60cb0 0x556e0f059a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f05a060 con 0x556e0ef60cb0 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0ef60cb0 0x556e0f059a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5484a7640 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4300383f0 0x7ff43003a8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff530001e90 tx=0x7ff5300013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0ef60cb0 0x556e0f059a40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 -- 172.21.15.114:0/2683704713 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5400083f0 con 0x556e0ef60cb0 2024-05-08T18:09:05.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f05a940 con 0x556e0ef60cb0 2024-05-08T18:09:05.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 -- 172.21.15.114:0/2683704713 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5400083f0 con 0x556e0ef60cb0 2024-05-08T18:09:05.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f05bcf0 con 0x556e0ef60cb0 2024-05-08T18:09:05.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 -- 172.21.15.114:0/2683704713 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5400083f0 con 0x556e0ef60cb0 2024-05-08T18:09:05.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f05b190 con 0x556e0ef60cb0 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 -- 172.21.15.114:0/2683704713 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5400083f0 con 0x556e0ef60cb0 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f05b5b0 con 0x556e0ef60cb0 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.927+0000 7ff5494a9640 1 -- 172.21.15.114:0/2683704713 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5400083f0 con 0x556e0ef60cb0 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff54b194980 1 Processor -- start 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff54b194980 1 -- start start 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff54b194980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 0x556e0f06ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff54b194980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e0ee65fc0 con 0x556e0f06a840 2024-05-08T18:09:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff5484a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 0x556e0f06ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff5484a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 0x556e0f06ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52160/0 (socket says 172.21.15.114:52160) 2024-05-08T18:09:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff5484a7640 1 -- 172.21.15.114:0/2310430866 learned_addr learned my addr 172.21.15.114:0/2310430866 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff5484a7640 1 -- 172.21.15.114:0/2310430866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0f06b1a0 con 0x556e0f06a840 2024-05-08T18:09:05.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff5484a7640 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 0x556e0f06ac60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e670 tx=0x7ff53000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff42e7fc640 1 -- 172.21.15.114:0/2310430866 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff530022070 con 0x556e0f06a840 2024-05-08T18:09:05.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff42e7fc640 1 -- 172.21.15.114:0/2310430866 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff53000d660 con 0x556e0f06a840 2024-05-08T18:09:05.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e0f06bc40 con 0x556e0f06a840 2024-05-08T18:09:05.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff42e7fc640 1 -- 172.21.15.114:0/2310430866 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff530006070 con 0x556e0f06a840 2024-05-08T18:09:05.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e0f06c110 con 0x556e0f06a840 2024-05-08T18:09:05.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff42e7fc640 1 -- 172.21.15.114:0/2310430866 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff530025070 con 0x556e0f06a840 2024-05-08T18:09:05.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff42e7fc640 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff420038440 0x7ff42003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff42e7fc640 1 -- 172.21.15.114:0/2310430866 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ff5300500c0 con 0x556e0f06a840 2024-05-08T18:09:05.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.931+0000 7ff5494a9640 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff420038440 0x7ff42003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 Processor -- start 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- start start 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5494a9640 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff420038440 0x7ff42003a900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x556e0f05b530 tx=0x7ff540003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f077de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e0f04be90 con 0x556e0f0779c0 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f077de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f077de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52174/0 (socket says 172.21.15.114:52174) 2024-05-08T18:09:05.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 -- 172.21.15.114:0/241214000 learned_addr learned my addr 172.21.15.114:0/241214000 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 -- 172.21.15.114:0/241214000 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0f0783b0 con 0x556e0f0779c0 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 --2- 172.21.15.114:0/241214000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f077de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff530026fd0 tx=0x7ff53000df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8e6011a654d16d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff41ffff640 1 -- 172.21.15.114:0/241214000 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5300264e0 con 0x556e0f0779c0 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff41ffff640 1 -- 172.21.15.114:0/241214000 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5300242c0 con 0x556e0f0779c0 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff41ffff640 1 -- 172.21.15.114:0/241214000 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5300268d0 con 0x556e0f0779c0 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- 172.21.15.114:0/241214000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 msgr2=0x556e0f077de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:05.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 --2- 172.21.15.114:0/241214000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f077de0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff530026fd0 tx=0x7ff53000df30 comp rx=0 tx=0).stop 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- 172.21.15.114:0/241214000 shutdown_connections 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 --2- 172.21.15.114:0/241214000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f077de0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- 172.21.15.114:0/241214000 >> 172.21.15.114:0/241214000 conn(0x556e0f073d50 msgr2=0x556e0f071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- 172.21.15.114:0/241214000 shutdown_connections 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- 172.21.15.114:0/241214000 wait complete. 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 Processor -- start 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- start start 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f07ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff54b194980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556e0f078aa0 con 0x556e0f0779c0 2024-05-08T18:09:05.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f07ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f07ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52184/0 (socket says 172.21.15.114:52184) 2024-05-08T18:09:05.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 learned_addr learned my addr 172.21.15.114:0/1405143257 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:05.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.935+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e0f07f450 con 0x556e0f0779c0 2024-05-08T18:09:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff5484a7640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f07ef10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c470 tx=0x7ff53000ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff41e7fc640 1 -- 172.21.15.114:0/1405143257 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53000d980 con 0x556e0f0779c0 2024-05-08T18:09:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e0f07f450 con 0x556e0f0779c0 2024-05-08T18:09:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff41e7fc640 1 -- 172.21.15.114:0/1405143257 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff530026be0 con 0x556e0f0779c0 2024-05-08T18:09:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff41e7fc640 1 -- 172.21.15.114:0/1405143257 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff53001a670 con 0x556e0f0779c0 2024-05-08T18:09:05.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e0f07f450 con 0x556e0f0779c0 2024-05-08T18:09:05.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff41e7fc640 1 -- 172.21.15.114:0/1405143257 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff53001a810 con 0x556e0f0779c0 2024-05-08T18:09:05.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff41e7fc640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4140383f0 0x7ff41403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff41e7fc640 1 -- 172.21.15.114:0/1405143257 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ff530032c40 con 0x556e0f0779c0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff5494a9640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4140383f0 0x7ff41403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0f089fe0 0x556e0f08c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08cbf0 con 0x556e0f089fe0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff548ca8640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0f089fe0 0x556e0f08c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff5494a9640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4140383f0 0x7ff41403a8b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff54000f010 tx=0x7ff54001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff548ca8640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0f089fe0 0x556e0f08c4a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 realm 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08d000 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08d8d0 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.939+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08dc70 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08e4c0 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 20 searching for the correct realm 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556e0f090230 0x556e0f092620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5484a7640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556e0f090230 0x556e0f092620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5484a7640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556e0f090230 0x556e0f092620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5484a7640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff530031020 0x7ff53003e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff530031020 2024-05-08T18:09:05.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5494a9640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff530031020 0x7ff53003e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5494a9640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff530031020 0x7ff53003e3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5494a9640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff540019040 0x7ff540019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff548ca8640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff540019040 0x7ff540019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff548ca8640 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff540019040 0x7ff540019930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.943+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff530031020 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff530031020 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.947+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f090230 2024-05-08T18:09:05.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff530031020 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x556e0f089fe0 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.951+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092b60 con 0x7ff540019040 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x556e0f090230 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x7ff540019040 2024-05-08T18:09:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x7ff530031020 2024-05-08T18:09:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x556e0f090230 2024-05-08T18:09:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x7ff540019040 2024-05-08T18:09:05.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x556e0f089fe0 2024-05-08T18:09:05.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7ff5380ef040 con 0x7ff530031020 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.955+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08ee10 con 0x556e0f089fe0 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08f6b0 con 0x556e0f089fe0 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f08f6b0 con 0x556e0f089fe0 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 zone default found 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 4 Realm: () 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 zonegroup default 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f092f90 con 0x7ff540019040 2024-05-08T18:09:05.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0949a0 con 0x556e0f090230 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f094e30 con 0x556e0f090230 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 started sync module instance, tier type = 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:05.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f093e10 con 0x7ff530031020 2024-05-08T18:09:05.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93931187028480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f095740 con 0x7ff530031020 2024-05-08T18:09:05.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.959+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f095f90 con 0x556e0f089fe0 2024-05-08T18:09:05.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.963+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.963+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93931187033920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f096050 con 0x556e0f089fe0 2024-05-08T18:09:05.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.963+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f096b50 con 0x556e0f090230 2024-05-08T18:09:05.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.963+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93931187028480] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93931187033920] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93931187037760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f095b60 con 0x556e0f090230 2024-05-08T18:09:05.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0973f0 con 0x7ff530031020 2024-05-08T18:09:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93931187037760] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93931187040064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f097810 con 0x7ff530031020 2024-05-08T18:09:05.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.967+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0980a0 con 0x556e0f089fe0 2024-05-08T18:09:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.971+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.971+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93931187042320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f097c30 con 0x556e0f089fe0 2024-05-08T18:09:05.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.971+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f098fa0 con 0x7ff540019040 2024-05-08T18:09:05.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.971+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93931187040064] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.975+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93931187042320] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.975+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.975+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93931187041120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f098ab0 con 0x7ff540019040 2024-05-08T18:09:05.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.975+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099840 con 0x7ff540019040 2024-05-08T18:09:05.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.975+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93931187041120] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.979+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.979+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93931187045408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099520 con 0x7ff540019040 2024-05-08T18:09:05.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.979+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099d70 con 0x7ff540019040 2024-05-08T18:09:05.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93931187045408] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93931187049040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099be0 con 0x7ff540019040 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=0 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=1 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=2 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=3 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=4 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=5 2024-05-08T18:09:05.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.983+0000 7ff54b194980 20 add_watcher() i=6 2024-05-08T18:09:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93931187049040] v30'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 20 add_watcher() i=7 2024-05-08T18:09:05.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f09d150 con 0x556e0f089fe0 2024-05-08T18:09:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93931187050096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f09a610 con 0x556e0f089fe0 2024-05-08T18:09:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93931187050096] v30'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff3fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:05.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.987+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f09cfe0 con 0x556e0f089fe0 2024-05-08T18:09:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.991+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.991+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a61c0 con 0x7ff540019040 2024-05-08T18:09:05.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.991+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:05.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.991+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a61c0 con 0x556e0f090230 2024-05-08T18:09:05.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.995+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.995+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a65e0 con 0x556e0f089fe0 2024-05-08T18:09:05.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.995+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:05.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.995+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a6560 con 0x7ff530031020 2024-05-08T18:09:05.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.999+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:05.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.999+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a6b90 con 0x556e0f090230 2024-05-08T18:09:05.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.999+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:05.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.999+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a7010 con 0x556e0f089fe0 2024-05-08T18:09:06.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.999+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:05.999+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a70f0 con 0x7ff540019040 2024-05-08T18:09:06.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.003+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.003+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a70f0 con 0x7ff530031020 2024-05-08T18:09:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.007+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.007+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a7810 con 0x556e0f090230 2024-05-08T18:09:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.007+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.007+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a80e0 con 0x7ff530031020 2024-05-08T18:09:06.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.007+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.011+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a80c0 con 0x7ff540019040 2024-05-08T18:09:06.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.011+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.011+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8080 con 0x7ff530031020 2024-05-08T18:09:06.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.015+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.015+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8110 con 0x7ff540019040 2024-05-08T18:09:06.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.015+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.015+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8110 con 0x556e0f089fe0 2024-05-08T18:09:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.019+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.019+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8110 con 0x556e0f090230 2024-05-08T18:09:06.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.019+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.019+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8110 con 0x7ff530031020 2024-05-08T18:09:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.023+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.023+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8220 con 0x556e0f090230 2024-05-08T18:09:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.023+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.023+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8220 con 0x556e0f089fe0 2024-05-08T18:09:06.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.027+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.027+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8220 con 0x556e0f089fe0 2024-05-08T18:09:06.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.027+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.027+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8220 con 0x556e0f090230 2024-05-08T18:09:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.031+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.031+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a8220 con 0x7ff530031020 2024-05-08T18:09:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.031+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.031+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x556e0f090230 2024-05-08T18:09:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.035+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.035+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x556e0f090230 2024-05-08T18:09:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.035+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.035+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x556e0f090230 2024-05-08T18:09:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.039+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.039+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x556e0f090230 2024-05-08T18:09:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.039+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.039+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x7ff540019040 2024-05-08T18:09:06.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.043+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.043+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x556e0f090230 2024-05-08T18:09:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.043+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.043+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x7ff540019040 2024-05-08T18:09:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.047+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.047+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x556e0f090230 2024-05-08T18:09:06.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.051+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.051+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x7ff540019040 2024-05-08T18:09:06.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.051+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.051+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a86c0 con 0x7ff530031020 2024-05-08T18:09:06.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff3fdfe3640 20 reqs_thread_entry: start 2024-05-08T18:09:06.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff54b194980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:06.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff54b194980 20 Filter name: none 2024-05-08T18:09:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff36f7fe640 20 reqs_thread_entry: start 2024-05-08T18:09:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff54b194980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:06.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff54b194980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.055+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0c3b00 con 0x556e0f089fe0 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff54b194980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff54b194980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff54b194980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff3fefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93931187050096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f0a4c00 con 0x556e0f089fe0 2024-05-08T18:09:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93931187050096] v30'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.059+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93931187028480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099670 con 0x7ff530031020 2024-05-08T18:09:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93931187028480] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff54b194980 20 remove_watcher() i=0 2024-05-08T18:09:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff54b194980 2 removed watcher, disabling cache 2024-05-08T18:09:06.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93931187033920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099670 con 0x556e0f089fe0 2024-05-08T18:09:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93931187033920] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff54b194980 20 remove_watcher() i=1 2024-05-08T18:09:06.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.063+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93931187037760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099670 con 0x556e0f090230 2024-05-08T18:09:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.067+0000 7ff5484a7640 1 -- 172.21.15.114:0/1405143257 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93931187037760] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff530038070 con 0x556e0f090230 2024-05-08T18:09:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.067+0000 7ff54b194980 20 remove_watcher() i=2 2024-05-08T18:09:06.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.067+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93931187040064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f096640 con 0x7ff530031020 2024-05-08T18:09:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.067+0000 7ff5494a9640 1 -- 172.21.15.114:0/1405143257 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93931187040064] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff54002f040 con 0x7ff530031020 2024-05-08T18:09:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.067+0000 7ff54b194980 20 remove_watcher() i=3 2024-05-08T18:09:06.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.067+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93931187042320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f099670 con 0x556e0f089fe0 2024-05-08T18:09:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.071+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93931187042320] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x556e0f089fe0 2024-05-08T18:09:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.071+0000 7ff54b194980 20 remove_watcher() i=4 2024-05-08T18:09:06.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.071+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93931187041120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f096f40 con 0x7ff540019040 2024-05-08T18:09:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.071+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93931187041120] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.071+0000 7ff54b194980 20 remove_watcher() i=5 2024-05-08T18:09:06.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.071+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93931187045408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f096640 con 0x7ff540019040 2024-05-08T18:09:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93931187045408] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff54b194980 20 remove_watcher() i=6 2024-05-08T18:09:06.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93931187049040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556e0f097810 con 0x7ff540019040 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93931187049040] v30'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5380d03a0 con 0x7ff540019040 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff54b194980 20 remove_watcher() i=7 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff540019040 msgr2=0x7ff540019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff540019040 0x7ff540019930 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.075+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0f089fe0 msgr2=0x556e0f08c4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0f089fe0 0x556e0f08c4a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff530031020 msgr2=0x7ff53003e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff530031020 0x7ff53003e3c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556e0f090230 msgr2=0x556e0f092620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556e0f090230 0x556e0f092620 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4140383f0 msgr2=0x7ff41403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4140383f0 0x7ff41403a8b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff54000f010 tx=0x7ff54001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 msgr2=0x556e0f07ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff548ca8640 1 -- 172.21.15.114:0/1405143257 reap_dead start 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f07ef10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff53000c470 tx=0x7ff53000ff50 comp rx=0 tx=0).stop 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 shutdown_connections 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/1405143257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f0779c0 0x556e0f07ef10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 >> 172.21.15.114:0/1405143257 conn(0x556e0f073d50 msgr2=0x556e0f0713b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 shutdown_connections 2024-05-08T18:09:06.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/1405143257 wait complete. 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff420038440 msgr2=0x7ff42003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff420038440 0x7ff42003a900 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x556e0f05b530 tx=0x7ff540003070 comp rx=0 tx=0).stop 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 msgr2=0x556e0f06ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 0x556e0f06ac60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff53000e670 tx=0x7ff53000ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 shutdown_connections 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff420038440 0x7ff42003a900 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2310430866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0f06a840 0x556e0f06ac60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 >> 172.21.15.114:0/2310430866 conn(0x556e0f05f650 msgr2=0x556e0f060160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 shutdown_connections 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2310430866 wait complete. 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0ef60cb0 msgr2=0x556e0f059a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0ef60cb0 0x556e0f059a40 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4300383f0 msgr2=0x7ff43003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4300383f0 0x7ff43003a8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff530001e90 tx=0x7ff5300013f0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 msgr2=0x556e0f052ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f052ab0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff53801b0d0 tx=0x7ff538017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 shutdown_connections 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556e0ef60cb0 0x556e0f059a40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff4300383f0 0x7ff43003a8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 --2- 172.21.15.114:0/2683704713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e0ef60390 0x556e0f052ab0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 >> 172.21.15.114:0/2683704713 conn(0x556e0eed37e0 msgr2=0x556e0f045ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 shutdown_connections 2024-05-08T18:09:06.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.079+0000 7ff54b194980 1 -- 172.21.15.114:0/2683704713 wait complete. 2024-05-08T18:09:06.092 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T18:09:06.092 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:09:06.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:09:06.092 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T18:09:06.171 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:06.172 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:06.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.171+0000 7fd879686980 1 Processor -- start 2024-05-08T18:09:06.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.171+0000 7fd879686980 1 -- start start 2024-05-08T18:09:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.171+0000 7fd879686980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fc84b9d610 0x55fc84b9fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.171+0000 7fd879686980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc84a42710 con 0x55fc84b99100 2024-05-08T18:09:06.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.171+0000 7fd879686980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fc84a56f00 con 0x55fc84b9d610 2024-05-08T18:09:06.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876999640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fc84b9d610 0x55fc84b9fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876999640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fc84b9d610 0x55fc84b9fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52194/0 (socket says 172.21.15.114:52194) 2024-05-08T18:09:06.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd87719a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55fc84b99100 0x55fc84b994e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50920/0 (socket says 172.21.15.114:50920) 2024-05-08T18:09:06.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876999640 1 -- 172.21.15.114:0/836875862 learned_addr learned my addr 172.21.15.114:0/836875862 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876999640 1 -- 172.21.15.114:0/836875862 >> v1:172.21.15.53:6789/0 conn(0x55fc84b99100 legacy=0x55fc84b994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876999640 1 -- 172.21.15.114:0/836875862 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84a1eae0 con 0x55fc84b9d610 2024-05-08T18:09:06.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876999640 1 --2- 172.21.15.114:0/836875862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b9d610 0x55fc84b9fa00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00a5c0 tx=0x7fd86c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b26169556926bcf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876198640 1 -- 172.21.15.114:0/836875862 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0a6070 con 0x55fc84b9d610 2024-05-08T18:09:06.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876198640 1 -- 172.21.15.114:0/836875862 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86c0af070 con 0x55fc84b9d610 2024-05-08T18:09:06.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.175+0000 7fd876198640 1 -- 172.21.15.114:0/836875862 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86c0aa5c0 con 0x55fc84b9d610 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 -- 172.21.15.114:0/836875862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b9d610 msgr2=0x55fc84b9fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 --2- 172.21.15.114:0/836875862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b9d610 0x55fc84b9fa00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd86c00a5c0 tx=0x7fd86c01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 -- 172.21.15.114:0/836875862 shutdown_connections 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 --2- 172.21.15.114:0/836875862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b9d610 0x55fc84b9fa00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 -- 172.21.15.114:0/836875862 >> 172.21.15.114:0/836875862 conn(0x55fc84b0c7e0 msgr2=0x55fc84b0cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 -- 172.21.15.114:0/836875862 shutdown_connections 2024-05-08T18:09:06.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.179+0000 7fd879686980 1 -- 172.21.15.114:0/836875862 wait complete. 2024-05-08T18:09:06.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 Processor -- start 2024-05-08T18:09:06.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 -- start start 2024-05-08T18:09:06.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fc84a9af80 con 0x55fc84b99100 2024-05-08T18:09:06.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd87719a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd87719a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c841a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52198/0 (socket says 172.21.15.114:52198) 2024-05-08T18:09:06.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd87719a640 1 -- 172.21.15.114:0/3887212192 learned_addr learned my addr 172.21.15.114:0/3887212192 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd87719a640 1 -- 172.21.15.114:0/3887212192 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84a62da0 con 0x55fc84b99100 2024-05-08T18:09:06.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd87719a640 1 --2- 172.21.15.114:0/3887212192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c841a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd868001ec0 tx=0x7fd86800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2fdd77d02c3244 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd76560a640 1 -- 172.21.15.114:0/3887212192 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86800e5d0 con 0x55fc84b99100 2024-05-08T18:09:06.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd76560a640 1 -- 172.21.15.114:0/3887212192 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86800e770 con 0x55fc84b99100 2024-05-08T18:09:06.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd76560a640 1 -- 172.21.15.114:0/3887212192 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86800ea70 con 0x55fc84b99100 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 -- 172.21.15.114:0/3887212192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 msgr2=0x55fc84c841a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 --2- 172.21.15.114:0/3887212192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c841a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd868001ec0 tx=0x7fd86800b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 -- 172.21.15.114:0/3887212192 shutdown_connections 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 --2- 172.21.15.114:0/3887212192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c841a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.195+0000 7fd879686980 1 -- 172.21.15.114:0/3887212192 >> 172.21.15.114:0/3887212192 conn(0x55fc84b0c7e0 msgr2=0x55fc84c7fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- 172.21.15.114:0/3887212192 shutdown_connections 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- 172.21.15.114:0/3887212192 wait complete. 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 Processor -- start 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- start start 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c8b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fc84ba2a30 con 0x55fc84b99100 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87719a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c8b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87719a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c8b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52210/0 (socket says 172.21.15.114:52210) 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87719a640 1 -- 172.21.15.114:0/3194133059 learned_addr learned my addr 172.21.15.114:0/3194133059 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87719a640 1 -- 172.21.15.114:0/3194133059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84c8bbc0 con 0x55fc84b99100 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87719a640 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c8b680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55fc84c85030 tx=0x7fd868000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd763e07640 1 -- 172.21.15.114:0/3194133059 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86800f8a0 con 0x55fc84b99100 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc84c8be50 con 0x55fc84b99100 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd763e07640 1 -- 172.21.15.114:0/3194133059 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86800fa40 con 0x55fc84b99100 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd763e07640 1 -- 172.21.15.114:0/3194133059 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86802c060 con 0x55fc84b99100 2024-05-08T18:09:06.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc84c8eb30 con 0x55fc84b99100 2024-05-08T18:09:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 Processor -- start 2024-05-08T18:09:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- start start 2024-05-08T18:09:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c98f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd879686980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fc84a9efc0 con 0x55fc84c98b60 2024-05-08T18:09:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd763e07640 1 -- 172.21.15.114:0/3194133059 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd868017070 con 0x55fc84b99100 2024-05-08T18:09:06.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87799b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c98f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87799b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c98f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52224/0 (socket says 172.21.15.114:52224) 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.199+0000 7fd87799b640 1 -- 172.21.15.114:0/2388513378 learned_addr learned my addr 172.21.15.114:0/2388513378 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd763e07640 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd75c0383f0 0x7fd75c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd763e07640 1 -- 172.21.15.114:0/3194133059 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fd868015020 con 0x55fc84b99100 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87719a640 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd75c0383f0 0x7fd75c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 -- 172.21.15.114:0/2388513378 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84c994c0 con 0x55fc84c98b60 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 --2- 172.21.15.114:0/2388513378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c98f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd87000a430 tx=0x7fd87000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef2a834be383021 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87719a640 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd75c0383f0 0x7fd75c03a8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd86801bce0 tx=0x7fd86801bc50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd761e03640 1 -- 172.21.15.114:0/2388513378 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87000f6e0 con 0x55fc84c98b60 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd761e03640 1 -- 172.21.15.114:0/2388513378 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd870015070 con 0x55fc84c98b60 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd761e03640 1 -- 172.21.15.114:0/2388513378 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87000fa10 con 0x55fc84c98b60 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2388513378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 msgr2=0x55fc84c98f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 --2- 172.21.15.114:0/2388513378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c98f80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd87000a430 tx=0x7fd87000a8f0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2388513378 shutdown_connections 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 --2- 172.21.15.114:0/2388513378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c98f80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2388513378 >> 172.21.15.114:0/2388513378 conn(0x55fc84b9d610 msgr2=0x55fc84c93fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2388513378 shutdown_connections 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2388513378 wait complete. 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 Processor -- start 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- start start 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c9fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fc84c99e80 con 0x55fc84c98b60 2024-05-08T18:09:06.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c9fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c9fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52234/0 (socket says 172.21.15.114:52234) 2024-05-08T18:09:06.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 -- 172.21.15.114:0/2136282303 learned_addr learned my addr 172.21.15.114:0/2136282303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 -- 172.21.15.114:0/2136282303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84ca0410 con 0x55fc84c98b60 2024-05-08T18:09:06.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd87799b640 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c9fed0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55fc84c99940 tx=0x7fd870003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd753fff640 1 -- 172.21.15.114:0/2136282303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87000fe00 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc84ca06a0 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd753fff640 1 -- 172.21.15.114:0/2136282303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd870010a20 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd753fff640 1 -- 172.21.15.114:0/2136282303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd870010dc0 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.203+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc84ca3380 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd753fff640 1 -- 172.21.15.114:0/2136282303 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd87001a480 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd753fff640 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd7580383f0 0x7fd75803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd753fff640 1 -- 172.21.15.114:0/2136282303 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fd87004eef0 con 0x55fc84c98b60 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 1 Processor -- start 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87799b640 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd7580383f0 0x7fd75803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 1 -- start start 2024-05-08T18:09:06.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 0x55fc84cba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fc84c848f0 con 0x55fc84cb9da0 2024-05-08T18:09:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87799b640 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd7580383f0 0x7fd75803a8b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd870024ef0 tx=0x7fd870024e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87719a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 0x55fc84cba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87719a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 0x55fc84cba1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52250/0 (socket says 172.21.15.114:52250) 2024-05-08T18:09:06.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87719a640 1 -- 172.21.15.114:0/1269262990 learned_addr learned my addr 172.21.15.114:0/1269262990 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87719a640 1 -- 172.21.15.114:0/1269262990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc84cba700 con 0x55fc84cb9da0 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd87719a640 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 0x55fc84cba1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd86801cfd0 tx=0x7fd86804eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd6effff640 1 -- 172.21.15.114:0/1269262990 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86804c070 con 0x55fc84cb9da0 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd6effff640 1 -- 172.21.15.114:0/1269262990 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd86800fd20 con 0x55fc84cb9da0 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc84cbb1a0 con 0x55fc84cb9da0 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd6effff640 1 -- 172.21.15.114:0/1269262990 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd86801c450 con 0x55fc84cb9da0 2024-05-08T18:09:06.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.207+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc84cbb1a0 con 0x55fc84cb9da0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd6effff640 1 -- 172.21.15.114:0/1269262990 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd86801b3d0 con 0x55fc84cb9da0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd6effff640 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd6b0038440 0x7fd6b003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd6effff640 1 -- 172.21.15.114:0/1269262990 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fd86803c050 con 0x55fc84cb9da0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd876999640 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd6b0038440 0x7fd6b003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd6edffb640 20 reqs_thread_entry: start 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fc84cbf7c0 0x55fc84cc1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd876999640 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd6b0038440 0x7fd6b003a900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0ae000 tx=0x7fd86c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fc84cc2230 con 0x55fc84cbf7c0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd87799b640 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fc84cbf7c0 0x55fc84cc1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd87799b640 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fc84cbf7c0 0x55fc84cc1bb0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd87799b640 1 -- 172.21.15.114:0/3194133059 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd87000e070 con 0x55fc84cbf7c0 2024-05-08T18:09:06.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fc84cc3b40 con 0x55fc84cbf7c0 2024-05-08T18:09:06.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd87799b640 1 -- 172.21.15.114:0/3194133059 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd87000e070 con 0x55fc84cbf7c0 2024-05-08T18:09:06.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.211+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fc84cc85a0 con 0x55fc84cbf7c0 2024-05-08T18:09:06.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd87799b640 1 -- 172.21.15.114:0/3194133059 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [stat,call,call,writefull 0~993] v30'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fd87000e070 con 0x55fc84cbf7c0 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd7580383f0 msgr2=0x7fd75803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd7580383f0 0x7fd75803a8b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd870024ef0 tx=0x7fd870024e80 comp rx=0 tx=0).stop 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 msgr2=0x55fc84c9fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c9fed0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55fc84c99940 tx=0x7fd870003380 comp rx=0 tx=0).stop 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 shutdown_connections 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd7580383f0 0x7fd75803a8b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/2136282303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84c98b60 0x55fc84c9fed0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 >> 172.21.15.114:0/2136282303 conn(0x55fc84b9d610 msgr2=0x55fc84c92dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 shutdown_connections 2024-05-08T18:09:06.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/2136282303 wait complete. 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd6b0038440 msgr2=0x7fd6b003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd6b0038440 0x7fd6b003a900 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd86c0ae000 tx=0x7fd86c0a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 msgr2=0x55fc84cba1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 0x55fc84cba1c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd86801cfd0 tx=0x7fd86804eeb0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 shutdown_connections 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd6b0038440 0x7fd6b003a900 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/1269262990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84cb9da0 0x55fc84cba1c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 >> 172.21.15.114:0/1269262990 conn(0x55fc84cae980 msgr2=0x55fc84caf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 shutdown_connections 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/1269262990 wait complete. 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fc84cbf7c0 msgr2=0x55fc84cc1bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fc84cbf7c0 0x55fc84cc1bb0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd75c0383f0 msgr2=0x7fd75c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd75c0383f0 0x7fd75c03a8b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd86801bce0 tx=0x7fd86801bc50 comp rx=0 tx=0).stop 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 msgr2=0x55fc84c8b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c8b680 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55fc84c85030 tx=0x7fd868000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 shutdown_connections 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fc84cbf7c0 0x55fc84cc1bb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd75c0383f0 0x7fd75c03a8b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 --2- 172.21.15.114:0/3194133059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc84b99100 0x55fc84c8b680 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 >> 172.21.15.114:0/3194133059 conn(0x55fc84b0c7e0 msgr2=0x55fc84c7e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 shutdown_connections 2024-05-08T18:09:06.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.215+0000 7fd879686980 1 -- 172.21.15.114:0/3194133059 wait complete. 2024-05-08T18:09:06.226 INFO:teuthology.orchestra.run.smithi114.stdout:{"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:09:06.227 DEBUG:tasks.util.rgw: json result: {'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:09:06.228 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T18:09:06.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T18:09:06.228 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T18:09:06.302 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:06.302 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1689206980 1 Processor -- start 2024-05-08T18:09:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1689206980 1 -- start start 2024-05-08T18:09:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1689206980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fff1f63670 0x55fff1f65a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1689206980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fff1e08710 con 0x55fff1ed0f40 2024-05-08T18:09:06.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1689206980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fff1e1cf00 con 0x55fff1f63670 2024-05-08T18:09:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1686519640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fff1f63670 0x55fff1f65a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1686519640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fff1f63670 0x55fff1f65a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52260/0 (socket says 172.21.15.114:52260) 2024-05-08T18:09:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1686519640 1 -- 172.21.15.114:0/1047054522 learned_addr learned my addr 172.21.15.114:0/1047054522 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1686d1a640 1 --1- 172.21.15.114:0/1047054522 >> v1:172.21.15.53:6789/0 conn(0x55fff1ed0f40 0x55fff1f61f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50934/0 (socket says 172.21.15.114:50934) 2024-05-08T18:09:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1686519640 1 -- 172.21.15.114:0/1047054522 >> v1:172.21.15.53:6789/0 conn(0x55fff1ed0f40 legacy=0x55fff1f61f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.303+0000 7f1686519640 1 -- 172.21.15.114:0/1047054522 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff1de4ae0 con 0x55fff1f63670 2024-05-08T18:09:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1686519640 1 --2- 172.21.15.114:0/1047054522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1f63670 0x55fff1f65a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f167000a5c0 tx=0x7f167001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7622481430cd14d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1685d18640 1 -- 172.21.15.114:0/1047054522 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700a6070 con 0x55fff1f63670 2024-05-08T18:09:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1685d18640 1 -- 172.21.15.114:0/1047054522 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16700af070 con 0x55fff1f63670 2024-05-08T18:09:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1685d18640 1 -- 172.21.15.114:0/1047054522 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700aa5c0 con 0x55fff1f63670 2024-05-08T18:09:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 -- 172.21.15.114:0/1047054522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1f63670 msgr2=0x55fff1f65a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 --2- 172.21.15.114:0/1047054522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1f63670 0x55fff1f65a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f167000a5c0 tx=0x7f167001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:06.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 -- 172.21.15.114:0/1047054522 shutdown_connections 2024-05-08T18:09:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 --2- 172.21.15.114:0/1047054522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1f63670 0x55fff1f65a60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 -- 172.21.15.114:0/1047054522 >> 172.21.15.114:0/1047054522 conn(0x55fff1f57630 msgr2=0x55fff1f59a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 -- 172.21.15.114:0/1047054522 shutdown_connections 2024-05-08T18:09:06.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.307+0000 7f1689206980 1 -- 172.21.15.114:0/1047054522 wait complete. 2024-05-08T18:09:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1689206980 1 Processor -- start 2024-05-08T18:09:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1689206980 1 -- start start 2024-05-08T18:09:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1689206980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff204a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1689206980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fff1e60f80 con 0x55fff1ed0f40 2024-05-08T18:09:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1686d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff204a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1686d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff204a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52264/0 (socket says 172.21.15.114:52264) 2024-05-08T18:09:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1686d1a640 1 -- 172.21.15.114:0/396770247 learned_addr learned my addr 172.21.15.114:0/396770247 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1686d1a640 1 -- 172.21.15.114:0/396770247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff1e28da0 con 0x55fff1ed0f40 2024-05-08T18:09:06.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1686d1a640 1 --2- 172.21.15.114:0/396770247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff204a160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1678001680 tx=0x7f1678001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37624f7451145149 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1574e09640 1 -- 172.21.15.114:0/396770247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1678013420 con 0x55fff1ed0f40 2024-05-08T18:09:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1574e09640 1 -- 172.21.15.114:0/396770247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16780135c0 con 0x55fff1ed0f40 2024-05-08T18:09:06.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.323+0000 7f1574e09640 1 -- 172.21.15.114:0/396770247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16780138e0 con 0x55fff1ed0f40 2024-05-08T18:09:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/396770247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 msgr2=0x55fff204a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 --2- 172.21.15.114:0/396770247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff204a160 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1678001680 tx=0x7f1678001b40 comp rx=0 tx=0).stop 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/396770247 shutdown_connections 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 --2- 172.21.15.114:0/396770247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff204a160 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/396770247 >> 172.21.15.114:0/396770247 conn(0x55fff1f57630 msgr2=0x55fff2045cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/396770247 shutdown_connections 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/396770247 wait complete. 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 Processor -- start 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- start start 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff2051640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fff1f68a00 con 0x55fff1ed0f40 2024-05-08T18:09:06.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1686d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff2051640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1686d1a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff2051640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52268/0 (socket says 172.21.15.114:52268) 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1686d1a640 1 -- 172.21.15.114:0/1259775941 learned_addr learned my addr 172.21.15.114:0/1259775941 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1686d1a640 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff2051b80 con 0x55fff1ed0f40 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1686d1a640 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff2051640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1678002260 tx=0x7f1678000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1573606640 1 -- 172.21.15.114:0/1259775941 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16780037a0 con 0x55fff1ed0f40 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1573606640 1 -- 172.21.15.114:0/1259775941 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1678023070 con 0x55fff1ed0f40 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fff2051e10 con 0x55fff1ed0f40 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1573606640 1 -- 172.21.15.114:0/1259775941 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1678003a70 con 0x55fff1ed0f40 2024-05-08T18:09:06.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.327+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fff2054af0 con 0x55fff1ed0f40 2024-05-08T18:09:06.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1573606640 1 -- 172.21.15.114:0/1259775941 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f1678010070 con 0x55fff1ed0f40 2024-05-08T18:09:06.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1573606640 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f156c0383f0 0x7f156c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1573606640 1 -- 172.21.15.114:0/1259775941 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f167804e7c0 con 0x55fff1ed0f40 2024-05-08T18:09:06.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1686519640 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f156c0383f0 0x7f156c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff1f63670 0x55fff2058630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff2058c70 con 0x55fff1f63670 2024-05-08T18:09:06.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff1f63670 0x55fff2058630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1686519640 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f156c0383f0 0x7f156c03a8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16700ae000 tx=0x7f16700a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff1f63670 0x55fff2058630 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 -- 172.21.15.114:0/1259775941 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f16800083f0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff2055cf0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 -- 172.21.15.114:0/1259775941 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16800083f0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff205aa90 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 -- 172.21.15.114:0/1259775941 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16800083f0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff2059cc0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 -- 172.21.15.114:0/1259775941 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16800083f0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff205a0e0 con 0x55fff1f63670 2024-05-08T18:09:06.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f168751b640 1 -- 172.21.15.114:0/1259775941 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16800083f0 con 0x55fff1f63670 2024-05-08T18:09:06.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 Processor -- start 2024-05-08T18:09:06.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.331+0000 7f1689206980 1 -- start start 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 0x55fff20697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fff1e64fc0 con 0x55fff2069390 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1686519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 0x55fff20697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1686519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 0x55fff20697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52278/0 (socket says 172.21.15.114:52278) 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1686519640 1 -- 172.21.15.114:0/2752312809 learned_addr learned my addr 172.21.15.114:0/2752312809 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1686519640 1 -- 172.21.15.114:0/2752312809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff2069cf0 con 0x55fff2069390 2024-05-08T18:09:06.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1686519640 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 0x55fff20697b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f16700ac040 tx=0x7f16700180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1570e01640 1 -- 172.21.15.114:0/2752312809 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700b3b80 con 0x55fff2069390 2024-05-08T18:09:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fff206a790 con 0x55fff2069390 2024-05-08T18:09:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1570e01640 1 -- 172.21.15.114:0/2752312809 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16700b3d20 con 0x55fff2069390 2024-05-08T18:09:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1570e01640 1 -- 172.21.15.114:0/2752312809 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700c8560 con 0x55fff2069390 2024-05-08T18:09:06.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fff206ac00 con 0x55fff2069390 2024-05-08T18:09:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1570e01640 1 -- 172.21.15.114:0/2752312809 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f16700d1440 con 0x55fff2069390 2024-05-08T18:09:06.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1570e01640 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15600383f0 0x7f156003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1570e01640 1 -- 172.21.15.114:0/2752312809 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f16700ec070 con 0x55fff2069390 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f168751b640 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15600383f0 0x7f156003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 Processor -- start 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 -- start start 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f168751b640 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15600383f0 0x7f156003a8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55fff205a060 tx=0x7f1680003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff2076850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.335+0000 7f1689206980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fff204a8b0 con 0x55fff2076450 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff2076850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff2076850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52292/0 (socket says 172.21.15.114:52292) 2024-05-08T18:09:06.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 -- 172.21.15.114:0/3348240511 learned_addr learned my addr 172.21.15.114:0/3348240511 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 -- 172.21.15.114:0/3348240511 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff2076e20 con 0x55fff2076450 2024-05-08T18:09:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 --2- 172.21.15.114:0/3348240511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff2076850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16700b3fd0 tx=0x7f16700d1b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85706ff61bcd9387 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f156a7fc640 1 -- 172.21.15.114:0/3348240511 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700e7030 con 0x55fff2076450 2024-05-08T18:09:06.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f156a7fc640 1 -- 172.21.15.114:0/3348240511 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16700bd390 con 0x55fff2076450 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f156a7fc640 1 -- 172.21.15.114:0/3348240511 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700be410 con 0x55fff2076450 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3348240511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 msgr2=0x55fff2076850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 --2- 172.21.15.114:0/3348240511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff2076850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f16700b3fd0 tx=0x7f16700d1b10 comp rx=0 tx=0).stop 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3348240511 shutdown_connections 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 --2- 172.21.15.114:0/3348240511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff2076850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3348240511 >> 172.21.15.114:0/3348240511 conn(0x55fff2072790 msgr2=0x55fff20707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3348240511 shutdown_connections 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3348240511 wait complete. 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 Processor -- start 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- start start 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff207d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fff2077560 con 0x55fff2076450 2024-05-08T18:09:06.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff207d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff207d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52298/0 (socket says 172.21.15.114:52298) 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 learned_addr learned my addr 172.21.15.114:0/3268777603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff207de30 con 0x55fff2076450 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1686519640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff207d8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16700b3fd0 tx=0x7f16700ea410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1568ff9640 1 -- 172.21.15.114:0/3268777603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700f1070 con 0x55fff2076450 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fff207e0c0 con 0x55fff2076450 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1568ff9640 1 -- 172.21.15.114:0/3268777603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16700c7c10 con 0x55fff2076450 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1568ff9640 1 -- 172.21.15.114:0/3268777603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16700e7040 con 0x55fff2076450 2024-05-08T18:09:06.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.339+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fff2080da0 con 0x55fff2076450 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1568ff9640 1 -- 172.21.15.114:0/3268777603 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f16700f4070 con 0x55fff2076450 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1568ff9640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15500383f0 0x7f155003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1568ff9640 1 -- 172.21.15.114:0/3268777603 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f16700f7c80 con 0x55fff2076450 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f168751b640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15500383f0 0x7f155003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff2088bf0 0x55fff208b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208b7b0 con 0x55fff2088bf0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff2088bf0 0x55fff208b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff2088bf0 0x55fff208b060 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f168751b640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15500383f0 0x7f155003a8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f168000f010 tx=0x7f168001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 realm 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208bbc0 con 0x55fff2088bf0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208c490 con 0x55fff2088bf0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208c830 con 0x55fff2088bf0 2024-05-08T18:09:06.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208ccd0 con 0x55fff2088bf0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 20 searching for the correct realm 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fff208ec40 0x55fff2091030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff208ec40 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.343+0000 7f1686519640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fff208ec40 0x55fff2091030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686519640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fff208ec40 0x55fff2091030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686519640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f16700f6060 0x7f16700bf920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f16700f6060 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f168751b640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f16700f6060 0x7f16700bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f168751b640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f16700f6060 0x7f16700bf920 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f168751b640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f1680019040 0x7f1680019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f1680019040 2024-05-08T18:09:06.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f1680019040 0x7f1680019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f1680019040 0x7f1680019930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff2088bf0 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff2088bf0 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.347+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f1680019040 2024-05-08T18:09:06.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f1680019040 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f16700f6060 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff208ec40 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff2088bf0 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f1680019040 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff2088bf0 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f16700f6060 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff208ec40 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff208ec40 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x7f1680019040 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.351+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff208ec40 2024-05-08T18:09:06.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff208ec40 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fff20916b0 con 0x55fff2088bf0 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x55fff2088bf0 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f1680019040 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x55fff208ec40 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f16700f6060 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x55fff2088bf0 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f1680019040 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x55fff208ec40 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.355+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f1680019040 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f16700f6060 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x55fff208ec40 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f1680019040 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x55fff2088bf0 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f1678040040 con 0x7f16700f6060 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:06.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208d5b0 con 0x55fff2088bf0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208d9a0 con 0x55fff2088bf0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208d9a0 con 0x55fff2088bf0 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 zone default found 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 4 Realm: () 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 zonegroup default 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208ddc0 con 0x7f1680019040 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.359+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff208ddc0 con 0x55fff208ec40 2024-05-08T18:09:06.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20934f0 con 0x55fff208ec40 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 started sync module instance, tier type = 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:06.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2092990 con 0x7f16700f6060 2024-05-08T18:09:06.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94557765709232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20925f0 con 0x7f16700f6060 2024-05-08T18:09:06.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2094250 con 0x55fff2088bf0 2024-05-08T18:09:06.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.363+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94557765709232] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94557765712016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2094210 con 0x55fff2088bf0 2024-05-08T18:09:06.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2094c60 con 0x55fff208ec40 2024-05-08T18:09:06.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94557765712016] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94557765715888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2095050 con 0x55fff208ec40 2024-05-08T18:09:06.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.367+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2095a10 con 0x7f16700f6060 2024-05-08T18:09:06.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94557765719664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2096140 con 0x7f16700f6060 2024-05-08T18:09:06.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2096c60 con 0x55fff2088bf0 2024-05-08T18:09:06.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94557765715888] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94557765719664] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94557765723952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2096c20 con 0x55fff2088bf0 2024-05-08T18:09:06.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.371+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2097500 con 0x7f1680019040 2024-05-08T18:09:06.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94557765723952] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94557765713072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20970d0 con 0x7f1680019040 2024-05-08T18:09:06.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2097980 con 0x7f1680019040 2024-05-08T18:09:06.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94557765726416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2097f60 con 0x7f1680019040 2024-05-08T18:09:06.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20987f0 con 0x7f1680019040 2024-05-08T18:09:06.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.375+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94557765713072] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94557765725216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2098410 con 0x7f1680019040 2024-05-08T18:09:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=0 2024-05-08T18:09:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=1 2024-05-08T18:09:06.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=2 2024-05-08T18:09:06.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=3 2024-05-08T18:09:06.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=4 2024-05-08T18:09:06.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=5 2024-05-08T18:09:06.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94557765726416] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=6 2024-05-08T18:09:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94557765725216] v30'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 20 add_watcher() i=7 2024-05-08T18:09:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.379+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff2097f40 con 0x55fff2088bf0 2024-05-08T18:09:06.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94557765728912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2097eb0 con 0x55fff2088bf0 2024-05-08T18:09:06.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94557765728912] v30'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f153d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 5 note: GC not initialized 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f14b7fff640 20 reqs_thread_entry: start 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 20 Filter name: none 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f14b5ffb640 20 reqs_thread_entry: start 2024-05-08T18:09:06.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20bf5f0 con 0x55fff2088bf0 2024-05-08T18:09:06.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20bf5f0 con 0x7f16700f6060 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20bf5f0 con 0x55fff2088bf0 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20bf5b0 con 0x55fff208ec40 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.383+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20bfb00 con 0x55fff208ec40 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20bff00 con 0x55fff208ec40 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c0350 con 0x55fff2088bf0 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c0350 con 0x55fff2088bf0 2024-05-08T18:09:06.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c0350 con 0x55fff208ec40 2024-05-08T18:09:06.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c0350 con 0x55fff208ec40 2024-05-08T18:09:06.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x7f1680019040 2024-05-08T18:09:06.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x55fff2088bf0 2024-05-08T18:09:06.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x7f16700f6060 2024-05-08T18:09:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x55fff208ec40 2024-05-08T18:09:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x7f1680019040 2024-05-08T18:09:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.387+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x7f1680019040 2024-05-08T18:09:06.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x55fff208ec40 2024-05-08T18:09:06.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x7f1680019040 2024-05-08T18:09:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02e0 con 0x55fff2088bf0 2024-05-08T18:09:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02c0 con 0x55fff208ec40 2024-05-08T18:09:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02c0 con 0x7f1680019040 2024-05-08T18:09:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f16700f6060 2024-05-08T18:09:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.391+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f1680019040 2024-05-08T18:09:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff208ec40 2024-05-08T18:09:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff208ec40 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff208ec40 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff208ec40 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f1680019040 2024-05-08T18:09:06.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.395+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f153d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94557765728912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94557765728912] v30'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94557765709232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f16700f6060 2024-05-08T18:09:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94557765709232] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f1689206980 20 remove_watcher() i=0 2024-05-08T18:09:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f1689206980 2 removed watcher, disabling cache 2024-05-08T18:09:06.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.399+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94557765712016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.403+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94557765712016] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.403+0000 7f1689206980 20 remove_watcher() i=1 2024-05-08T18:09:06.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.403+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94557765715888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff208ec40 2024-05-08T18:09:06.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.407+0000 7f1686519640 1 -- 172.21.15.114:0/3268777603 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94557765715888] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16700f3030 con 0x55fff208ec40 2024-05-08T18:09:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.407+0000 7f1689206980 20 remove_watcher() i=2 2024-05-08T18:09:06.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.407+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94557765719664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f16700f6060 2024-05-08T18:09:06.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.407+0000 7f168751b640 1 -- 172.21.15.114:0/3268777603 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94557765719664] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f168002f040 con 0x7f16700f6060 2024-05-08T18:09:06.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.407+0000 7f1689206980 20 remove_watcher() i=3 2024-05-08T18:09:06.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.407+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94557765723952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x55fff2088bf0 2024-05-08T18:09:06.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.411+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94557765723952] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x55fff2088bf0 2024-05-08T18:09:06.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.411+0000 7f1689206980 20 remove_watcher() i=4 2024-05-08T18:09:06.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.411+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94557765713072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f1680019040 2024-05-08T18:09:06.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.411+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94557765713072] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.411+0000 7f1689206980 20 remove_watcher() i=5 2024-05-08T18:09:06.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.411+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94557765726416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff2093d40 con 0x7f1680019040 2024-05-08T18:09:06.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94557765726416] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 20 remove_watcher() i=6 2024-05-08T18:09:06.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94557765725216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fff20c02a0 con 0x7f1680019040 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94557765725216] v30'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f167800f030 con 0x7f1680019040 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 20 remove_watcher() i=7 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f1680019040 msgr2=0x7f1680019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f1680019040 0x7f1680019930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff2088bf0 msgr2=0x55fff208b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff2088bf0 0x55fff208b060 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f16700f6060 msgr2=0x7f16700bf920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f16700f6060 0x7f16700bf920 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fff208ec40 msgr2=0x55fff2091030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fff208ec40 0x55fff2091030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15500383f0 msgr2=0x7f155003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15500383f0 0x7f155003a8b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f168000f010 tx=0x7f168001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 msgr2=0x55fff207d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1686d1a640 1 -- 172.21.15.114:0/3268777603 reap_dead start 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff207d8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f16700b3fd0 tx=0x7f16700ea410 comp rx=0 tx=0).stop 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 shutdown_connections 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 --2- 172.21.15.114:0/3268777603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2076450 0x55fff207d8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 >> 172.21.15.114:0/3268777603 conn(0x55fff2072790 msgr2=0x55fff206fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 shutdown_connections 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.415+0000 7f1689206980 1 -- 172.21.15.114:0/3268777603 wait complete. 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15600383f0 msgr2=0x7f156003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15600383f0 0x7f156003a8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55fff205a060 tx=0x7f1680003070 comp rx=0 tx=0).stop 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 msgr2=0x55fff20697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 0x55fff20697b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f16700ac040 tx=0x7f16700180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 shutdown_connections 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f15600383f0 0x7f156003a8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/2752312809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff2069390 0x55fff20697b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 >> 172.21.15.114:0/2752312809 conn(0x55fff205e1a0 msgr2=0x55fff205ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 shutdown_connections 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/2752312809 wait complete. 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff1f63670 msgr2=0x55fff2058630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff1f63670 0x55fff2058630 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f156c0383f0 msgr2=0x7f156c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f156c0383f0 0x7f156c03a8b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16700ae000 tx=0x7f16700a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:06.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 msgr2=0x55fff2051640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff2051640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1678002260 tx=0x7f1678000f50 comp rx=0 tx=0).stop 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 shutdown_connections 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fff1f63670 0x55fff2058630 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f156c0383f0 0x7f156c03a8b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 --2- 172.21.15.114:0/1259775941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fff1ed0f40 0x55fff2051640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 >> 172.21.15.114:0/1259775941 conn(0x55fff1f57630 msgr2=0x55fff2044800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 shutdown_connections 2024-05-08T18:09:06.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.419+0000 7f1689206980 1 -- 172.21.15.114:0/1259775941 wait complete. 2024-05-08T18:09:06.429 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[],"summary":[]} 2024-05-08T18:09:06.429 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T18:09:06.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:06.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:06.430 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:06.506 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:06.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767d79b980 1 Processor -- start 2024-05-08T18:09:06.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767d79b980 1 -- start start 2024-05-08T18:09:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767d79b980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563560358ed0 0x5635603592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767d79b980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563560204710 con 0x5635603597f0 2024-05-08T18:09:06.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767d79b980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563560218f00 con 0x563560358ed0 2024-05-08T18:09:06.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767b2af640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563560358ed0 0x5635603592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767aaae640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5635603597f0 0x56356035a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50942/0 (socket says 172.21.15.114:50942) 2024-05-08T18:09:06.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767aaae640 1 -- 172.21.15.114:0/3820555105 learned_addr learned my addr 172.21.15.114:0/3820555105 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:06.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767b2af640 1 -- 172.21.15.114:0/3820555105 >> v1:172.21.15.53:6789/0 conn(0x5635603597f0 legacy=0x56356035a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.507+0000 7f767b2af640 1 -- 172.21.15.114:0/3820555105 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635601e0ae0 con 0x563560358ed0 2024-05-08T18:09:06.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767b2af640 1 --2- 172.21.15.114:0/3820555105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635603592b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f766c00a480 tx=0x7f766c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f6e1080284e104 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767a2ad640 1 -- 172.21.15.114:0/3820555105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0b0070 con 0x563560358ed0 2024-05-08T18:09:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767a2ad640 1 -- 172.21.15.114:0/3820555105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0ab540 con 0x563560358ed0 2024-05-08T18:09:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767a2ad640 1 -- 172.21.15.114:0/3820555105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0ab840 con 0x563560358ed0 2024-05-08T18:09:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 -- 172.21.15.114:0/3820555105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 msgr2=0x5635603592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 --2- 172.21.15.114:0/3820555105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635603592b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f766c00a480 tx=0x7f766c01b280 comp rx=0 tx=0).stop 2024-05-08T18:09:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 -- 172.21.15.114:0/3820555105 shutdown_connections 2024-05-08T18:09:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 --2- 172.21.15.114:0/3820555105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635603592b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 -- 172.21.15.114:0/3820555105 >> 172.21.15.114:0/3820555105 conn(0x5635603547a0 msgr2=0x563560356bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 -- 172.21.15.114:0/3820555105 shutdown_connections 2024-05-08T18:09:06.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.511+0000 7f767d79b980 1 -- 172.21.15.114:0/3820555105 wait complete. 2024-05-08T18:09:06.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767d79b980 1 Processor -- start 2024-05-08T18:09:06.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767d79b980 1 -- start start 2024-05-08T18:09:06.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767d79b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635604445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767d79b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56356025cf80 con 0x563560358ed0 2024-05-08T18:09:06.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635604445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635604445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52310/0 (socket says 172.21.15.114:52310) 2024-05-08T18:09:06.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767b2af640 1 -- 172.21.15.114:0/2169259429 learned_addr learned my addr 172.21.15.114:0/2169259429 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767b2af640 1 -- 172.21.15.114:0/2169259429 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563560224da0 con 0x563560358ed0 2024-05-08T18:09:06.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.527+0000 7f767b2af640 1 --2- 172.21.15.114:0/2169259429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635604445e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ae040 tx=0x7f766c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de79b2bc95b111b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f756960a640 1 -- 172.21.15.114:0/2169259429 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0b0040 con 0x563560358ed0 2024-05-08T18:09:06.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f756960a640 1 -- 172.21.15.114:0/2169259429 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0ab9b0 con 0x563560358ed0 2024-05-08T18:09:06.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f756960a640 1 -- 172.21.15.114:0/2169259429 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0abc90 con 0x563560358ed0 2024-05-08T18:09:06.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/2169259429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 msgr2=0x5635604445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 --2- 172.21.15.114:0/2169259429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635604445e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ae040 tx=0x7f766c003030 comp rx=0 tx=0).stop 2024-05-08T18:09:06.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/2169259429 shutdown_connections 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 --2- 172.21.15.114:0/2169259429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x5635604445e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/2169259429 >> 172.21.15.114:0/2169259429 conn(0x5635603547a0 msgr2=0x563560440170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/2169259429 shutdown_connections 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/2169259429 wait complete. 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 Processor -- start 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- start start 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x56356044b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563560362ed0 con 0x563560358ed0 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x56356044b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767b2af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x56356044b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52322/0 (socket says 172.21.15.114:52322) 2024-05-08T18:09:06.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767b2af640 1 -- 172.21.15.114:0/3188844760 learned_addr learned my addr 172.21.15.114:0/3188844760 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767b2af640 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356044be40 con 0x563560358ed0 2024-05-08T18:09:06.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767b2af640 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x56356044b900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f766c01bb20 tx=0x7f766c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f7567e07640 1 -- 172.21.15.114:0/3188844760 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0c5070 con 0x563560358ed0 2024-05-08T18:09:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56356044c0d0 con 0x563560358ed0 2024-05-08T18:09:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f7567e07640 1 -- 172.21.15.114:0/3188844760 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0b6970 con 0x563560358ed0 2024-05-08T18:09:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f7567e07640 1 -- 172.21.15.114:0/3188844760 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f766c0b0050 con 0x563560358ed0 2024-05-08T18:09:06.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.531+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356044ed60 con 0x563560358ed0 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f7567e07640 1 -- 172.21.15.114:0/3188844760 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f766c0c8070 con 0x563560358ed0 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f7567e07640 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75600383f0 0x7f756003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f7567e07640 1 -- 172.21.15.114:0/3188844760 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f766c0bc070 con 0x563560358ed0 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767aaae640 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75600383f0 0x7f756003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5635603597f0 0x563560452860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560452ed0 con 0x5635603597f0 2024-05-08T18:09:06.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767bab0640 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5635603597f0 0x563560452860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767aaae640 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75600383f0 0x7f756003a8b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7670004180 tx=0x7f7670001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767bab0640 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5635603597f0 0x563560452860 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767bab0640 1 -- 172.21.15.114:0/3188844760 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f767400a4d0 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56356044ff60 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767bab0640 1 -- 172.21.15.114:0/3188844760 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f767400a4d0 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560454cf0 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767bab0640 1 -- 172.21.15.114:0/3188844760 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f767400a4d0 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560453f20 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767bab0640 1 -- 172.21.15.114:0/3188844760 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f767400a4d0 con 0x5635603597f0 2024-05-08T18:09:06.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.535+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560454340 con 0x5635603597f0 2024-05-08T18:09:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767bab0640 1 -- 172.21.15.114:0/3188844760 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f767400a4d0 con 0x5635603597f0 2024-05-08T18:09:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767d79b980 1 Processor -- start 2024-05-08T18:09:06.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767d79b980 1 -- start start 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767d79b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 0x563560463a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767d79b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563560260fc0 con 0x563560463660 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 0x563560463a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 0x563560463a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52328/0 (socket says 172.21.15.114:52328) 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767aaae640 1 -- 172.21.15.114:0/4242705215 learned_addr learned my addr 172.21.15.114:0/4242705215 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767aaae640 1 -- 172.21.15.114:0/4242705215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563560463fc0 con 0x563560463660 2024-05-08T18:09:06.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.539+0000 7f767aaae640 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 0x563560463a80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f767000d660 tx=0x7f767000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.543+0000 7f7565602640 1 -- 172.21.15.114:0/4242705215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f767000c6b0 con 0x563560463660 2024-05-08T18:09:06.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.543+0000 7f7565602640 1 -- 172.21.15.114:0/4242705215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767000c850 con 0x563560463660 2024-05-08T18:09:06.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.543+0000 7f7565602640 1 -- 172.21.15.114:0/4242705215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f767000cb30 con 0x563560463660 2024-05-08T18:09:06.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.543+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563560464a60 con 0x563560463660 2024-05-08T18:09:06.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.543+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563560464f30 con 0x563560463660 2024-05-08T18:09:06.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f7565602640 1 -- 172.21.15.114:0/4242705215 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7670023020 con 0x563560463660 2024-05-08T18:09:06.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f7565602640 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7554038490 0x7f755403a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f7565602640 1 -- 172.21.15.114:0/4242705215 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7670021020 con 0x563560463660 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767bab0640 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7554038490 0x7f755403a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 Processor -- start 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- start start 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767bab0640 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7554038490 0x7f755403a950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5635604542c0 tx=0x7f7674005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560470c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563560444c70 con 0x563560470890 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560470c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560470c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52338/0 (socket says 172.21.15.114:52338) 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767aaae640 1 -- 172.21.15.114:0/3027393596 learned_addr learned my addr 172.21.15.114:0/3027393596 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767aaae640 1 -- 172.21.15.114:0/3027393596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563560471240 con 0x563560470890 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767aaae640 1 --2- 172.21.15.114:0/3027393596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560470c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f767004f230 tx=0x7f7670024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbeb801874a2f23e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f755effd640 1 -- 172.21.15.114:0/3027393596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7670043020 con 0x563560470890 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f755effd640 1 -- 172.21.15.114:0/3027393596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767003e0d0 con 0x563560470890 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f755effd640 1 -- 172.21.15.114:0/3027393596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f767000ccd0 con 0x563560470890 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- 172.21.15.114:0/3027393596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 msgr2=0x563560470c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 --2- 172.21.15.114:0/3027393596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560470c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f767004f230 tx=0x7f7670024740 comp rx=0 tx=0).stop 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- 172.21.15.114:0/3027393596 shutdown_connections 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 --2- 172.21.15.114:0/3027393596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560470c70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- 172.21.15.114:0/3027393596 >> 172.21.15.114:0/3027393596 conn(0x56356046cbd0 msgr2=0x56356046ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- 172.21.15.114:0/3027393596 shutdown_connections 2024-05-08T18:09:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- 172.21.15.114:0/3027393596 wait complete. 2024-05-08T18:09:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 Processor -- start 2024-05-08T18:09:06.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- start start 2024-05-08T18:09:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560477dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.547+0000 7f767d79b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563560471a00 con 0x563560470890 2024-05-08T18:09:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560477dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767aaae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560477dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52344/0 (socket says 172.21.15.114:52344) 2024-05-08T18:09:06.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 learned_addr learned my addr 172.21.15.114:0/4232351074 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563560478310 con 0x563560470890 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767aaae640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560477dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7670023850 tx=0x7f767004f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f755d7fa640 1 -- 172.21.15.114:0/4232351074 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7670043070 con 0x563560470890 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f755d7fa640 1 -- 172.21.15.114:0/4232351074 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7670033070 con 0x563560470890 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635604785a0 con 0x563560470890 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f755d7fa640 1 -- 172.21.15.114:0/4232351074 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7670019820 con 0x563560470890 2024-05-08T18:09:06.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635604785a0 con 0x563560470890 2024-05-08T18:09:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f755d7fa640 1 -- 172.21.15.114:0/4232351074 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f767001b420 con 0x563560470890 2024-05-08T18:09:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f755d7fa640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75440383a0 0x7f754403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f755d7fa640 1 -- 172.21.15.114:0/4232351074 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7670005030 con 0x563560470890 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767bab0640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75440383a0 0x7f754403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563560483060 0x5635604854f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560485c40 con 0x563560483060 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767b2af640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563560483060 0x5635604854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767bab0640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75440383a0 0x7f754403a860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x563560453a40 tx=0x7f767401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.551+0000 7f767b2af640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563560483060 0x5635604854f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 realm 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560486050 con 0x563560483060 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560486920 con 0x563560483060 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560486cc0 con 0x563560483060 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560487120 con 0x563560483060 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:06.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 20 searching for the correct realm 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563560489090 0x56356048b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767aaae640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563560489090 0x56356048b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767aaae640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563560489090 0x56356048b480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767aaae640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7670040070 0x7f76700152e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7670040070 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767bab0640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7670040070 0x7f76700152e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767bab0640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7670040070 0x7f76700152e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f767401f070 con 0x7f7670040070 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767bab0640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7674031040 0x7f7674032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.555+0000 7f767b2af640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7674031040 0x7f7674032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7674031040 0x7f7674032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x7f7674031040 2024-05-08T18:09:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x7f7674031040 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x7f7674031040 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7670040070 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f767401f070 con 0x7f7670040070 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.559+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x7f7674031040 2024-05-08T18:09:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7670040070 2024-05-08T18:09:06.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f767401f070 con 0x7f7670040070 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x7f7674031040 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f766c0c7030 con 0x563560483060 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.563+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7670040070 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f767401f070 con 0x7f7670040070 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7670040070 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f767401f070 con 0x7f7670040070 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560489090 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.567+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7674031040 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x563560483060 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56356048bb00 con 0x7f7670040070 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f767401f070 con 0x7f7670040070 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560487b00 con 0x563560483060 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635604883a0 con 0x563560483060 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560487740 con 0x563560483060 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 zone default found 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 4 Realm: () 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 zonegroup default 2024-05-08T18:09:06.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635604883a0 con 0x7f7674031040 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56356048d960 con 0x563560489090 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56356048dd00 con 0x563560489090 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 started sync module instance, tier type = 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:06.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.571+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048ce00 con 0x7f7670040070 2024-05-08T18:09:06.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674040040 con 0x7f7670040070 2024-05-08T18:09:06.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94787248640544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048e550 con 0x7f7670040070 2024-05-08T18:09:06.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048eda0 con 0x563560483060 2024-05-08T18:09:06.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94787248645456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048eec0 con 0x563560483060 2024-05-08T18:09:06.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048f9e0 con 0x563560489090 2024-05-08T18:09:06.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.575+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94787248640544] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674040040 con 0x7f7670040070 2024-05-08T18:09:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.579+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.579+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94787248649392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048fdd0 con 0x563560489090 2024-05-08T18:09:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.579+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560490790 con 0x7f7670040070 2024-05-08T18:09:06.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.579+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94787248645456] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94787248649392] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674040040 con 0x7f7670040070 2024-05-08T18:09:06.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94787248646512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560490790 con 0x7f7670040070 2024-05-08T18:09:06.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560490fe0 con 0x563560483060 2024-05-08T18:09:06.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94787248654496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604912f0 con 0x563560483060 2024-05-08T18:09:06.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.583+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560491e10 con 0x7f7674031040 2024-05-08T18:09:06.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.587+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94787248646512] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674040040 con 0x7f7670040070 2024-05-08T18:09:06.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.587+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.587+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94787248658656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560491dd0 con 0x7f7674031040 2024-05-08T18:09:06.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.587+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560492820 con 0x7f7674031040 2024-05-08T18:09:06.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.591+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94787248654496] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.591+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94787248658656] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.591+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.591+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94787248653024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560492370 con 0x7f7674031040 2024-05-08T18:09:06.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.591+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560492bc0 con 0x7f7674031040 2024-05-08T18:09:06.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94787248653024] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94787248661360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x563560492c40 con 0x7f7674031040 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=0 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=1 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=2 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=3 2024-05-08T18:09:06.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=4 2024-05-08T18:09:06.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=5 2024-05-08T18:09:06.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=6 2024-05-08T18:09:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94787248661360] v30'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 20 add_watcher() i=7 2024-05-08T18:09:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:06.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x563560495f20 con 0x563560483060 2024-05-08T18:09:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.595+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94787248662784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604931d0 con 0x563560483060 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94787248662784] v30'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f7531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 5 note: GC not initialized 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f7530fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 20 Filter name: none 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f74aa7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5635604b9520 con 0x563560483060 2024-05-08T18:09:06.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:could not fetch user info: no user info saved2024-05-08T18:09:06.599+0000 7f767d79b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.601 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-08T18:09:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f7531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.599+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94787248662784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604b94e0 con 0x563560483060 2024-05-08T18:09:06.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.603+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94787248662784] v30'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.603+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94787248640544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604b94e0 con 0x7f7670040070 2024-05-08T18:09:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.603+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94787248640544] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674040040 con 0x7f7670040070 2024-05-08T18:09:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.603+0000 7f767d79b980 20 remove_watcher() i=0 2024-05-08T18:09:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.603+0000 7f767d79b980 2 removed watcher, disabling cache 2024-05-08T18:09:06.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.603+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94787248645456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604b94e0 con 0x563560483060 2024-05-08T18:09:06.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.607+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94787248645456] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.607+0000 7f767d79b980 20 remove_watcher() i=1 2024-05-08T18:09:06.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.607+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94787248649392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604b94e0 con 0x563560489090 2024-05-08T18:09:06.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767aaae640 1 -- 172.21.15.114:0/4232351074 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94787248649392] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7670059040 con 0x563560489090 2024-05-08T18:09:06.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767d79b980 20 remove_watcher() i=2 2024-05-08T18:09:06.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94787248646512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048d220 con 0x7f7670040070 2024-05-08T18:09:06.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767bab0640 1 -- 172.21.15.114:0/4232351074 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94787248646512] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7674040040 con 0x7f7670040070 2024-05-08T18:09:06.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767d79b980 20 remove_watcher() i=3 2024-05-08T18:09:06.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94787248654496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048f4b0 con 0x563560483060 2024-05-08T18:09:06.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94787248654496] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x563560483060 2024-05-08T18:09:06.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767d79b980 20 remove_watcher() i=4 2024-05-08T18:09:06.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.611+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94787248658656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048d220 con 0x7f7674031040 2024-05-08T18:09:06.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.615+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94787248658656] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.615+0000 7f767d79b980 20 remove_watcher() i=5 2024-05-08T18:09:06.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.615+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94787248653024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5635604908a0 con 0x7f7674031040 2024-05-08T18:09:06.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94787248653024] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 20 remove_watcher() i=6 2024-05-08T18:09:06.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94787248661360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56356048f4b0 con 0x7f7674031040 2024-05-08T18:09:06.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94787248661360] v30'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f766c0ee040 con 0x7f7674031040 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 20 remove_watcher() i=7 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7674031040 msgr2=0x7f7674032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7674031040 0x7f7674032940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563560483060 msgr2=0x5635604854f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563560483060 0x5635604854f0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7670040070 msgr2=0x7f76700152e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7670040070 0x7f76700152e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563560489090 msgr2=0x56356048b480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563560489090 0x56356048b480 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75440383a0 msgr2=0x7f754403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75440383a0 0x7f754403a860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x563560453a40 tx=0x7f767401f000 comp rx=0 tx=0).stop 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 msgr2=0x563560477dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560477dd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7670023850 tx=0x7f767004f190 comp rx=0 tx=0).stop 2024-05-08T18:09:06.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767b2af640 1 -- 172.21.15.114:0/4232351074 reap_dead start 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 shutdown_connections 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4232351074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560470890 0x563560477dd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 >> 172.21.15.114:0/4232351074 conn(0x56356046cbd0 msgr2=0x56356046a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 shutdown_connections 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4232351074 wait complete. 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7554038490 msgr2=0x7f755403a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7554038490 0x7f755403a950 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x5635604542c0 tx=0x7f7674005850 comp rx=0 tx=0).stop 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 msgr2=0x563560463a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 0x563560463a80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f767000d660 tx=0x7f767000da60 comp rx=0 tx=0).stop 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 shutdown_connections 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7554038490 0x7f755403a950 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/4242705215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560463660 0x563560463a80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 >> 172.21.15.114:0/4242705215 conn(0x563560458470 msgr2=0x563560458f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 shutdown_connections 2024-05-08T18:09:06.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/4242705215 wait complete. 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5635603597f0 msgr2=0x563560452860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5635603597f0 0x563560452860 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75600383f0 msgr2=0x7f756003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75600383f0 0x7f756003a8b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7670004180 tx=0x7f7670001340 comp rx=0 tx=0).stop 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 msgr2=0x56356044b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.619+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x56356044b900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f766c01bb20 tx=0x7f766c018020 comp rx=0 tx=0).stop 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 shutdown_connections 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5635603597f0 0x563560452860 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f75600383f0 0x7f756003a8b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 --2- 172.21.15.114:0/3188844760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563560358ed0 0x56356044b900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 >> 172.21.15.114:0/3188844760 conn(0x5635603547a0 msgr2=0x56356043ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 shutdown_connections 2024-05-08T18:09:06.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.623+0000 7f767d79b980 1 -- 172.21.15.114:0/3188844760 wait complete. 2024-05-08T18:09:06.632 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T18:09:06.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T18:09:06.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T18:09:06.633 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-08T18:09:06.721 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:06.721 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:06.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe51578980 1 Processor -- start 2024-05-08T18:09:06.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe51578980 1 -- start start 2024-05-08T18:09:06.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe51578980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560aa5d29630 0x560aa5d2ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe51578980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560aa5bce710 con 0x560aa5c977c0 2024-05-08T18:09:06.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe51578980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560aa5be2f00 con 0x560aa5d29630 2024-05-08T18:09:06.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe4e88b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560aa5d29630 0x560aa5d2ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe4e88b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560aa5d29630 0x560aa5d2ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52356/0 (socket says 172.21.15.114:52356) 2024-05-08T18:09:06.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe4e88b640 1 -- 172.21.15.114:0/2637719242 learned_addr learned my addr 172.21.15.114:0/2637719242 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe4e88b640 1 -- 172.21.15.114:0/2637719242 >> v1:172.21.15.53:6789/0 conn(0x560aa5c977c0 legacy=0x560aa5d27f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.723+0000 7efe4e88b640 1 -- 172.21.15.114:0/2637719242 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa5baaae0 con 0x560aa5d29630 2024-05-08T18:09:06.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe4e88b640 1 --2- 172.21.15.114:0/2637719242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5d29630 0x560aa5d2ba20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe3800a5c0 tx=0x7efe3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa65e35804cd926b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe4e08a640 1 -- 172.21.15.114:0/2637719242 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380a6070 con 0x560aa5d29630 2024-05-08T18:09:06.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe4e08a640 1 -- 172.21.15.114:0/2637719242 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe380af070 con 0x560aa5d29630 2024-05-08T18:09:06.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe4e08a640 1 -- 172.21.15.114:0/2637719242 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380aa5c0 con 0x560aa5d29630 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 -- 172.21.15.114:0/2637719242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5d29630 msgr2=0x560aa5d2ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 --2- 172.21.15.114:0/2637719242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5d29630 0x560aa5d2ba20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efe3800a5c0 tx=0x7efe3801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 -- 172.21.15.114:0/2637719242 shutdown_connections 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 --2- 172.21.15.114:0/2637719242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5d29630 0x560aa5d2ba20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 -- 172.21.15.114:0/2637719242 >> 172.21.15.114:0/2637719242 conn(0x560aa5d1d630 msgr2=0x560aa5d1fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 -- 172.21.15.114:0/2637719242 shutdown_connections 2024-05-08T18:09:06.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.727+0000 7efe51578980 1 -- 172.21.15.114:0/2637719242 wait complete. 2024-05-08T18:09:06.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 Processor -- start 2024-05-08T18:09:06.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- start start 2024-05-08T18:09:06.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e102a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa5c26f80 con 0x560aa5c977c0 2024-05-08T18:09:06.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe4f08c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe4f08c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52366/0 (socket says 172.21.15.114:52366) 2024-05-08T18:09:06.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe4f08c640 1 -- 172.21.15.114:0/1383376661 learned_addr learned my addr 172.21.15.114:0/1383376661 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe4f08c640 1 -- 172.21.15.114:0/1383376661 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa5beeda0 con 0x560aa5c977c0 2024-05-08T18:09:06.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe4f08c640 1 --2- 172.21.15.114:0/1383376661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e102a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efe40001680 tx=0x7efe40001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5cbb253c946230 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efd3d60a640 1 -- 172.21.15.114:0/1383376661 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40016070 con 0x560aa5c977c0 2024-05-08T18:09:06.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efd3d60a640 1 -- 172.21.15.114:0/1383376661 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe4000f660 con 0x560aa5c977c0 2024-05-08T18:09:06.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efd3d60a640 1 -- 172.21.15.114:0/1383376661 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe4000f980 con 0x560aa5c977c0 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- 172.21.15.114:0/1383376661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 msgr2=0x560aa5e102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 --2- 172.21.15.114:0/1383376661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e102a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efe40001680 tx=0x7efe40001b40 comp rx=0 tx=0).stop 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- 172.21.15.114:0/1383376661 shutdown_connections 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 --2- 172.21.15.114:0/1383376661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e102a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- 172.21.15.114:0/1383376661 >> 172.21.15.114:0/1383376661 conn(0x560aa5d1d630 msgr2=0x560aa5e0be30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- 172.21.15.114:0/1383376661 shutdown_connections 2024-05-08T18:09:06.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- 172.21.15.114:0/1383376661 wait complete. 2024-05-08T18:09:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 Processor -- start 2024-05-08T18:09:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- start start 2024-05-08T18:09:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e17660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.743+0000 7efe51578980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa5d2ea20 con 0x560aa5c977c0 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f08c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e17660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f08c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e17660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52368/0 (socket says 172.21.15.114:52368) 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f08c640 1 -- 172.21.15.114:0/2688800448 learned_addr learned my addr 172.21.15.114:0/2688800448 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f08c640 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa5e17ba0 con 0x560aa5c977c0 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f08c640 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e17660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efe4000f630 tx=0x7efe40000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efd3be07640 1 -- 172.21.15.114:0/2688800448 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe40016040 con 0x560aa5c977c0 2024-05-08T18:09:06.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560aa5e17e30 con 0x560aa5c977c0 2024-05-08T18:09:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efd3be07640 1 -- 172.21.15.114:0/2688800448 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe40022070 con 0x560aa5c977c0 2024-05-08T18:09:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efd3be07640 1 -- 172.21.15.114:0/2688800448 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe400061c0 con 0x560aa5c977c0 2024-05-08T18:09:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa5e1aac0 con 0x560aa5c977c0 2024-05-08T18:09:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efd3be07640 1 -- 172.21.15.114:0/2688800448 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efe400117c0 con 0x560aa5c977c0 2024-05-08T18:09:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efd3be07640 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd340383a0 0x7efd3403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efd3be07640 1 -- 172.21.15.114:0/2688800448 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7efe4004e310 con 0x560aa5c977c0 2024-05-08T18:09:06.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4e88b640 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd340383a0 0x7efd3403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5d29630 0x560aa5e1e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e1ec90 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f88d640 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5d29630 0x560aa5e1e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4e88b640 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd340383a0 0x7efd3403a860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe380ae000 tx=0x7efe380a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.747+0000 7efe4f88d640 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5d29630 0x560aa5e1e710 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4f88d640 1 -- 172.21.15.114:0/2688800448 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe480083f0 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e1bcc0 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4f88d640 1 -- 172.21.15.114:0/2688800448 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe480083f0 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e20ac0 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4f88d640 1 -- 172.21.15.114:0/2688800448 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe480083f0 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e1fc30 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4f88d640 1 -- 172.21.15.114:0/2688800448 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe480083f0 con 0x560aa5d29630 2024-05-08T18:09:06.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e20050 con 0x560aa5d29630 2024-05-08T18:09:06.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4f88d640 1 -- 172.21.15.114:0/2688800448 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efe480083f0 con 0x560aa5d29630 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 Processor -- start 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- start start 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 0x560aa5e2f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa5c2afc0 con 0x560aa5e2f410 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4e88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 0x560aa5e2f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4e88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 0x560aa5e2f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52376/0 (socket says 172.21.15.114:52376) 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4e88b640 1 -- 172.21.15.114:0/3307022671 learned_addr learned my addr 172.21.15.114:0/3307022671 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4e88b640 1 -- 172.21.15.114:0/3307022671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa5e2fd70 con 0x560aa5e2f410 2024-05-08T18:09:06.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe4e88b640 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 0x560aa5e2f830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe380199f0 tx=0x7efe380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efd39602640 1 -- 172.21.15.114:0/3307022671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380b3b90 con 0x560aa5e2f410 2024-05-08T18:09:06.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560aa5e30810 con 0x560aa5e2f410 2024-05-08T18:09:06.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efd39602640 1 -- 172.21.15.114:0/3307022671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe380b3d30 con 0x560aa5e2f410 2024-05-08T18:09:06.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efd39602640 1 -- 172.21.15.114:0/3307022671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380c8560 con 0x560aa5e2f410 2024-05-08T18:09:06.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.751+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa5e30c80 con 0x560aa5e2f410 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efd39602640 1 -- 172.21.15.114:0/3307022671 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efe380d1440 con 0x560aa5e2f410 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efd39602640 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd28038440 0x7efd2803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efd39602640 1 -- 172.21.15.114:0/3307022671 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7efe380ec0d0 con 0x560aa5e2f410 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4f88d640 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd28038440 0x7efd2803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe51578980 1 Processor -- start 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe51578980 1 -- start start 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4f88d640 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd28038440 0x7efd2803a900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560aa5e1ffd0 tx=0x7efe48003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe51578980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e3c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe51578980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa5e109f0 con 0x560aa5e3c4f0 2024-05-08T18:09:06.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4e88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e3c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4e88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e3c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52392/0 (socket says 172.21.15.114:52392) 2024-05-08T18:09:06.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4e88b640 1 -- 172.21.15.114:0/1729292194 learned_addr learned my addr 172.21.15.114:0/1729292194 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4e88b640 1 -- 172.21.15.114:0/1729292194 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa5e3cec0 con 0x560aa5e3c4f0 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efe4e88b640 1 --2- 172.21.15.114:0/1729292194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e3c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe380ea450 tx=0x7efe380d1a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0eb88c1ab511c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efd32ffd640 1 -- 172.21.15.114:0/1729292194 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380bd390 con 0x560aa5e3c4f0 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efd32ffd640 1 -- 172.21.15.114:0/1729292194 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe380bd530 con 0x560aa5e3c4f0 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.755+0000 7efd32ffd640 1 -- 172.21.15.114:0/1729292194 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380be410 con 0x560aa5e3c4f0 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/1729292194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 msgr2=0x560aa5e3c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 --2- 172.21.15.114:0/1729292194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e3c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efe380ea450 tx=0x7efe380d1a80 comp rx=0 tx=0).stop 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/1729292194 shutdown_connections 2024-05-08T18:09:06.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 --2- 172.21.15.114:0/1729292194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e3c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/1729292194 >> 172.21.15.114:0/1729292194 conn(0x560aa5e38830 msgr2=0x560aa5e36890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/1729292194 shutdown_connections 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/1729292194 wait complete. 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 Processor -- start 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- start start 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e43990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560aa5e3d600 con 0x560aa5e3c4f0 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe4e88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e43990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe4e88b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e43990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52400/0 (socket says 172.21.15.114:52400) 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 learned_addr learned my addr 172.21.15.114:0/177481090 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aa5e43ed0 con 0x560aa5e3c4f0 2024-05-08T18:09:06.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe4e88b640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e43990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe380b37e0 tx=0x7efe380ea3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efd317fa640 1 -- 172.21.15.114:0/177481090 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380c7cf0 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560aa5e44160 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efd317fa640 1 -- 172.21.15.114:0/177481090 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe380bf910 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efd317fa640 1 -- 172.21.15.114:0/177481090 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe380c7e90 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aa5e44570 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efd317fa640 1 -- 172.21.15.114:0/177481090 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efe380f4060 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efd317fa640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd180383f0 0x7efd1803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efd317fa640 1 -- 172.21.15.114:0/177481090 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7efe380eec30 con 0x560aa5e3c4f0 2024-05-08T18:09:06.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe4f88d640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd180383f0 0x7efd1803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5e4ec80 0x560aa5e51140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.759+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e51890 con 0x560aa5e4ec80 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5e4ec80 0x560aa5e51140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f88d640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd180383f0 0x7efd1803a8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x560aa5e1f750 tx=0x7efe4801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5e4ec80 0x560aa5e51140 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 realm 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e51ca0 con 0x560aa5e4ec80 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e52540 con 0x560aa5e4ec80 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e528e0 con 0x560aa5e4ec80 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e53130 con 0x560aa5e4ec80 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:06.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 20 searching for the correct realm 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560aa5e54ea0 0x560aa5e57290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4e88b640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560aa5e54ea0 0x560aa5e57290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4e88b640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560aa5e54ea0 0x560aa5e57290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4e88b640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efe380f6070 0x7efe380caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe380f6070 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f88d640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efe380f6070 0x7efe380caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f88d640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efe380f6070 0x7efe380caa70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f88d640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efe48019040 0x7efe48019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.763+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efe48019040 0x7efe48019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efe48019040 0x7efe48019930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x7efe48019040 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x7efe48019040 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x7efe48019040 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe380f6070 2024-05-08T18:09:06.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.767+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x7efe48019040 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe380f6070 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x7efe48019040 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7efe4000f070 con 0x560aa5e4ec80 2024-05-08T18:09:06.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.771+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe380f6070 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe380f6070 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e54ea0 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe48019040 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.775+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x560aa5e4ec80 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e577d0 con 0x7efe380f6070 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:06.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e53ae0 con 0x560aa5e4ec80 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e54330 con 0x560aa5e4ec80 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e54330 con 0x560aa5e4ec80 2024-05-08T18:09:06.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 zone default found 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 4 Realm: () 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 zonegroup default 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e57c00 con 0x7efe48019040 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e59640 con 0x560aa5e54ea0 2024-05-08T18:09:06.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e59b10 con 0x560aa5e54ea0 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 started sync module instance, tier type = 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:06.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.779+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e58a80 con 0x7efe380f6070 2024-05-08T18:09:06.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94603732946592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e586e0 con 0x7efe380f6070 2024-05-08T18:09:06.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5aa40 con 0x560aa5e4ec80 2024-05-08T18:09:06.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94603732952464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5ae60 con 0x560aa5e4ec80 2024-05-08T18:09:06.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5b8a0 con 0x560aa5e54ea0 2024-05-08T18:09:06.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.783+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94603732946592] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.787+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94603732952464] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.787+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.787+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94603732950896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5ae60 con 0x560aa5e54ea0 2024-05-08T18:09:06.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.787+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5c140 con 0x7efe380f6070 2024-05-08T18:09:06.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94603732950896] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94603732958352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5c560 con 0x7efe380f6070 2024-05-08T18:09:06.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5cdb0 con 0x560aa5e4ec80 2024-05-08T18:09:06.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94603732960912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5d1a0 con 0x560aa5e4ec80 2024-05-08T18:09:06.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.791+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5dc90 con 0x7efe48019040 2024-05-08T18:09:06.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.795+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94603732958352] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.795+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.795+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94603732965216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5dc50 con 0x7efe48019040 2024-05-08T18:09:06.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.795+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5e6a0 con 0x7efe48019040 2024-05-08T18:09:06.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.795+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94603732960912] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.795+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94603732965216] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.799+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.799+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94603732959408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5e1f0 con 0x7efe48019040 2024-05-08T18:09:06.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.799+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5ea40 con 0x7efe48019040 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94603732959408] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94603732967920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5eac0 con 0x7efe48019040 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=0 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=1 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=2 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=3 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=4 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=5 2024-05-08T18:09:06.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=6 2024-05-08T18:09:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94603732967920] v30'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 20 add_watcher() i=7 2024-05-08T18:09:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e61de0 con 0x560aa5e4ec80 2024-05-08T18:09:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.803+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94603732969344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5f050 con 0x560aa5e4ec80 2024-05-08T18:09:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94603732969344] v30'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efd05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 5 note: GC not initialized 2024-05-08T18:09:06.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efd04fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 Filter name: none 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efc7e7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e85900 con 0x560aa5e4ec80 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e83f40 con 0x560aa5e4ec80 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e84330 con 0x7efe48019040 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.807+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e88ea0 con 0x560aa5e4ec80 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe51578980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe51578980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe51578980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:06.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94603733125392 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e89430 con 0x560aa5e4ec80 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify (1) cookie 94603732960912 notify 128849018880 ret 0) ==== 609+0+0 (crc 0 0 0) 0x560aa5e855b0 con 0x560aa5e4ec80 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efd32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94603732960912 notifier 4289 bl.length()=567 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efd32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efd32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 notify.4 [notify cookie 94603733125392 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efd32ffd640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efd14003eb0 con 0x560aa5e4ec80 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== watch-notify(notify_complete (2) cookie 94603733125392 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560aa5e85350 con 0x560aa5e4ec80 2024-05-08T18:09:06.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.811+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e86e80 con 0x560aa5e4ec80 2024-05-08T18:09:06.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94603733125344 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e86e80 con 0x7efe380f6070 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== watch-notify(notify (1) cookie 94603732958352 notify 128849018880 ret 0) ==== 211+0+0 (crc 0 0 0) 0x7efe48010040 con 0x7efe380f6070 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efd32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94603732958352 notifier 4289 bl.length()=169 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efd32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efd32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(69 notify.3 [notify cookie 94603733125344 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efd32ffd640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efd14003eb0 con 0x7efe380f6070 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== watch-notify(notify_complete (2) cookie 94603733125344 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efe48026880 con 0x7efe380f6070 2024-05-08T18:09:06.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e893f0 con 0x7efe48019040 2024-05-08T18:09:06.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94603733144560 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e89860 con 0x7efe380f6070 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== watch-notify(notify (1) cookie 94603732958352 notify 128849018881 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7efe48026880 con 0x7efe380f6070 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.815+0000 7efd32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94603732958352 notifier 4289 bl.length()=177 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efd32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efd32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(72 notify.3 [notify cookie 94603733144560 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efd32ffd640 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7efd14003eb0 con 0x7efe380f6070 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== watch-notify(notify_complete (2) cookie 94603733144560 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efe48026c60 con 0x7efe380f6070 2024-05-08T18:09:06.819 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:06.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efd05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94603732969344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e835a0 con 0x560aa5e4ec80 2024-05-08T18:09:06.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94603732969344] v30'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94603732946592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e835a0 con 0x7efe380f6070 2024-05-08T18:09:06.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94603732946592] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe51578980 20 remove_watcher() i=0 2024-05-08T18:09:06.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe51578980 2 removed watcher, disabling cache 2024-05-08T18:09:06.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.819+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94603732952464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e835a0 con 0x560aa5e4ec80 2024-05-08T18:09:06.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.823+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94603732952464] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.823+0000 7efe51578980 20 remove_watcher() i=1 2024-05-08T18:09:06.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.823+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94603732950896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e835a0 con 0x560aa5e54ea0 2024-05-08T18:09:06.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe4e88b640 1 -- 172.21.15.114:0/177481090 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94603732950896] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe380ce020 con 0x560aa5e54ea0 2024-05-08T18:09:06.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe51578980 20 remove_watcher() i=2 2024-05-08T18:09:06.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94603732958352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5a590 con 0x7efe380f6070 2024-05-08T18:09:06.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe4f88d640 1 -- 172.21.15.114:0/177481090 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94603732958352] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe4802f040 con 0x7efe380f6070 2024-05-08T18:09:06.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe51578980 20 remove_watcher() i=3 2024-05-08T18:09:06.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94603732960912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e59f70 con 0x560aa5e4ec80 2024-05-08T18:09:06.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94603732960912] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x560aa5e4ec80 2024-05-08T18:09:06.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe51578980 20 remove_watcher() i=4 2024-05-08T18:09:06.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.827+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94603732965216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5bc90 con 0x7efe48019040 2024-05-08T18:09:06.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.831+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94603732965216] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.831+0000 7efe51578980 20 remove_watcher() i=5 2024-05-08T18:09:06.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.831+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94603732959408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5a590 con 0x7efe48019040 2024-05-08T18:09:06.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.831+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94603732959408] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.831+0000 7efe51578980 20 remove_watcher() i=6 2024-05-08T18:09:06.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.831+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94603732967920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560aa5e5c690 con 0x7efe48019040 2024-05-08T18:09:06.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94603732967920] v30'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efe40042040 con 0x7efe48019040 2024-05-08T18:09:06.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 20 remove_watcher() i=7 2024-05-08T18:09:06.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efe48019040 msgr2=0x7efe48019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efe48019040 0x7efe48019930 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5e4ec80 msgr2=0x560aa5e51140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5e4ec80 0x560aa5e51140 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efe380f6070 msgr2=0x7efe380caa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efe380f6070 0x7efe380caa70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560aa5e54ea0 msgr2=0x560aa5e57290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560aa5e54ea0 0x560aa5e57290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd180383f0 msgr2=0x7efd1803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd180383f0 0x7efd1803a8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x560aa5e1f750 tx=0x7efe4801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 msgr2=0x560aa5e43990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe4f08c640 1 -- 172.21.15.114:0/177481090 reap_dead start 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e43990 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efe380b37e0 tx=0x7efe380ea3b0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 shutdown_connections 2024-05-08T18:09:06.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/177481090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e3c4f0 0x560aa5e43990 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 >> 172.21.15.114:0/177481090 conn(0x560aa5e38830 msgr2=0x560aa5e35e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 shutdown_connections 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/177481090 wait complete. 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd28038440 msgr2=0x7efd2803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd28038440 0x7efd2803a900 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x560aa5e1ffd0 tx=0x7efe48003070 comp rx=0 tx=0).stop 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 msgr2=0x560aa5e2f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 0x560aa5e2f830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe380199f0 tx=0x7efe380180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 shutdown_connections 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd28038440 0x7efd2803a900 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/3307022671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5e2f410 0x560aa5e2f830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 >> 172.21.15.114:0/3307022671 conn(0x560aa5e24220 msgr2=0x560aa5e24d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 shutdown_connections 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/3307022671 wait complete. 2024-05-08T18:09:06.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5d29630 msgr2=0x560aa5e1e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5d29630 0x560aa5e1e710 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd340383a0 msgr2=0x7efd3403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd340383a0 0x7efd3403a860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe380ae000 tx=0x7efe380a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 msgr2=0x560aa5e17660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e17660 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efe4000f630 tx=0x7efe40000f50 comp rx=0 tx=0).stop 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 shutdown_connections 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560aa5d29630 0x560aa5e1e710 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd340383a0 0x7efd3403a860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 --2- 172.21.15.114:0/2688800448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560aa5c977c0 0x560aa5e17660 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 >> 172.21.15.114:0/2688800448 conn(0x560aa5d1d630 msgr2=0x560aa5e0a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 shutdown_connections 2024-05-08T18:09:06.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.835+0000 7efe51578980 1 -- 172.21.15.114:0/2688800448 wait complete. 2024-05-08T18:09:06.848 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:06.848 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T18:09:06.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T18:09:06.848 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-08T18:09:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:06.883 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:06.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7c1631980 1 Processor -- start 2024-05-08T18:09:06.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7c1631980 1 -- start start 2024-05-08T18:09:06.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7c1631980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d9b94b8670 0x55d9b94baa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7c1631980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d9b935d710 con 0x55d9b9426780 2024-05-08T18:09:06.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7c1631980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d9b9371f00 con 0x55d9b94b8670 2024-05-08T18:09:06.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7be944640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d9b94b8670 0x55d9b94baa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7be944640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d9b94b8670 0x55d9b94baa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52406/0 (socket says 172.21.15.114:52406) 2024-05-08T18:09:06.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7bf145640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d9b9426780 0x55d9b94b6f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50962/0 (socket says 172.21.15.114:50962) 2024-05-08T18:09:06.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.883+0000 7ff7be944640 1 -- 172.21.15.114:0/375151612 learned_addr learned my addr 172.21.15.114:0/375151612 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7be944640 1 -- 172.21.15.114:0/375151612 >> v1:172.21.15.53:6789/0 conn(0x55d9b9426780 legacy=0x55d9b94b6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7be944640 1 -- 172.21.15.114:0/375151612 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b9339ae0 con 0x55d9b94b8670 2024-05-08T18:09:06.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7be944640 1 --2- 172.21.15.114:0/375151612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b94b8670 0x55d9b94baa60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400a5c0 tx=0x7ff7b401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7eaab06bf5ccede server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7be143640 1 -- 172.21.15.114:0/375151612 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40a6070 con 0x55d9b94b8670 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7be143640 1 -- 172.21.15.114:0/375151612 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40af070 con 0x55d9b94b8670 2024-05-08T18:09:06.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7be143640 1 -- 172.21.15.114:0/375151612 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40aa5c0 con 0x55d9b94b8670 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 -- 172.21.15.114:0/375151612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b94b8670 msgr2=0x55d9b94baa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 --2- 172.21.15.114:0/375151612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b94b8670 0x55d9b94baa60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff7b400a5c0 tx=0x7ff7b401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 -- 172.21.15.114:0/375151612 shutdown_connections 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 --2- 172.21.15.114:0/375151612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b94b8670 0x55d9b94baa60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 -- 172.21.15.114:0/375151612 >> 172.21.15.114:0/375151612 conn(0x55d9b94ac630 msgr2=0x55d9b94aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 -- 172.21.15.114:0/375151612 shutdown_connections 2024-05-08T18:09:06.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.887+0000 7ff7c1631980 1 -- 172.21.15.114:0/375151612 wait complete. 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7c1631980 1 Processor -- start 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7c1631980 1 -- start start 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7c1631980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b959f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7c1631980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d9b93b5f80 con 0x55d9b9426780 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7bf145640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b959f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7bf145640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b959f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52412/0 (socket says 172.21.15.114:52412) 2024-05-08T18:09:06.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7bf145640 1 -- 172.21.15.114:0/2450400951 learned_addr learned my addr 172.21.15.114:0/2450400951 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7bf145640 1 -- 172.21.15.114:0/2450400951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b937dda0 con 0x55d9b9426780 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff7bf145640 1 --2- 172.21.15.114:0/2450400951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b959f160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0001ec0 tx=0x7ff7b000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b2a32d59268e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff6ad60a640 1 -- 172.21.15.114:0/2450400951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000e5d0 con 0x55d9b9426780 2024-05-08T18:09:06.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff6ad60a640 1 -- 172.21.15.114:0/2450400951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b000e770 con 0x55d9b9426780 2024-05-08T18:09:06.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.903+0000 7ff6ad60a640 1 -- 172.21.15.114:0/2450400951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000ea70 con 0x55d9b9426780 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/2450400951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 msgr2=0x55d9b959f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 --2- 172.21.15.114:0/2450400951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b959f160 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0001ec0 tx=0x7ff7b000b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/2450400951 shutdown_connections 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 --2- 172.21.15.114:0/2450400951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b959f160 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/2450400951 >> 172.21.15.114:0/2450400951 conn(0x55d9b94ac630 msgr2=0x55d9b959acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/2450400951 shutdown_connections 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/2450400951 wait complete. 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 Processor -- start 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- start start 2024-05-08T18:09:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b95a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d9b94bda00 con 0x55d9b9426780 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7bf145640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b95a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7bf145640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b95a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52414/0 (socket says 172.21.15.114:52414) 2024-05-08T18:09:06.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7bf145640 1 -- 172.21.15.114:0/3765163742 learned_addr learned my addr 172.21.15.114:0/3765163742 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7bf145640 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b95a6ac0 con 0x55d9b9426780 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7bf145640 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b95a6580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55d9b959fff0 tx=0x7ff7b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff6abe07640 1 -- 172.21.15.114:0/3765163742 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b000f8a0 con 0x55d9b9426780 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b95a6d50 con 0x55d9b9426780 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff6abe07640 1 -- 172.21.15.114:0/3765163742 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b000fa40 con 0x55d9b9426780 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b95a9a30 con 0x55d9b9426780 2024-05-08T18:09:06.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.907+0000 7ff6abe07640 1 -- 172.21.15.114:0/3765163742 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b002c060 con 0x55d9b9426780 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff6abe07640 1 -- 172.21.15.114:0/3765163742 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff7b0017070 con 0x55d9b9426780 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff6abe07640 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6a40383f0 0x7ff6a403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff6abe07640 1 -- 172.21.15.114:0/3765163742 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ff7b0015020 con 0x55d9b9426780 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7be944640 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6a40383f0 0x7ff6a403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b94b8670 0x55d9b95ad550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95adb90 con 0x55d9b94b8670 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b94b8670 0x55d9b95ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7be944640 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6a40383f0 0x7ff6a403a8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40ae000 tx=0x7ff7b40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b94b8670 0x55d9b95ad550 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 -- 172.21.15.114:0/3765163742 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b800a4d0 con 0x55d9b94b8670 2024-05-08T18:09:06.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95aac50 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 -- 172.21.15.114:0/3765163742 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7b800a4d0 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95af9d0 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 -- 172.21.15.114:0/3765163742 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff7b800a4d0 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95aec00 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 -- 172.21.15.114:0/3765163742 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7b800a4d0 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95af020 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7bf946640 1 -- 172.21.15.114:0/3765163742 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff7b800a4d0 con 0x55d9b94b8670 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 Processor -- start 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- start start 2024-05-08T18:09:06.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 0x55d9b95be770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.911+0000 7ff7c1631980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d9b93b9fc0 con 0x55d9b95be350 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 0x55d9b95be770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 0x55d9b95be770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52424/0 (socket says 172.21.15.114:52424) 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 -- 172.21.15.114:0/1356143972 learned_addr learned my addr 172.21.15.114:0/1356143972 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 -- 172.21.15.114:0/1356143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b95becb0 con 0x55d9b95be350 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 0x55d9b95be770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40199f0 tx=0x7ff7b40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff6a9602640 1 -- 172.21.15.114:0/1356143972 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40b3b90 con 0x55d9b95be350 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b95bf750 con 0x55d9b95be350 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff6a9602640 1 -- 172.21.15.114:0/1356143972 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40b3d30 con 0x55d9b95be350 2024-05-08T18:09:06.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff6a9602640 1 -- 172.21.15.114:0/1356143972 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40c8560 con 0x55d9b95be350 2024-05-08T18:09:06.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b95bfbc0 con 0x55d9b95be350 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff6a9602640 1 -- 172.21.15.114:0/1356143972 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff7b40d1440 con 0x55d9b95be350 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff6a9602640 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6980383f0 0x7ff69803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff6a9602640 1 -- 172.21.15.114:0/1356143972 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ff7b40ec010 con 0x55d9b95be350 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7bf946640 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6980383f0 0x7ff69803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7c1631980 1 Processor -- start 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7c1631980 1 -- start start 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7c1631980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7c1631980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d9b959f8b0 con 0x55d9b95cb430 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7bf946640 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6980383f0 0x7ff69803a8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55d9b95aefa0 tx=0x7ff7b8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52438/0 (socket says 172.21.15.114:52438) 2024-05-08T18:09:06.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.915+0000 7ff7be944640 1 -- 172.21.15.114:0/3519932187 learned_addr learned my addr 172.21.15.114:0/3519932187 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 -- 172.21.15.114:0/3519932187 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b95cbde0 con 0x55d9b95cb430 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 --2- 172.21.15.114:0/3519932187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95cb810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005bb0 tx=0x7ff7b40d1b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c231df3027a36b8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff6a2ffd640 1 -- 172.21.15.114:0/3519932187 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40bd390 con 0x55d9b95cb430 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff6a2ffd640 1 -- 172.21.15.114:0/3519932187 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40bd530 con 0x55d9b95cb430 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff6a2ffd640 1 -- 172.21.15.114:0/3519932187 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40be410 con 0x55d9b95cb430 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/3519932187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 msgr2=0x55d9b95cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3519932187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95cb810 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff7b4005bb0 tx=0x7ff7b40d1b10 comp rx=0 tx=0).stop 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/3519932187 shutdown_connections 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3519932187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95cb810 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/3519932187 >> 172.21.15.114:0/3519932187 conn(0x55d9b95c7770 msgr2=0x55d9b95c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/3519932187 shutdown_connections 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/3519932187 wait complete. 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 Processor -- start 2024-05-08T18:09:06.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- start start 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95d2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d9b95cc5a0 con 0x55d9b95cb430 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95d2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95d2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52446/0 (socket says 172.21.15.114:52446) 2024-05-08T18:09:06.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 learned_addr learned my addr 172.21.15.114:0/4286349414 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9b95d2eb0 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7be944640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95d2970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40b37e0 tx=0x7ff7b40ea3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff6a17fa640 1 -- 172.21.15.114:0/4286349414 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40bd390 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d9b95d3140 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff6a17fa640 1 -- 172.21.15.114:0/4286349414 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b40be710 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff6a17fa640 1 -- 172.21.15.114:0/4286349414 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff7b40c7500 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.919+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9b95d5e20 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff6a17fa640 1 -- 172.21.15.114:0/4286349414 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff7b40bf8f0 con 0x55d9b95cb430 2024-05-08T18:09:06.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff6a17fa640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6880383f0 0x7ff68803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff6a17fa640 1 -- 172.21.15.114:0/4286349414 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ff7b40eec50 con 0x55d9b95cb430 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf946640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6880383f0 0x7ff68803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b95ddca0 0x55d9b95e0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e0890 con 0x55d9b95ddca0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b95ddca0 0x55d9b95e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf946640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6880383f0 0x7ff68803a8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55d9b95ae720 tx=0x7ff7b801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b95ddca0 0x55d9b95e0140 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 realm 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e0ca0 con 0x55d9b95ddca0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e1570 con 0x55d9b95ddca0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e1910 con 0x55d9b95ddca0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e2160 con 0x55d9b95ddca0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 20 searching for the correct realm 2024-05-08T18:09:06.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d9b95e3b90 0x55d9b95e6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7be944640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d9b95e3b90 0x55d9b95e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.923+0000 7ff7be944640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d9b95e3b90 0x55d9b95e6050 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7be944640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff7b40ed030 0x7ff7b40dba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b40ed030 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf946640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff7b40ed030 0x7ff7b40dba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf946640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff7b40ed030 0x7ff7b40dba00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b801f070 con 0x7ff7b40ed030 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf946640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff7b8031040 0x7ff7b8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff7b8031040 0x7ff7b8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff7b8031040 0x7ff7b8032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.927+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b40ed030 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b801f070 con 0x7ff7b40ed030 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b40ed030 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff7b801f070 con 0x7ff7b40ed030 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.931+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b40ed030 2024-05-08T18:09:06.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b801f070 con 0x7ff7b40ed030 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff7b002e070 con 0x55d9b95ddca0 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b002e070 con 0x7ff7b8031040 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b40ed030 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b801f070 con 0x7ff7b40ed030 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.935+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95e3b90 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b8031040 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x55d9b95ddca0 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6720 con 0x7ff7b40ed030 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff7b801f070 con 0x7ff7b40ed030 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e29b0 con 0x55d9b95ddca0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e2da0 con 0x55d9b95ddca0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:06.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e6ba0 con 0x55d9b95ddca0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 zone default found 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 4 Realm: () 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 zonegroup default 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e25d0 con 0x7ff7b8031040 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e8ab0 con 0x55d9b95e3b90 2024-05-08T18:09:06.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e8e80 con 0x55d9b95e3b90 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 started sync module instance, tier type = 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.939+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e7f50 con 0x7ff7b40ed030 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b8040040 con 0x7ff7b40ed030 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94393606243136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e7bb0 con 0x7ff7b40ed030 2024-05-08T18:09:06.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e9db0 con 0x55d9b95ddca0 2024-05-08T18:09:06.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94393606248704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ea1d0 con 0x55d9b95ddca0 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95eac40 con 0x55d9b95e3b90 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.943+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94393606243136] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b8040040 con 0x7ff7b40ed030 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94393606252304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95eb030 con 0x55d9b95e3b90 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95eb9f0 con 0x7ff7b40ed030 2024-05-08T18:09:06.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94393606248704] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b8040040 con 0x7ff7b40ed030 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94393606255936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ebe10 con 0x7ff7b40ed030 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.947+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ec6e0 con 0x55d9b95ddca0 2024-05-08T18:09:06.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.951+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94393606252304] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.951+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.951+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94393606247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ec2c0 con 0x55d9b95ddca0 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.951+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ed0f0 con 0x7ff7b8031040 2024-05-08T18:09:06.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.951+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94393606255936] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b8040040 con 0x7ff7b40ed030 2024-05-08T18:09:06.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.955+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94393606247136] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.955+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.955+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94393606257264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ecc40 con 0x7ff7b8031040 2024-05-08T18:09:06.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.955+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ed490 con 0x7ff7b8031040 2024-05-08T18:09:06.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.955+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94393606257264] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.959+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.959+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94393606261824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ed510 con 0x7ff7b8031040 2024-05-08T18:09:06.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.959+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95edda0 con 0x7ff7b8031040 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94393606261824] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94393606262880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95edf80 con 0x7ff7b8031040 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=0 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=1 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=2 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=3 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=4 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=5 2024-05-08T18:09:06.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=6 2024-05-08T18:09:06.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94393606262880] v30'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 20 add_watcher() i=7 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95f1350 con 0x55d9b95ddca0 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.963+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94393606266480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95ee740 con 0x55d9b95ddca0 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94393606266480] v30'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff6767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:06.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 5 note: GC not initialized 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff6757e2640 20 reqs_thread_entry: start 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 Filter name: none 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff66e7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:06.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b9614d20 con 0x7ff7b8031040 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b9613360 con 0x55d9b95ddca0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rados_obj.operate() r=0 bl.length=7 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:06.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rados->read ofs=0 len=0 2024-05-08T18:09:06.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d9b9613750 con 0x55d9b95ddca0 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.967+0000 7ff7c1631980 20 get_user_info_from_index found 0 xattrs 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff6767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94393606266480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95f3c90 con 0x55d9b95ddca0 2024-05-08T18:09:06.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94393606266480] v30'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94393606243136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b9612a50 con 0x7ff7b40ed030 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94393606243136] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b8040040 con 0x7ff7b40ed030 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7c1631980 20 remove_watcher() i=0 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7c1631980 2 removed watcher, disabling cache 2024-05-08T18:09:06.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.971+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94393606248704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b9612a50 con 0x55d9b95ddca0 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.975+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94393606248704] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.975+0000 7ff7c1631980 20 remove_watcher() i=1 2024-05-08T18:09:06.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.975+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94393606252304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b9612a50 con 0x55d9b95e3b90 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.975+0000 7ff7be944640 1 -- 172.21.15.114:0/4286349414 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94393606252304] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b40f3020 con 0x55d9b95e3b90 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.975+0000 7ff7c1631980 20 remove_watcher() i=2 2024-05-08T18:09:06.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.975+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94393606255936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e8340 con 0x7ff7b40ed030 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.979+0000 7ff7bf946640 1 -- 172.21.15.114:0/4286349414 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94393606255936] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b8040040 con 0x7ff7b40ed030 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.979+0000 7ff7c1631980 20 remove_watcher() i=3 2024-05-08T18:09:06.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.979+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94393606247136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e9900 con 0x55d9b95ddca0 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.979+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94393606247136] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x55d9b95ddca0 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.979+0000 7ff7c1631980 20 remove_watcher() i=4 2024-05-08T18:09:06.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.979+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94393606257264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95eb540 con 0x7ff7b8031040 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.983+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94393606257264] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.983+0000 7ff7c1631980 20 remove_watcher() i=5 2024-05-08T18:09:06.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.983+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94393606261824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e8340 con 0x7ff7b8031040 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.983+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94393606261824] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.983+0000 7ff7c1631980 20 remove_watcher() i=6 2024-05-08T18:09:06.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.983+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94393606262880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d9b95e9900 con 0x7ff7b8031040 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94393606262880] v30'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff7b0055040 con 0x7ff7b8031040 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 20 remove_watcher() i=7 2024-05-08T18:09:06.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff7b8031040 msgr2=0x7ff7b8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff7b8031040 0x7ff7b8032940 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b95ddca0 msgr2=0x55d9b95e0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b95ddca0 0x55d9b95e0140 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff7b40ed030 msgr2=0x7ff7b40dba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ff7b40ed030 0x7ff7b40dba00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d9b95e3b90 msgr2=0x55d9b95e6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d9b95e3b90 0x55d9b95e6050 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6880383f0 msgr2=0x7ff68803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6880383f0 0x7ff68803a8b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x55d9b95ae720 tx=0x7ff7b801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 msgr2=0x55d9b95d2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/4286349414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95cb430 0x55d9b95d2970 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40b37e0 tx=0x7ff7b40ea3b0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 reap_dead start 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7bf145640 1 -- 172.21.15.114:0/4286349414 reap_dead start 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 shutdown_connections 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 >> 172.21.15.114:0/4286349414 conn(0x55d9b95c7770 msgr2=0x55d9b95c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 shutdown_connections 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/4286349414 wait complete. 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6980383f0 msgr2=0x7ff69803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6980383f0 0x7ff69803a8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55d9b95aefa0 tx=0x7ff7b8005850 comp rx=0 tx=0).stop 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 msgr2=0x55d9b95be770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 0x55d9b95be770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40199f0 tx=0x7ff7b40180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 shutdown_connections 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6980383f0 0x7ff69803a8b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/1356143972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b95be350 0x55d9b95be770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 >> 172.21.15.114:0/1356143972 conn(0x55d9b95b3160 msgr2=0x55d9b95b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 shutdown_connections 2024-05-08T18:09:06.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/1356143972 wait complete. 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b94b8670 msgr2=0x55d9b95ad550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b94b8670 0x55d9b95ad550 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6a40383f0 msgr2=0x7ff6a403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6a40383f0 0x7ff6a403a8b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff7b40ae000 tx=0x7ff7b40a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 msgr2=0x55d9b95a6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b95a6580 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x55d9b959fff0 tx=0x7ff7b0000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 shutdown_connections 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d9b94b8670 0x55d9b95ad550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff6a40383f0 0x7ff6a403a8b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 --2- 172.21.15.114:0/3765163742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d9b9426780 0x55d9b95a6580 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 >> 172.21.15.114:0/3765163742 conn(0x55d9b94ac630 msgr2=0x55d9b9599800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 shutdown_connections 2024-05-08T18:09:06.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:06.987+0000 7ff7c1631980 1 -- 172.21.15.114:0/3765163742 wait complete. 2024-05-08T18:09:06.999 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-08T18:09:07.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:07.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:07.000 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:07.074 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:07.074 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda3804980 1 Processor -- start 2024-05-08T18:09:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda3804980 1 -- start start 2024-05-08T18:09:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda3804980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561e03ac6840 0x561e03ac4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda3804980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561e039fb710 con 0x561e03ac5380 2024-05-08T18:09:07.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda3804980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x561e03a0ff00 con 0x561e03ac6840 2024-05-08T18:09:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda1318640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561e03ac6840 0x561e03ac4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda0b17640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x561e03ac5380 0x561e03b57f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50972/0 (socket says 172.21.15.114:50972) 2024-05-08T18:09:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda1318640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561e03ac6840 0x561e03ac4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52452/0 (socket says 172.21.15.114:52452) 2024-05-08T18:09:07.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda0b17640 1 -- 172.21.15.114:0/3069583886 learned_addr learned my addr 172.21.15.114:0/3069583886 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efd93fff640 1 -- 172.21.15.114:0/3069583886 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289283011 0 0) 0x561e039fb710 con 0x561e03ac5380 2024-05-08T18:09:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efd93fff640 1 -- 172.21.15.114:0/3069583886 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd8c001e20 con 0x561e03ac5380 2024-05-08T18:09:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda1318640 1 -- 172.21.15.114:0/3069583886 >> v1:172.21.15.53:6789/0 conn(0x561e03ac5380 legacy=0x561e03b57f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.075+0000 7efda1318640 1 -- 172.21.15.114:0/3069583886 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e039d7ae0 con 0x561e03ac6840 2024-05-08T18:09:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda1318640 1 --2- 172.21.15.114:0/3069583886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac6840 0x561e03ac4e40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd9800a480 tx=0x7efd9801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd02fd4daaa941a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efd93fff640 1 -- 172.21.15.114:0/3069583886 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980b0070 con 0x561e03ac6840 2024-05-08T18:09:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efd93fff640 1 -- 172.21.15.114:0/3069583886 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd980ab540 con 0x561e03ac6840 2024-05-08T18:09:07.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efd93fff640 1 -- 172.21.15.114:0/3069583886 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980ab820 con 0x561e03ac6840 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 -- 172.21.15.114:0/3069583886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac6840 msgr2=0x561e03ac4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 --2- 172.21.15.114:0/3069583886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac6840 0x561e03ac4e40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efd9800a480 tx=0x7efd9801b280 comp rx=0 tx=0).stop 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 -- 172.21.15.114:0/3069583886 shutdown_connections 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 --2- 172.21.15.114:0/3069583886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac6840 0x561e03ac4e40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 -- 172.21.15.114:0/3069583886 >> 172.21.15.114:0/3069583886 conn(0x561e03b4b7d0 msgr2=0x561e03b4dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 -- 172.21.15.114:0/3069583886 shutdown_connections 2024-05-08T18:09:07.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.079+0000 7efda3804980 1 -- 172.21.15.114:0/3069583886 wait complete. 2024-05-08T18:09:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda3804980 1 Processor -- start 2024-05-08T18:09:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda3804980 1 -- start start 2024-05-08T18:09:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda3804980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c3d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda3804980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e03a53f80 con 0x561e03ac5380 2024-05-08T18:09:07.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda1318640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c3d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda1318640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c3d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52464/0 (socket says 172.21.15.114:52464) 2024-05-08T18:09:07.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda1318640 1 -- 172.21.15.114:0/2449998738 learned_addr learned my addr 172.21.15.114:0/2449998738 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda1318640 1 -- 172.21.15.114:0/2449998738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e03a1bda0 con 0x561e03ac5380 2024-05-08T18:09:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efda1318640 1 --2- 172.21.15.114:0/2449998738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c3d650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd9801b2c0 tx=0x7efd98003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24f920422b85c24d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efc8f606640 1 -- 172.21.15.114:0/2449998738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980b0040 con 0x561e03ac5380 2024-05-08T18:09:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efc8f606640 1 -- 172.21.15.114:0/2449998738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd980ac9f0 con 0x561e03ac5380 2024-05-08T18:09:07.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.095+0000 7efc8f606640 1 -- 172.21.15.114:0/2449998738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980accf0 con 0x561e03ac5380 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/2449998738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 msgr2=0x561e03c3d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 --2- 172.21.15.114:0/2449998738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c3d650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efd9801b2c0 tx=0x7efd98003030 comp rx=0 tx=0).stop 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/2449998738 shutdown_connections 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 --2- 172.21.15.114:0/2449998738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c3d650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/2449998738 >> 172.21.15.114:0/2449998738 conn(0x561e03b4b7d0 msgr2=0x561e03c391e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/2449998738 shutdown_connections 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/2449998738 wait complete. 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 Processor -- start 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- start start 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c44970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e03b5c080 con 0x561e03ac5380 2024-05-08T18:09:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda1318640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c44970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda1318640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c44970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52470/0 (socket says 172.21.15.114:52470) 2024-05-08T18:09:07.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda1318640 1 -- 172.21.15.114:0/519747964 learned_addr learned my addr 172.21.15.114:0/519747964 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda1318640 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e03c44eb0 con 0x561e03ac5380 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda1318640 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c44970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd9801b2c0 tx=0x7efd98018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efc8de03640 1 -- 172.21.15.114:0/519747964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980b0070 con 0x561e03ac5380 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e03c45140 con 0x561e03ac5380 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efc8de03640 1 -- 172.21.15.114:0/519747964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd980c17b0 con 0x561e03ac5380 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e03c47dd0 con 0x561e03ac5380 2024-05-08T18:09:07.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.099+0000 7efc8de03640 1 -- 172.21.15.114:0/519747964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd980c1a90 con 0x561e03ac5380 2024-05-08T18:09:07.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efc8de03640 1 -- 172.21.15.114:0/519747964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efd980c1c30 con 0x561e03ac5380 2024-05-08T18:09:07.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efc8de03640 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc88038440 0x7efc8803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efc8de03640 1 -- 172.21.15.114:0/519747964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7efd980bc070 con 0x561e03ac5380 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda0b17640 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc88038440 0x7efc8803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03ac6840 0x561e03c4b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c4bef0 con 0x561e03ac6840 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03ac6840 0x561e03c4b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda0b17640 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc88038440 0x7efc8803a900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd94001dc0 tx=0x7efd94001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03ac6840 0x561e03c4b8b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 -- 172.21.15.114:0/519747964 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd9c00a4d0 con 0x561e03ac6840 2024-05-08T18:09:07.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c48ff0 con 0x561e03ac6840 2024-05-08T18:09:07.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 -- 172.21.15.114:0/519747964 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd9c00a4d0 con 0x561e03ac6840 2024-05-08T18:09:07.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c4dd10 con 0x561e03ac6840 2024-05-08T18:09:07.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 -- 172.21.15.114:0/519747964 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efd9c00a4d0 con 0x561e03ac6840 2024-05-08T18:09:07.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c4cf40 con 0x561e03ac6840 2024-05-08T18:09:07.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 -- 172.21.15.114:0/519747964 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd9c00a4d0 con 0x561e03ac6840 2024-05-08T18:09:07.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c4d390 con 0x561e03ac6840 2024-05-08T18:09:07.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda1b19640 1 -- 172.21.15.114:0/519747964 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efd9c00a4d0 con 0x561e03ac6840 2024-05-08T18:09:07.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 Processor -- start 2024-05-08T18:09:07.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- start start 2024-05-08T18:09:07.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 0x561e03c5ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.103+0000 7efda3804980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e03a57fc0 con 0x561e03c5c650 2024-05-08T18:09:07.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda0b17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 0x561e03c5ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda0b17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 0x561e03c5ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52482/0 (socket says 172.21.15.114:52482) 2024-05-08T18:09:07.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda0b17640 1 -- 172.21.15.114:0/1295377616 learned_addr learned my addr 172.21.15.114:0/1295377616 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda0b17640 1 -- 172.21.15.114:0/1295377616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e03c5cfb0 con 0x561e03c5c650 2024-05-08T18:09:07.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda0b17640 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 0x561e03c5ca70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efd9400d460 tx=0x7efd9400d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efc86ffd640 1 -- 172.21.15.114:0/1295377616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd9400c6b0 con 0x561e03c5c650 2024-05-08T18:09:07.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efc86ffd640 1 -- 172.21.15.114:0/1295377616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9400c850 con 0x561e03c5c650 2024-05-08T18:09:07.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e03c5da50 con 0x561e03c5c650 2024-05-08T18:09:07.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efc86ffd640 1 -- 172.21.15.114:0/1295377616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd9400cb50 con 0x561e03c5c650 2024-05-08T18:09:07.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e03c5df20 con 0x561e03c5c650 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efc86ffd640 1 -- 172.21.15.114:0/1295377616 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efd94023020 con 0x561e03c5c650 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efc86ffd640 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc780383f0 0x7efc7803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efc86ffd640 1 -- 172.21.15.114:0/1295377616 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7efd94021020 con 0x561e03c5c650 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda1b19640 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc780383f0 0x7efc7803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda3804980 1 Processor -- start 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda3804980 1 -- start start 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda1b19640 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc780383f0 0x7efc7803a8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x561e03c4ca60 tx=0x7efd9c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda3804980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c69cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.107+0000 7efda3804980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e03c3dce0 con 0x561e03c698b0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c69cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c69cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52492/0 (socket says 172.21.15.114:52492) 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 -- 172.21.15.114:0/1363862710 learned_addr learned my addr 172.21.15.114:0/1363862710 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 -- 172.21.15.114:0/1363862710 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e03c6a2a0 con 0x561e03c698b0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 --2- 172.21.15.114:0/1363862710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c69cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd9404f2a0 tx=0x7efd940092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36db6f2a258528c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efc84ff9640 1 -- 172.21.15.114:0/1363862710 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd9401bcc0 con 0x561e03c698b0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efc84ff9640 1 -- 172.21.15.114:0/1363862710 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94019a70 con 0x561e03c698b0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efc84ff9640 1 -- 172.21.15.114:0/1363862710 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd94009b20 con 0x561e03c698b0 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/1363862710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 msgr2=0x561e03c69cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 --2- 172.21.15.114:0/1363862710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c69cd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efd9404f2a0 tx=0x7efd940092f0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/1363862710 shutdown_connections 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 --2- 172.21.15.114:0/1363862710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c69cd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/1363862710 >> 172.21.15.114:0/1363862710 conn(0x561e03c65c40 msgr2=0x561e03c63ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/1363862710 shutdown_connections 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/1363862710 wait complete. 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 Processor -- start 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- start start 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c70e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561e03c6a9f0 con 0x561e03c698b0 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c70e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c70e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52498/0 (socket says 172.21.15.114:52498) 2024-05-08T18:09:07.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 learned_addr learned my addr 172.21.15.114:0/279396022 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e03c71390 con 0x561e03c698b0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda0b17640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c70e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efd9400ddb0 tx=0x7efd9404f230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efc76ffd640 1 -- 172.21.15.114:0/279396022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd94032070 con 0x561e03c698b0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efc76ffd640 1 -- 172.21.15.114:0/279396022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd94019820 con 0x561e03c698b0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efc76ffd640 1 -- 172.21.15.114:0/279396022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd9401b550 con 0x561e03c698b0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561e03c71620 con 0x561e03c698b0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.111+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e03c71620 con 0x561e03c698b0 2024-05-08T18:09:07.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efc76ffd640 1 -- 172.21.15.114:0/279396022 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efd9401b6f0 con 0x561e03c698b0 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efc76ffd640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc6c0383f0 0x7efc6c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efc76ffd640 1 -- 172.21.15.114:0/279396022 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7efd94044070 con 0x561e03c698b0 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1b19640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc6c0383f0 0x7efc6c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03c7c070 0x561e03c7e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c7ec60 con 0x561e03c7c070 2024-05-08T18:09:07.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03c7c070 0x561e03c7e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1b19640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc6c0383f0 0x7efc6c03a8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x561e03c48f10 tx=0x7efd9c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03c7c070 0x561e03c7e510 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 realm 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c7f070 con 0x561e03c7c070 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c7f940 con 0x561e03c7c070 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c7fce0 con 0x561e03c7c070 2024-05-08T18:09:07.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c80140 con 0x561e03c7c070 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 20 searching for the correct realm 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x561e03c820b0 0x561e03c844a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x561e03c84b20 con 0x561e03c820b0 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.115+0000 7efda0b17640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x561e03c820b0 0x561e03c844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda0b17640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x561e03c820b0 0x561e03c844a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda0b17640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efd9401c070 0x7efd9403f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9401c070 2024-05-08T18:09:07.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1b19640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efd9401c070 0x7efd9403f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1b19640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efd9401c070 0x7efd9403f850 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9c01f070 con 0x7efd9401c070 2024-05-08T18:09:07.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1b19640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efd9c031040 0x7efd9c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efd9c031040 0x7efd9c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efd9c031040 0x7efd9c032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x7efd9c031040 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.119+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x7efd9c031040 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x7efd9c031040 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9401c070 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9c01f070 con 0x7efd9401c070 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x7efd9c031040 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9401c070 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd9c01f070 con 0x7efd9401c070 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.123+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x7efd9c031040 2024-05-08T18:09:07.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980b3040 con 0x7efd9c031040 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9401c070 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9c01f070 con 0x7efd9401c070 2024-05-08T18:09:07.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efd980b3040 con 0x561e03c7c070 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.127+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9401c070 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9c01f070 con 0x7efd9401c070 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c820b0 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9c031040 2024-05-08T18:09:07.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x561e03c7c070 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7efd9405b040 con 0x7efd9401c070 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd9c01f070 con 0x7efd9401c070 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:07.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c80b50 con 0x561e03c7c070 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c813f0 con 0x561e03c7c070 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c80790 con 0x561e03c7c070 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:07.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 zone default found 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 4 Realm: () 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 zonegroup default 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.131+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c813f0 con 0x7efd9c031040 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86980 con 0x561e03c820b0 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86d20 con 0x561e03c820b0 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 started sync module instance, tier type = 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c85e20 con 0x7efd9401c070 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9c040040 con 0x7efd9401c070 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94686912471616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c87570 con 0x7efd9401c070 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c87dc0 con 0x561e03c7c070 2024-05-08T18:09:07.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.135+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94686912471616] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9c040040 con 0x7efd9401c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94686912475328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c87a30 con 0x561e03c7c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c88550 con 0x561e03c820b0 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94686912479264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c88df0 con 0x561e03c820b0 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c897f0 con 0x7efd9401c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94686912475328] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9c040040 con 0x7efd9401c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94686912476384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c89be0 con 0x7efd9401c070 2024-05-08T18:09:07.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.139+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8a5a0 con 0x561e03c7c070 2024-05-08T18:09:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.143+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94686912479264] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.143+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94686912476384] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9c040040 con 0x7efd9401c070 2024-05-08T18:09:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.143+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.143+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94686912484096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8a0f0 con 0x561e03c7c070 2024-05-08T18:09:07.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.143+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8a940 con 0x7efd9c031040 2024-05-08T18:09:07.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.147+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94686912484096] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.147+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.147+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94686912487664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c88a50 con 0x7efd9c031040 2024-05-08T18:09:07.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.147+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8b240 con 0x7efd9c031040 2024-05-08T18:09:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94686912490800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8b6b0 con 0x7efd9c031040 2024-05-08T18:09:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8c190 con 0x7efd9c031040 2024-05-08T18:09:07.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94686912487664] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94686912494752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8c190 con 0x7efd9c031040 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=0 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=1 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=2 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=3 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=4 2024-05-08T18:09:07.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=5 2024-05-08T18:09:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94686912490800] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.151+0000 7efda3804980 20 add_watcher() i=6 2024-05-08T18:09:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94686912494752] v30'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 add_watcher() i=7 2024-05-08T18:09:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8a510 con 0x561e03c7c070 2024-05-08T18:09:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94686912488720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8c590 con 0x561e03c7c070 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94686912488720] v30'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efc577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 5 note: GC not initialized 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efc567e4640 20 reqs_thread_entry: start 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 Filter name: none 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efbc7fff640 20 reqs_thread_entry: start 2024-05-08T18:09:07.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x561e03cb2640 con 0x561e03c7c070 2024-05-08T18:09:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.155+0000 7efda3804980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:07.157 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:07.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efc577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94686912488720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03cb1430 con 0x561e03c7c070 2024-05-08T18:09:07.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94686912488720] v30'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94686912471616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c8a510 con 0x7efd9401c070 2024-05-08T18:09:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94686912471616] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9c040040 con 0x7efd9401c070 2024-05-08T18:09:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda3804980 20 remove_watcher() i=0 2024-05-08T18:09:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda3804980 2 removed watcher, disabling cache 2024-05-08T18:09:07.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.159+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94686912475328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x561e03c7c070 2024-05-08T18:09:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.163+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94686912475328] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.163+0000 7efda3804980 20 remove_watcher() i=1 2024-05-08T18:09:07.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.163+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94686912479264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x561e03c820b0 2024-05-08T18:09:07.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.163+0000 7efda0b17640 1 -- 172.21.15.114:0/279396022 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94686912479264] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9403f050 con 0x561e03c820b0 2024-05-08T18:09:07.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.163+0000 7efda3804980 20 remove_watcher() i=2 2024-05-08T18:09:07.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.163+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94686912476384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x7efd9401c070 2024-05-08T18:09:07.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.167+0000 7efda1b19640 1 -- 172.21.15.114:0/279396022 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94686912476384] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd9c040040 con 0x7efd9401c070 2024-05-08T18:09:07.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.167+0000 7efda3804980 20 remove_watcher() i=3 2024-05-08T18:09:07.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.167+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94686912484096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x561e03c7c070 2024-05-08T18:09:07.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.167+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94686912484096] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x561e03c7c070 2024-05-08T18:09:07.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.167+0000 7efda3804980 20 remove_watcher() i=4 2024-05-08T18:09:07.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.167+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94686912487664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x7efd9c031040 2024-05-08T18:09:07.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.171+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94686912487664] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.171+0000 7efda3804980 20 remove_watcher() i=5 2024-05-08T18:09:07.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.171+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94686912490800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x7efd9c031040 2024-05-08T18:09:07.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.171+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94686912490800] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.171+0000 7efda3804980 20 remove_watcher() i=6 2024-05-08T18:09:07.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.171+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94686912494752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x561e03c86240 con 0x7efd9c031040 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94686912494752] v30'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd980f9040 con 0x7efd9c031040 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 20 remove_watcher() i=7 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efd9c031040 msgr2=0x7efd9c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efd9c031040 0x7efd9c032940 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03c7c070 msgr2=0x561e03c7e510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03c7c070 0x561e03c7e510 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efd9401c070 msgr2=0x7efd9403f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efd9401c070 0x7efd9403f850 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x561e03c820b0 msgr2=0x561e03c844a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x561e03c820b0 0x561e03c844a0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc6c0383f0 msgr2=0x7efc6c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc6c0383f0 0x7efc6c03a8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x561e03c48f10 tx=0x7efd9c01f000 comp rx=0 tx=0).stop 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 msgr2=0x561e03c70e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda1318640 1 -- 172.21.15.114:0/279396022 reap_dead start 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c70e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efd9400ddb0 tx=0x7efd9404f230 comp rx=0 tx=0).stop 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 shutdown_connections 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/279396022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c698b0 0x561e03c70e50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 >> 172.21.15.114:0/279396022 conn(0x561e03c65c40 msgr2=0x561e03c6b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 shutdown_connections 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/279396022 wait complete. 2024-05-08T18:09:07.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc780383f0 msgr2=0x7efc7803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc780383f0 0x7efc7803a8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x561e03c4ca60 tx=0x7efd9c005850 comp rx=0 tx=0).stop 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 msgr2=0x561e03c5ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 0x561e03c5ca70 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efd9400d460 tx=0x7efd9400d860 comp rx=0 tx=0).stop 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 shutdown_connections 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc780383f0 0x7efc7803a8b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/1295377616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03c5c650 0x561e03c5ca70 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 >> 172.21.15.114:0/1295377616 conn(0x561e03c51460 msgr2=0x561e03c51f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 shutdown_connections 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/1295377616 wait complete. 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03ac6840 msgr2=0x561e03c4b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03ac6840 0x561e03c4b8b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc88038440 msgr2=0x7efc8803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc88038440 0x7efc8803a900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efd94001dc0 tx=0x7efd94001320 comp rx=0 tx=0).stop 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 msgr2=0x561e03c44970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c44970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efd9801b2c0 tx=0x7efd98018020 comp rx=0 tx=0).stop 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 shutdown_connections 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561e03ac6840 0x561e03c4b8b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efc88038440 0x7efc8803a900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 --2- 172.21.15.114:0/519747964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e03ac5380 0x561e03c44970 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 >> 172.21.15.114:0/519747964 conn(0x561e03b4b7d0 msgr2=0x561e03c37cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 shutdown_connections 2024-05-08T18:09:07.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.175+0000 7efda3804980 1 -- 172.21.15.114:0/519747964 wait complete. 2024-05-08T18:09:07.188 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:07.188 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T18:09:07.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T18:09:07.188 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T18:09:07.266 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:07.266 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562b966980 1 Processor -- start 2024-05-08T18:09:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562b966980 1 -- start start 2024-05-08T18:09:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562b966980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b2919e7e0 0x559b2922cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562b966980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559b290d5710 con 0x559b2922d0f0 2024-05-08T18:09:07.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562b966980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559b290e9f00 con 0x559b2919e7e0 2024-05-08T18:09:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562947a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559b2919e7e0 0x559b2922cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f5628c79640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559b2922d0f0 0x559b2922f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50980/0 (socket says 172.21.15.114:50980) 2024-05-08T18:09:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f5628c79640 1 -- 172.21.15.114:0/1270635049 learned_addr learned my addr 172.21.15.114:0/1270635049 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562947a640 1 -- 172.21.15.114:0/1270635049 >> v1:172.21.15.53:6789/0 conn(0x559b2922d0f0 legacy=0x559b2922f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.267+0000 7f562947a640 1 -- 172.21.15.114:0/1270635049 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b290b1ae0 con 0x559b2919e7e0 2024-05-08T18:09:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562947a640 1 --2- 172.21.15.114:0/1270635049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b2922cbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f561400a480 tx=0x7f561401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50235beec24538e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f5623fff640 1 -- 172.21.15.114:0/1270635049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56140b0070 con 0x559b2919e7e0 2024-05-08T18:09:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f5623fff640 1 -- 172.21.15.114:0/1270635049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56140ab540 con 0x559b2919e7e0 2024-05-08T18:09:07.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f5623fff640 1 -- 172.21.15.114:0/1270635049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56140ab840 con 0x559b2919e7e0 2024-05-08T18:09:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 -- 172.21.15.114:0/1270635049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 msgr2=0x559b2922cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 --2- 172.21.15.114:0/1270635049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b2922cbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f561400a480 tx=0x7f561401b280 comp rx=0 tx=0).stop 2024-05-08T18:09:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 -- 172.21.15.114:0/1270635049 shutdown_connections 2024-05-08T18:09:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 --2- 172.21.15.114:0/1270635049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b2922cbb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 -- 172.21.15.114:0/1270635049 >> 172.21.15.114:0/1270635049 conn(0x559b29224690 msgr2=0x559b29226ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 -- 172.21.15.114:0/1270635049 shutdown_connections 2024-05-08T18:09:07.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.271+0000 7f562b966980 1 -- 172.21.15.114:0/1270635049 wait complete. 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562b966980 1 Processor -- start 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562b966980 1 -- start start 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562b966980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b29314fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562b966980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b2912df80 con 0x559b2919e7e0 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562947a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b29314fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562947a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b29314fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52508/0 (socket says 172.21.15.114:52508) 2024-05-08T18:09:07.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.287+0000 7f562947a640 1 -- 172.21.15.114:0/1729751336 learned_addr learned my addr 172.21.15.114:0/1729751336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 -- 172.21.15.114:0/1729751336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b290f5da0 con 0x559b2919e7e0 2024-05-08T18:09:07.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 --2- 172.21.15.114:0/1729751336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b29314fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56140ae040 tx=0x7f5614003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d15062c2a74d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f5517606640 1 -- 172.21.15.114:0/1729751336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56140b0040 con 0x559b2919e7e0 2024-05-08T18:09:07.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f5517606640 1 -- 172.21.15.114:0/1729751336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56140ab9d0 con 0x559b2919e7e0 2024-05-08T18:09:07.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f5517606640 1 -- 172.21.15.114:0/1729751336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56140abcf0 con 0x559b2919e7e0 2024-05-08T18:09:07.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- 172.21.15.114:0/1729751336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 msgr2=0x559b29314fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 --2- 172.21.15.114:0/1729751336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b29314fb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f56140ae040 tx=0x7f5614003030 comp rx=0 tx=0).stop 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- 172.21.15.114:0/1729751336 shutdown_connections 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 --2- 172.21.15.114:0/1729751336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2919e7e0 0x559b29314fb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- 172.21.15.114:0/1729751336 >> 172.21.15.114:0/1729751336 conn(0x559b29224690 msgr2=0x559b29310b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- 172.21.15.114:0/1729751336 shutdown_connections 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- 172.21.15.114:0/1729751336 wait complete. 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 Processor -- start 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- start start 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 0x559b2931c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562b966980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b29231710 con 0x559b2922d0f0 2024-05-08T18:09:07.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 0x559b2931c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 0x559b2931c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52518/0 (socket says 172.21.15.114:52518) 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 -- 172.21.15.114:0/2623128394 learned_addr learned my addr 172.21.15.114:0/2623128394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2931ca50 con 0x559b2922d0f0 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.291+0000 7f562947a640 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 0x559b2931c510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5614018eb0 tx=0x7f5614018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5515e03640 1 -- 172.21.15.114:0/2623128394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56140c5070 con 0x559b2922d0f0 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b2931cce0 con 0x559b2922d0f0 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5515e03640 1 -- 172.21.15.114:0/2623128394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56140b67b0 con 0x559b2922d0f0 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5515e03640 1 -- 172.21.15.114:0/2623128394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56140b0050 con 0x559b2922d0f0 2024-05-08T18:09:07.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2931f920 con 0x559b2922d0f0 2024-05-08T18:09:07.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5515e03640 1 -- 172.21.15.114:0/2623128394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f56140c8070 con 0x559b2922d0f0 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5515e03640 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55100383f0 0x7f551003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5515e03640 1 -- 172.21.15.114:0/2623128394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f56140bc070 con 0x559b2922d0f0 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5628c79640 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55100383f0 0x7f551003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b293213f0 0x559b293237e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29323db0 con 0x559b293213f0 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5629c7b640 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b293213f0 0x559b293237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5628c79640 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55100383f0 0x7f551003a8b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f561c001650 tx=0x7f561c006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5629c7b640 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b293213f0 0x559b293237e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5629c7b640 1 -- 172.21.15.114:0/2623128394 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56240083f0 con 0x559b293213f0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29324670 con 0x559b293213f0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5629c7b640 1 -- 172.21.15.114:0/2623128394 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56240083f0 con 0x559b293213f0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29325a20 con 0x559b293213f0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f5629c7b640 1 -- 172.21.15.114:0/2623128394 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f56240083f0 con 0x559b293213f0 2024-05-08T18:09:07.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.295+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29324ec0 con 0x559b293213f0 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5629c7b640 1 -- 172.21.15.114:0/2623128394 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56240083f0 con 0x559b293213f0 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b293252e0 con 0x559b293213f0 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5629c7b640 1 -- 172.21.15.114:0/2623128394 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56240083f0 con 0x559b293213f0 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 Processor -- start 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 -- start start 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 0x559b29334990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b29131fc0 con 0x559b29334570 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5628c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 0x559b29334990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5628c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 0x559b29334990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52520/0 (socket says 172.21.15.114:52520) 2024-05-08T18:09:07.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5628c79640 1 -- 172.21.15.114:0/3857094146 learned_addr learned my addr 172.21.15.114:0/3857094146 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5628c79640 1 -- 172.21.15.114:0/3857094146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b29334ed0 con 0x559b29334570 2024-05-08T18:09:07.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f5628c79640 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 0x559b29334990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f561c006960 tx=0x7f561c015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f550effd640 1 -- 172.21.15.114:0/3857094146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c015240 con 0x559b29334570 2024-05-08T18:09:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f550effd640 1 -- 172.21.15.114:0/3857094146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c011440 con 0x559b29334570 2024-05-08T18:09:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b29335970 con 0x559b29334570 2024-05-08T18:09:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f550effd640 1 -- 172.21.15.114:0/3857094146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c011720 con 0x559b29334570 2024-05-08T18:09:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.299+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b29335e40 con 0x559b29334570 2024-05-08T18:09:07.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f550effd640 1 -- 172.21.15.114:0/3857094146 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f561c0118c0 con 0x559b29334570 2024-05-08T18:09:07.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f550effd640 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55000383f0 0x7f550003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f550effd640 1 -- 172.21.15.114:0/3857094146 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f561c01b030 con 0x559b29334570 2024-05-08T18:09:07.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55000383f0 0x7f550003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 Processor -- start 2024-05-08T18:09:07.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- start start 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55000383f0 0x7f550003a8b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559b29325260 tx=0x7f5624003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29341b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b29315640 con 0x559b29341750 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5628c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29341b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5628c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29341b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52522/0 (socket says 172.21.15.114:52522) 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5628c79640 1 -- 172.21.15.114:0/2457427327 learned_addr learned my addr 172.21.15.114:0/2457427327 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5628c79640 1 -- 172.21.15.114:0/2457427327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b29342140 con 0x559b29341750 2024-05-08T18:09:07.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f5628c79640 1 --2- 172.21.15.114:0/2457427327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29341b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f561c015400 tx=0x7f561c013f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86016d9cf7835b62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f550cff9640 1 -- 172.21.15.114:0/2457427327 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c04d1d0 con 0x559b29341750 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f550cff9640 1 -- 172.21.15.114:0/2457427327 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c01eda0 con 0x559b29341750 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f550cff9640 1 -- 172.21.15.114:0/2457427327 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c020580 con 0x559b29341750 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- 172.21.15.114:0/2457427327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 msgr2=0x559b29341b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 --2- 172.21.15.114:0/2457427327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29341b70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f561c015400 tx=0x7f561c013f60 comp rx=0 tx=0).stop 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- 172.21.15.114:0/2457427327 shutdown_connections 2024-05-08T18:09:07.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 --2- 172.21.15.114:0/2457427327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29341b70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- 172.21.15.114:0/2457427327 >> 172.21.15.114:0/2457427327 conn(0x559b2933dae0 msgr2=0x559b2933bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- 172.21.15.114:0/2457427327 shutdown_connections 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- 172.21.15.114:0/2457427327 wait complete. 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 Processor -- start 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 -- start start 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.303+0000 7f562b966980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29348cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562b966980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559b29342890 con 0x559b29341750 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5628c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29348cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5628c79640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29348cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52532/0 (socket says 172.21.15.114:52532) 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 learned_addr learned my addr 172.21.15.114:0/3796828951 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b29349200 con 0x559b29341750 2024-05-08T18:09:07.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5628c79640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29348cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f561c015400 tx=0x7f561c04e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f54feffd640 1 -- 172.21.15.114:0/3796828951 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c04e9d0 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559b29349490 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f54feffd640 1 -- 172.21.15.114:0/3796828951 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c04eb70 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f54feffd640 1 -- 172.21.15.114:0/3796828951 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c01f7f0 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b29349490 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f54feffd640 1 -- 172.21.15.114:0/3796828951 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f561c03a060 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f54feffd640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f54f40383f0 0x7f54f403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f54feffd640 1 -- 172.21.15.114:0/3796828951 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f561c043020 con 0x559b29341750 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f54f40383f0 0x7f54f403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b29354010 0x559b293564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29356c00 con 0x559b29354010 2024-05-08T18:09:07.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562947a640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b29354010 0x559b293564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f54f40383f0 0x7f54f403a8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f562400f010 tx=0x7f562401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.307+0000 7f562947a640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b29354010 0x559b293564b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 realm 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29357010 con 0x559b29354010 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b293578e0 con 0x559b29354010 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29357c80 con 0x559b29354010 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 20 searching for the correct realm 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559b2935a240 0x559b2935c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2935cb70 con 0x559b2935a240 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5628c79640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559b2935a240 0x559b2935c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5628c79640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559b2935a240 0x559b2935c630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5628c79640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f561c03c070 0x7f561c0419e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2935cb70 con 0x7f561c03c070 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f561c03c070 0x7f561c0419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f561c03c070 0x7f561c0419e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5629c7b640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5624019040 0x7f5624019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b2935cb70 con 0x7f5624019040 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.311+0000 7f562947a640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5624019040 0x7f5624019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5624019040 0x7f5624019930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f561c03c070 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.315+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f561c03c070 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.319+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f561c03c070 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f561c03c070 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b2935a240 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.323+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f5624019040 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x559b29354010 2024-05-08T18:09:07.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559b293584d0 con 0x7f561c03c070 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29358d20 con 0x559b29354010 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29359110 con 0x559b29354010 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29359110 con 0x559b29354010 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 zone default found 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 4 Realm: () 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:07.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 zonegroup default 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29358950 con 0x7f5624019040 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2935e980 con 0x559b2935a240 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2935ed20 con 0x559b2935a240 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 started sync module instance, tier type = 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:07.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.327+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935de20 con 0x7f561c03c070 2024-05-08T18:09:07.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94124899686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f0c0 con 0x7f561c03c070 2024-05-08T18:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f950 con 0x559b29354010 2024-05-08T18:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94124899686768] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94124899688976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f570 con 0x559b29354010 2024-05-08T18:09:07.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.331+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29360360 con 0x559b2935a240 2024-05-08T18:09:07.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94124899688976] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94124899692736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f4e0 con 0x559b2935a240 2024-05-08T18:09:07.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b293610b0 con 0x7f561c03c070 2024-05-08T18:09:07.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94124899699984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29361950 con 0x7f561c03c070 2024-05-08T18:09:07.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.335+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29362350 con 0x559b29354010 2024-05-08T18:09:07.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.339+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94124899692736] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.339+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.339+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94124899698512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29362310 con 0x559b29354010 2024-05-08T18:09:07.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.339+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29362d60 con 0x7f5624019040 2024-05-08T18:09:07.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.339+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94124899699984] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.339+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94124899698512] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94124899704416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b293628b0 con 0x7f5624019040 2024-05-08T18:09:07.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29363100 con 0x7f5624019040 2024-05-08T18:09:07.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94124899704416] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94124899707056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29363180 con 0x7f5624019040 2024-05-08T18:09:07.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.343+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29363b40 con 0x7f5624019040 2024-05-08T18:09:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94124899707056] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94124899708384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29363b40 con 0x7f5624019040 2024-05-08T18:09:07.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=0 2024-05-08T18:09:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=1 2024-05-08T18:09:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=2 2024-05-08T18:09:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=3 2024-05-08T18:09:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=4 2024-05-08T18:09:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=5 2024-05-08T18:09:07.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.347+0000 7f562b966980 20 add_watcher() i=6 2024-05-08T18:09:07.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94124899708384] v30'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 20 add_watcher() i=7 2024-05-08T18:09:07.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:07.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b29366e40 con 0x559b29354010 2024-05-08T18:09:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94124899710976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b293640d0 con 0x559b29354010 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94124899710976] v30'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f54df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 5 note: GC not initialized 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f54de7e4640 20 reqs_thread_entry: start 2024-05-08T18:09:07.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:07.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 20 Filter name: none 2024-05-08T18:09:07.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f544ffff640 20 reqs_thread_entry: start 2024-05-08T18:09:07.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:07.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.351+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2938a8e0 con 0x559b29354010 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2938d370 con 0x7f561c03c070 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29390b40 con 0x559b29354010 2024-05-08T18:09:07.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:07.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:07.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94124899894672 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559b2938c360 con 0x559b29354010 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94124899698512 notify 128849018881 ret 0) ==== 609+0+0 (crc 0 0 0) 0x559b2931f920 con 0x559b29354010 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f550cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94124899698512 notifier 4310 bl.length()=567 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f550cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f550cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(65 notify.4 [notify cookie 94124899894672 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f550cff9640 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f54ec003eb0 con 0x559b29354010 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.355+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94124899894672 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559b2931cce0 con 0x559b29354010 2024-05-08T18:09:07.357 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:07.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f54df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94124899710976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29388610 con 0x559b29354010 2024-05-08T18:09:07.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94124899710976] v30'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94124899686768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29388610 con 0x7f561c03c070 2024-05-08T18:09:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94124899686768] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f562b966980 20 remove_watcher() i=0 2024-05-08T18:09:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f562b966980 2 removed watcher, disabling cache 2024-05-08T18:09:07.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.359+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94124899688976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29388610 con 0x559b29354010 2024-05-08T18:09:07.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.363+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94124899688976] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.363+0000 7f562b966980 20 remove_watcher() i=1 2024-05-08T18:09:07.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.363+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94124899692736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29388610 con 0x559b2935a240 2024-05-08T18:09:07.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.363+0000 7f5628c79640 1 -- 172.21.15.114:0/3796828951 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94124899692736] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f561c03d040 con 0x559b2935a240 2024-05-08T18:09:07.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.363+0000 7f562b966980 20 remove_watcher() i=2 2024-05-08T18:09:07.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.363+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94124899699984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f0c0 con 0x7f561c03c070 2024-05-08T18:09:07.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.367+0000 7f5629c7b640 1 -- 172.21.15.114:0/3796828951 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94124899699984] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f562402f040 con 0x7f561c03c070 2024-05-08T18:09:07.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.367+0000 7f562b966980 20 remove_watcher() i=3 2024-05-08T18:09:07.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.367+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94124899698512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f0c0 con 0x559b29354010 2024-05-08T18:09:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.367+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94124899698512] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x559b29354010 2024-05-08T18:09:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.367+0000 7f562b966980 20 remove_watcher() i=4 2024-05-08T18:09:07.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.367+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94124899704416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29360750 con 0x7f5624019040 2024-05-08T18:09:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.371+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94124899704416] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.371+0000 7f562b966980 20 remove_watcher() i=5 2024-05-08T18:09:07.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.371+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94124899707056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b2935f0c0 con 0x7f5624019040 2024-05-08T18:09:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.371+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94124899707056] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.371+0000 7f562b966980 20 remove_watcher() i=6 2024-05-08T18:09:07.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.371+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94124899708384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559b29361e60 con 0x7f5624019040 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94124899708384] v30'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56140c7030 con 0x7f5624019040 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 20 remove_watcher() i=7 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5624019040 msgr2=0x7f5624019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5624019040 0x7f5624019930 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b29354010 msgr2=0x559b293564b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b29354010 0x559b293564b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f561c03c070 msgr2=0x7f561c0419e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f561c03c070 0x7f561c0419e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559b2935a240 msgr2=0x559b2935c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559b2935a240 0x559b2935c630 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f54f40383f0 msgr2=0x7f54f403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f54f40383f0 0x7f54f403a8b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f562400f010 tx=0x7f562401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 msgr2=0x559b29348cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29348cc0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f561c015400 tx=0x7f561c04e5d0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562947a640 1 -- 172.21.15.114:0/3796828951 reap_dead start 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 shutdown_connections 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3796828951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29341750 0x559b29348cc0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 >> 172.21.15.114:0/3796828951 conn(0x559b2933dae0 msgr2=0x559b29342fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 shutdown_connections 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3796828951 wait complete. 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55000383f0 msgr2=0x7f550003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55000383f0 0x7f550003a8b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x559b29325260 tx=0x7f5624003070 comp rx=0 tx=0).stop 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 msgr2=0x559b29334990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 0x559b29334990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f561c006960 tx=0x7f561c015820 comp rx=0 tx=0).stop 2024-05-08T18:09:07.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 shutdown_connections 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55000383f0 0x7f550003a8b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/3857094146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b29334570 0x559b29334990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 >> 172.21.15.114:0/3857094146 conn(0x559b29329380 msgr2=0x559b29329e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 shutdown_connections 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/3857094146 wait complete. 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b293213f0 msgr2=0x559b293237e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b293213f0 0x559b293237e0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55100383f0 msgr2=0x7f551003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55100383f0 0x7f551003a8b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f561c001650 tx=0x7f561c006720 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 msgr2=0x559b2931c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 0x559b2931c510 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5614018eb0 tx=0x7f5614018020 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 shutdown_connections 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559b293213f0 0x559b293237e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f55100383f0 0x7f551003a8b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 --2- 172.21.15.114:0/2623128394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559b2922d0f0 0x559b2931c510 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 >> 172.21.15.114:0/2623128394 conn(0x559b29224690 msgr2=0x559b2930f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 shutdown_connections 2024-05-08T18:09:07.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.375+0000 7f562b966980 1 -- 172.21.15.114:0/2623128394 wait complete. 2024-05-08T18:09:07.388 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:07.388 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:07.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:07.388 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:07.464 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:07.464 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.463+0000 7f29f5024980 1 Processor -- start 2024-05-08T18:09:07.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f5024980 1 -- start start 2024-05-08T18:09:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f5024980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ddcf2ae390 0x55ddcf2b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f5024980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ddcf155710 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f5024980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ddcf169f00 con 0x55ddcf2ae390 2024-05-08T18:09:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2337640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ddcf2ae390 0x55ddcf2b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2337640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ddcf2ae390 0x55ddcf2b0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52546/0 (socket says 172.21.15.114:52546) 2024-05-08T18:09:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2b38640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55ddcf2a9ed0 0x55ddcf2aa2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:50992/0 (socket says 172.21.15.114:50992) 2024-05-08T18:09:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2337640 1 -- 172.21.15.114:0/904587987 learned_addr learned my addr 172.21.15.114:0/904587987 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2337640 1 -- 172.21.15.114:0/904587987 >> v1:172.21.15.53:6789/0 conn(0x55ddcf2a9ed0 legacy=0x55ddcf2aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2337640 1 -- 172.21.15.114:0/904587987 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcf131ae0 con 0x55ddcf2ae390 2024-05-08T18:09:07.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.467+0000 7f29f2337640 1 --2- 172.21.15.114:0/904587987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2ae390 0x55ddcf2b0780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29e400a4e0 tx=0x7f29e401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2573e7dd2328cd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f1b36640 1 -- 172.21.15.114:0/904587987 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40aa540 con 0x55ddcf2ae390 2024-05-08T18:09:07.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f1b36640 1 -- 172.21.15.114:0/904587987 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40aa6e0 con 0x55ddcf2ae390 2024-05-08T18:09:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f1b36640 1 -- 172.21.15.114:0/904587987 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40aaa40 con 0x55ddcf2ae390 2024-05-08T18:09:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 -- 172.21.15.114:0/904587987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2ae390 msgr2=0x55ddcf2b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 --2- 172.21.15.114:0/904587987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2ae390 0x55ddcf2b0780 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f29e400a4e0 tx=0x7f29e401b090 comp rx=0 tx=0).stop 2024-05-08T18:09:07.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 -- 172.21.15.114:0/904587987 shutdown_connections 2024-05-08T18:09:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 --2- 172.21.15.114:0/904587987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2ae390 0x55ddcf2b0780 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 -- 172.21.15.114:0/904587987 >> 172.21.15.114:0/904587987 conn(0x55ddcf2a57a0 msgr2=0x55ddcf2a7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 -- 172.21.15.114:0/904587987 shutdown_connections 2024-05-08T18:09:07.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.471+0000 7f29f5024980 1 -- 172.21.15.114:0/904587987 wait complete. 2024-05-08T18:09:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 Processor -- start 2024-05-08T18:09:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- start start 2024-05-08T18:09:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf394f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddcf1adf80 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f2b38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf394f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f2b38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf394f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52550/0 (socket says 172.21.15.114:52550) 2024-05-08T18:09:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f2b38640 1 -- 172.21.15.114:0/3324352663 learned_addr learned my addr 172.21.15.114:0/3324352663 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f2b38640 1 -- 172.21.15.114:0/3324352663 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcf175da0 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f2b38640 1 --2- 172.21.15.114:0/3324352663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf394f30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29dc001ec0 tx=0x7f29dc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4915bcf63ffbd2ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f28e0e09640 1 -- 172.21.15.114:0/3324352663 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc00e5d0 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f28e0e09640 1 -- 172.21.15.114:0/3324352663 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc00e770 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f28e0e09640 1 -- 172.21.15.114:0/3324352663 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc00ea70 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- 172.21.15.114:0/3324352663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 msgr2=0x55ddcf394f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 --2- 172.21.15.114:0/3324352663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf394f30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f29dc001ec0 tx=0x7f29dc00b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- 172.21.15.114:0/3324352663 shutdown_connections 2024-05-08T18:09:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 --2- 172.21.15.114:0/3324352663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf394f30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- 172.21.15.114:0/3324352663 >> 172.21.15.114:0/3324352663 conn(0x55ddcf2a57a0 msgr2=0x55ddcf390ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- 172.21.15.114:0/3324352663 shutdown_connections 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- 172.21.15.114:0/3324352663 wait complete. 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 Processor -- start 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- start start 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf39c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.487+0000 7f29f5024980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddcf2b37b0 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2b38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf39c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2b38640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf39c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52560/0 (socket says 172.21.15.114:52560) 2024-05-08T18:09:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2b38640 1 -- 172.21.15.114:0/1608928568 learned_addr learned my addr 172.21.15.114:0/1608928568 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2b38640 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcf39c930 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2b38640 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf39c3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55ddcf395dc0 tx=0x7f29dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f28df606640 1 -- 172.21.15.114:0/1608928568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc00f8a0 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f28df606640 1 -- 172.21.15.114:0/1608928568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29dc00fa40 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddcf39cbc0 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f28df606640 1 -- 172.21.15.114:0/1608928568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29dc00fd20 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcf39f850 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f28df606640 1 -- 172.21.15.114:0/1608928568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f29dc017070 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f28df606640 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28d8038490 0x7f28d803a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f28df606640 1 -- 172.21.15.114:0/1608928568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f29dc015020 con 0x55ddcf2a9ed0 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2337640 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28d8038490 0x7f28d803a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf2ae390 0x55ddcf3a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3a39e0 con 0x55ddcf2ae390 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f3339640 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf2ae390 0x55ddcf3a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f2337640 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28d8038490 0x7f28d803a950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29e40ab000 tx=0x7f29e40a5000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.491+0000 7f29f3339640 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf2ae390 0x55ddcf3a3370 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f3339640 1 -- 172.21.15.114:0/1608928568 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29ec0083f0 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3a0a70 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f3339640 1 -- 172.21.15.114:0/1608928568 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29ec0083f0 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3a5820 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f3339640 1 -- 172.21.15.114:0/1608928568 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f29ec0083f0 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3a4a50 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f3339640 1 -- 172.21.15.114:0/1608928568 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29ec0083f0 con 0x55ddcf2ae390 2024-05-08T18:09:07.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3a4ea0 con 0x55ddcf2ae390 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f3339640 1 -- 172.21.15.114:0/1608928568 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f29ec0083f0 con 0x55ddcf2ae390 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 Processor -- start 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- start start 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 0x55ddcf21e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddcf1b1fc0 con 0x55ddcf2201b0 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f2337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 0x55ddcf21e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f2337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 0x55ddcf21e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52566/0 (socket says 172.21.15.114:52566) 2024-05-08T18:09:07.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f2337640 1 -- 172.21.15.114:0/3223851383 learned_addr learned my addr 172.21.15.114:0/3223851383 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f2337640 1 -- 172.21.15.114:0/3223851383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcf21eb90 con 0x55ddcf2201b0 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f2337640 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 0x55ddcf21e650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f29e40ac040 tx=0x7f29e4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f28dce01640 1 -- 172.21.15.114:0/3223851383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40c4020 con 0x55ddcf2201b0 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddcf21ee20 con 0x55ddcf2201b0 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f28dce01640 1 -- 172.21.15.114:0/3223851383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40c0560 con 0x55ddcf2201b0 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.495+0000 7f28dce01640 1 -- 172.21.15.114:0/3223851383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40b9030 con 0x55ddcf2201b0 2024-05-08T18:09:07.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcf21f290 con 0x55ddcf2201b0 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f28dce01640 1 -- 172.21.15.114:0/3223851383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f29e40c7020 con 0x55ddcf2201b0 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f28dce01640 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28cc0383f0 0x7f28cc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f28dce01640 1 -- 172.21.15.114:0/3223851383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f29e40ba070 con 0x55ddcf2201b0 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f3339640 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28cc0383f0 0x7f28cc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f5024980 1 Processor -- start 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f5024980 1 -- start start 2024-05-08T18:09:07.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f3339640 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28cc0383f0 0x7f28cc03a8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ddcf3a4570 tx=0x7f29ec003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f5024980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f5024980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddcf395680 con 0x55ddcf3c33e0 2024-05-08T18:09:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f2337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f2337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3c37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52578/0 (socket says 172.21.15.114:52578) 2024-05-08T18:09:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f2337640 1 -- 172.21.15.114:0/3047151364 learned_addr learned my addr 172.21.15.114:0/3047151364 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f2337640 1 -- 172.21.15.114:0/3047151364 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcf3c3db0 con 0x55ddcf3c33e0 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f29f2337640 1 --2- 172.21.15.114:0/3047151364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3c37e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f29e40e9a00 tx=0x7f29e40b3a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea1ba7e3d322955 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f28d67fc640 1 -- 172.21.15.114:0/3047151364 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40d6020 con 0x55ddcf3c33e0 2024-05-08T18:09:07.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f28d67fc640 1 -- 172.21.15.114:0/3047151364 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40b44d0 con 0x55ddcf3c33e0 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.499+0000 7f28d67fc640 1 -- 172.21.15.114:0/3047151364 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40b3460 con 0x55ddcf3c33e0 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3047151364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 msgr2=0x55ddcf3c37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 --2- 172.21.15.114:0/3047151364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3c37e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f29e40e9a00 tx=0x7f29e40b3a80 comp rx=0 tx=0).stop 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3047151364 shutdown_connections 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 --2- 172.21.15.114:0/3047151364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3c37e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3047151364 >> 172.21.15.114:0/3047151364 conn(0x55ddcf3bf720 msgr2=0x55ddcf3bd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3047151364 shutdown_connections 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3047151364 wait complete. 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 Processor -- start 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- start start 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ddcf3c44f0 con 0x55ddcf3c33e0 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f2337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f2337640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52592/0 (socket says 172.21.15.114:52592) 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 learned_addr learned my addr 172.21.15.114:0/3422617482 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddcf3cadc0 con 0x55ddcf3c33e0 2024-05-08T18:09:07.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f2337640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3ca880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29e40b5b70 tx=0x7f29e40e9990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f28d4ff9640 1 -- 172.21.15.114:0/3422617482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40e2070 con 0x55ddcf3c33e0 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f28d4ff9640 1 -- 172.21.15.114:0/3422617482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e4005020 con 0x55ddcf3c33e0 2024-05-08T18:09:07.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f28d4ff9640 1 -- 172.21.15.114:0/3422617482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e40d6040 con 0x55ddcf3c33e0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ddcf3cb050 con 0x55ddcf3c33e0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.503+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddcf3cb460 con 0x55ddcf3c33e0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f28d4ff9640 1 -- 172.21.15.114:0/3422617482 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f29e40f2060 con 0x55ddcf3c33e0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f28d4ff9640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28bc038440 0x7f28bc03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f28d4ff9640 1 -- 172.21.15.114:0/3422617482 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f29e40e40a0 con 0x55ddcf3c33e0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f3339640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28bc038440 0x7f28bc03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf3d5d50 0x55ddcf3d81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf3d5d50 0x55ddcf3d81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3d8940 con 0x55ddcf3d5d50 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf3d5d50 0x55ddcf3d81f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f3339640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28bc038440 0x7f28bc03a900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00f010 tx=0x7f29ec01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 realm 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3d8d50 con 0x55ddcf3d5d50 2024-05-08T18:09:07.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3d9620 con 0x55ddcf3d5d50 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3d99c0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3d9270 con 0x55ddcf3d5d50 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 20 searching for the correct realm 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ddcf3dbde0 0x55ddcf3de1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3dbde0 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2337640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ddcf3dbde0 0x55ddcf3de1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.507+0000 7f29f2337640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ddcf3dbde0 0x55ddcf3de1d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2337640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f29e40f4070 0x7f29e40cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29e40f4070 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f3339640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f29e40f4070 0x7f29e40cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f3339640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f29e40f4070 0x7f29e40cba80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f3339640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f29ec019040 0x7f29ec019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29ec019040 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f29ec019040 0x7f29ec019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f29ec019040 0x7f29ec019930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3d5d50 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3d5d50 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29ec019040 2024-05-08T18:09:07.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.511+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29ec019040 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29e40f4070 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3dbde0 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3d5d50 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29ec019040 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3d5d50 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x7f29e40f4070 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3dbde0 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3de850 con 0x55ddcf3dbde0 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29ec019040 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.515+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3dbde0 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3dbde0 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3d5d50 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3d5d50 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29ec019040 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3dbde0 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29e40f4070 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3d5d50 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29ec019040 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3dbde0 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.519+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29ec019040 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29e40f4070 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3dbde0 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29ec019040 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x55ddcf3d5d50 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f29e4104040 con 0x7f29e40f4070 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:07.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3da850 con 0x55ddcf3d5d50 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3db0f0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3da490 con 0x55ddcf3d5d50 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 zone default found 2024-05-08T18:09:07.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 4 Realm: () 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 zonegroup default 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3df180 con 0x7f29ec019040 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.523+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e0c20 con 0x55ddcf3dbde0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e1070 con 0x55ddcf3dbde0 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 started sync module instance, tier type = 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:07.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3dfff0 con 0x7f29e40f4070 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94411153081312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e1960 con 0x7f29e40f4070 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e21b0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94411153081312] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.527+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94411153085616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e1d80 con 0x55ddcf3d5d50 2024-05-08T18:09:07.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.531+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e2880 con 0x55ddcf3dbde0 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.531+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94411153085616] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.531+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.531+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94411153086672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e1cf0 con 0x55ddcf3dbde0 2024-05-08T18:09:07.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.531+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e35d0 con 0x7f29e40f4070 2024-05-08T18:09:07.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.535+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94411153086672] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.535+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.535+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94411153091968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e39c0 con 0x7f29e40f4070 2024-05-08T18:09:07.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.535+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e4380 con 0x55ddcf3d5d50 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.539+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.539+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94411153096400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e47a0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.539+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e51c0 con 0x7f29ec019040 2024-05-08T18:09:07.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.539+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94411153091968] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94411153099952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5180 con 0x7f29ec019040 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5bd0 con 0x7f29ec019040 2024-05-08T18:09:07.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94411153096400] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94411153099952] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94411153093152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5720 con 0x7f29ec019040 2024-05-08T18:09:07.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.543+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5f70 con 0x7f29ec019040 2024-05-08T18:09:07.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94411153093152] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94411153102624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5ff0 con 0x7f29ec019040 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=0 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=1 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=2 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=3 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=4 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=5 2024-05-08T18:09:07.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.547+0000 7f29f5024980 20 add_watcher() i=6 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.551+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94411153102624] v30'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.551+0000 7f29f5024980 20 add_watcher() i=7 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.551+0000 7f29f5024980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.551+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e92d0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.551+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.551+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94411153104048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e6580 con 0x55ddcf3d5d50 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94411153104048] v30'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f28a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 5 note: GC not initialized 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f2823fff640 20 reqs_thread_entry: start 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 20 Filter name: none 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f2821ffb640 20 reqs_thread_entry: start 2024-05-08T18:09:07.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf40c8b0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:07.556 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f28a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.555+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94411153104048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf40b6a0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.559+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94411153104048] v30'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.559+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94411153081312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5cb0 con 0x7f29e40f4070 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.559+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94411153081312] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.559+0000 7f29f5024980 20 remove_watcher() i=0 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.559+0000 7f29f5024980 2 removed watcher, disabling cache 2024-05-08T18:09:07.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.559+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94411153085616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5cb0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94411153085616] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f5024980 20 remove_watcher() i=1 2024-05-08T18:09:07.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94411153086672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e14b0 con 0x55ddcf3dbde0 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f2337640 1 -- 172.21.15.114:0/3422617482 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94411153086672] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29e40d8030 con 0x55ddcf3dbde0 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f5024980 20 remove_watcher() i=2 2024-05-08T18:09:07.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94411153091968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5cb0 con 0x7f29e40f4070 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.563+0000 7f29f3339640 1 -- 172.21.15.114:0/3422617482 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94411153091968] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29ec02f040 con 0x7f29e40f4070 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.567+0000 7f29f5024980 20 remove_watcher() i=3 2024-05-08T18:09:07.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.567+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94411153096400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5cb0 con 0x55ddcf3d5d50 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.567+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94411153096400] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x55ddcf3d5d50 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.567+0000 7f29f5024980 20 remove_watcher() i=4 2024-05-08T18:09:07.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.567+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94411153099952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e3ed0 con 0x7f29ec019040 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.571+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94411153099952] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.571+0000 7f29f5024980 20 remove_watcher() i=5 2024-05-08T18:09:07.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.571+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94411153093152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e5cb0 con 0x7f29ec019040 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.571+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94411153093152] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.571+0000 7f29f5024980 20 remove_watcher() i=6 2024-05-08T18:09:07.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.571+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94411153102624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55ddcf3e3230 con 0x7f29ec019040 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94411153102624] v30'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f29dc02e070 con 0x7f29ec019040 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 20 remove_watcher() i=7 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f29ec019040 msgr2=0x7f29ec019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f29ec019040 0x7f29ec019930 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf3d5d50 msgr2=0x55ddcf3d81f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf3d5d50 0x55ddcf3d81f0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f29e40f4070 msgr2=0x7f29e40cba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f29e40f4070 0x7f29e40cba80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ddcf3dbde0 msgr2=0x55ddcf3de1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ddcf3dbde0 0x55ddcf3de1d0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28bc038440 msgr2=0x7f28bc03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28bc038440 0x7f28bc03a900 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29ec00f010 tx=0x7f29ec01b070 comp rx=0 tx=0).stop 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 msgr2=0x55ddcf3ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3422617482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf3c33e0 0x55ddcf3ca880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f29e40b5b70 tx=0x7f29e40e9990 comp rx=0 tx=0).stop 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 reap_dead start 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f2b38640 1 -- 172.21.15.114:0/3422617482 reap_dead start 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 shutdown_connections 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 >> 172.21.15.114:0/3422617482 conn(0x55ddcf3bf720 msgr2=0x55ddcf3bd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 shutdown_connections 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3422617482 wait complete. 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28cc0383f0 msgr2=0x7f28cc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28cc0383f0 0x7f28cc03a8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x55ddcf3a4570 tx=0x7f29ec003070 comp rx=0 tx=0).stop 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 msgr2=0x55ddcf21e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 0x55ddcf21e650 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f29e40ac040 tx=0x7f29e4017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 shutdown_connections 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28cc0383f0 0x7f28cc03a8b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/3223851383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2201b0 0x55ddcf21e650 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 >> 172.21.15.114:0/3223851383 conn(0x55ddcf3a8f70 msgr2=0x55ddcf3a9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 shutdown_connections 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/3223851383 wait complete. 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf2ae390 msgr2=0x55ddcf3a3370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf2ae390 0x55ddcf3a3370 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28d8038490 msgr2=0x7f28d803a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28d8038490 0x7f28d803a950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f29e40ab000 tx=0x7f29e40a5000 comp rx=0 tx=0).stop 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 msgr2=0x55ddcf39c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf39c3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x55ddcf395dc0 tx=0x7f29dc000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 shutdown_connections 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ddcf2ae390 0x55ddcf3a3370 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f28d8038490 0x7f28d803a950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 --2- 172.21.15.114:0/1608928568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ddcf2a9ed0 0x55ddcf39c3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 >> 172.21.15.114:0/1608928568 conn(0x55ddcf2a57a0 msgr2=0x55ddcf38f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 shutdown_connections 2024-05-08T18:09:07.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.575+0000 7f29f5024980 1 -- 172.21.15.114:0/1608928568 wait complete. 2024-05-08T18:09:07.589 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:07.589 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T18:09:07.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T18:09:07.589 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T18:09:07.667 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:07.668 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f357879f980 1 Processor -- start 2024-05-08T18:09:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f357879f980 1 -- start start 2024-05-08T18:09:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f357879f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555ab66ed800 0x555ab66efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f357879f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555ab6592710 con 0x555ab66e7560 2024-05-08T18:09:07.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f357879f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555ab65a6f00 con 0x555ab66ed800 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f3575ab2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555ab66ed800 0x555ab66efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f3575ab2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555ab66ed800 0x555ab66efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52598/0 (socket says 172.21.15.114:52598) 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f3575ab2640 1 -- 172.21.15.114:0/1065529616 learned_addr learned my addr 172.21.15.114:0/1065529616 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.667+0000 7f35762b3640 1 --1- 172.21.15.114:0/1065529616 >> v1:172.21.15.53:6789/0 conn(0x555ab66e7560 0x555ab66e7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51000/0 (socket says 172.21.15.114:51000) 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f3575ab2640 1 -- 172.21.15.114:0/1065529616 >> v1:172.21.15.53:6789/0 conn(0x555ab66e7560 legacy=0x555ab66e7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f35752b1640 1 -- 172.21.15.114:0/1065529616 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437821442 0 0) 0x555ab6592710 con 0x555ab66e7560 2024-05-08T18:09:07.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f3575ab2640 1 -- 172.21.15.114:0/1065529616 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab656eae0 con 0x555ab66ed800 2024-05-08T18:09:07.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f3575ab2640 1 --2- 172.21.15.114:0/1065529616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab66efbf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f356c00a5c0 tx=0x7f356c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698fedd22a4ee93a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f35752b1640 1 -- 172.21.15.114:0/1065529616 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0b1070 con 0x555ab66ed800 2024-05-08T18:09:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f35752b1640 1 -- 172.21.15.114:0/1065529616 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0a8070 con 0x555ab66ed800 2024-05-08T18:09:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f35752b1640 1 -- 172.21.15.114:0/1065529616 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0ac5b0 con 0x555ab66ed800 2024-05-08T18:09:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 -- 172.21.15.114:0/1065529616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 msgr2=0x555ab66efbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 --2- 172.21.15.114:0/1065529616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab66efbf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f356c00a5c0 tx=0x7f356c01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 -- 172.21.15.114:0/1065529616 shutdown_connections 2024-05-08T18:09:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 --2- 172.21.15.114:0/1065529616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab66efbf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 -- 172.21.15.114:0/1065529616 >> 172.21.15.114:0/1065529616 conn(0x555ab66e0dc0 msgr2=0x555ab66e31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 -- 172.21.15.114:0/1065529616 shutdown_connections 2024-05-08T18:09:07.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.671+0000 7f357879f980 1 -- 172.21.15.114:0/1065529616 wait complete. 2024-05-08T18:09:07.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.687+0000 7f357879f980 1 Processor -- start 2024-05-08T18:09:07.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.687+0000 7f357879f980 1 -- start start 2024-05-08T18:09:07.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.687+0000 7f357879f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 0x555ab67d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.687+0000 7f357879f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ab65eaf80 con 0x555ab66e7560 2024-05-08T18:09:07.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.687+0000 7f35762b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 0x555ab67d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 0x555ab67d4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52600/0 (socket says 172.21.15.114:52600) 2024-05-08T18:09:07.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 -- 172.21.15.114:0/488671774 learned_addr learned my addr 172.21.15.114:0/488671774 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 -- 172.21.15.114:0/488671774 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab65b2da0 con 0x555ab66e7560 2024-05-08T18:09:07.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 --2- 172.21.15.114:0/488671774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 0x555ab67d4030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3568001eb0 tx=0x7f356800b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818fa8e376f54b0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f3464608640 1 -- 172.21.15.114:0/488671774 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356800d640 con 0x555ab66e7560 2024-05-08T18:09:07.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f3464608640 1 -- 172.21.15.114:0/488671774 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3568008070 con 0x555ab66e7560 2024-05-08T18:09:07.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f3464608640 1 -- 172.21.15.114:0/488671774 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356800d970 con 0x555ab66e7560 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- 172.21.15.114:0/488671774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 msgr2=0x555ab67d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 --2- 172.21.15.114:0/488671774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 0x555ab67d4030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3568001eb0 tx=0x7f356800b6b0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- 172.21.15.114:0/488671774 shutdown_connections 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 --2- 172.21.15.114:0/488671774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66e7560 0x555ab67d4030 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3568001eb0 tx=0x7f356800b6b0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- 172.21.15.114:0/488671774 >> 172.21.15.114:0/488671774 conn(0x555ab66e0dc0 msgr2=0x555ab67cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- 172.21.15.114:0/488671774 shutdown_connections 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- 172.21.15.114:0/488671774 wait complete. 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 Processor -- start 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- start start 2024-05-08T18:09:07.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab67db790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f357879f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ab66f2b60 con 0x555ab66ed800 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab67db790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab67db790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52606/0 (socket says 172.21.15.114:52606) 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 -- 172.21.15.114:0/1422523131 learned_addr learned my addr 172.21.15.114:0/1422523131 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab67dbcd0 con 0x555ab66ed800 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.691+0000 7f35762b3640 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab67db790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x555ab67d4ec0 tx=0x7f3568000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3462e05640 1 -- 172.21.15.114:0/1422523131 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356801a690 con 0x555ab66ed800 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3462e05640 1 -- 172.21.15.114:0/1422523131 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356801a830 con 0x555ab66ed800 2024-05-08T18:09:07.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3462e05640 1 -- 172.21.15.114:0/1422523131 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356801ab50 con 0x555ab66ed800 2024-05-08T18:09:07.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ab67dbf60 con 0x555ab66ed800 2024-05-08T18:09:07.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab67dec40 con 0x555ab66ed800 2024-05-08T18:09:07.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3462e05640 1 -- 172.21.15.114:0/1422523131 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3568017070 con 0x555ab66ed800 2024-05-08T18:09:07.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3462e05640 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f345c0383f0 0x7f345c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3462e05640 1 -- 172.21.15.114:0/1422523131 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f3568015020 con 0x555ab66ed800 2024-05-08T18:09:07.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3575ab2640 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f345c0383f0 0x7f345c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab67e0710 0x555ab67e2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab67e3190 con 0x555ab67e0710 2024-05-08T18:09:07.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3576ab4640 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab67e0710 0x555ab67e2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3575ab2640 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f345c0383f0 0x7f345c03a8b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f356c0ae000 tx=0x7f356c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3576ab4640 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab67e0710 0x555ab67e2b20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f3576ab4640 1 -- 172.21.15.114:0/1422523131 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f357000a4d0 con 0x555ab67e0710 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.695+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab67dfe60 con 0x555ab67e0710 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3576ab4640 1 -- 172.21.15.114:0/1422523131 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f357000a4d0 con 0x555ab67e0710 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab67e4fb0 con 0x555ab67e0710 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3576ab4640 1 -- 172.21.15.114:0/1422523131 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f357000a4d0 con 0x555ab67e0710 2024-05-08T18:09:07.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab67e4120 con 0x555ab67e0710 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3576ab4640 1 -- 172.21.15.114:0/1422523131 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f357000a4d0 con 0x555ab67e0710 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab67e4570 con 0x555ab67e0710 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3576ab4640 1 -- 172.21.15.114:0/1422523131 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f357000a4d0 con 0x555ab67e0710 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 Processor -- start 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- start start 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 0x555ab67f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ab65eefc0 con 0x555ab67f3870 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3575ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 0x555ab67f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3575ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 0x555ab67f3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52616/0 (socket says 172.21.15.114:52616) 2024-05-08T18:09:07.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3575ab2640 1 -- 172.21.15.114:0/2042505733 learned_addr learned my addr 172.21.15.114:0/2042505733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3575ab2640 1 -- 172.21.15.114:0/2042505733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab67f41d0 con 0x555ab67f3870 2024-05-08T18:09:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f3575ab2640 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 0x555ab67f3c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f356c017f50 tx=0x7f356c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f345bfff640 1 -- 172.21.15.114:0/2042505733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0c8070 con 0x555ab67f3870 2024-05-08T18:09:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ab67f4c70 con 0x555ab67f3870 2024-05-08T18:09:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f345bfff640 1 -- 172.21.15.114:0/2042505733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0c3410 con 0x555ab67f3870 2024-05-08T18:09:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f345bfff640 1 -- 172.21.15.114:0/2042505733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0b1040 con 0x555ab67f3870 2024-05-08T18:09:07.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.699+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab67f5140 con 0x555ab67f3870 2024-05-08T18:09:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f345bfff640 1 -- 172.21.15.114:0/2042505733 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f356c0cb070 con 0x555ab67f3870 2024-05-08T18:09:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f345bfff640 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3450038440 0x7f345003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f345bfff640 1 -- 172.21.15.114:0/2042505733 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f356c0c0070 con 0x555ab67f3870 2024-05-08T18:09:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3450038440 0x7f345003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f357879f980 1 Processor -- start 2024-05-08T18:09:07.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f357879f980 1 -- start start 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3450038440 0x7f345003a900 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x555ab67e3c40 tx=0x7f3570005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f357879f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6800d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f357879f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ab67d4780 con 0x555ab6800930 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3575ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6800d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3575ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6800d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52632/0 (socket says 172.21.15.114:52632) 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3575ab2640 1 -- 172.21.15.114:0/366416570 learned_addr learned my addr 172.21.15.114:0/366416570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3575ab2640 1 -- 172.21.15.114:0/366416570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab68012e0 con 0x555ab6800930 2024-05-08T18:09:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3575ab2640 1 --2- 172.21.15.114:0/366416570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6800d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f356c000bf0 tx=0x7f356c006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ea1dcbd6ec6b90 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3459ffb640 1 -- 172.21.15.114:0/366416570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0c3900 con 0x555ab6800930 2024-05-08T18:09:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3459ffb640 1 -- 172.21.15.114:0/366416570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0c3aa0 con 0x555ab6800930 2024-05-08T18:09:07.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.703+0000 7f3459ffb640 1 -- 172.21.15.114:0/366416570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0e2060 con 0x555ab6800930 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/366416570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 msgr2=0x555ab6800d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 --2- 172.21.15.114:0/366416570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6800d10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f356c000bf0 tx=0x7f356c006e10 comp rx=0 tx=0).stop 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/366416570 shutdown_connections 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 --2- 172.21.15.114:0/366416570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6800d10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/366416570 >> 172.21.15.114:0/366416570 conn(0x555ab67fcc70 msgr2=0x555ab67facd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/366416570 shutdown_connections 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/366416570 wait complete. 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 Processor -- start 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- start start 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6807e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555ab6801aa0 con 0x555ab6800930 2024-05-08T18:09:07.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3575ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6807e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3575ab2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6807e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52636/0 (socket says 172.21.15.114:52636) 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 learned_addr learned my addr 172.21.15.114:0/2358729724 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ab6808350 con 0x555ab6800930 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3575ab2640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6807e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f356c0b8fd0 tx=0x7f356c0e8ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3447fff640 1 -- 172.21.15.114:0/2358729724 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0ee020 con 0x555ab6800930 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555ab68085e0 con 0x555ab6800930 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3447fff640 1 -- 172.21.15.114:0/2358729724 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f356c0cceb0 con 0x555ab6800930 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f3447fff640 1 -- 172.21.15.114:0/2358729724 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f356c0c3900 con 0x555ab6800930 2024-05-08T18:09:07.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.707+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ab68085e0 con 0x555ab6800930 2024-05-08T18:09:07.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3447fff640 1 -- 172.21.15.114:0/2358729724 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f356c0f1020 con 0x555ab6800930 2024-05-08T18:09:07.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3447fff640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f34400383f0 0x7f344003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3447fff640 1 -- 172.21.15.114:0/2358729724 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f356c0e2050 con 0x555ab6800930 2024-05-08T18:09:07.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f34400383f0 0x7f344003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab6813130 0x555ab68155d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6815d20 con 0x555ab6813130 2024-05-08T18:09:07.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab6813130 0x555ab68155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f34400383f0 0x7f344003a8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x555ab67dfdb0 tx=0x7f357001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab6813130 0x555ab68155d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 realm 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6816130 con 0x555ab6813130 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6816a00 con 0x555ab6813130 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6816da0 con 0x555ab6813130 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab68175f0 con 0x555ab6813130 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 20 searching for the correct realm 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555ab6819360 0x555ab681b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3575ab2640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555ab6819360 0x555ab681b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3575ab2640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555ab6819360 0x555ab681b750 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3575ab2640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f356c0fe040 0x7f356c0daab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f356c0fe040 2024-05-08T18:09:07.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.711+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f356c0fe040 0x7f356c0daab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f356c0fe040 0x7f356c0daab0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357001f070 con 0x7f356c0fe040 2024-05-08T18:09:07.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f3576ab4640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3570031040 0x7f3570032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3570031040 0x7f3570032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3570031040 0x7f3570032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.715+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f356c0fe040 2024-05-08T18:09:07.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357001f070 con 0x7f356c0fe040 2024-05-08T18:09:07.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f356c0fe040 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f357001f070 con 0x7f356c0fe040 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.719+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f356c0fe040 2024-05-08T18:09:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357001f070 con 0x7f356c0fe040 2024-05-08T18:09:07.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.723+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f356c0fe040 2024-05-08T18:09:07.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357001f070 con 0x7f356c0fe040 2024-05-08T18:09:07.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6819360 2024-05-08T18:09:07.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f3570031040 2024-05-08T18:09:07.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x555ab6813130 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555ab681bc90 con 0x7f356c0fe040 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f357001f070 con 0x7f356c0fe040 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6817ed0 con 0x555ab6813130 2024-05-08T18:09:07.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6818770 con 0x555ab6813130 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab681c0c0 con 0x555ab6813130 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 zone default found 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 4 Realm: () 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:07.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:07.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 zonegroup default 2024-05-08T18:09:07.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.727+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab681c170 con 0x7f3570031040 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab681df90 con 0x555ab6819360 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab681e380 con 0x555ab6819360 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 started sync module instance, tier type = 2024-05-08T18:09:07.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab681d430 con 0x7f356c0fe040 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93848097380384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab681d090 con 0x7f356c0fe040 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab681f2b0 con 0x555ab6813130 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.731+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93848097380384] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93848097384416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab681f2b0 con 0x555ab6813130 2024-05-08T18:09:07.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab681fc70 con 0x555ab6819360 2024-05-08T18:09:07.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93848097388480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab68204c0 con 0x555ab6819360 2024-05-08T18:09:07.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6820e80 con 0x7f356c0fe040 2024-05-08T18:09:07.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.735+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93848097384416] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.739+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93848097388480] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.739+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.739+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93848097385984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6820e80 con 0x7f356c0fe040 2024-05-08T18:09:07.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.739+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6821720 con 0x555ab6813130 2024-05-08T18:09:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93848097395312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6821b40 con 0x555ab6813130 2024-05-08T18:09:07.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6822500 con 0x7f3570031040 2024-05-08T18:09:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93848097398864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6822470 con 0x7f3570031040 2024-05-08T18:09:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6823400 con 0x7f3570031040 2024-05-08T18:09:07.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.743+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93848097385984] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.747+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93848097395312] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.747+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.747+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93848097396368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6822f10 con 0x7f3570031040 2024-05-08T18:09:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.747+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab68238d0 con 0x7f3570031040 2024-05-08T18:09:07.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.747+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93848097398864] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93848097396368] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93848097393104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6823420 con 0x7f3570031040 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=0 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=1 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=2 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=3 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=4 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=5 2024-05-08T18:09:07.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=6 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93848097393104] v30'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 20 add_watcher() i=7 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab6826900 con 0x555ab6813130 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.751+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93848097403936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6823cf0 con 0x555ab6813130 2024-05-08T18:09:07.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93848097403936] v30'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f342cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 5 note: GC not initialized 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f33a77fe640 20 reqs_thread_entry: start 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 20 Filter name: none 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f33a57fa640 20 reqs_thread_entry: start 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab684a190 con 0x555ab6813130 2024-05-08T18:09:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:07.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab684cc20 con 0x7f356c0fe040 2024-05-08T18:09:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.755+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6850420 con 0x555ab6813130 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v30'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f357879f980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f357879f980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f357879f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93848097586832 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555ab684ef70 con 0x555ab6813130 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 93848097395312 notify 128849018882 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f3568056080 con 0x555ab6813130 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f3459ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 93848097395312 notifier 4324 bl.length()=567 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f3459ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:07.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f3459ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:07.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f3459ffb640 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f343c003eb0 con 0x555ab6813130 2024-05-08T18:09:07.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(65 notify.4 [notify cookie 93848097586832 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 93848097586832 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555ab67dec40 con 0x555ab6813130 2024-05-08T18:09:07.760 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:07.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f342cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.759+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93848097403936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6847ec0 con 0x555ab6813130 2024-05-08T18:09:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 93848097403936] v30'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93848097380384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6847ec0 con 0x7f356c0fe040 2024-05-08T18:09:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 93848097380384] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f357879f980 20 remove_watcher() i=0 2024-05-08T18:09:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f357879f980 2 removed watcher, disabling cache 2024-05-08T18:09:07.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93848097384416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6847ec0 con 0x555ab6813130 2024-05-08T18:09:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 93848097384416] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f357879f980 20 remove_watcher() i=1 2024-05-08T18:09:07.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.763+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93848097388480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6847ec0 con 0x555ab6819360 2024-05-08T18:09:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.767+0000 7f3575ab2640 1 -- 172.21.15.114:0/2358729724 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 93848097388480] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356c0ca030 con 0x555ab6819360 2024-05-08T18:09:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.767+0000 7f357879f980 20 remove_watcher() i=2 2024-05-08T18:09:07.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.767+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93848097385984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab684ef70 con 0x7f356c0fe040 2024-05-08T18:09:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.767+0000 7f3576ab4640 1 -- 172.21.15.114:0/2358729724 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 93848097385984] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3570040040 con 0x7f356c0fe040 2024-05-08T18:09:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.767+0000 7f357879f980 20 remove_watcher() i=3 2024-05-08T18:09:07.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.767+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93848097395312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab684ef70 con 0x555ab6813130 2024-05-08T18:09:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.771+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 93848097395312] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x555ab6813130 2024-05-08T18:09:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.771+0000 7f357879f980 20 remove_watcher() i=4 2024-05-08T18:09:07.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.771+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93848097398864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab684ef70 con 0x7f3570031040 2024-05-08T18:09:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.775+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 93848097398864] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.775+0000 7f357879f980 20 remove_watcher() i=5 2024-05-08T18:09:07.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.775+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93848097396368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab684ef70 con 0x7f3570031040 2024-05-08T18:09:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.775+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 93848097396368] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.775+0000 7f357879f980 20 remove_watcher() i=6 2024-05-08T18:09:07.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.775+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93848097393104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555ab6821720 con 0x7f3570031040 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 93848097393104] v30'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f356802e070 con 0x7f3570031040 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 20 remove_watcher() i=7 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3570031040 msgr2=0x7f3570032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3570031040 0x7f3570032940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab6813130 msgr2=0x555ab68155d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab6813130 0x555ab68155d0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f356c0fe040 msgr2=0x7f356c0daab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f356c0fe040 0x7f356c0daab0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555ab6819360 msgr2=0x555ab681b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555ab6819360 0x555ab681b750 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f34400383f0 msgr2=0x7f344003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f34400383f0 0x7f344003a8b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x555ab67dfdb0 tx=0x7f357001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 msgr2=0x555ab6807e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6807e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f356c0b8fd0 tx=0x7f356c0e8ff0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f35762b3640 1 -- 172.21.15.114:0/2358729724 reap_dead start 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 shutdown_connections 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2358729724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab6800930 0x555ab6807e10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 >> 172.21.15.114:0/2358729724 conn(0x555ab67fcc70 msgr2=0x555ab67fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 shutdown_connections 2024-05-08T18:09:07.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2358729724 wait complete. 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3450038440 msgr2=0x7f345003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3450038440 0x7f345003a900 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x555ab67e3c40 tx=0x7f3570005850 comp rx=0 tx=0).stop 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 msgr2=0x555ab67f3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 0x555ab67f3c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f356c017f50 tx=0x7f356c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 shutdown_connections 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3450038440 0x7f345003a900 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/2042505733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab67f3870 0x555ab67f3c90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 >> 172.21.15.114:0/2042505733 conn(0x555ab67e8680 msgr2=0x555ab67e9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 shutdown_connections 2024-05-08T18:09:07.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/2042505733 wait complete. 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab67e0710 msgr2=0x555ab67e2b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab67e0710 0x555ab67e2b20 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f345c0383f0 msgr2=0x7f345c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f345c0383f0 0x7f345c03a8b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f356c0ae000 tx=0x7f356c0a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 msgr2=0x555ab67db790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab67db790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x555ab67d4ec0 tx=0x7f3568000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 shutdown_connections 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555ab67e0710 0x555ab67e2b20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f345c0383f0 0x7f345c03a8b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 --2- 172.21.15.114:0/1422523131 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555ab66ed800 0x555ab67db790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 >> 172.21.15.114:0/1422523131 conn(0x555ab66e0dc0 msgr2=0x555ab67ce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 shutdown_connections 2024-05-08T18:09:07.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.779+0000 7f357879f980 1 -- 172.21.15.114:0/1422523131 wait complete. 2024-05-08T18:09:07.791 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:07.791 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:07.791 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:07.792 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:07.869 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:07.870 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395f7bb980 1 Processor -- start 2024-05-08T18:09:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395f7bb980 1 -- start start 2024-05-08T18:09:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395f7bb980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d394bdb5b0 0x55d394bdd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395f7bb980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d394a80710 con 0x55d394bd70f0 2024-05-08T18:09:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395f7bb980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d394a94f00 con 0x55d394bdb5b0 2024-05-08T18:09:07.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395cace640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d394bdb5b0 0x55d394bdd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395cace640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d394bdb5b0 0x55d394bdd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52652/0 (socket says 172.21.15.114:52652) 2024-05-08T18:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395d2cf640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d394bd70f0 0x55d394bd74d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51016/0 (socket says 172.21.15.114:51016) 2024-05-08T18:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395cace640 1 -- 172.21.15.114:0/255419172 learned_addr learned my addr 172.21.15.114:0/255419172 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395cace640 1 -- 172.21.15.114:0/255419172 >> v1:172.21.15.53:6789/0 conn(0x55d394bd70f0 legacy=0x55d394bd74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.871+0000 7f395cace640 1 -- 172.21.15.114:0/255419172 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394a5cae0 con 0x55d394bdb5b0 2024-05-08T18:09:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395cace640 1 --2- 172.21.15.114:0/255419172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bdb5b0 0x55d394bdd9a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f395400a5c0 tx=0x7f395401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e46e795490134e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f394ffff640 1 -- 172.21.15.114:0/255419172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540a6070 con 0x55d394bdb5b0 2024-05-08T18:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f394ffff640 1 -- 172.21.15.114:0/255419172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540af070 con 0x55d394bdb5b0 2024-05-08T18:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f394ffff640 1 -- 172.21.15.114:0/255419172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540aa5c0 con 0x55d394bdb5b0 2024-05-08T18:09:07.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 -- 172.21.15.114:0/255419172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bdb5b0 msgr2=0x55d394bdd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 --2- 172.21.15.114:0/255419172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bdb5b0 0x55d394bdd9a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f395400a5c0 tx=0x7f395401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 -- 172.21.15.114:0/255419172 shutdown_connections 2024-05-08T18:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 --2- 172.21.15.114:0/255419172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bdb5b0 0x55d394bdd9a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 -- 172.21.15.114:0/255419172 >> 172.21.15.114:0/255419172 conn(0x55d394b4a7d0 msgr2=0x55d394b4abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 -- 172.21.15.114:0/255419172 shutdown_connections 2024-05-08T18:09:07.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.875+0000 7f395f7bb980 1 -- 172.21.15.114:0/255419172 wait complete. 2024-05-08T18:09:07.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 Processor -- start 2024-05-08T18:09:07.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- start start 2024-05-08T18:09:07.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d394ad8f80 con 0x55d394bd70f0 2024-05-08T18:09:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395d2cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395d2cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52660/0 (socket says 172.21.15.114:52660) 2024-05-08T18:09:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395d2cf640 1 -- 172.21.15.114:0/2095561794 learned_addr learned my addr 172.21.15.114:0/2095561794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395d2cf640 1 -- 172.21.15.114:0/2095561794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394aa0da0 con 0x55d394bd70f0 2024-05-08T18:09:07.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395d2cf640 1 --2- 172.21.15.114:0/2095561794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc2160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3958001ec0 tx=0x7f395800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4444f3968495b9a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f384b606640 1 -- 172.21.15.114:0/2095561794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f395800e5d0 con 0x55d394bd70f0 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f384b606640 1 -- 172.21.15.114:0/2095561794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395800e770 con 0x55d394bd70f0 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f384b606640 1 -- 172.21.15.114:0/2095561794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f395800ea70 con 0x55d394bd70f0 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- 172.21.15.114:0/2095561794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 msgr2=0x55d394cc2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2095561794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc2160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3958001ec0 tx=0x7f395800b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- 172.21.15.114:0/2095561794 shutdown_connections 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2095561794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc2160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- 172.21.15.114:0/2095561794 >> 172.21.15.114:0/2095561794 conn(0x55d394b4a7d0 msgr2=0x55d394cbdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- 172.21.15.114:0/2095561794 shutdown_connections 2024-05-08T18:09:07.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.891+0000 7f395f7bb980 1 -- 172.21.15.114:0/2095561794 wait complete. 2024-05-08T18:09:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 Processor -- start 2024-05-08T18:09:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 -- start start 2024-05-08T18:09:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d394be09d0 con 0x55d394bd70f0 2024-05-08T18:09:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395d2cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395d2cf640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52668/0 (socket says 172.21.15.114:52668) 2024-05-08T18:09:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395d2cf640 1 -- 172.21.15.114:0/2102211742 learned_addr learned my addr 172.21.15.114:0/2102211742 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395d2cf640 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394cc9b80 con 0x55d394bd70f0 2024-05-08T18:09:07.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395d2cf640 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc9640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f395800b710 tx=0x7f3958000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f3849e03640 1 -- 172.21.15.114:0/2102211742 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f395801a7c0 con 0x55d394bd70f0 2024-05-08T18:09:07.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d394cc9e10 con 0x55d394bd70f0 2024-05-08T18:09:07.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f3849e03640 1 -- 172.21.15.114:0/2102211742 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f395801a960 con 0x55d394bd70f0 2024-05-08T18:09:07.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f3849e03640 1 -- 172.21.15.114:0/2102211742 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f395801acc0 con 0x55d394bd70f0 2024-05-08T18:09:07.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d394cccaf0 con 0x55d394bd70f0 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f3849e03640 1 -- 172.21.15.114:0/2102211742 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3958017070 con 0x55d394bd70f0 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f3849e03640 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38440383f0 0x7f384403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f3849e03640 1 -- 172.21.15.114:0/2102211742 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f3958015020 con 0x55d394bd70f0 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395cace640 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38440383f0 0x7f384403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394bdb5b0 0x55d394cd0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.895+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394cd0c80 con 0x55d394bdb5b0 2024-05-08T18:09:07.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394bdb5b0 0x55d394cd0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395cace640 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38440383f0 0x7f384403a8b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f39540ae000 tx=0x7f39540a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394bdb5b0 0x55d394cd0610 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 -- 172.21.15.114:0/2102211742 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395000a4d0 con 0x55d394bdb5b0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394ccdd10 con 0x55d394bdb5b0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 -- 172.21.15.114:0/2102211742 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f395000a4d0 con 0x55d394bdb5b0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394cd2aa0 con 0x55d394bdb5b0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 -- 172.21.15.114:0/2102211742 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f395000a4d0 con 0x55d394bdb5b0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394cd1c10 con 0x55d394bdb5b0 2024-05-08T18:09:07.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 -- 172.21.15.114:0/2102211742 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f395000a4d0 con 0x55d394bdb5b0 2024-05-08T18:09:07.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394cd2060 con 0x55d394bdb5b0 2024-05-08T18:09:07.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395dad0640 1 -- 172.21.15.114:0/2102211742 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f395000a4d0 con 0x55d394bdb5b0 2024-05-08T18:09:07.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 Processor -- start 2024-05-08T18:09:07.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 -- start start 2024-05-08T18:09:07.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 0x55d394ce1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395f7bb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d394adcfc0 con 0x55d394ce1360 2024-05-08T18:09:07.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395cace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 0x55d394ce1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395cace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 0x55d394ce1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52684/0 (socket says 172.21.15.114:52684) 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395cace640 1 -- 172.21.15.114:0/2415664469 learned_addr learned my addr 172.21.15.114:0/2415664469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.899+0000 7f395cace640 1 -- 172.21.15.114:0/2415664469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394ce1cc0 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395cace640 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 0x55d394ce1780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39540ac040 tx=0x7f39540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f3842ffd640 1 -- 172.21.15.114:0/2415664469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540b3b80 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f3842ffd640 1 -- 172.21.15.114:0/2415664469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540b3d20 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f3842ffd640 1 -- 172.21.15.114:0/2415664469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540c8560 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d394ce2760 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d394ce2bd0 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f3842ffd640 1 -- 172.21.15.114:0/2415664469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f39540d1440 con 0x55d394ce1360 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f3842ffd640 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3834038440 0x7f383403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f3842ffd640 1 -- 172.21.15.114:0/2415664469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f39540ec060 con 0x55d394ce1360 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395dad0640 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3834038440 0x7f383403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395f7bb980 1 Processor -- start 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395f7bb980 1 -- start start 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395dad0640 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3834038440 0x7f383403a900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55d394cd1730 tx=0x7f3950005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395f7bb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cee840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395f7bb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d394cc28b0 con 0x55d394cee440 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395cace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395cace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cee840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52698/0 (socket says 172.21.15.114:52698) 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.903+0000 7f395cace640 1 -- 172.21.15.114:0/171281210 learned_addr learned my addr 172.21.15.114:0/171281210 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 -- 172.21.15.114:0/171281210 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394ceee10 con 0x55d394cee440 2024-05-08T18:09:07.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 --2- 172.21.15.114:0/171281210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cee840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f39540ea470 tx=0x7f39540d1a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1665a5be807532 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f3840ff9640 1 -- 172.21.15.114:0/171281210 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540e7030 con 0x55d394cee440 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f3840ff9640 1 -- 172.21.15.114:0/171281210 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540bd390 con 0x55d394cee440 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f3840ff9640 1 -- 172.21.15.114:0/171281210 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540bd670 con 0x55d394cee440 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/171281210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 msgr2=0x55d394cee840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 --2- 172.21.15.114:0/171281210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cee840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f39540ea470 tx=0x7f39540d1a80 comp rx=0 tx=0).stop 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/171281210 shutdown_connections 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 --2- 172.21.15.114:0/171281210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cee840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/171281210 >> 172.21.15.114:0/171281210 conn(0x55d394cea780 msgr2=0x55d394ce87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/171281210 shutdown_connections 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/171281210 wait complete. 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 Processor -- start 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- start start 2024-05-08T18:09:07.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cf5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d394cef550 con 0x55d394cee440 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cf5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cf5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52712/0 (socket says 172.21.15.114:52712) 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 learned_addr learned my addr 172.21.15.114:0/2769245956 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d394cf5e40 con 0x55d394cee440 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395cace640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cf5900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39540bcfd0 tx=0x7f39540ea400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f3832ffd640 1 -- 172.21.15.114:0/2769245956 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540f2070 con 0x55d394cee440 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d394cf60d0 con 0x55d394cee440 2024-05-08T18:09:07.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f3832ffd640 1 -- 172.21.15.114:0/2769245956 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39540c7c10 con 0x55d394cee440 2024-05-08T18:09:07.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f3832ffd640 1 -- 172.21.15.114:0/2769245956 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39540bf920 con 0x55d394cee440 2024-05-08T18:09:07.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.907+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d394cf60d0 con 0x55d394cee440 2024-05-08T18:09:07.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f3832ffd640 1 -- 172.21.15.114:0/2769245956 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f39540f5070 con 0x55d394cee440 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f3832ffd640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38280383f0 0x7f382803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f3832ffd640 1 -- 172.21.15.114:0/2769245956 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f39540f8c80 con 0x55d394cee440 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395dad0640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38280383f0 0x7f382803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394d00be0 0x55d394d03050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d037a0 con 0x55d394d00be0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394d00be0 0x55d394d03050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395dad0640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38280383f0 0x7f382803a8b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55d394ccdc60 tx=0x7f395001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394d00be0 0x55d394d03050 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 realm 2024-05-08T18:09:07.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d03bb0 con 0x55d394d00be0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d04480 con 0x55d394d00be0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d04820 con 0x55d394d00be0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d04c80 con 0x55d394d00be0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 20 searching for the correct realm 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d394d06bf0 0x55d394d08fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.911+0000 7f395cace640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d394d06bf0 0x55d394d08fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395cace640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d394d06bf0 0x55d394d08fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395cace640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39540f7060 0x7f39540eaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f39540f7060 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395dad0640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39540f7060 0x7f39540eaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395dad0640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39540f7060 0x7f39540eaa30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395001f070 con 0x7f39540f7060 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395dad0640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3950031040 0x7f3950032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3950031040 0x7f3950032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3950031040 0x7f3950032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.915+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f39540f7060 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395001f070 con 0x7f39540f7060 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f39540f7060 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f395001f070 con 0x7f39540f7060 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.919+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f39540f7060 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395001f070 con 0x7f39540f7060 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.923+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f39540f7060 2024-05-08T18:09:07.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395001f070 con 0x7f39540f7060 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d06bf0 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f3950031040 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x55d394d00be0 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09690 con 0x7f39540f7060 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f395001f070 con 0x7f39540f7060 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:07.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d05660 con 0x55d394d00be0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d05f00 con 0x55d394d00be0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.927+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d052a0 con 0x55d394d00be0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:07.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 zone default found 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 4 Realm: () 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 zonegroup default 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d09b10 con 0x7f3950031040 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0b9a0 con 0x55d394d06bf0 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0bd40 con 0x55d394d06bf0 2024-05-08T18:09:07.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:07.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 started sync module instance, tier type = 2024-05-08T18:09:07.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:07.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ade0 con 0x7f39540f7060 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3950040040 con 0x7f39540f7060 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94367223165392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0b5f0 con 0x7f39540f7060 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.931+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ca40 con 0x55d394d00be0 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94367223165392] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3950040040 con 0x7f39540f7060 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94367223169520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ce30 con 0x55d394d00be0 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0d7f0 con 0x55d394d06bf0 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94367223173952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0e090 con 0x55d394d06bf0 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ea50 con 0x7f39540f7060 2024-05-08T18:09:07.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.935+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94367223169520] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94367223173952] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3950040040 con 0x7f39540f7060 2024-05-08T18:09:07.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94367223170768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ea50 con 0x7f39540f7060 2024-05-08T18:09:07.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0f2f0 con 0x55d394d00be0 2024-05-08T18:09:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94367223180864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0f710 con 0x55d394d00be0 2024-05-08T18:09:07.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.939+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d10150 con 0x7f3950031040 2024-05-08T18:09:07.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.943+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94367223170768] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3950040040 con 0x7f39540f7060 2024-05-08T18:09:07.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.943+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94367223180864] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.943+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.943+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94367223184416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0f260 con 0x7f3950031040 2024-05-08T18:09:07.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.943+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d109f0 con 0x7f3950031040 2024-05-08T18:09:07.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94367223184416] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94367223178656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0f260 con 0x7f3950031040 2024-05-08T18:09:07.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d10ee0 con 0x7f3950031040 2024-05-08T18:09:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94367223178656] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94367223186752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d10e10 con 0x7f3950031040 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=0 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=1 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=2 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=3 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=4 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=5 2024-05-08T18:09:07.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.947+0000 7f395f7bb980 20 add_watcher() i=6 2024-05-08T18:09:07.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.951+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94367223186752] v30'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.951+0000 7f395f7bb980 20 add_watcher() i=7 2024-05-08T18:09:07.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.951+0000 7f395f7bb980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:07.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.951+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d14300 con 0x55d394d00be0 2024-05-08T18:09:07.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.951+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.951+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94367223188272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d11820 con 0x55d394d00be0 2024-05-08T18:09:07.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94367223188272] v30'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f3813fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 5 note: GC not initialized 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f3812fe5640 20 reqs_thread_entry: start 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 20 Filter name: none 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f3810fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:07.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d394d37840 con 0x55d394d00be0 2024-05-08T18:09:07.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:07.956 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:07.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f3813fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:07.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.955+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94367223188272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d36630 con 0x55d394d00be0 2024-05-08T18:09:07.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94367223188272] v30'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94367223165392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d10b00 con 0x7f39540f7060 2024-05-08T18:09:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94367223165392] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3950040040 con 0x7f39540f7060 2024-05-08T18:09:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395f7bb980 20 remove_watcher() i=0 2024-05-08T18:09:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395f7bb980 2 removed watcher, disabling cache 2024-05-08T18:09:07.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94367223169520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0b1d0 con 0x55d394d00be0 2024-05-08T18:09:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94367223169520] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395f7bb980 20 remove_watcher() i=1 2024-05-08T18:09:07.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.959+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94367223173952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0b1d0 con 0x55d394d06bf0 2024-05-08T18:09:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.963+0000 7f395cace640 1 -- 172.21.15.114:0/2769245956 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94367223173952] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39540f4030 con 0x55d394d06bf0 2024-05-08T18:09:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.963+0000 7f395f7bb980 20 remove_watcher() i=2 2024-05-08T18:09:07.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.963+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94367223170768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0d340 con 0x7f39540f7060 2024-05-08T18:09:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.963+0000 7f395dad0640 1 -- 172.21.15.114:0/2769245956 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94367223170768] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3950040040 con 0x7f39540f7060 2024-05-08T18:09:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.963+0000 7f395f7bb980 20 remove_watcher() i=3 2024-05-08T18:09:07.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.963+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94367223180864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0d340 con 0x55d394d00be0 2024-05-08T18:09:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.967+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94367223180864] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x55d394d00be0 2024-05-08T18:09:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.967+0000 7f395f7bb980 20 remove_watcher() i=4 2024-05-08T18:09:07.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.967+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94367223184416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ee40 con 0x7f3950031040 2024-05-08T18:09:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.967+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94367223184416] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.967+0000 7f395f7bb980 20 remove_watcher() i=5 2024-05-08T18:09:07.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.967+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94367223178656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0d340 con 0x7f3950031040 2024-05-08T18:09:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94367223178656] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 20 remove_watcher() i=6 2024-05-08T18:09:07.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94367223186752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d394d0ee40 con 0x7f3950031040 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94367223186752] v30'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f395802e070 con 0x7f3950031040 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 20 remove_watcher() i=7 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3950031040 msgr2=0x7f3950032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3950031040 0x7f3950032940 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394d00be0 msgr2=0x55d394d03050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394d00be0 0x55d394d03050 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39540f7060 msgr2=0x7f39540eaa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39540f7060 0x7f39540eaa30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d394d06bf0 msgr2=0x55d394d08fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d394d06bf0 0x55d394d08fe0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38280383f0 msgr2=0x7f382803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38280383f0 0x7f382803a8b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55d394ccdc60 tx=0x7f395001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 msgr2=0x55d394cf5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cf5900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39540bcfd0 tx=0x7f39540ea400 comp rx=0 tx=0).stop 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395d2cf640 1 -- 172.21.15.114:0/2769245956 reap_dead start 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 shutdown_connections 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2769245956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394cee440 0x55d394cf5900 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 >> 172.21.15.114:0/2769245956 conn(0x55d394cea780 msgr2=0x55d394ce7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.971+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 shutdown_connections 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2769245956 wait complete. 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3834038440 msgr2=0x7f383403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3834038440 0x7f383403a900 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55d394cd1730 tx=0x7f3950005850 comp rx=0 tx=0).stop 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 msgr2=0x55d394ce1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 0x55d394ce1780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39540ac040 tx=0x7f39540180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 shutdown_connections 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3834038440 0x7f383403a900 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2415664469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394ce1360 0x55d394ce1780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 >> 172.21.15.114:0/2415664469 conn(0x55d394cd6170 msgr2=0x55d394cd6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 shutdown_connections 2024-05-08T18:09:07.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2415664469 wait complete. 2024-05-08T18:09:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394bdb5b0 msgr2=0x55d394cd0610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394bdb5b0 0x55d394cd0610 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38440383f0 msgr2=0x7f384403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38440383f0 0x7f384403a8b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f39540ae000 tx=0x7f39540a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 msgr2=0x55d394cc9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:07.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc9640 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f395800b710 tx=0x7f3958000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 shutdown_connections 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d394bdb5b0 0x55d394cd0610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38440383f0 0x7f384403a8b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 --2- 172.21.15.114:0/2102211742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d394bd70f0 0x55d394cc9640 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 >> 172.21.15.114:0/2102211742 conn(0x55d394b4a7d0 msgr2=0x55d394cbc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 shutdown_connections 2024-05-08T18:09:07.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:07.975+0000 7f395f7bb980 1 -- 172.21.15.114:0/2102211742 wait complete. 2024-05-08T18:09:07.985 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:07.986 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T18:09:07.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T18:09:07.986 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-08T18:09:08.065 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:08.065 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:08.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17ed22980 1 Processor -- start 2024-05-08T18:09:08.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17ed22980 1 -- start start 2024-05-08T18:09:08.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17ed22980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562c2c50fe70 0x562c2c510250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17ed22980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c2c3bb710 con 0x562c2c510790 2024-05-08T18:09:08.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17ed22980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562c2c3cff00 con 0x562c2c50fe70 2024-05-08T18:09:08.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17c836640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562c2c50fe70 0x562c2c510250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17c035640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562c2c510790 0x562c2c511100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51026/0 (socket says 172.21.15.114:51026) 2024-05-08T18:09:08.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17c836640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562c2c50fe70 0x562c2c510250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52714/0 (socket says 172.21.15.114:52714) 2024-05-08T18:09:08.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17c035640 1 -- 172.21.15.114:0/3809891559 learned_addr learned my addr 172.21.15.114:0/3809891559 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:08.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17c836640 1 -- 172.21.15.114:0/3809891559 >> v1:172.21.15.53:6789/0 conn(0x562c2c510790 legacy=0x562c2c511100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.067+0000 7fb17c836640 1 -- 172.21.15.114:0/3809891559 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2c397ae0 con 0x562c2c50fe70 2024-05-08T18:09:08.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17c836640 1 --2- 172.21.15.114:0/3809891559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c510250 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00a480 tx=0x7fb16c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3622d9487b43a349 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17b834640 1 -- 172.21.15.114:0/3809891559 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16c0b0070 con 0x562c2c50fe70 2024-05-08T18:09:08.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17b834640 1 -- 172.21.15.114:0/3809891559 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c0ab540 con 0x562c2c50fe70 2024-05-08T18:09:08.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17b834640 1 -- 172.21.15.114:0/3809891559 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16c0ab840 con 0x562c2c50fe70 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 -- 172.21.15.114:0/3809891559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 msgr2=0x562c2c510250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3809891559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c510250 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00a480 tx=0x7fb16c01b280 comp rx=0 tx=0).stop 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 -- 172.21.15.114:0/3809891559 shutdown_connections 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3809891559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c510250 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 -- 172.21.15.114:0/3809891559 >> 172.21.15.114:0/3809891559 conn(0x562c2c50b740 msgr2=0x562c2c50db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 -- 172.21.15.114:0/3809891559 shutdown_connections 2024-05-08T18:09:08.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.071+0000 7fb17ed22980 1 -- 172.21.15.114:0/3809891559 wait complete. 2024-05-08T18:09:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17ed22980 1 Processor -- start 2024-05-08T18:09:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17ed22980 1 -- start start 2024-05-08T18:09:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17ed22980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c5fb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17ed22980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c2c413f80 con 0x562c2c50fe70 2024-05-08T18:09:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17c836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c5fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17c836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c5fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52722/0 (socket says 172.21.15.114:52722) 2024-05-08T18:09:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17c836640 1 -- 172.21.15.114:0/3505235797 learned_addr learned my addr 172.21.15.114:0/3505235797 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17c836640 1 -- 172.21.15.114:0/3505235797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2c3dbda0 con 0x562c2c50fe70 2024-05-08T18:09:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb17c836640 1 --2- 172.21.15.114:0/3505235797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c5fb700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ae040 tx=0x7fb16c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d5de19607bb585 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb06ae0d640 1 -- 172.21.15.114:0/3505235797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16c0b0040 con 0x562c2c50fe70 2024-05-08T18:09:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb06ae0d640 1 -- 172.21.15.114:0/3505235797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c0ab9d0 con 0x562c2c50fe70 2024-05-08T18:09:08.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.087+0000 7fb06ae0d640 1 -- 172.21.15.114:0/3505235797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16c0abcf0 con 0x562c2c50fe70 2024-05-08T18:09:08.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3505235797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 msgr2=0x562c2c5fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3505235797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c5fb700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb16c0ae040 tx=0x7fb16c003030 comp rx=0 tx=0).stop 2024-05-08T18:09:08.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3505235797 shutdown_connections 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3505235797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c5fb700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3505235797 >> 172.21.15.114:0/3505235797 conn(0x562c2c50b740 msgr2=0x562c2c5f7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3505235797 shutdown_connections 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3505235797 wait complete. 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 Processor -- start 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- start start 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c602ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c2c519e70 con 0x562c2c50fe70 2024-05-08T18:09:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17c836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c602ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17c836640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c602ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52730/0 (socket says 172.21.15.114:52730) 2024-05-08T18:09:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17c836640 1 -- 172.21.15.114:0/3162195085 learned_addr learned my addr 172.21.15.114:0/3162195085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17c836640 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2c602ff0 con 0x562c2c50fe70 2024-05-08T18:09:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17c836640 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c602ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb16c018eb0 tx=0x7fb16c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb06960a640 1 -- 172.21.15.114:0/3162195085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16c0b0070 con 0x562c2c50fe70 2024-05-08T18:09:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb06960a640 1 -- 172.21.15.114:0/3162195085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c0b68f0 con 0x562c2c50fe70 2024-05-08T18:09:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb06960a640 1 -- 172.21.15.114:0/3162195085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb16c0b6bd0 con 0x562c2c50fe70 2024-05-08T18:09:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c2c603280 con 0x562c2c50fe70 2024-05-08T18:09:08.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.091+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2c605f10 con 0x562c2c50fe70 2024-05-08T18:09:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb06960a640 1 -- 172.21.15.114:0/3162195085 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb16c0b7420 con 0x562c2c50fe70 2024-05-08T18:09:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb06960a640 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0640383f0 0x7fb06403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb06960a640 1 -- 172.21.15.114:0/3162195085 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb16c0bc070 con 0x562c2c50fe70 2024-05-08T18:09:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17c035640 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0640383f0 0x7fb06403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c510790 0x562c2c6099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c60a040 con 0x562c2c510790 2024-05-08T18:09:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c510790 0x562c2c6099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17c035640 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0640383f0 0x7fb06403a8b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb170001650 tx=0x7fb170006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c510790 0x562c2c6099f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 -- 172.21.15.114:0/3162195085 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1740083f0 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c60a8e0 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 -- 172.21.15.114:0/3162195085 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1740083f0 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c60bc90 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 -- 172.21.15.114:0/3162195085 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1740083f0 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c60b130 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 -- 172.21.15.114:0/3162195085 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1740083f0 con 0x562c2c510790 2024-05-08T18:09:08.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c60b550 con 0x562c2c510790 2024-05-08T18:09:08.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17d037640 1 -- 172.21.15.114:0/3162195085 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1740083f0 con 0x562c2c510790 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 Processor -- start 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- start start 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 0x562c2c61abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17ed22980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c2c417fc0 con 0x562c2c61a7c0 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17c035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 0x562c2c61abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17c035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 0x562c2c61abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52738/0 (socket says 172.21.15.114:52738) 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.095+0000 7fb17c035640 1 -- 172.21.15.114:0/3149286870 learned_addr learned my addr 172.21.15.114:0/3149286870 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17c035640 1 -- 172.21.15.114:0/3149286870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2c61b120 con 0x562c2c61a7c0 2024-05-08T18:09:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17c035640 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 0x562c2c61abe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb170006960 tx=0x7fb170015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb0627fc640 1 -- 172.21.15.114:0/3149286870 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170015240 con 0x562c2c61a7c0 2024-05-08T18:09:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb0627fc640 1 -- 172.21.15.114:0/3149286870 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170011440 con 0x562c2c61a7c0 2024-05-08T18:09:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb0627fc640 1 -- 172.21.15.114:0/3149286870 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170011720 con 0x562c2c61a7c0 2024-05-08T18:09:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c2c61bbc0 con 0x562c2c61a7c0 2024-05-08T18:09:08.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2c61c090 con 0x562c2c61a7c0 2024-05-08T18:09:08.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb0627fc640 1 -- 172.21.15.114:0/3149286870 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb1700118c0 con 0x562c2c61a7c0 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb0627fc640 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb054038440 0x7fb05403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb0627fc640 1 -- 172.21.15.114:0/3149286870 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb17001b030 con 0x562c2c61a7c0 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17d037640 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb054038440 0x7fb05403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17ed22980 1 Processor -- start 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.099+0000 7fb17ed22980 1 -- start start 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c627d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c2c5fbd90 con 0x562c2c6279a0 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17d037640 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb054038440 0x7fb05403a900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562c2c60b4d0 tx=0x7fb174003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c627d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c627d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52752/0 (socket says 172.21.15.114:52752) 2024-05-08T18:09:08.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 -- 172.21.15.114:0/3772823601 learned_addr learned my addr 172.21.15.114:0/3772823601 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 -- 172.21.15.114:0/3772823601 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2c628350 con 0x562c2c6279a0 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 --2- 172.21.15.114:0/3772823601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c627d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb17004e5e0 tx=0x7fb170050110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5edbfa4ffce409f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb053fff640 1 -- 172.21.15.114:0/3772823601 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170043070 con 0x562c2c6279a0 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb053fff640 1 -- 172.21.15.114:0/3772823601 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170011d90 con 0x562c2c6279a0 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb053fff640 1 -- 172.21.15.114:0/3772823601 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170013560 con 0x562c2c6279a0 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- 172.21.15.114:0/3772823601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 msgr2=0x562c2c627d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3772823601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c627d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb17004e5e0 tx=0x7fb170050110 comp rx=0 tx=0).stop 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- 172.21.15.114:0/3772823601 shutdown_connections 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3772823601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c627d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- 172.21.15.114:0/3772823601 >> 172.21.15.114:0/3772823601 conn(0x562c2c623ce0 msgr2=0x562c2c621d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- 172.21.15.114:0/3772823601 shutdown_connections 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- 172.21.15.114:0/3772823601 wait complete. 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 Processor -- start 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- start start 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c62eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17ed22980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562c2c628b10 con 0x562c2c6279a0 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c62eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c62eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52760/0 (socket says 172.21.15.114:52760) 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 learned_addr learned my addr 172.21.15.114:0/611067881 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.103+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c2c62f420 con 0x562c2c6279a0 2024-05-08T18:09:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c035640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c62eee0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb170004fd0 tx=0x7fb17004e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb0527fc640 1 -- 172.21.15.114:0/611067881 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170036070 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c2c62f6b0 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb0527fc640 1 -- 172.21.15.114:0/611067881 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17004e9c0 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb0527fc640 1 -- 172.21.15.114:0/611067881 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb170043030 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c2c632390 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb0527fc640 1 -- 172.21.15.114:0/611067881 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb170039070 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb0527fc640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0480383f0 0x7fb04803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb0527fc640 1 -- 172.21.15.114:0/611067881 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb170044070 con 0x562c2c6279a0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17d037640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0480383f0 0x7fb04803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c63a370 0x562c2c63c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63cf80 con 0x562c2c63a370 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c836640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c63a370 0x562c2c63c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17d037640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0480383f0 0x7fb04803a8b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb174008fd0 tx=0x7fb17401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c836640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c63a370 0x562c2c63c830 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 realm 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63d390 con 0x562c2c63a370 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63dc60 con 0x562c2c63a370 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63e000 con 0x562c2c63a370 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.107+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63e850 con 0x562c2c63a370 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17ed22980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17ed22980 20 searching for the correct realm 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562c2c6405c0 0x562c2c6429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c035640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562c2c6405c0 0x562c2c6429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c035640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562c2c6405c0 0x562c2c6429b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c035640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb170053020 0x7fb1700207c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb170053020 2024-05-08T18:09:08.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17d037640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb170053020 0x7fb1700207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17d037640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb170053020 0x7fb1700207c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17d037640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb174019040 0x7fb174019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb174019040 0x7fb174019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb174019040 0x7fb174019930 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.111+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb170053020 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb170053020 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.115+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb170053020 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb16c0e1d70 con 0x562c2c63a370 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.119+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0e1d70 con 0x7fb174019040 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb170053020 2024-05-08T18:09:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c6405c0 2024-05-08T18:09:08.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb174019040 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x562c2c63a370 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x562c2c642ef0 con 0x7fb170053020 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63f130 con 0x562c2c63a370 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.123+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63f9d0 con 0x562c2c63a370 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c63f9d0 con 0x562c2c63a370 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 zone default found 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 4 Realm: () 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:08.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 zonegroup default 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c643320 con 0x7fb174019040 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c644d30 con 0x562c2c6405c0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c645200 con 0x562c2c6405c0 2024-05-08T18:09:08.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 started sync module instance, tier type = 2024-05-08T18:09:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:08.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c6441a0 con 0x7fb170053020 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94747723318672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c643e00 con 0x7fb170053020 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.127+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c646040 con 0x562c2c63a370 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.131+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94747723318672] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.131+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.131+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94747723322976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c646000 con 0x562c2c63a370 2024-05-08T18:09:08.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.131+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c646a50 con 0x562c2c6405c0 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.131+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94747723322976] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.131+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94747723326880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c646e40 con 0x562c2c6405c0 2024-05-08T18:09:08.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c647710 con 0x7fb170053020 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94747723330016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c647fb0 con 0x7fb170053020 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c6489f0 con 0x562c2c63a370 2024-05-08T18:09:08.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94747723326880] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94747723330016] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94747723334848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c647b00 con 0x562c2c63a370 2024-05-08T18:09:08.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.135+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c649290 con 0x7fb174019040 2024-05-08T18:09:08.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.139+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94747723334848] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.139+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.139+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94747723324032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c647b00 con 0x7fb174019040 2024-05-08T18:09:08.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.139+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c649760 con 0x7fb174019040 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94747723338288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c649bd0 con 0x7fb174019040 2024-05-08T18:09:08.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c64a6a0 con 0x7fb174019040 2024-05-08T18:09:08.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94747723324032] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94747723338288] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94747723342224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c649720 con 0x7fb174019040 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=0 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=1 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=2 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=3 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=4 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=5 2024-05-08T18:09:08.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.143+0000 7fb17ed22980 20 add_watcher() i=6 2024-05-08T18:09:08.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94747723342224] v30'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 20 add_watcher() i=7 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c64d7a0 con 0x562c2c63a370 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94747723336640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c64ac20 con 0x562c2c63a370 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94747723336640] v30'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb0337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 5 note: GC not initialized 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb0327e4640 20 reqs_thread_entry: start 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.147+0000 7fb17ed22980 20 Filter name: none 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb02b7fe640 20 reqs_thread_entry: start 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c671000 con 0x562c2c63a370 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:08.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c671a70 con 0x7fb174019040 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:09:08.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c6773f0 con 0x562c2c63a370 2024-05-08T18:09:08.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v30'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94747723525728 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c672ae0 con 0x562c2c63a370 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94747723334848 notify 128849018883 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7fb16c0d7040 con 0x562c2c63a370 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb053fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94747723334848 notifier 4338 bl.length()=678 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb053fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb053fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(65 notify.4 [notify cookie 94747723525728 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb053fff640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb040003eb0 con 0x562c2c63a370 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94747723525728 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c2c605f10 con 0x562c2c63a370 2024-05-08T18:09:08.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.151+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c676e60 con 0x7fb174019040 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17ed22980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17ed22980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17ed22980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:09:08.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94747723525728 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562c2c672630 con 0x562c2c6405c0 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== watch-notify(notify (1) cookie 94747723326880 notify 128849018880 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562c2c62f6b0 con 0x562c2c6405c0 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb053fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94747723326880 notifier 4338 bl.length()=177 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb053fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb053fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(68 notify.2 [notify cookie 94747723525728 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb053fff640 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb040003eb0 con 0x562c2c6405c0 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.155+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== watch-notify(notify_complete (2) cookie 94747723525728 notify 128849018880 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562c2c62f420 con 0x562c2c6405c0 2024-05-08T18:09:08.157 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:09:08.154796Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb0337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94747723336640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c672f10 con 0x562c2c63a370 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94747723336640] v30'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94747723318672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c66eca0 con 0x7fb170053020 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94747723318672] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17ed22980 20 remove_watcher() i=0 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17ed22980 2 removed watcher, disabling cache 2024-05-08T18:09:08.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.159+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94747723322976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c66eca0 con 0x562c2c63a370 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.163+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94747723322976] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.163+0000 7fb17ed22980 20 remove_watcher() i=1 2024-05-08T18:09:08.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.163+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94747723326880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c66eca0 con 0x562c2c6405c0 2024-05-08T18:09:08.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.163+0000 7fb17c035640 1 -- 172.21.15.114:0/611067881 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94747723326880] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb170038030 con 0x562c2c6405c0 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.163+0000 7fb17ed22980 20 remove_watcher() i=2 2024-05-08T18:09:08.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.163+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94747723330016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c645660 con 0x7fb170053020 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.167+0000 7fb17d037640 1 -- 172.21.15.114:0/611067881 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94747723330016] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb17402f040 con 0x7fb170053020 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.167+0000 7fb17ed22980 20 remove_watcher() i=3 2024-05-08T18:09:08.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.167+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94747723334848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c645660 con 0x562c2c63a370 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.167+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94747723334848] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x562c2c63a370 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.167+0000 7fb17ed22980 20 remove_watcher() i=4 2024-05-08T18:09:08.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.167+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94747723324032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c6484c0 con 0x7fb174019040 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.171+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94747723324032] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.171+0000 7fb17ed22980 20 remove_watcher() i=5 2024-05-08T18:09:08.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.171+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94747723338288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c6484c0 con 0x7fb174019040 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.171+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94747723338288] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.171+0000 7fb17ed22980 20 remove_watcher() i=6 2024-05-08T18:09:08.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.171+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94747723342224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x562c2c6484c0 con 0x7fb174019040 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94747723342224] v30'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb16c0ef040 con 0x7fb174019040 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 20 remove_watcher() i=7 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb174019040 msgr2=0x7fb174019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb174019040 0x7fb174019930 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c63a370 msgr2=0x562c2c63c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c63a370 0x562c2c63c830 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb170053020 msgr2=0x7fb1700207c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb170053020 0x7fb1700207c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562c2c6405c0 msgr2=0x562c2c6429b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562c2c6405c0 0x562c2c6429b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0480383f0 msgr2=0x7fb04803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0480383f0 0x7fb04803a8b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb174008fd0 tx=0x7fb17401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 msgr2=0x562c2c62eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17c836640 1 -- 172.21.15.114:0/611067881 reap_dead start 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c62eee0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb170004fd0 tx=0x7fb17004e540 comp rx=0 tx=0).stop 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 shutdown_connections 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/611067881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c6279a0 0x562c2c62eee0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 >> 172.21.15.114:0/611067881 conn(0x562c2c623ce0 msgr2=0x562c2c621340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 shutdown_connections 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/611067881 wait complete. 2024-05-08T18:09:08.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb054038440 msgr2=0x7fb05403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb054038440 0x7fb05403a900 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562c2c60b4d0 tx=0x7fb174003070 comp rx=0 tx=0).stop 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 msgr2=0x562c2c61abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 0x562c2c61abe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb170006960 tx=0x7fb170015820 comp rx=0 tx=0).stop 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 shutdown_connections 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb054038440 0x7fb05403a900 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3149286870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c61a7c0 0x562c2c61abe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 >> 172.21.15.114:0/3149286870 conn(0x562c2c60f5d0 msgr2=0x562c2c6100e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 shutdown_connections 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3149286870 wait complete. 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c510790 msgr2=0x562c2c6099f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c510790 0x562c2c6099f0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0640383f0 msgr2=0x7fb06403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0640383f0 0x7fb06403a8b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb170001650 tx=0x7fb170006720 comp rx=0 tx=0).stop 2024-05-08T18:09:08.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 msgr2=0x562c2c602ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c602ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb16c018eb0 tx=0x7fb16c018020 comp rx=0 tx=0).stop 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 shutdown_connections 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562c2c510790 0x562c2c6099f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb0640383f0 0x7fb06403a8b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 --2- 172.21.15.114:0/3162195085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c2c50fe70 0x562c2c602ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 >> 172.21.15.114:0/3162195085 conn(0x562c2c50b740 msgr2=0x562c2c5f5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 shutdown_connections 2024-05-08T18:09:08.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.175+0000 7fb17ed22980 1 -- 172.21.15.114:0/3162195085 wait complete. 2024-05-08T18:09:08.186 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:09:08.154796Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:08.187 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:08.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:08.187 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:08.266 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:08.266 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:08.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd868f980 1 Processor -- start 2024-05-08T18:09:08.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd868f980 1 -- start start 2024-05-08T18:09:08.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd868f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558170894320 0x558170896710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd868f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55817073c710 con 0x55817088fdc0 2024-05-08T18:09:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd868f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558170750f00 con 0x558170894320 2024-05-08T18:09:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd59a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558170894320 0x558170896710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd59a2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558170894320 0x558170896710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52768/0 (socket says 172.21.15.114:52768) 2024-05-08T18:09:08.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd59a2640 1 -- 172.21.15.114:0/1217022781 learned_addr learned my addr 172.21.15.114:0/1217022781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd59a2640 1 -- 172.21.15.114:0/1217022781 >> v1:172.21.15.53:6789/0 conn(0x55817088fdc0 legacy=0x5581708901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd51a1640 1 -- 172.21.15.114:0/1217022781 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553087100 0 0) 0x55817073c710 con 0x55817088fdc0 2024-05-08T18:09:08.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.267+0000 7fccd59a2640 1 -- 172.21.15.114:0/1217022781 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558170718ae0 con 0x558170894320 2024-05-08T18:09:08.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd59a2640 1 --2- 172.21.15.114:0/1217022781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558170894320 0x558170896710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00a5c0 tx=0x7fcccc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ec1057d89a188d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd51a1640 1 -- 172.21.15.114:0/1217022781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0a6070 con 0x558170894320 2024-05-08T18:09:08.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd51a1640 1 -- 172.21.15.114:0/1217022781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc0af070 con 0x558170894320 2024-05-08T18:09:08.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd51a1640 1 -- 172.21.15.114:0/1217022781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0aa5c0 con 0x558170894320 2024-05-08T18:09:08.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 -- 172.21.15.114:0/1217022781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558170894320 msgr2=0x558170896710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 --2- 172.21.15.114:0/1217022781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558170894320 0x558170896710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00a5c0 tx=0x7fcccc01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:08.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 -- 172.21.15.114:0/1217022781 shutdown_connections 2024-05-08T18:09:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 --2- 172.21.15.114:0/1217022781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558170894320 0x558170896710 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 -- 172.21.15.114:0/1217022781 >> 172.21.15.114:0/1217022781 conn(0x55817088b690 msgr2=0x55817088dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 -- 172.21.15.114:0/1217022781 shutdown_connections 2024-05-08T18:09:08.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.271+0000 7fccd868f980 1 -- 172.21.15.114:0/1217022781 wait complete. 2024-05-08T18:09:08.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd868f980 1 Processor -- start 2024-05-08T18:09:08.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd868f980 1 -- start start 2024-05-08T18:09:08.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd868f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x55817097bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd868f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558170794f80 con 0x55817088fdc0 2024-05-08T18:09:08.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd61a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x55817097bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd61a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x55817097bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52778/0 (socket says 172.21.15.114:52778) 2024-05-08T18:09:08.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd61a3640 1 -- 172.21.15.114:0/315984 learned_addr learned my addr 172.21.15.114:0/315984 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd61a3640 1 -- 172.21.15.114:0/315984 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817075cda0 con 0x55817088fdc0 2024-05-08T18:09:08.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.287+0000 7fccd61a3640 1 --2- 172.21.15.114:0/315984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x55817097bdb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fccc8006f80 tx=0x7fccc8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cf070a8874cec5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fcbc4608640 1 -- 172.21.15.114:0/315984 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc8017070 con 0x55817088fdc0 2024-05-08T18:09:08.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fcbc4608640 1 -- 172.21.15.114:0/315984 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc80025d0 con 0x55817088fdc0 2024-05-08T18:09:08.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fcbc4608640 1 -- 172.21.15.114:0/315984 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc8002910 con 0x55817088fdc0 2024-05-08T18:09:08.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/315984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 msgr2=0x55817097bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 --2- 172.21.15.114:0/315984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x55817097bdb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fccc8006f80 tx=0x7fccc8001b10 comp rx=0 tx=0).stop 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/315984 shutdown_connections 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 --2- 172.21.15.114:0/315984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x55817097bdb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/315984 >> 172.21.15.114:0/315984 conn(0x55817088b690 msgr2=0x558170805130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/315984 shutdown_connections 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/315984 wait complete. 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 Processor -- start 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- start start 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x558170977e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558170899740 con 0x55817088fdc0 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd61a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x558170977e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd61a3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x558170977e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52792/0 (socket says 172.21.15.114:52792) 2024-05-08T18:09:08.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd61a3640 1 -- 172.21.15.114:0/3609743566 learned_addr learned my addr 172.21.15.114:0/3609743566 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd61a3640 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558170976530 con 0x55817088fdc0 2024-05-08T18:09:08.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd61a3640 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x558170977e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccc8015040 tx=0x7fccc8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fcbc2e05640 1 -- 172.21.15.114:0/3609743566 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc8017040 con 0x55817088fdc0 2024-05-08T18:09:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fcbc2e05640 1 -- 172.21.15.114:0/3609743566 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc8023070 con 0x55817088fdc0 2024-05-08T18:09:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581709767c0 con 0x55817088fdc0 2024-05-08T18:09:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fcbc2e05640 1 -- 172.21.15.114:0/3609743566 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc80061a0 con 0x55817088fdc0 2024-05-08T18:09:08.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.291+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558170976cb0 con 0x55817088fdc0 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fcbc2e05640 1 -- 172.21.15.114:0/3609743566 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fccc8012790 con 0x55817088fdc0 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fcbc2e05640 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbbc038440 0x7fcbbc03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fcbc2e05640 1 -- 172.21.15.114:0/3609743566 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fccc804e310 con 0x55817088fdc0 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd59a2640 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbbc038440 0x7fcbbc03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558170894320 0x55817098c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55817098cb60 con 0x558170894320 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558170894320 0x55817098c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd59a2640 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbbc038440 0x7fcbbc03a900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ae000 tx=0x7fcccc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558170894320 0x55817098c620 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 -- 172.21.15.114:0/3609743566 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccd00083f0 con 0x558170894320 2024-05-08T18:09:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55817098cf60 con 0x558170894320 2024-05-08T18:09:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 -- 172.21.15.114:0/3609743566 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccd00083f0 con 0x558170894320 2024-05-08T18:09:08.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55817098e860 con 0x558170894320 2024-05-08T18:09:08.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 -- 172.21.15.114:0/3609743566 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fccd00083f0 con 0x558170894320 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55817098d9d0 con 0x558170894320 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 -- 172.21.15.114:0/3609743566 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccd00083f0 con 0x558170894320 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55817098ddf0 con 0x558170894320 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd69a4640 1 -- 172.21.15.114:0/3609743566 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fccd00083f0 con 0x558170894320 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.295+0000 7fccd868f980 1 Processor -- start 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 -- start start 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 0x55817099d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558170798fc0 con 0x55817099d1b0 2024-05-08T18:09:08.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd59a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 0x55817099d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd59a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 0x55817099d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52794/0 (socket says 172.21.15.114:52794) 2024-05-08T18:09:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd59a2640 1 -- 172.21.15.114:0/2494547773 learned_addr learned my addr 172.21.15.114:0/2494547773 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd59a2640 1 -- 172.21.15.114:0/2494547773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55817099db10 con 0x55817099d1b0 2024-05-08T18:09:08.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd59a2640 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 0x55817099d5d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ac040 tx=0x7fcccc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fcbbbfff640 1 -- 172.21.15.114:0/2494547773 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0b3b90 con 0x55817099d1b0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fcbbbfff640 1 -- 172.21.15.114:0/2494547773 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc0b3d30 con 0x55817099d1b0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55817099e5b0 con 0x55817099d1b0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fcbbbfff640 1 -- 172.21.15.114:0/2494547773 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0c8560 con 0x55817099d1b0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55817099ea20 con 0x55817099d1b0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fcbbbfff640 1 -- 172.21.15.114:0/2494547773 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcccc0d1440 con 0x55817099d1b0 2024-05-08T18:09:08.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fcbbbfff640 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbb00383f0 0x7fcbb003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fcbbbfff640 1 -- 172.21.15.114:0/2494547773 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcccc0ec090 con 0x55817099d1b0 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbb00383f0 0x7fcbb003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 Processor -- start 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd868f980 1 -- start start 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.299+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbb00383f0 0x7fcbb003a8b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55817098dd70 tx=0x7fccd0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709aa670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55817097c500 con 0x5581709aa270 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709aa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709aa670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52802/0 (socket says 172.21.15.114:52802) 2024-05-08T18:09:08.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 -- 172.21.15.114:0/938255085 learned_addr learned my addr 172.21.15.114:0/938255085 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 -- 172.21.15.114:0/938255085 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581709aac40 con 0x5581709aa270 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 --2- 172.21.15.114:0/938255085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709aa670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ea3e0 tx=0x7fcccc0bcd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ff504a41e72381 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fcbb9ffb640 1 -- 172.21.15.114:0/938255085 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0e7030 con 0x5581709aa270 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fcbb9ffb640 1 -- 172.21.15.114:0/938255085 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc0d1940 con 0x5581709aa270 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fcbb9ffb640 1 -- 172.21.15.114:0/938255085 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0bd4c0 con 0x5581709aa270 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- 172.21.15.114:0/938255085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 msgr2=0x5581709aa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 --2- 172.21.15.114:0/938255085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709aa670 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ea3e0 tx=0x7fcccc0bcd90 comp rx=0 tx=0).stop 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- 172.21.15.114:0/938255085 shutdown_connections 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 --2- 172.21.15.114:0/938255085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709aa670 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- 172.21.15.114:0/938255085 >> 172.21.15.114:0/938255085 conn(0x5581709a65b0 msgr2=0x5581709a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- 172.21.15.114:0/938255085 shutdown_connections 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- 172.21.15.114:0/938255085 wait complete. 2024-05-08T18:09:08.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 Processor -- start 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- start start 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd868f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5581709ab380 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52814/0 (socket says 172.21.15.114:52814) 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 learned_addr learned my addr 172.21.15.114:0/2628689157 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581709b1cb0 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.303+0000 7fccd59a2640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709b1770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0bcfd0 tx=0x7fcccc0ea370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fcba7fff640 1 -- 172.21.15.114:0/2628689157 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0bd670 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fcba7fff640 1 -- 172.21.15.114:0/2628689157 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcccc0d1dd0 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5581709b1f40 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fcba7fff640 1 -- 172.21.15.114:0/2628689157 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcccc0c7c10 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581709b2350 con 0x5581709aa270 2024-05-08T18:09:08.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fcba7fff640 1 -- 172.21.15.114:0/2628689157 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcccc0f4060 con 0x5581709aa270 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fcba7fff640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcba0038440 0x7fcba003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fcba7fff640 1 -- 172.21.15.114:0/2628689157 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcccc0e1070 con 0x5581709aa270 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcba0038440 0x7fcba003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5581709bcc00 0x5581709bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709bf7f0 con 0x5581709bcc00 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd61a3640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5581709bcc00 0x5581709bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcba0038440 0x7fcba003a900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55817098d4f0 tx=0x7fccd001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd61a3640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5581709bcc00 0x5581709bf0a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 realm 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709bfc00 con 0x5581709bcc00 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c04d0 con 0x5581709bcc00 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c0870 con 0x5581709bcc00 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.307+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c0d10 con 0x5581709bcc00 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd868f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd868f980 20 searching for the correct realm 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5581709c2c80 0x5581709c5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd59a2640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5581709c2c80 0x5581709c5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd59a2640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5581709c2c80 0x5581709c5070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd59a2640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcccc0f6070 0x7fcccc0bf970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fcccc0f6070 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcccc0f6070 0x7fcccc0bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcccc0f6070 0x7fcccc0bf970 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd69a4640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fccd0019040 0x7fccd0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fccd0019040 0x7fccd0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fccd0019040 0x7fccd0019930 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x7fccd0019040 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.311+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x7fccd0019040 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x7fccd0019040 2024-05-08T18:09:08.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fcccc0f6070 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x7fccd0019040 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fcccc0f6070 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.315+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x7fccd0019040 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fccc800f070 con 0x5581709bcc00 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fcccc0f6070 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.319+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fcccc0f6070 2024-05-08T18:09:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709c2c80 2024-05-08T18:09:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fccd0019040 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x5581709bcc00 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5581709c56f0 con 0x7fcccc0f6070 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:08.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c16f0 con 0x5581709bcc00 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c1f90 con 0x5581709bcc00 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.323+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c1330 con 0x5581709bcc00 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 zone default found 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 4 Realm: () 2024-05-08T18:09:08.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 zonegroup default 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c1f90 con 0x7fccd0019040 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c7530 con 0x5581709c2c80 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709c78d0 con 0x5581709c2c80 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 started sync module instance, tier type = 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c69d0 con 0x7fcccc0f6070 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94014428442048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c8120 con 0x7fcccc0f6070 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c8970 con 0x5581709bcc00 2024-05-08T18:09:08.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.327+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94014428442048] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.331+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.331+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94014428445808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c85a0 con 0x5581709bcc00 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.331+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c9090 con 0x5581709c2c80 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.331+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.331+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94014428449632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c9930 con 0x5581709c2c80 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.331+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709ca330 con 0x7fcccc0f6070 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94014428445808] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94014428446864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709ca720 con 0x7fcccc0f6070 2024-05-08T18:09:08.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cb0e0 con 0x5581709bcc00 2024-05-08T18:09:08.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94014428449632] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94014428446864] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94014428454464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cac30 con 0x5581709bcc00 2024-05-08T18:09:08.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.335+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cb980 con 0x7fccd0019040 2024-05-08T18:09:08.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94014428454464] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94014428451968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cb670 con 0x7fccd0019040 2024-05-08T18:09:08.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cbec0 con 0x7fccd0019040 2024-05-08T18:09:08.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94014428460928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cc210 con 0x7fccd0019040 2024-05-08T18:09:08.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.339+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709ccd30 con 0x7fccd0019040 2024-05-08T18:09:08.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94014428451968] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94014428460928] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94014428465152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cbc60 con 0x7fccd0019040 2024-05-08T18:09:08.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=0 2024-05-08T18:09:08.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=1 2024-05-08T18:09:08.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=2 2024-05-08T18:09:08.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=3 2024-05-08T18:09:08.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=4 2024-05-08T18:09:08.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=5 2024-05-08T18:09:08.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.343+0000 7fccd868f980 20 add_watcher() i=6 2024-05-08T18:09:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94014428465152] v30'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 add_watcher() i=7 2024-05-08T18:09:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709cfd20 con 0x5581709bcc00 2024-05-08T18:09:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94014428459456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709cd1a0 con 0x5581709bcc00 2024-05-08T18:09:08.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94014428459456] v30'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fcb8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 5 note: GC not initialized 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fcb077fe640 20 reqs_thread_entry: start 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 Filter name: none 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fcb057fa640 20 reqs_thread_entry: start 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5581709f3220 con 0x5581709bcc00 2024-05-08T18:09:08.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.347+0000 7fccd868f980 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T18:09:08.350 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:09:08.154796Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:08.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fcb8cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94014428459456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709f1c70 con 0x5581709bcc00 2024-05-08T18:09:08.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94014428459456] v30'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94014428442048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709f0fb0 con 0x7fcccc0f6070 2024-05-08T18:09:08.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94014428442048] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd868f980 20 remove_watcher() i=0 2024-05-08T18:09:08.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd868f980 2 removed watcher, disabling cache 2024-05-08T18:09:08.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.351+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94014428445808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709f0fb0 con 0x5581709bcc00 2024-05-08T18:09:08.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.355+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94014428445808] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.355+0000 7fccd868f980 20 remove_watcher() i=1 2024-05-08T18:09:08.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.355+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94014428449632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709f0fb0 con 0x5581709c2c80 2024-05-08T18:09:08.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.355+0000 7fccd59a2640 1 -- 172.21.15.114:0/2628689157 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94014428449632] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcccc0ce020 con 0x5581709c2c80 2024-05-08T18:09:08.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.355+0000 7fccd868f980 20 remove_watcher() i=2 2024-05-08T18:09:08.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.355+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94014428446864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c6dc0 con 0x7fcccc0f6070 2024-05-08T18:09:08.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.359+0000 7fccd69a4640 1 -- 172.21.15.114:0/2628689157 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94014428446864] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccd002f040 con 0x7fcccc0f6070 2024-05-08T18:09:08.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.359+0000 7fccd868f980 20 remove_watcher() i=3 2024-05-08T18:09:08.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.359+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94014428454464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c8b60 con 0x5581709bcc00 2024-05-08T18:09:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.359+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94014428454464] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x5581709bcc00 2024-05-08T18:09:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.359+0000 7fccd868f980 20 remove_watcher() i=4 2024-05-08T18:09:08.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.359+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94014428451968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c6dc0 con 0x7fccd0019040 2024-05-08T18:09:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.363+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94014428451968] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.363+0000 7fccd868f980 20 remove_watcher() i=5 2024-05-08T18:09:08.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.363+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94014428460928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c9e40 con 0x7fccd0019040 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.363+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94014428460928] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.363+0000 7fccd868f980 20 remove_watcher() i=6 2024-05-08T18:09:08.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.363+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94014428465152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5581709c8b60 con 0x7fccd0019040 2024-05-08T18:09:08.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94014428465152] v30'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc8043040 con 0x7fccd0019040 2024-05-08T18:09:08.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 20 remove_watcher() i=7 2024-05-08T18:09:08.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fccd0019040 msgr2=0x7fccd0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fccd0019040 0x7fccd0019930 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5581709bcc00 msgr2=0x5581709bf0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5581709bcc00 0x5581709bf0a0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcccc0f6070 msgr2=0x7fcccc0bf970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcccc0f6070 0x7fcccc0bf970 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5581709c2c80 msgr2=0x5581709c5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5581709c2c80 0x5581709c5070 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcba0038440 msgr2=0x7fcba003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcba0038440 0x7fcba003a900 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x55817098d4f0 tx=0x7fccd001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 msgr2=0x5581709b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709b1770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0bcfd0 tx=0x7fcccc0ea370 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd61a3640 1 -- 172.21.15.114:0/2628689157 reap_dead start 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 shutdown_connections 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2628689157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5581709aa270 0x5581709b1770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 >> 172.21.15.114:0/2628689157 conn(0x5581709a65b0 msgr2=0x5581709a3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 shutdown_connections 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2628689157 wait complete. 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbb00383f0 msgr2=0x7fcbb003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbb00383f0 0x7fcbb003a8b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x55817098dd70 tx=0x7fccd0003070 comp rx=0 tx=0).stop 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 msgr2=0x55817099d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 0x55817099d5d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ac040 tx=0x7fcccc0180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 shutdown_connections 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbb00383f0 0x7fcbb003a8b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/2494547773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817099d1b0 0x55817099d5d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 >> 172.21.15.114:0/2494547773 conn(0x558170991fc0 msgr2=0x558170992ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 shutdown_connections 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/2494547773 wait complete. 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558170894320 msgr2=0x55817098c620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558170894320 0x55817098c620 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbbc038440 msgr2=0x7fcbbc03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbbc038440 0x7fcbbc03a900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ae000 tx=0x7fcccc0a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 msgr2=0x558170977e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x558170977e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fccc8015040 tx=0x7fccc8001260 comp rx=0 tx=0).stop 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 shutdown_connections 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558170894320 0x55817098c620 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcbbc038440 0x7fcbbc03a900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 --2- 172.21.15.114:0/3609743566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55817088fdc0 0x558170977e10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 >> 172.21.15.114:0/3609743566 conn(0x55817088b690 msgr2=0x558170975360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 shutdown_connections 2024-05-08T18:09:08.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.367+0000 7fccd868f980 1 -- 172.21.15.114:0/3609743566 wait complete. 2024-05-08T18:09:08.379 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:09:08.154796Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:08.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T18:09:08.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T18:09:08.380 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-08T18:09:08.460 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:08.460 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:08.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.459+0000 7f657f4e8980 1 Processor -- start 2024-05-08T18:09:08.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.459+0000 7f657f4e8980 1 -- start start 2024-05-08T18:09:08.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657f4e8980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cb2e56ff60 0x55cb2e600f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657f4e8980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cb2e4a7710 con 0x55cb2e6014b0 2024-05-08T18:09:08.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657f4e8980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55cb2e4bbf00 con 0x55cb2e56ff60 2024-05-08T18:09:08.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657cffc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cb2e56ff60 0x55cb2e600f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657cffc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55cb2e56ff60 0x55cb2e600f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52830/0 (socket says 172.21.15.114:52830) 2024-05-08T18:09:08.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657c7fb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55cb2e6014b0 0x55cb2e6038a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51050/0 (socket says 172.21.15.114:51050) 2024-05-08T18:09:08.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657cffc640 1 -- 172.21.15.114:0/2462299339 learned_addr learned my addr 172.21.15.114:0/2462299339 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657cffc640 1 -- 172.21.15.114:0/2462299339 >> v1:172.21.15.53:6789/0 conn(0x55cb2e6014b0 legacy=0x55cb2e6038a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657cffc640 1 -- 172.21.15.114:0/2462299339 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2e483ae0 con 0x55cb2e56ff60 2024-05-08T18:09:08.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657cffc640 1 --2- 172.21.15.114:0/2462299339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e600f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f657400a4e0 tx=0x7f657401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d3a39da7e892ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657bffa640 1 -- 172.21.15.114:0/2462299339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65740aa540 con 0x55cb2e56ff60 2024-05-08T18:09:08.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657bffa640 1 -- 172.21.15.114:0/2462299339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740aa6e0 con 0x55cb2e56ff60 2024-05-08T18:09:08.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.463+0000 7f657bffa640 1 -- 172.21.15.114:0/2462299339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65740aaa40 con 0x55cb2e56ff60 2024-05-08T18:09:08.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 -- 172.21.15.114:0/2462299339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 msgr2=0x55cb2e600f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2462299339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e600f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f657400a4e0 tx=0x7f657401b090 comp rx=0 tx=0).stop 2024-05-08T18:09:08.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 -- 172.21.15.114:0/2462299339 shutdown_connections 2024-05-08T18:09:08.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2462299339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e600f70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 -- 172.21.15.114:0/2462299339 >> 172.21.15.114:0/2462299339 conn(0x55cb2e5f6650 msgr2=0x55cb2e5f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 -- 172.21.15.114:0/2462299339 shutdown_connections 2024-05-08T18:09:08.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.467+0000 7f657f4e8980 1 -- 172.21.15.114:0/2462299339 wait complete. 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.479+0000 7f657f4e8980 1 Processor -- start 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- start start 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e6e9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb2e4fff80 con 0x55cb2e56ff60 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e6e9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e6e9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52846/0 (socket says 172.21.15.114:52846) 2024-05-08T18:09:08.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 -- 172.21.15.114:0/2879495901 learned_addr learned my addr 172.21.15.114:0/2879495901 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 -- 172.21.15.114:0/2879495901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2e4c7da0 con 0x55cb2e56ff60 2024-05-08T18:09:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 --2- 172.21.15.114:0/2879495901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e6e9190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6574017ca0 tx=0x7f65740033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2249b95623273b54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f646ae0d640 1 -- 172.21.15.114:0/2879495901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65740b9070 con 0x55cb2e56ff60 2024-05-08T18:09:08.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f646ae0d640 1 -- 172.21.15.114:0/2879495901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740aaa80 con 0x55cb2e56ff60 2024-05-08T18:09:08.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f646ae0d640 1 -- 172.21.15.114:0/2879495901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65740aad60 con 0x55cb2e56ff60 2024-05-08T18:09:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- 172.21.15.114:0/2879495901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 msgr2=0x55cb2e6e9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2879495901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e6e9190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6574017ca0 tx=0x7f65740033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- 172.21.15.114:0/2879495901 shutdown_connections 2024-05-08T18:09:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2879495901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e56ff60 0x55cb2e6e9190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- 172.21.15.114:0/2879495901 >> 172.21.15.114:0/2879495901 conn(0x55cb2e5f6650 msgr2=0x55cb2e6e4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- 172.21.15.114:0/2879495901 shutdown_connections 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- 172.21.15.114:0/2879495901 wait complete. 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 Processor -- start 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- start start 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 0x55cb2e6f07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657f4e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb2e607a20 con 0x55cb2e6014b0 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 0x55cb2e6f07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 0x55cb2e6f07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52860/0 (socket says 172.21.15.114:52860) 2024-05-08T18:09:08.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.483+0000 7f657cffc640 1 -- 172.21.15.114:0/25686515 learned_addr learned my addr 172.21.15.114:0/25686515 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657cffc640 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2e6f0ce0 con 0x55cb2e6014b0 2024-05-08T18:09:08.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657cffc640 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 0x55cb2e6f07a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6574017ca0 tx=0x7f6574017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f646960a640 1 -- 172.21.15.114:0/25686515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65740b9050 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f646960a640 1 -- 172.21.15.114:0/25686515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65740c7470 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f646960a640 1 -- 172.21.15.114:0/25686515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65740c77b0 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb2e6f0f70 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb2e6f3c00 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f646960a640 1 -- 172.21.15.114:0/25686515 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f65740b3040 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f646960a640 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f64640383f0 0x7f646403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f646960a640 1 -- 172.21.15.114:0/25686515 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f65740c3030 con 0x55cb2e6014b0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657c7fb640 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f64640383f0 0x7f646403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e6f5840 0x55cb2e6f7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e6f8170 con 0x55cb2e6f5840 2024-05-08T18:09:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657d7fd640 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e6f5840 0x55cb2e6f7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657c7fb640 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f64640383f0 0x7f646403a8b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6570001e40 tx=0x7f65700013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657d7fd640 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e6f5840 0x55cb2e6f7c30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657d7fd640 1 -- 172.21.15.114:0/25686515 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f656c0083f0 con 0x55cb2e6f5840 2024-05-08T18:09:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.487+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e6f8a80 con 0x55cb2e6f5840 2024-05-08T18:09:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657d7fd640 1 -- 172.21.15.114:0/25686515 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f656c0083f0 con 0x55cb2e6f5840 2024-05-08T18:09:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e6f9e30 con 0x55cb2e6f5840 2024-05-08T18:09:08.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657d7fd640 1 -- 172.21.15.114:0/25686515 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f656c0083f0 con 0x55cb2e6f5840 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e6f92d0 con 0x55cb2e6f5840 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657d7fd640 1 -- 172.21.15.114:0/25686515 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f656c0083f0 con 0x55cb2e6f5840 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e6f96f0 con 0x55cb2e6f5840 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657d7fd640 1 -- 172.21.15.114:0/25686515 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f656c0083f0 con 0x55cb2e6f5840 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 Processor -- start 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- start start 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 0x55cb2e708d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb2e503fc0 con 0x55cb2e708960 2024-05-08T18:09:08.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657c7fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 0x55cb2e708d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657c7fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 0x55cb2e708d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52864/0 (socket says 172.21.15.114:52864) 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657c7fb640 1 -- 172.21.15.114:0/3526586176 learned_addr learned my addr 172.21.15.114:0/3526586176 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657c7fb640 1 -- 172.21.15.114:0/3526586176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2e7092c0 con 0x55cb2e708960 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657c7fb640 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 0x55cb2e708d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f657000e670 tx=0x7f657000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f64627fc640 1 -- 172.21.15.114:0/3526586176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6570022070 con 0x55cb2e708960 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f64627fc640 1 -- 172.21.15.114:0/3526586176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657000d660 con 0x55cb2e708960 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb2e709d60 con 0x55cb2e708960 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f64627fc640 1 -- 172.21.15.114:0/3526586176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6570006070 con 0x55cb2e708960 2024-05-08T18:09:08.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.491+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb2e70a230 con 0x55cb2e708960 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f64627fc640 1 -- 172.21.15.114:0/3526586176 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f6570025070 con 0x55cb2e708960 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f64627fc640 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6454038490 0x7f645403a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f64627fc640 1 -- 172.21.15.114:0/3526586176 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f657004ff50 con 0x55cb2e708960 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657d7fd640 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6454038490 0x7f645403a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 Processor -- start 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- start start 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657d7fd640 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6454038490 0x7f645403a950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55cb2e6f9670 tx=0x7f656c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e715f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb2e6e9820 con 0x55cb2e715ae0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657c7fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e715f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657c7fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e715f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52876/0 (socket says 172.21.15.114:52876) 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657c7fb640 1 -- 172.21.15.114:0/3121091781 learned_addr learned my addr 172.21.15.114:0/3121091781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657c7fb640 1 -- 172.21.15.114:0/3121091781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2e7164d0 con 0x55cb2e715ae0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657c7fb640 1 --2- 172.21.15.114:0/3121091781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e715f00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6570026fd0 tx=0x7f657000da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f5ee8d742b0b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f6453fff640 1 -- 172.21.15.114:0/3121091781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6570024e50 con 0x55cb2e715ae0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f6453fff640 1 -- 172.21.15.114:0/3121091781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657001a320 con 0x55cb2e715ae0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f6453fff640 1 -- 172.21.15.114:0/3121091781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6570025c40 con 0x55cb2e715ae0 2024-05-08T18:09:08.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- 172.21.15.114:0/3121091781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 msgr2=0x55cb2e715f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 --2- 172.21.15.114:0/3121091781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e715f00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6570026fd0 tx=0x7f657000da00 comp rx=0 tx=0).stop 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- 172.21.15.114:0/3121091781 shutdown_connections 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 --2- 172.21.15.114:0/3121091781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e715f00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- 172.21.15.114:0/3121091781 >> 172.21.15.114:0/3121091781 conn(0x55cb2e711e70 msgr2=0x55cb2e70fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- 172.21.15.114:0/3121091781 shutdown_connections 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 -- 172.21.15.114:0/3121091781 wait complete. 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.495+0000 7f657f4e8980 1 Processor -- start 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 -- start start 2024-05-08T18:09:08.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e71d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55cb2e716c20 con 0x55cb2e715ae0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657c7fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e71d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657c7fb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e71d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52890/0 (socket says 172.21.15.114:52890) 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 learned_addr learned my addr 172.21.15.114:0/2586215802 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2e71d590 con 0x55cb2e715ae0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657c7fb640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e71d050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6570024a30 tx=0x7f657004a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f64527fc640 1 -- 172.21.15.114:0/2586215802 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6570024e50 con 0x55cb2e715ae0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cb2e71d590 con 0x55cb2e715ae0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f64527fc640 1 -- 172.21.15.114:0/2586215802 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657001b8c0 con 0x55cb2e715ae0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f64527fc640 1 -- 172.21.15.114:0/2586215802 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f657001bbc0 con 0x55cb2e715ae0 2024-05-08T18:09:08.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb2e71d590 con 0x55cb2e715ae0 2024-05-08T18:09:08.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f64527fc640 1 -- 172.21.15.114:0/2586215802 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f657003e850 con 0x55cb2e715ae0 2024-05-08T18:09:08.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f64527fc640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6448038590 0x7f644803aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f64527fc640 1 -- 172.21.15.114:0/2586215802 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f657003ba40 con 0x55cb2e715ae0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657d7fd640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6448038590 0x7f644803aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e728120 0x55cb2e72a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72ad30 con 0x55cb2e728120 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.499+0000 7f657cffc640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e728120 0x55cb2e72a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657d7fd640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6448038590 0x7f644803aa50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55cb2e6f8900 tx=0x7f656c01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e728120 0x55cb2e72a5e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 realm 2024-05-08T18:09:08.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72b140 con 0x55cb2e728120 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72b9e0 con 0x55cb2e728120 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72bd80 con 0x55cb2e728120 2024-05-08T18:09:08.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72c5d0 con 0x55cb2e728120 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 20 searching for the correct realm 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55cb2e72e340 0x55cb2e730730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x55cb2e72e340 2024-05-08T18:09:08.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657c7fb640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55cb2e72e340 0x55cb2e730730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657c7fb640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55cb2e72e340 0x55cb2e730730 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657c7fb640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6570056040 0x7f657001c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x7f6570056040 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657d7fd640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6570056040 0x7f657001c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657d7fd640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6570056040 0x7f657001c780 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657d7fd640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f656c019040 0x7f656c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x7f656c019040 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.503+0000 7f657cffc640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f656c019040 0x7f656c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f656c019040 0x7f656c019930 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x7f656c019040 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x55cb2e728120 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x55cb2e728120 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x7f656c019040 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x7f656c019040 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x7f656c019040 2024-05-08T18:09:08.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x7f656c019040 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x7f6570056040 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x55cb2e72e340 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x55cb2e728120 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.507+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x7f656c019040 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x7f656c019040 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e730c70 con 0x55cb2e728120 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f6570056040 2024-05-08T18:09:08.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f656c019040 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x7f656c019040 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e728120 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e728120 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f656c019040 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740cd060 con 0x7f656c019040 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.511+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f6570056040 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e728120 2024-05-08T18:09:08.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65740cd060 con 0x55cb2e728120 2024-05-08T18:09:08.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f656c019040 2024-05-08T18:09:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f656c019040 2024-05-08T18:09:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f6570056040 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e72e340 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f656c019040 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.515+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x55cb2e728120 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f65740df040 con 0x7f6570056040 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:08.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72ce20 con 0x55cb2e728120 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72d1c0 con 0x55cb2e728120 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72d1c0 con 0x55cb2e728120 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 zone default found 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 4 Realm: () 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 zonegroup default 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e72ca80 con 0x7f656c019040 2024-05-08T18:09:08.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e732a80 con 0x55cb2e72e340 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e732e20 con 0x55cb2e72e340 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 started sync module instance, tier type = 2024-05-08T18:09:08.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.519+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e731f20 con 0x7f6570056040 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94331146019600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e733670 con 0x7f6570056040 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e733ec0 con 0x55cb2e728120 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94331146019600] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94331146023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e733a90 con 0x55cb2e728120 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.523+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e734450 con 0x55cb2e72e340 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94331146026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e734cf0 con 0x55cb2e72e340 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e735730 con 0x7f6570056040 2024-05-08T18:09:08.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94331146023360] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94331146031616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e735b20 con 0x7f6570056040 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7364e0 con 0x55cb2e728120 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94331146026912] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.527+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94331146031616] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94331146024416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e736030 con 0x55cb2e728120 2024-05-08T18:09:08.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e736d80 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94331146024416] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94331146029120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e736a70 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.531+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7372c0 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94331146029120] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94331146036944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7370c0 con 0x7f656c019040 2024-05-08T18:09:08.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e737b80 con 0x7f656c019040 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94331146036944] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94331146040912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e737ff0 con 0x7f656c019040 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=0 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=1 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=2 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=3 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=4 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=5 2024-05-08T18:09:08.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.535+0000 7f657f4e8980 20 add_watcher() i=6 2024-05-08T18:09:08.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94331146040912] v30'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 20 add_watcher() i=7 2024-05-08T18:09:08.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:08.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e737ff0 con 0x55cb2e728120 2024-05-08T18:09:08.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94331146042176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e737f60 con 0x55cb2e728120 2024-05-08T18:09:08.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94331146042176] v30'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f6432fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.539+0000 7f657f4e8980 5 note: GC not initialized 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f6431fe3640 20 reqs_thread_entry: start 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 20 Filter name: none 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f63a37fe640 20 reqs_thread_entry: start 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:08.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e75eaa0 con 0x55cb2e728120 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:08.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7650b0 con 0x55cb2e728120 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94331146226464 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7607e0 con 0x55cb2e728120 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94331146024416 notify 128849018884 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f65740d9040 con 0x55cb2e728120 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f6453fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94331146024416 notifier 4352 bl.length()=567 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f6453fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f6453fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 94331146226464 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f6453fff640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6440003eb0 con 0x55cb2e728120 2024-05-08T18:09:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94331146226464 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb2e6f3c00 con 0x55cb2e728120 2024-05-08T18:09:08.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.543+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e764b20 con 0x7f656c019040 2024-05-08T18:09:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657f4e8980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:09:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94331146226464 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e760330 con 0x55cb2e72e340 2024-05-08T18:09:08.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== watch-notify(notify (1) cookie 94331146026912 notify 128849018881 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f6570046070 con 0x55cb2e72e340 2024-05-08T18:09:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f64537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94331146026912 notifier 4352 bl.length()=170 2024-05-08T18:09:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 notify.2 [notify cookie 94331146226464 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f64537fe640 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f63b00032d0 con 0x55cb2e72e340 2024-05-08T18:09:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== watch-notify(notify_complete (2) cookie 94331146226464 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cb2e7164d0 con 0x55cb2e72e340 2024-05-08T18:09:08.549 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f6432fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.547+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94331146042176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e75c780 con 0x55cb2e728120 2024-05-08T18:09:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94331146042176] v30'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94331146019600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e75c780 con 0x7f6570056040 2024-05-08T18:09:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94331146019600] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657f4e8980 20 remove_watcher() i=0 2024-05-08T18:09:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657f4e8980 2 removed watcher, disabling cache 2024-05-08T18:09:08.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94331146023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e75c780 con 0x55cb2e728120 2024-05-08T18:09:08.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94331146023360] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657f4e8980 20 remove_watcher() i=1 2024-05-08T18:09:08.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.551+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94331146026912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e75c780 con 0x55cb2e72e340 2024-05-08T18:09:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.555+0000 7f657c7fb640 1 -- 172.21.15.114:0/2586215802 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94331146026912] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6570053040 con 0x55cb2e72e340 2024-05-08T18:09:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.555+0000 7f657f4e8980 20 remove_watcher() i=2 2024-05-08T18:09:08.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.555+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94331146031616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e732310 con 0x7f6570056040 2024-05-08T18:09:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.555+0000 7f657d7fd640 1 -- 172.21.15.114:0/2586215802 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94331146031616] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f656c02f040 con 0x7f6570056040 2024-05-08T18:09:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.555+0000 7f657f4e8980 20 remove_watcher() i=3 2024-05-08T18:09:08.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.555+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94331146024416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7331c0 con 0x55cb2e728120 2024-05-08T18:09:08.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.559+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94331146024416] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x55cb2e728120 2024-05-08T18:09:08.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.559+0000 7f657f4e8980 20 remove_watcher() i=4 2024-05-08T18:09:08.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.559+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94331146029120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e735200 con 0x7f656c019040 2024-05-08T18:09:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.563+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94331146029120] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.563+0000 7f657f4e8980 20 remove_watcher() i=5 2024-05-08T18:09:08.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.563+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94331146036944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e732310 con 0x7f656c019040 2024-05-08T18:09:08.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.563+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94331146036944] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.563+0000 7f657f4e8980 20 remove_watcher() i=6 2024-05-08T18:09:08.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.563+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94331146040912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55cb2e7366d0 con 0x7f656c019040 2024-05-08T18:09:08.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94331146040912] v30'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65740ef040 con 0x7f656c019040 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 20 remove_watcher() i=7 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f656c019040 msgr2=0x7f656c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f656c019040 0x7f656c019930 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e728120 msgr2=0x55cb2e72a5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e728120 0x55cb2e72a5e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6570056040 msgr2=0x7f657001c780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6570056040 0x7f657001c780 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55cb2e72e340 msgr2=0x55cb2e730730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55cb2e72e340 0x55cb2e730730 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6448038590 msgr2=0x7f644803aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6448038590 0x7f644803aa50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55cb2e6f8900 tx=0x7f656c01b070 comp rx=0 tx=0).stop 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657cffc640 1 -- 172.21.15.114:0/2586215802 reap_dead start 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 msgr2=0x55cb2e71d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e71d050 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6570024a30 tx=0x7f657004a040 comp rx=0 tx=0).stop 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 shutdown_connections 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/2586215802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e715ae0 0x55cb2e71d050 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 >> 172.21.15.114:0/2586215802 conn(0x55cb2e711e70 msgr2=0x55cb2e717340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 shutdown_connections 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/2586215802 wait complete. 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6454038490 msgr2=0x7f645403a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6454038490 0x7f645403a950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55cb2e6f9670 tx=0x7f656c003070 comp rx=0 tx=0).stop 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 msgr2=0x55cb2e708d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 0x55cb2e708d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f657000e670 tx=0x7f657000ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 shutdown_connections 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6454038490 0x7f645403a950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/3526586176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e708960 0x55cb2e708d80 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 >> 172.21.15.114:0/3526586176 conn(0x55cb2e6fd770 msgr2=0x55cb2e6fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 shutdown_connections 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/3526586176 wait complete. 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e6f5840 msgr2=0x55cb2e6f7c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e6f5840 0x55cb2e6f7c30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f64640383f0 msgr2=0x7f646403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f64640383f0 0x7f646403a8b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6570001e40 tx=0x7f65700013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 msgr2=0x55cb2e6f07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 0x55cb2e6f07a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6574017ca0 tx=0x7f6574017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 shutdown_connections 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55cb2e6f5840 0x55cb2e6f7c30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f64640383f0 0x7f646403a8b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 --2- 172.21.15.114:0/25686515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2e6014b0 0x55cb2e6f07a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 >> 172.21.15.114:0/25686515 conn(0x55cb2e5f6650 msgr2=0x55cb2e6e3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 shutdown_connections 2024-05-08T18:09:08.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.567+0000 7f657f4e8980 1 -- 172.21.15.114:0/25686515 wait complete. 2024-05-08T18:09:08.578 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:08.578 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T18:09:08.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T18:09:08.579 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-08T18:09:08.658 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:08.659 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f255a6c2980 1 Processor -- start 2024-05-08T18:09:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f255a6c2980 1 -- start start 2024-05-08T18:09:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f255a6c2980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654c09a3830 0x5654c0a33f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f255a6c2980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5654c08da710 con 0x5654c0a344c0 2024-05-08T18:09:08.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f255a6c2980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5654c08eef00 con 0x5654c09a3830 2024-05-08T18:09:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f25581d6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654c09a3830 0x5654c0a33f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f25581d6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5654c09a3830 0x5654c0a33f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52902/0 (socket says 172.21.15.114:52902) 2024-05-08T18:09:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f25581d6640 1 -- 172.21.15.114:0/321983259 learned_addr learned my addr 172.21.15.114:0/321983259 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f25581d6640 1 -- 172.21.15.114:0/321983259 >> v1:172.21.15.53:6789/0 conn(0x5654c0a344c0 legacy=0x5654c0a368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.659+0000 7f25581d6640 1 -- 172.21.15.114:0/321983259 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c08b6ae0 con 0x5654c09a3830 2024-05-08T18:09:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f25581d6640 1 --2- 172.21.15.114:0/321983259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0a33f80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f254801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05a4eea9080878d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f25571d4640 1 -- 172.21.15.114:0/321983259 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25480a6070 con 0x5654c09a3830 2024-05-08T18:09:08.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f25571d4640 1 -- 172.21.15.114:0/321983259 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25480af070 con 0x5654c09a3830 2024-05-08T18:09:08.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f25571d4640 1 -- 172.21.15.114:0/321983259 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25480aa5c0 con 0x5654c09a3830 2024-05-08T18:09:08.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 -- 172.21.15.114:0/321983259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 msgr2=0x5654c0a33f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 --2- 172.21.15.114:0/321983259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0a33f80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f254801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:08.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 -- 172.21.15.114:0/321983259 shutdown_connections 2024-05-08T18:09:08.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 --2- 172.21.15.114:0/321983259 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0a33f80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 -- 172.21.15.114:0/321983259 >> 172.21.15.114:0/321983259 conn(0x5654c0a296a0 msgr2=0x5654c0a2bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 -- 172.21.15.114:0/321983259 shutdown_connections 2024-05-08T18:09:08.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.663+0000 7f255a6c2980 1 -- 172.21.15.114:0/321983259 wait complete. 2024-05-08T18:09:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.679+0000 7f255a6c2980 1 Processor -- start 2024-05-08T18:09:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.679+0000 7f255a6c2980 1 -- start start 2024-05-08T18:09:08.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.679+0000 7f255a6c2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b1c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.679+0000 7f255a6c2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654c0932f80 con 0x5654c09a3830 2024-05-08T18:09:08.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b1c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b1c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52916/0 (socket says 172.21.15.114:52916) 2024-05-08T18:09:08.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 -- 172.21.15.114:0/2552326971 learned_addr learned my addr 172.21.15.114:0/2552326971 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 -- 172.21.15.114:0/2552326971 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c08fada0 con 0x5654c09a3830 2024-05-08T18:09:08.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 --2- 172.21.15.114:0/2552326971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b1c1f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f2548003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7885d075505c2656 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f244660c640 1 -- 172.21.15.114:0/2552326971 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25480aa9b0 con 0x5654c09a3830 2024-05-08T18:09:08.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f244660c640 1 -- 172.21.15.114:0/2552326971 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25480aab50 con 0x5654c09a3830 2024-05-08T18:09:08.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f244660c640 1 -- 172.21.15.114:0/2552326971 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25480aae50 con 0x5654c09a3830 2024-05-08T18:09:08.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- 172.21.15.114:0/2552326971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 msgr2=0x5654c0b1c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 --2- 172.21.15.114:0/2552326971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b1c1f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f2548003030 comp rx=0 tx=0).stop 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- 172.21.15.114:0/2552326971 shutdown_connections 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 --2- 172.21.15.114:0/2552326971 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b1c1f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- 172.21.15.114:0/2552326971 >> 172.21.15.114:0/2552326971 conn(0x5654c0a296a0 msgr2=0x5654c0b17d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- 172.21.15.114:0/2552326971 shutdown_connections 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- 172.21.15.114:0/2552326971 wait complete. 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 Processor -- start 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- start start 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b23420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f255a6c2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654c0a3aa90 con 0x5654c09a3830 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b23420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b23420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52926/0 (socket says 172.21.15.114:52926) 2024-05-08T18:09:08.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 -- 172.21.15.114:0/1532175910 learned_addr learned my addr 172.21.15.114:0/1532175910 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c0b23960 con 0x5654c09a3830 2024-05-08T18:09:08.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.683+0000 7f25581d6640 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b23420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f25480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f2444e09640 1 -- 172.21.15.114:0/1532175910 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25480c6750 con 0x5654c09a3830 2024-05-08T18:09:08.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f2444e09640 1 -- 172.21.15.114:0/1532175910 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25480c68f0 con 0x5654c09a3830 2024-05-08T18:09:08.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654c0b23bf0 con 0x5654c09a3830 2024-05-08T18:09:08.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f2444e09640 1 -- 172.21.15.114:0/1532175910 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25480c6bd0 con 0x5654c09a3830 2024-05-08T18:09:08.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c0b26880 con 0x5654c09a3830 2024-05-08T18:09:08.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f2444e09640 1 -- 172.21.15.114:0/1532175910 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f25480ce020 con 0x5654c09a3830 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f2444e09640 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2440038440 0x7f244003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f2444e09640 1 -- 172.21.15.114:0/1532175910 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f25480cc020 con 0x5654c09a3830 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25579d5640 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2440038440 0x7f244003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0a344c0 0x5654c0b2a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b2a9a0 con 0x5654c0a344c0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25589d7640 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0a344c0 0x5654c0b2a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25579d5640 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2440038440 0x7f244003a900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2540001ec0 tx=0x7f2540001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25589d7640 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0a344c0 0x5654c0b2a360 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25589d7640 1 -- 172.21.15.114:0/1532175910 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f255000a4d0 con 0x5654c0a344c0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b2b260 con 0x5654c0a344c0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25589d7640 1 -- 172.21.15.114:0/1532175910 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f255000a4d0 con 0x5654c0a344c0 2024-05-08T18:09:08.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b2c610 con 0x5654c0a344c0 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.687+0000 7f25589d7640 1 -- 172.21.15.114:0/1532175910 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f255000a4d0 con 0x5654c0a344c0 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b2bab0 con 0x5654c0a344c0 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25589d7640 1 -- 172.21.15.114:0/1532175910 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f255000a4d0 con 0x5654c0a344c0 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b2bed0 con 0x5654c0a344c0 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25589d7640 1 -- 172.21.15.114:0/1532175910 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f255000a4d0 con 0x5654c0a344c0 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 Processor -- start 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 -- start start 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 0x5654c0b3b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654c0936fc0 con 0x5654c0b3b160 2024-05-08T18:09:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25579d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 0x5654c0b3b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25579d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 0x5654c0b3b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52938/0 (socket says 172.21.15.114:52938) 2024-05-08T18:09:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25579d5640 1 -- 172.21.15.114:0/3487100256 learned_addr learned my addr 172.21.15.114:0/3487100256 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25579d5640 1 -- 172.21.15.114:0/3487100256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c0b3bac0 con 0x5654c0b3b160 2024-05-08T18:09:08.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f25579d5640 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 0x5654c0b3b580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2540010fd0 tx=0x7f254000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f243dffb640 1 -- 172.21.15.114:0/3487100256 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f254000a040 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654c0b3c560 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f243dffb640 1 -- 172.21.15.114:0/3487100256 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2540017050 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f243dffb640 1 -- 172.21.15.114:0/3487100256 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f254000e6b0 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.691+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c0b3ca30 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f243dffb640 1 -- 172.21.15.114:0/3487100256 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f254000e8e0 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f243dffb640 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24300383f0 0x7f243003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f243dffb640 1 -- 172.21.15.114:0/3487100256 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2540050600 con 0x5654c0b3b160 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25589d7640 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24300383f0 0x7f243003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 Processor -- start 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- start start 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25589d7640 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24300383f0 0x7f243003a8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5654c0b2be50 tx=0x7f2550005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b48790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654c0b1c880 con 0x5654c0b48390 2024-05-08T18:09:08.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b48790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b48790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52948/0 (socket says 172.21.15.114:52948) 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 -- 172.21.15.114:0/273123452 learned_addr learned my addr 172.21.15.114:0/273123452 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 -- 172.21.15.114:0/273123452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c0b48d60 con 0x5654c0b48390 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 --2- 172.21.15.114:0/273123452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b48790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f254004ea40 tx=0x7f254001aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f60937f3d65a5aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f24377fe640 1 -- 172.21.15.114:0/273123452 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2540043070 con 0x5654c0b48390 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f24377fe640 1 -- 172.21.15.114:0/273123452 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254001a310 con 0x5654c0b48390 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f24377fe640 1 -- 172.21.15.114:0/273123452 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25400500d0 con 0x5654c0b48390 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- 172.21.15.114:0/273123452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 msgr2=0x5654c0b48790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 --2- 172.21.15.114:0/273123452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b48790 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f254004ea40 tx=0x7f254001aee0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- 172.21.15.114:0/273123452 shutdown_connections 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 --2- 172.21.15.114:0/273123452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b48790 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- 172.21.15.114:0/273123452 >> 172.21.15.114:0/273123452 conn(0x5654c0b446d0 msgr2=0x5654c0b42730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- 172.21.15.114:0/273123452 shutdown_connections 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- 172.21.15.114:0/273123452 wait complete. 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 Processor -- start 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- start start 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b4f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f255a6c2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5654c0b494a0 con 0x5654c0b48390 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b4f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b4f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52964/0 (socket says 172.21.15.114:52964) 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.695+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 learned_addr learned my addr 172.21.15.114:0/888731304 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c0b4fd70 con 0x5654c0b48390 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25579d5640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b4f830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f254004d8e0 tx=0x7f254004e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f2435ffb640 1 -- 172.21.15.114:0/888731304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2540034070 con 0x5654c0b48390 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5654c0b50000 con 0x5654c0b48390 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f2435ffb640 1 -- 172.21.15.114:0/888731304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254001a990 con 0x5654c0b48390 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f2435ffb640 1 -- 172.21.15.114:0/888731304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2540043040 con 0x5654c0b48390 2024-05-08T18:09:08.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c0b52ce0 con 0x5654c0b48390 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f2435ffb640 1 -- 172.21.15.114:0/888731304 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2540037070 con 0x5654c0b48390 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f2435ffb640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24280383f0 0x7f242803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f2435ffb640 1 -- 172.21.15.114:0/888731304 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2540030cc0 con 0x5654c0b48390 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25589d7640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24280383f0 0x7f242803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0b5ad20 0x5654c0b5d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5d930 con 0x5654c0b5ad20 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25581d6640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0b5ad20 0x5654c0b5d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25589d7640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24280383f0 0x7f242803a8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x5654c0b2b0e0 tx=0x7f255001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25581d6640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0b5ad20 0x5654c0b5d1e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 realm 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5dd40 con 0x5654c0b5ad20 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5e610 con 0x5654c0b5ad20 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.699+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5e9b0 con 0x5654c0b5ad20 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 20 searching for the correct realm 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5654c0b60c90 0x5654c0b63150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b63820 con 0x5654c0b60c90 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25579d5640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5654c0b60c90 0x5654c0b63150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25579d5640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5654c0b60c90 0x5654c0b63150 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25579d5640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2540039060 0x7f2540038810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b63820 con 0x7f2540039060 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25589d7640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2540039060 0x7f2540038810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25589d7640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2540039060 0x7f2540038810 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f255001f070 con 0x7f2540039060 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25589d7640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2550031040 0x7f2550032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b63820 con 0x7f2550031040 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2550031040 0x7f2550032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2550031040 0x7f2550032940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x7f2550031040 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.703+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x7f2550031040 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x7f2550031040 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2540039060 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f255001f070 con 0x7f2540039060 2024-05-08T18:09:08.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x7f2550031040 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2540039060 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f255001f070 con 0x7f2540039060 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.707+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x7f2550031040 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480d0c60 con 0x7f2550031040 2024-05-08T18:09:08.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2540039060 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f255001f070 con 0x7f2540039060 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25480d0c60 con 0x5654c0b5ad20 2024-05-08T18:09:08.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.711+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2540039060 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f255001f070 con 0x7f2540039060 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b60c90 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2550031040 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x5654c0b5ad20 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f200 con 0x7f2540039060 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f255001f070 con 0x7f2540039060 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:08.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f5a0 con 0x5654c0b5ad20 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f990 con 0x5654c0b5ad20 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.715+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5f990 con 0x5654c0b5ad20 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 zone default found 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 4 Realm: () 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 zonegroup default 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5ee60 con 0x7f2550031040 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b5ee60 con 0x5654c0b60c90 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b657e0 con 0x5654c0b60c90 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 started sync module instance, tier type = 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b64b20 con 0x7f2540039060 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94922010414864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b660f0 con 0x7f2540039060 2024-05-08T18:09:08.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b66940 con 0x5654c0b5ad20 2024-05-08T18:09:08.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.719+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94922010414864] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94922010418240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b66510 con 0x5654c0b5ad20 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b67030 con 0x5654c0b60c90 2024-05-08T18:09:08.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94922010418240] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94922010419296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b66480 con 0x5654c0b60c90 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.723+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b67d80 con 0x7f2540039060 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94922010425824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b684d0 con 0x7f2540039060 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b68ff0 con 0x5654c0b5ad20 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94922010419296] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94922010425824] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94922010430144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b68fb0 con 0x5654c0b5ad20 2024-05-08T18:09:08.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.727+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b69890 con 0x7f2550031040 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94922010430144] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94922010424352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b69460 con 0x7f2550031040 2024-05-08T18:09:08.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b69d30 con 0x7f2550031040 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94922010432608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b6a3e0 con 0x7f2550031040 2024-05-08T18:09:08.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b6ac90 con 0x7f2550031040 2024-05-08T18:09:08.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.731+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94922010424352] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94922010431408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b6ae70 con 0x7f2550031040 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=0 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=1 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=2 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=3 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=4 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=5 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94922010432608] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=6 2024-05-08T18:09:08.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94922010431408] v30'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 20 add_watcher() i=7 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b6dd90 con 0x5654c0b5ad20 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.735+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94922010435456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b6b210 con 0x5654c0b5ad20 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94922010435456] v30'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f240e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 5 note: GC not initialized 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f240d7e2640 20 reqs_thread_entry: start 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 Filter name: none 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f237effd640 20 reqs_thread_entry: start 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b91590 con 0x5654c0b5ad20 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b92000 con 0x5654c0b5ad20 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:09:08.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-08T18:09:08.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b979e0 con 0x5654c0b5ad20 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v30'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94922010621008 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b93010 con 0x5654c0b5ad20 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify (1) cookie 94922010430144 notify 128849018885 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5654c0b26880 con 0x5654c0b5ad20 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f24377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94922010430144 notifier 4359 bl.length()=732 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f24377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f24377fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f24377fe640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f241c003eb0 con 0x5654c0b5ad20 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify cookie 94922010621008 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.739+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== watch-notify(notify_complete (2) cookie 94922010621008 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5654c0b23bf0 con 0x5654c0b5ad20 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b97450 con 0x5654c0b5ad20 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94922010621008 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b92b60 con 0x7f2540039060 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== watch-notify(notify (1) cookie 94922010414864 notify 128849018882 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f25500247b0 con 0x7f2540039060 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f2436ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94922010414864 notifier 4359 bl.length()=166 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(68 notify.0 [notify cookie 94922010621008 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f2436ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f2436ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f2436ffd640 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f238c003410 con 0x7f2540039060 2024-05-08T18:09:08.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== watch-notify(notify_complete (2) cookie 94922010621008 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2550024980 con 0x7f2540039060 2024-05-08T18:09:08.746 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"jx77yT87gHcxq6K0XhdlPLfaEkM8hMBrlBB9RMCo","active":true,"create_date":"2024-05-08T18:09:08.743349Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f240e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94922010435456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b8f2c0 con 0x5654c0b5ad20 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94922010435456] v30'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.743+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94922010414864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b8f2c0 con 0x7f2540039060 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94922010414864] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f255a6c2980 20 remove_watcher() i=0 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f255a6c2980 2 removed watcher, disabling cache 2024-05-08T18:09:08.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94922010418240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b8f2c0 con 0x5654c0b5ad20 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94922010418240] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f255a6c2980 20 remove_watcher() i=1 2024-05-08T18:09:08.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.747+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94922010419296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b8f2c0 con 0x5654c0b60c90 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f25579d5640 1 -- 172.21.15.114:0/888731304 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94922010419296] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2540036030 con 0x5654c0b60c90 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f255a6c2980 20 remove_watcher() i=2 2024-05-08T18:09:08.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94922010425824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b64f10 con 0x7f2540039060 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f25589d7640 1 -- 172.21.15.114:0/888731304 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94922010425824] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2550040040 con 0x7f2540039060 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f255a6c2980 20 remove_watcher() i=3 2024-05-08T18:09:08.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94922010430144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b64f10 con 0x5654c0b5ad20 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94922010430144] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x5654c0b5ad20 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f255a6c2980 20 remove_watcher() i=4 2024-05-08T18:09:08.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.751+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94922010424352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b68ac0 con 0x7f2550031040 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.755+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94922010424352] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.755+0000 7f255a6c2980 20 remove_watcher() i=5 2024-05-08T18:09:08.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.755+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94922010432608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b64f10 con 0x7f2550031040 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94922010432608] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 20 remove_watcher() i=6 2024-05-08T18:09:08.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94922010431408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5654c0b69460 con 0x7f2550031040 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94922010431408] v30'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25480fa040 con 0x7f2550031040 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 20 remove_watcher() i=7 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2550031040 msgr2=0x7f2550032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2550031040 0x7f2550032940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0b5ad20 msgr2=0x5654c0b5d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0b5ad20 0x5654c0b5d1e0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2540039060 msgr2=0x7f2540038810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2540039060 0x7f2540038810 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5654c0b60c90 msgr2=0x5654c0b63150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5654c0b60c90 0x5654c0b63150 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24280383f0 msgr2=0x7f242803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24280383f0 0x7f242803a8b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x5654c0b2b0e0 tx=0x7f255001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f25581d6640 1 -- 172.21.15.114:0/888731304 reap_dead start 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 msgr2=0x5654c0b4f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b4f830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f254004d8e0 tx=0x7f254004e9a0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 shutdown_connections 2024-05-08T18:09:08.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/888731304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b48390 0x5654c0b4f830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 >> 172.21.15.114:0/888731304 conn(0x5654c0b446d0 msgr2=0x5654c0b41d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 shutdown_connections 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/888731304 wait complete. 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24300383f0 msgr2=0x7f243003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24300383f0 0x7f243003a8b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5654c0b2be50 tx=0x7f2550005850 comp rx=0 tx=0).stop 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 msgr2=0x5654c0b3b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 0x5654c0b3b580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2540010fd0 tx=0x7f254000f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 shutdown_connections 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f24300383f0 0x7f243003a8b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/3487100256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c0b3b160 0x5654c0b3b580 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 >> 172.21.15.114:0/3487100256 conn(0x5654c0b2ff70 msgr2=0x5654c0b30a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 shutdown_connections 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/3487100256 wait complete. 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0a344c0 msgr2=0x5654c0b2a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0a344c0 0x5654c0b2a360 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2440038440 msgr2=0x7f244003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2440038440 0x7f244003a900 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2540001ec0 tx=0x7f2540001440 comp rx=0 tx=0).stop 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 msgr2=0x5654c0b23420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b23420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f25480180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 shutdown_connections 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5654c0a344c0 0x5654c0b2a360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2440038440 0x7f244003a900 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 --2- 172.21.15.114:0/1532175910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654c09a3830 0x5654c0b23420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 >> 172.21.15.114:0/1532175910 conn(0x5654c0a296a0 msgr2=0x5654c0b16890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 shutdown_connections 2024-05-08T18:09:08.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.759+0000 7f255a6c2980 1 -- 172.21.15.114:0/1532175910 wait complete. 2024-05-08T18:09:08.770 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'jx77yT87gHcxq6K0XhdlPLfaEkM8hMBrlBB9RMCo', 'active': True, 'create_date': '2024-05-08T18:09:08.743349Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:08.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T18:09:08.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T18:09:08.771 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-08T18:09:08.850 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:08.850 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:08.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f424127b980 1 Processor -- start 2024-05-08T18:09:08.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f424127b980 1 -- start start 2024-05-08T18:09:08.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f424127b980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eda6fde3e0 0x55eda6fde7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f424127b980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eda6e8a710 con 0x55eda6fded00 2024-05-08T18:09:08.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f424127b980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55eda6e9ef00 con 0x55eda6fde3e0 2024-05-08T18:09:08.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f423ed8f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eda6fde3e0 0x55eda6fde7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f423e58e640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55eda6fded00 0x55eda6fdf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51060/0 (socket says 172.21.15.114:51060) 2024-05-08T18:09:08.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f423e58e640 1 -- 172.21.15.114:0/2386223773 learned_addr learned my addr 172.21.15.114:0/2386223773 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:08.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f423ed8f640 1 -- 172.21.15.114:0/2386223773 >> v1:172.21.15.53:6789/0 conn(0x55eda6fded00 legacy=0x55eda6fdf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.851+0000 7f423ed8f640 1 -- 172.21.15.114:0/2386223773 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda6e66ae0 con 0x55eda6fde3e0 2024-05-08T18:09:08.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f423ed8f640 1 --2- 172.21.15.114:0/2386223773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda6fde7c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f423000a480 tx=0x7f423001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2c646230342f0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f423dd8d640 1 -- 172.21.15.114:0/2386223773 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42300b0070 con 0x55eda6fde3e0 2024-05-08T18:09:08.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f423dd8d640 1 -- 172.21.15.114:0/2386223773 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300ab540 con 0x55eda6fde3e0 2024-05-08T18:09:08.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f423dd8d640 1 -- 172.21.15.114:0/2386223773 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42300ab840 con 0x55eda6fde3e0 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 -- 172.21.15.114:0/2386223773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 msgr2=0x55eda6fde7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 --2- 172.21.15.114:0/2386223773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda6fde7c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f423000a480 tx=0x7f423001b280 comp rx=0 tx=0).stop 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 -- 172.21.15.114:0/2386223773 shutdown_connections 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 --2- 172.21.15.114:0/2386223773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda6fde7c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 -- 172.21.15.114:0/2386223773 >> 172.21.15.114:0/2386223773 conn(0x55eda6fd8d60 msgr2=0x55eda6fdb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 -- 172.21.15.114:0/2386223773 shutdown_connections 2024-05-08T18:09:08.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.855+0000 7f424127b980 1 -- 172.21.15.114:0/2386223773 wait complete. 2024-05-08T18:09:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 Processor -- start 2024-05-08T18:09:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- start start 2024-05-08T18:09:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eda6ee2f80 con 0x55eda6fde3e0 2024-05-08T18:09:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f423ed8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f423ed8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52974/0 (socket says 172.21.15.114:52974) 2024-05-08T18:09:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f423ed8f640 1 -- 172.21.15.114:0/1106929651 learned_addr learned my addr 172.21.15.114:0/1106929651 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f423ed8f640 1 -- 172.21.15.114:0/1106929651 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda6eaada0 con 0x55eda6fde3e0 2024-05-08T18:09:08.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f423ed8f640 1 --2- 172.21.15.114:0/1106929651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70c84f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f42300ae040 tx=0x7f4230003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1d33081d8f8d67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f412ce09640 1 -- 172.21.15.114:0/1106929651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42300b0040 con 0x55eda6fde3e0 2024-05-08T18:09:08.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f412ce09640 1 -- 172.21.15.114:0/1106929651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300ab9b0 con 0x55eda6fde3e0 2024-05-08T18:09:08.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f412ce09640 1 -- 172.21.15.114:0/1106929651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42300abc90 con 0x55eda6fde3e0 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- 172.21.15.114:0/1106929651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 msgr2=0x55eda70c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 --2- 172.21.15.114:0/1106929651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70c84f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f42300ae040 tx=0x7f4230003030 comp rx=0 tx=0).stop 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- 172.21.15.114:0/1106929651 shutdown_connections 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 --2- 172.21.15.114:0/1106929651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70c84f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- 172.21.15.114:0/1106929651 >> 172.21.15.114:0/1106929651 conn(0x55eda6fd8d60 msgr2=0x55eda70c4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- 172.21.15.114:0/1106929651 shutdown_connections 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- 172.21.15.114:0/1106929651 wait complete. 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 Processor -- start 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- start start 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f424127b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eda6fdd360 con 0x55eda6fde3e0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.871+0000 7f423ed8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423ed8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52980/0 (socket says 172.21.15.114:52980) 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423ed8f640 1 -- 172.21.15.114:0/2843858306 learned_addr learned my addr 172.21.15.114:0/2843858306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423ed8f640 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda70cfe10 con 0x55eda6fde3e0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423ed8f640 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70cf8d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f423001bb20 tx=0x7f4230018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f412b606640 1 -- 172.21.15.114:0/2843858306 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42300c5070 con 0x55eda6fde3e0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eda70d00a0 con 0x55eda6fde3e0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda70d04d0 con 0x55eda6fde3e0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f412b606640 1 -- 172.21.15.114:0/2843858306 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300b6970 con 0x55eda6fde3e0 2024-05-08T18:09:08.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f412b606640 1 -- 172.21.15.114:0/2843858306 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42300b0050 con 0x55eda6fde3e0 2024-05-08T18:09:08.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f412b606640 1 -- 172.21.15.114:0/2843858306 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f42300c8070 con 0x55eda6fde3e0 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f412b606640 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41240383f0 0x7f412403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f412b606640 1 -- 172.21.15.114:0/2843858306 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f42300bc070 con 0x55eda6fde3e0 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423e58e640 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41240383f0 0x7f412403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda6fded00 0x55eda70dacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda70db320 con 0x55eda6fded00 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423f590640 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda6fded00 0x55eda70dacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423e58e640 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41240383f0 0x7f412403a8b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4234004180 tx=0x7f4234001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423f590640 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda6fded00 0x55eda70dacb0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f423f590640 1 -- 172.21.15.114:0/2843858306 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423800a4d0 con 0x55eda6fded00 2024-05-08T18:09:08.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.875+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda70d8220 con 0x55eda6fded00 2024-05-08T18:09:08.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423f590640 1 -- 172.21.15.114:0/2843858306 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f423800a4d0 con 0x55eda6fded00 2024-05-08T18:09:08.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda70dd190 con 0x55eda6fded00 2024-05-08T18:09:08.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423f590640 1 -- 172.21.15.114:0/2843858306 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f423800a4d0 con 0x55eda6fded00 2024-05-08T18:09:08.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda70dc300 con 0x55eda6fded00 2024-05-08T18:09:08.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423f590640 1 -- 172.21.15.114:0/2843858306 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f423800a4d0 con 0x55eda6fded00 2024-05-08T18:09:08.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda70dc720 con 0x55eda6fded00 2024-05-08T18:09:08.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423f590640 1 -- 172.21.15.114:0/2843858306 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f423800a4d0 con 0x55eda6fded00 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 Processor -- start 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- start start 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 0x55eda70ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eda6ee6fc0 con 0x55eda70ebae0 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423e58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 0x55eda70ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423e58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 0x55eda70ebf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52994/0 (socket says 172.21.15.114:52994) 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423e58e640 1 -- 172.21.15.114:0/177528099 learned_addr learned my addr 172.21.15.114:0/177528099 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423e58e640 1 -- 172.21.15.114:0/177528099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda70ec440 con 0x55eda70ebae0 2024-05-08T18:09:08.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f423e58e640 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 0x55eda70ebf00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f423400d660 tx=0x7f423400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f4128e01640 1 -- 172.21.15.114:0/177528099 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423400c6b0 con 0x55eda70ebae0 2024-05-08T18:09:08.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f4128e01640 1 -- 172.21.15.114:0/177528099 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423400c850 con 0x55eda70ebae0 2024-05-08T18:09:08.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eda70ecee0 con 0x55eda70ebae0 2024-05-08T18:09:08.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f4128e01640 1 -- 172.21.15.114:0/177528099 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423400cb30 con 0x55eda70ebae0 2024-05-08T18:09:08.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.879+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda70ed3b0 con 0x55eda70ebae0 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f4128e01640 1 -- 172.21.15.114:0/177528099 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f4234023020 con 0x55eda70ebae0 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f4128e01640 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41180383f0 0x7f411803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f4128e01640 1 -- 172.21.15.114:0/177528099 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f4234021020 con 0x55eda70ebae0 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423f590640 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41180383f0 0x7f411803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 Processor -- start 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- start start 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423f590640 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41180383f0 0x7f411803a8b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55eda70dc6a0 tx=0x7f4238005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda70f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eda70c8b80 con 0x55eda70f8d20 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda70f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda70f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53010/0 (socket says 172.21.15.114:53010) 2024-05-08T18:09:08.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 -- 172.21.15.114:0/3528570889 learned_addr learned my addr 172.21.15.114:0/3528570889 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 -- 172.21.15.114:0/3528570889 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda70f9710 con 0x55eda70f8d20 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 --2- 172.21.15.114:0/3528570889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda70f9140 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f423404f2f0 tx=0x7f42340193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d2729dc77d6ed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f41227fc640 1 -- 172.21.15.114:0/3528570889 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423401bcc0 con 0x55eda70f8d20 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f41227fc640 1 -- 172.21.15.114:0/3528570889 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423403e0d0 con 0x55eda70f8d20 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f41227fc640 1 -- 172.21.15.114:0/3528570889 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423401be60 con 0x55eda70f8d20 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- 172.21.15.114:0/3528570889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 msgr2=0x55eda70f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 --2- 172.21.15.114:0/3528570889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda70f9140 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f423404f2f0 tx=0x7f42340193e0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- 172.21.15.114:0/3528570889 shutdown_connections 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 --2- 172.21.15.114:0/3528570889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda70f9140 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- 172.21.15.114:0/3528570889 >> 172.21.15.114:0/3528570889 conn(0x55eda70f50b0 msgr2=0x55eda70f3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- 172.21.15.114:0/3528570889 shutdown_connections 2024-05-08T18:09:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- 172.21.15.114:0/3528570889 wait complete. 2024-05-08T18:09:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 Processor -- start 2024-05-08T18:09:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- start start 2024-05-08T18:09:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda7100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f424127b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eda70f9e20 con 0x55eda70f8d20 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda7100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda7100280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53020/0 (socket says 172.21.15.114:53020) 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.883+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 learned_addr learned my addr 172.21.15.114:0/2441216457 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eda71007c0 con 0x55eda70f8d20 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423e58e640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda7100280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f42340238a0 tx=0x7f423404f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f4120ff9640 1 -- 172.21.15.114:0/2441216457 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4234032020 con 0x55eda70f8d20 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eda7100a50 con 0x55eda70f8d20 2024-05-08T18:09:08.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f4120ff9640 1 -- 172.21.15.114:0/2441216457 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423404f4c0 con 0x55eda70f8d20 2024-05-08T18:09:08.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f4120ff9640 1 -- 172.21.15.114:0/2441216457 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423401b550 con 0x55eda70f8d20 2024-05-08T18:09:08.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eda7100a50 con 0x55eda70f8d20 2024-05-08T18:09:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f4120ff9640 1 -- 172.21.15.114:0/2441216457 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f4234035020 con 0x55eda70f8d20 2024-05-08T18:09:08.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f4120ff9640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41080383a0 0x7f410803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f4120ff9640 1 -- 172.21.15.114:0/2441216457 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f4234005030 con 0x55eda70f8d20 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423f590640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41080383a0 0x7f410803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda710b5f0 0x55eda710dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda710e200 con 0x55eda710b5f0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423ed8f640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda710b5f0 0x55eda710dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423f590640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41080383a0 0x7f410803a860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55eda70dbe20 tx=0x7f423801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423ed8f640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda710b5f0 0x55eda710dab0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 realm 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda710e610 con 0x55eda710b5f0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda710eee0 con 0x55eda710b5f0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.887+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda710f280 con 0x55eda710b5f0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda710fad0 con 0x55eda710b5f0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 20 searching for the correct realm 2024-05-08T18:09:08.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eda7111840 0x55eda7113c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423e58e640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eda7111840 0x55eda7113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423e58e640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eda7111840 0x55eda7113c30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423e58e640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4234037020 0x7f423404f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4234037020 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423f590640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4234037020 0x7f423404f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423f590640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4234037020 0x7f423404f870 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423801f070 con 0x7f4234037020 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423f590640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4238031040 0x7f4238032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4238031040 0x7f4238032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4238031040 0x7f4238032430 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x7f4238031040 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.891+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x7f4238031040 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x7f4238031040 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4234037020 2024-05-08T18:09:08.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423801f070 con 0x7f4234037020 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x7f4238031040 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4234037020 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f423801f070 con 0x7f4234037020 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.895+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x7f4238031040 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f42300c7030 con 0x55eda710b5f0 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4234037020 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423801f070 con 0x7f4234037020 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.899+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4234045070 con 0x55eda7111840 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4234037020 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423801f070 con 0x7f4234037020 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda7111840 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423406a040 con 0x55eda7111840 2024-05-08T18:09:08.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4238031040 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x55eda710b5f0 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eda7114170 con 0x7f4234037020 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423801f070 con 0x7f4234037020 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:08.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda71103e0 con 0x55eda710b5f0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda7110c80 con 0x55eda710b5f0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda7110c80 con 0x55eda710b5f0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:08.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 zone default found 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 4 Realm: () 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 zonegroup default 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.903+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda71145a0 con 0x7f4238031040 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda7115f80 con 0x55eda7111840 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f423406a040 con 0x55eda7111840 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda71164a0 con 0x55eda7111840 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f423406a040 con 0x55eda7111840 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 started sync module instance, tier type = 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7115420 con 0x7f4234037020 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4238040040 con 0x7f4234037020 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94479198541840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7116db0 con 0x7f4234037020 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7117600 con 0x55eda710b5f0 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.907+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94479198541840] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4238040040 con 0x7f4234037020 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94479198546176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda71171d0 con 0x55eda710b5f0 2024-05-08T18:09:08.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7117cb0 con 0x55eda7111840 2024-05-08T18:09:08.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94479198546176] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423406a040 con 0x55eda7111840 2024-05-08T18:09:08.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94479198547232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7117140 con 0x55eda7111840 2024-05-08T18:09:08.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.911+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7118a70 con 0x7f4234037020 2024-05-08T18:09:08.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4238040040 con 0x7f4234037020 2024-05-08T18:09:08.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94479198553472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7119340 con 0x7f4234037020 2024-05-08T18:09:08.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7119d40 con 0x55eda710b5f0 2024-05-08T18:09:08.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94479198547232] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423406a040 con 0x55eda7111840 2024-05-08T18:09:08.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94479198553472] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4238040040 con 0x7f4234037020 2024-05-08T18:09:08.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94479198552272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7118e90 con 0x55eda710b5f0 2024-05-08T18:09:08.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.915+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda711a5e0 con 0x7f4238031040 2024-05-08T18:09:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94479198552272] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94479198558288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7118e90 con 0x7f4238031040 2024-05-08T18:09:08.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda711aa40 con 0x7f4238031040 2024-05-08T18:09:08.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94479198558288] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94479198560032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda711aa40 con 0x7f4238031040 2024-05-08T18:09:08.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.919+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda711b400 con 0x7f4238031040 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94479198560032] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94479198562160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda711b400 con 0x7f4238031040 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=0 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=1 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=2 2024-05-08T18:09:08.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=3 2024-05-08T18:09:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=4 2024-05-08T18:09:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=5 2024-05-08T18:09:08.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=6 2024-05-08T18:09:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94479198562160] v30'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 20 add_watcher() i=7 2024-05-08T18:09:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda711e860 con 0x55eda710b5f0 2024-05-08T18:09:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.923+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94479198564640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda711bd20 con 0x55eda710b5f0 2024-05-08T18:09:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94479198564640] v30'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f40f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:08.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 5 note: GC not initialized 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f406ffff640 20 reqs_thread_entry: start 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 20 Filter name: none 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f406dffb640 20 reqs_thread_entry: start 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:08.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda7142270 con 0x55eda710b5f0 2024-05-08T18:09:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:09:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:08.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.927+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda71489f0 con 0x55eda710b5f0 2024-05-08T18:09:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:08.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94479198749824 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eda7144140 con 0x55eda710b5f0 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94479198552272 notify 128849018886 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55eda70d04d0 con 0x55eda710b5f0 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f41227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94479198552272 notifier 4366 bl.length()=732 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f41227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f41227fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 94479198749824 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f41227fc640 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4104003eb0 con 0x55eda710b5f0 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94479198749824 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eda70d00a0 con 0x55eda710b5f0 2024-05-08T18:09:08.931 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f40f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94479198564640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7144570 con 0x55eda710b5f0 2024-05-08T18:09:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94479198564640] v30'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94479198541840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda713ff60 con 0x7f4234037020 2024-05-08T18:09:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94479198541840] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4238040040 con 0x7f4234037020 2024-05-08T18:09:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 20 remove_watcher() i=0 2024-05-08T18:09:08.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 2 removed watcher, disabling cache 2024-05-08T18:09:08.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.931+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94479198546176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda713ff60 con 0x55eda710b5f0 2024-05-08T18:09:08.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.935+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94479198546176] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.935+0000 7f424127b980 20 remove_watcher() i=1 2024-05-08T18:09:08.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.935+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94479198547232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda713ff60 con 0x55eda7111840 2024-05-08T18:09:08.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f423e58e640 1 -- 172.21.15.114:0/2441216457 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94479198547232] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423406a040 con 0x55eda7111840 2024-05-08T18:09:08.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f424127b980 20 remove_watcher() i=2 2024-05-08T18:09:08.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94479198553472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7115810 con 0x7f4234037020 2024-05-08T18:09:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f423f590640 1 -- 172.21.15.114:0/2441216457 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94479198553472] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4238040040 con 0x7f4234037020 2024-05-08T18:09:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f424127b980 20 remove_watcher() i=3 2024-05-08T18:09:08.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94479198552272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7115810 con 0x55eda710b5f0 2024-05-08T18:09:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94479198552272] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x55eda710b5f0 2024-05-08T18:09:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f424127b980 20 remove_watcher() i=4 2024-05-08T18:09:08.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.939+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94479198558288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda71180d0 con 0x7f4238031040 2024-05-08T18:09:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.943+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94479198558288] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.943+0000 7f424127b980 20 remove_watcher() i=5 2024-05-08T18:09:08.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.943+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94479198560032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda71180d0 con 0x7f4238031040 2024-05-08T18:09:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.943+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94479198560032] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.943+0000 7f424127b980 20 remove_watcher() i=6 2024-05-08T18:09:08.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.943+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94479198562160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eda7115810 con 0x7f4238031040 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94479198562160] v30'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42300ee040 con 0x7f4238031040 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 20 remove_watcher() i=7 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4238031040 msgr2=0x7f4238032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4238031040 0x7f4238032430 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda710b5f0 msgr2=0x55eda710dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda710b5f0 0x55eda710dab0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4234037020 msgr2=0x7f423404f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4234037020 0x7f423404f870 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eda7111840 msgr2=0x55eda7113c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eda7111840 0x55eda7113c30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41080383a0 msgr2=0x7f410803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41080383a0 0x7f410803a860 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55eda70dbe20 tx=0x7f423801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 msgr2=0x55eda7100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f423ed8f640 1 -- 172.21.15.114:0/2441216457 reap_dead start 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda7100280 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f42340238a0 tx=0x7f423404f250 comp rx=0 tx=0).stop 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 shutdown_connections 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2441216457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70f8d20 0x55eda7100280 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 >> 172.21.15.114:0/2441216457 conn(0x55eda70f50b0 msgr2=0x55eda70f2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 shutdown_connections 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2441216457 wait complete. 2024-05-08T18:09:08.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41180383f0 msgr2=0x7f411803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41180383f0 0x7f411803a8b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55eda70dc6a0 tx=0x7f4238005850 comp rx=0 tx=0).stop 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 msgr2=0x55eda70ebf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 0x55eda70ebf00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f423400d660 tx=0x7f423400da60 comp rx=0 tx=0).stop 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 shutdown_connections 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41180383f0 0x7f411803a8b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/177528099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda70ebae0 0x55eda70ebf00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 >> 172.21.15.114:0/177528099 conn(0x55eda70e08f0 msgr2=0x55eda70e1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 shutdown_connections 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/177528099 wait complete. 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda6fded00 msgr2=0x55eda70dacb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda6fded00 0x55eda70dacb0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41240383f0 msgr2=0x7f412403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41240383f0 0x7f412403a8b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4234004180 tx=0x7f4234001340 comp rx=0 tx=0).stop 2024-05-08T18:09:08.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 msgr2=0x55eda70cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70cf8d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f423001bb20 tx=0x7f4230018020 comp rx=0 tx=0).stop 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 shutdown_connections 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eda6fded00 0x55eda70dacb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41240383f0 0x7f412403a8b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 --2- 172.21.15.114:0/2843858306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eda6fde3e0 0x55eda70cf8d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 >> 172.21.15.114:0/2843858306 conn(0x55eda6fd8d60 msgr2=0x55eda70c2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 shutdown_connections 2024-05-08T18:09:08.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:08.947+0000 7f424127b980 1 -- 172.21.15.114:0/2843858306 wait complete. 2024-05-08T18:09:08.959 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:08.959 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:08.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:08.960 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:09.036 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:09.036 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:09.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32f173d980 1 Processor -- start 2024-05-08T18:09:09.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32f173d980 1 -- start start 2024-05-08T18:09:09.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32f173d980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5601448496d0 0x56014484bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32f173d980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601446ee710 con 0x5601447b77e0 2024-05-08T18:09:09.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32f173d980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560144702f00 con 0x5601448496d0 2024-05-08T18:09:09.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32eea50640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5601448496d0 0x56014484bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32eea50640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5601448496d0 0x56014484bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53034/0 (socket says 172.21.15.114:53034) 2024-05-08T18:09:09.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32ef251640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5601447b77e0 0x560144847fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51068/0 (socket says 172.21.15.114:51068) 2024-05-08T18:09:09.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.035+0000 7f32eea50640 1 -- 172.21.15.114:0/1217514653 learned_addr learned my addr 172.21.15.114:0/1217514653 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32eea50640 1 -- 172.21.15.114:0/1217514653 >> v1:172.21.15.53:6789/0 conn(0x5601447b77e0 legacy=0x560144847fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32eea50640 1 -- 172.21.15.114:0/1217514653 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601446caae0 con 0x5601448496d0 2024-05-08T18:09:09.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32eea50640 1 --2- 172.21.15.114:0/1217514653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601448496d0 0x56014484bac0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32d800a5c0 tx=0x7f32d801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3428851c4fd4c88a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32ee24f640 1 -- 172.21.15.114:0/1217514653 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80a6070 con 0x5601448496d0 2024-05-08T18:09:09.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32ee24f640 1 -- 172.21.15.114:0/1217514653 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d80af070 con 0x5601448496d0 2024-05-08T18:09:09.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32ee24f640 1 -- 172.21.15.114:0/1217514653 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80aa5c0 con 0x5601448496d0 2024-05-08T18:09:09.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32f173d980 1 -- 172.21.15.114:0/1217514653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601448496d0 msgr2=0x56014484bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32f173d980 1 --2- 172.21.15.114:0/1217514653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601448496d0 0x56014484bac0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f32d800a5c0 tx=0x7f32d801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:09.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32f173d980 1 -- 172.21.15.114:0/1217514653 shutdown_connections 2024-05-08T18:09:09.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32f173d980 1 --2- 172.21.15.114:0/1217514653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601448496d0 0x56014484bac0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32f173d980 1 -- 172.21.15.114:0/1217514653 >> 172.21.15.114:0/1217514653 conn(0x56014483d690 msgr2=0x56014483fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.039+0000 7f32f173d980 1 -- 172.21.15.114:0/1217514653 shutdown_connections 2024-05-08T18:09:09.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.043+0000 7f32f173d980 1 -- 172.21.15.114:0/1217514653 wait complete. 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32f173d980 1 Processor -- start 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32f173d980 1 -- start start 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32f173d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449301c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32f173d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560144746f80 con 0x5601447b77e0 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32ef251640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32ef251640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449301c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53044/0 (socket says 172.21.15.114:53044) 2024-05-08T18:09:09.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.055+0000 7f32ef251640 1 -- 172.21.15.114:0/3939279344 learned_addr learned my addr 172.21.15.114:0/3939279344 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 -- 172.21.15.114:0/3939279344 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014470eda0 con 0x5601447b77e0 2024-05-08T18:09:09.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 --2- 172.21.15.114:0/3939279344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449301c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f32e8001680 tx=0x7f32e8001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b653239e3f452f87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f31dd60a640 1 -- 172.21.15.114:0/3939279344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e8013420 con 0x5601447b77e0 2024-05-08T18:09:09.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f31dd60a640 1 -- 172.21.15.114:0/3939279344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e80135c0 con 0x5601447b77e0 2024-05-08T18:09:09.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f31dd60a640 1 -- 172.21.15.114:0/3939279344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e80138e0 con 0x5601447b77e0 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- 172.21.15.114:0/3939279344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 msgr2=0x5601449301c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 --2- 172.21.15.114:0/3939279344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449301c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f32e8001680 tx=0x7f32e8001b40 comp rx=0 tx=0).stop 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- 172.21.15.114:0/3939279344 shutdown_connections 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 --2- 172.21.15.114:0/3939279344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449301c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- 172.21.15.114:0/3939279344 >> 172.21.15.114:0/3939279344 conn(0x56014483d690 msgr2=0x56014492bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- 172.21.15.114:0/3939279344 shutdown_connections 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- 172.21.15.114:0/3939279344 wait complete. 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 Processor -- start 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- start start 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56014484ea60 con 0x5601447b77e0 2024-05-08T18:09:09.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449375c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53056/0 (socket says 172.21.15.114:53056) 2024-05-08T18:09:09.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 -- 172.21.15.114:0/787338964 learned_addr learned my addr 172.21.15.114:0/787338964 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560144937b00 con 0x5601447b77e0 2024-05-08T18:09:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32ef251640 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449375c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f32e8002260 tx=0x7f32e8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f31dbe07640 1 -- 172.21.15.114:0/787338964 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e80037a0 con 0x5601447b77e0 2024-05-08T18:09:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.059+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560144937d90 con 0x5601447b77e0 2024-05-08T18:09:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56014493aa20 con 0x5601447b77e0 2024-05-08T18:09:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f31dbe07640 1 -- 172.21.15.114:0/787338964 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32e8023070 con 0x5601447b77e0 2024-05-08T18:09:09.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f31dbe07640 1 -- 172.21.15.114:0/787338964 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32e8003a70 con 0x5601447b77e0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f31dbe07640 1 -- 172.21.15.114:0/787338964 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f32e8010070 con 0x5601447b77e0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f31dbe07640 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31d4038440 0x7f31d403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f31dbe07640 1 -- 172.21.15.114:0/787338964 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f32e804e720 con 0x5601447b77e0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32eea50640 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31d4038440 0x7f31d403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5601448496d0 0x56014493e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56014493eb20 con 0x5601448496d0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32efa52640 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5601448496d0 0x56014493e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32eea50640 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31d4038440 0x7f31d403a900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32d80ae000 tx=0x7f32d80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32efa52640 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5601448496d0 0x56014493e500 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32efa52640 1 -- 172.21.15.114:0/787338964 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32e00083f0 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56014493bc20 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32efa52640 1 -- 172.21.15.114:0/787338964 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32e00083f0 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144940970 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32efa52640 1 -- 172.21.15.114:0/787338964 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32e00083f0 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56014493fba0 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32efa52640 1 -- 172.21.15.114:0/787338964 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32e00083f0 con 0x5601448496d0 2024-05-08T18:09:09.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.063+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56014493ffc0 con 0x5601448496d0 2024-05-08T18:09:09.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32efa52640 1 -- 172.21.15.114:0/787338964 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f32e00083f0 con 0x5601448496d0 2024-05-08T18:09:09.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32f173d980 1 Processor -- start 2024-05-08T18:09:09.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32f173d980 1 -- start start 2024-05-08T18:09:09.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32f173d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 0x56014494f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32f173d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56014474afc0 con 0x56014494f2e0 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32eea50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 0x56014494f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32eea50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 0x56014494f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53070/0 (socket says 172.21.15.114:53070) 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32eea50640 1 -- 172.21.15.114:0/1748735330 learned_addr learned my addr 172.21.15.114:0/1748735330 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32eea50640 1 -- 172.21.15.114:0/1748735330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014494fc40 con 0x56014494f2e0 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32eea50640 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 0x56014494f700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f32d80199f0 tx=0x7f32d80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f31d9602640 1 -- 172.21.15.114:0/1748735330 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80b3b90 con 0x56014494f2e0 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f31d9602640 1 -- 172.21.15.114:0/1748735330 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d80b3d30 con 0x56014494f2e0 2024-05-08T18:09:09.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601449506e0 con 0x56014494f2e0 2024-05-08T18:09:09.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f31d9602640 1 -- 172.21.15.114:0/1748735330 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80c8560 con 0x56014494f2e0 2024-05-08T18:09:09.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.067+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560144950b50 con 0x56014494f2e0 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f31d9602640 1 -- 172.21.15.114:0/1748735330 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f32d80d1440 con 0x56014494f2e0 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f31d9602640 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31c8038440 0x7f31c803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f31d9602640 1 -- 172.21.15.114:0/1748735330 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f32d80ebf80 con 0x56014494f2e0 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32efa52640 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31c8038440 0x7f31c803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 Processor -- start 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- start start 2024-05-08T18:09:09.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32efa52640 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31c8038440 0x7f31c803a900 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56014493ff40 tx=0x7f32e0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x56014495c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560144930910 con 0x56014495c3a0 2024-05-08T18:09:09.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x56014495c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x56014495c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53078/0 (socket says 172.21.15.114:53078) 2024-05-08T18:09:09.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 -- 172.21.15.114:0/888023433 learned_addr learned my addr 172.21.15.114:0/888023433 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 -- 172.21.15.114:0/888023433 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56014495cd50 con 0x56014495c3a0 2024-05-08T18:09:09.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 --2- 172.21.15.114:0/888023433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x56014495c780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32d80ea3c0 tx=0x7f32d80d1a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7a12d586edb73f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f31d2ffd640 1 -- 172.21.15.114:0/888023433 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80bd390 con 0x56014495c3a0 2024-05-08T18:09:09.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f31d2ffd640 1 -- 172.21.15.114:0/888023433 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d80bd530 con 0x56014495c3a0 2024-05-08T18:09:09.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f31d2ffd640 1 -- 172.21.15.114:0/888023433 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80be410 con 0x56014495c3a0 2024-05-08T18:09:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- 172.21.15.114:0/888023433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 msgr2=0x56014495c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 --2- 172.21.15.114:0/888023433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x56014495c780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32d80ea3c0 tx=0x7f32d80d1a80 comp rx=0 tx=0).stop 2024-05-08T18:09:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- 172.21.15.114:0/888023433 shutdown_connections 2024-05-08T18:09:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 --2- 172.21.15.114:0/888023433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x56014495c780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- 172.21.15.114:0/888023433 >> 172.21.15.114:0/888023433 conn(0x5601449586e0 msgr2=0x560144956740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- 172.21.15.114:0/888023433 shutdown_connections 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- 172.21.15.114:0/888023433 wait complete. 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 Processor -- start 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- start start 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x5601449638e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32f173d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56014495d510 con 0x56014495c3a0 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x5601449638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x5601449638e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53086/0 (socket says 172.21.15.114:53086) 2024-05-08T18:09:09.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.071+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 learned_addr learned my addr 172.21.15.114:0/4073875175 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560144963e20 con 0x56014495c3a0 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32eea50640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x5601449638e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f32d80d1ac0 tx=0x7f32d80ea320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f31d17fa640 1 -- 172.21.15.114:0/4073875175 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80bd390 con 0x56014495c3a0 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601449640b0 con 0x56014495c3a0 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f31d17fa640 1 -- 172.21.15.114:0/4073875175 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d80be710 con 0x56014495c3a0 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f31d17fa640 1 -- 172.21.15.114:0/4073875175 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32d80c7d90 con 0x56014495c3a0 2024-05-08T18:09:09.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560144966d90 con 0x56014495c3a0 2024-05-08T18:09:09.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f31d17fa640 1 -- 172.21.15.114:0/4073875175 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f32d80bf910 con 0x56014495c3a0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f31d17fa640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31b80383f0 0x7f31b803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f31d17fa640 1 -- 172.21.15.114:0/4073875175 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f32d80e1070 con 0x56014495c3a0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32efa52640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31b80383f0 0x7f31b803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56014496ed20 0x5601449711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144971900 con 0x56014496ed20 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32ef251640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56014496ed20 0x5601449711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32efa52640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31b80383f0 0x7f31b803a8b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32e000f010 tx=0x7f32e001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32ef251640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56014496ed20 0x5601449711b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 20 realm 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144971d10 con 0x56014496ed20 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.075+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601449725e0 con 0x56014496ed20 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144972980 con 0x56014496ed20 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144972de0 con 0x56014496ed20 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 20 searching for the correct realm 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560144974d50 0x560144977140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32eea50640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560144974d50 0x560144977140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32eea50640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560144974d50 0x560144977140 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32eea50640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f32d8009040 0x7f32d80de9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32d8009040 2024-05-08T18:09:09.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32efa52640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f32d8009040 0x7f32d80de9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32efa52640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f32d8009040 0x7f32d80de9c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32efa52640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f32e0019040 0x7f32e0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32ef251640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f32e0019040 0x7f32e0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.079+0000 7f32ef251640 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f32e0019040 0x7f32e0019930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x7f32e0019040 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x7f32e0019040 2024-05-08T18:09:09.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x7f32e0019040 2024-05-08T18:09:09.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32d8009040 2024-05-08T18:09:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x7f32e0019040 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.083+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32d8009040 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x7f32e0019040 2024-05-08T18:09:09.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f32e800f030 con 0x56014496ed20 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32d8009040 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.087+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32d8009040 2024-05-08T18:09:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x560144974d50 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32e0019040 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x56014496ed20 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5601449777f0 con 0x7f32d8009040 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:09.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.091+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601449737f0 con 0x56014496ed20 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144974090 con 0x56014496ed20 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144973430 con 0x56014496ed20 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 zone default found 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 4 Realm: () 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 zonegroup default 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144974090 con 0x7f32e0019040 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x560144979630 con 0x560144974d50 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601449799d0 con 0x560144974d50 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 started sync module instance, tier type = 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:09.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560144978ad0 con 0x7f32d8009040 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94563445739248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560144978730 con 0x7f32d8009040 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.095+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497a840 con 0x56014496ed20 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94563445739248] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94563445742960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497a840 con 0x56014496ed20 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497b250 con 0x560144974d50 2024-05-08T18:09:09.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94563445747104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497baa0 con 0x560144974d50 2024-05-08T18:09:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.099+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497c4a0 con 0x7f32d8009040 2024-05-08T18:09:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94563445742960] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94563445744528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497c890 con 0x7f32d8009040 2024-05-08T18:09:09.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497d250 con 0x56014496ed20 2024-05-08T18:09:09.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94563445744528] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94563445747104] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94563445749232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497cda0 con 0x56014496ed20 2024-05-08T18:09:09.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.103+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497d630 con 0x7f32e0019040 2024-05-08T18:09:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94563445755296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497d1c0 con 0x7f32e0019040 2024-05-08T18:09:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497e4f0 con 0x7f32e0019040 2024-05-08T18:09:09.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94563445749232] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94563445755296] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94563445751728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497e040 con 0x7f32e0019040 2024-05-08T18:09:09.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.107+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497ea00 con 0x7f32e0019040 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94563445761360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497ee20 con 0x7f32e0019040 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=0 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=1 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=2 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=3 2024-05-08T18:09:09.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=4 2024-05-08T18:09:09.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=5 2024-05-08T18:09:09.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94563445751728] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=6 2024-05-08T18:09:09.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94563445761360] v30'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 20 add_watcher() i=7 2024-05-08T18:09:09.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:09.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.111+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56014497ee20 con 0x56014496ed20 2024-05-08T18:09:09.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94563445762416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497ed90 con 0x56014496ed20 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94563445762416] v30'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f31a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 5 note: GC not initialized 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f31a57e2640 20 reqs_thread_entry: start 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 20 Filter name: none 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f319e7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5601449a5390 con 0x56014496ed20 2024-05-08T18:09:09.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:09:09.117 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:09.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f31a67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.115+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94563445762416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5601449a3de0 con 0x56014496ed20 2024-05-08T18:09:09.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.119+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94563445762416] v30'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.119+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94563445739248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497e970 con 0x7f32d8009040 2024-05-08T18:09:09.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.119+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94563445739248] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.119+0000 7f32f173d980 20 remove_watcher() i=0 2024-05-08T18:09:09.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.119+0000 7f32f173d980 2 removed watcher, disabling cache 2024-05-08T18:09:09.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.119+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94563445742960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497e970 con 0x56014496ed20 2024-05-08T18:09:09.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94563445742960] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32f173d980 20 remove_watcher() i=1 2024-05-08T18:09:09.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94563445747104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x560144979d70 con 0x560144974d50 2024-05-08T18:09:09.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32eea50640 1 -- 172.21.15.114:0/4073875175 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94563445747104] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32d80f5020 con 0x560144974d50 2024-05-08T18:09:09.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32f173d980 20 remove_watcher() i=2 2024-05-08T18:09:09.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94563445744528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497e970 con 0x7f32d8009040 2024-05-08T18:09:09.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32efa52640 1 -- 172.21.15.114:0/4073875175 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94563445744528] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e002f040 con 0x7f32d8009040 2024-05-08T18:09:09.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32f173d980 20 remove_watcher() i=3 2024-05-08T18:09:09.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.123+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94563445749232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497ada0 con 0x56014496ed20 2024-05-08T18:09:09.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.127+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94563445749232] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x56014496ed20 2024-05-08T18:09:09.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.127+0000 7f32f173d980 20 remove_watcher() i=4 2024-05-08T18:09:09.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.127+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94563445755296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497a390 con 0x7f32e0019040 2024-05-08T18:09:09.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.131+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94563445755296] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.131+0000 7f32f173d980 20 remove_watcher() i=5 2024-05-08T18:09:09.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.131+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94563445751728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497e970 con 0x7f32e0019040 2024-05-08T18:09:09.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.131+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94563445751728] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.131+0000 7f32f173d980 20 remove_watcher() i=6 2024-05-08T18:09:09.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.131+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94563445761360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56014497b5f0 con 0x7f32e0019040 2024-05-08T18:09:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94563445761360] v30'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32e8054040 con 0x7f32e0019040 2024-05-08T18:09:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 20 remove_watcher() i=7 2024-05-08T18:09:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f32e0019040 msgr2=0x7f32e0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f32e0019040 0x7f32e0019930 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56014496ed20 msgr2=0x5601449711b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56014496ed20 0x5601449711b0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f32d8009040 msgr2=0x7f32d80de9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f32d8009040 0x7f32d80de9c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560144974d50 msgr2=0x560144977140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560144974d50 0x560144977140 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31b80383f0 msgr2=0x7f31b803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31b80383f0 0x7f31b803a8b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f32e000f010 tx=0x7f32e001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 msgr2=0x5601449638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32ef251640 1 -- 172.21.15.114:0/4073875175 reap_dead start 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x5601449638e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f32d80d1ac0 tx=0x7f32d80ea320 comp rx=0 tx=0).stop 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 shutdown_connections 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/4073875175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014495c3a0 0x5601449638e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 >> 172.21.15.114:0/4073875175 conn(0x5601449586e0 msgr2=0x560144955d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 shutdown_connections 2024-05-08T18:09:09.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/4073875175 wait complete. 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31c8038440 msgr2=0x7f31c803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31c8038440 0x7f31c803a900 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x56014493ff40 tx=0x7f32e0003070 comp rx=0 tx=0).stop 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 msgr2=0x56014494f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 0x56014494f700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f32d80199f0 tx=0x7f32d80180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 shutdown_connections 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31c8038440 0x7f31c803a900 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/1748735330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014494f2e0 0x56014494f700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 >> 172.21.15.114:0/1748735330 conn(0x5601449440f0 msgr2=0x560144944c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 shutdown_connections 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/1748735330 wait complete. 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5601448496d0 msgr2=0x56014493e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5601448496d0 0x56014493e500 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31d4038440 msgr2=0x7f31d403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31d4038440 0x7f31d403a900 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f32d80ae000 tx=0x7f32d80a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:09.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 msgr2=0x5601449375c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449375c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f32e8002260 tx=0x7f32e8000f50 comp rx=0 tx=0).stop 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 shutdown_connections 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5601448496d0 0x56014493e500 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f31d4038440 0x7f31d403a900 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 --2- 172.21.15.114:0/787338964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5601447b77e0 0x5601449375c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 >> 172.21.15.114:0/787338964 conn(0x56014483d690 msgr2=0x56014492a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 shutdown_connections 2024-05-08T18:09:09.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.135+0000 7f32f173d980 1 -- 172.21.15.114:0/787338964 wait complete. 2024-05-08T18:09:09.146 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:09.147 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:09.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:09.147 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06378a5980 1 Processor -- start 2024-05-08T18:09:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06378a5980 1 -- start start 2024-05-08T18:09:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06378a5980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d64584e280 0x55d645850670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06378a5980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6456f5710 con 0x55d6457bdf50 2024-05-08T18:09:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06378a5980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d645709f00 con 0x55d64584e280 2024-05-08T18:09:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f0634bb8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d64584e280 0x55d645850670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06353b9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d6457bdf50 0x55d64584cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51076/0 (socket says 172.21.15.114:51076) 2024-05-08T18:09:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f0634bb8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d64584e280 0x55d645850670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53088/0 (socket says 172.21.15.114:53088) 2024-05-08T18:09:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f06353b9640 1 -- 172.21.15.114:0/1484363402 learned_addr learned my addr 172.21.15.114:0/1484363402 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f0634bb8640 1 -- 172.21.15.114:0/1484363402 >> v1:172.21.15.53:6789/0 conn(0x55d6457bdf50 legacy=0x55d64584cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.227+0000 7f0634bb8640 1 -- 172.21.15.114:0/1484363402 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6456d1ae0 con 0x55d64584e280 2024-05-08T18:09:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f0634bb8640 1 --2- 172.21.15.114:0/1484363402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64584e280 0x55d645850670 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f062c00a480 tx=0x7f062c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fb2932ceb10ff1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f0627fff640 1 -- 172.21.15.114:0/1484363402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0b0070 con 0x55d64584e280 2024-05-08T18:09:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f0627fff640 1 -- 172.21.15.114:0/1484363402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c0ab540 con 0x55d64584e280 2024-05-08T18:09:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f0627fff640 1 -- 172.21.15.114:0/1484363402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0ab840 con 0x55d64584e280 2024-05-08T18:09:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 -- 172.21.15.114:0/1484363402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64584e280 msgr2=0x55d645850670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 --2- 172.21.15.114:0/1484363402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64584e280 0x55d645850670 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f062c00a480 tx=0x7f062c01b280 comp rx=0 tx=0).stop 2024-05-08T18:09:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 -- 172.21.15.114:0/1484363402 shutdown_connections 2024-05-08T18:09:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 --2- 172.21.15.114:0/1484363402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64584e280 0x55d645850670 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 -- 172.21.15.114:0/1484363402 >> 172.21.15.114:0/1484363402 conn(0x55d645844640 msgr2=0x55d645846a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 -- 172.21.15.114:0/1484363402 shutdown_connections 2024-05-08T18:09:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.231+0000 7f06378a5980 1 -- 172.21.15.114:0/1484363402 wait complete. 2024-05-08T18:09:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06378a5980 1 Processor -- start 2024-05-08T18:09:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06378a5980 1 -- start start 2024-05-08T18:09:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06378a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 0x55d645932ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06378a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d64574df80 con 0x55d6457bdf50 2024-05-08T18:09:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06353b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 0x55d645932ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06353b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 0x55d645932ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53104/0 (socket says 172.21.15.114:53104) 2024-05-08T18:09:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06353b9640 1 -- 172.21.15.114:0/716160839 learned_addr learned my addr 172.21.15.114:0/716160839 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06353b9640 1 -- 172.21.15.114:0/716160839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d645715da0 con 0x55d6457bdf50 2024-05-08T18:09:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f06353b9640 1 --2- 172.21.15.114:0/716160839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 0x55d645932ed0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0628001e50 tx=0x7f0628001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebd643eed0df7a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.247+0000 7f0523606640 1 -- 172.21.15.114:0/716160839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0628012020 con 0x55d6457bdf50 2024-05-08T18:09:09.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f0523606640 1 -- 172.21.15.114:0/716160839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062800e7c0 con 0x55d6457bdf50 2024-05-08T18:09:09.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f0523606640 1 -- 172.21.15.114:0/716160839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062800eaa0 con 0x55d6457bdf50 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/716160839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 msgr2=0x55d645932ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 --2- 172.21.15.114:0/716160839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 0x55d645932ed0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0628001e50 tx=0x7f0628001e80 comp rx=0 tx=0).stop 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/716160839 shutdown_connections 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 --2- 172.21.15.114:0/716160839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d6457bdf50 0x55d645932ed0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/716160839 >> 172.21.15.114:0/716160839 conn(0x55d645844640 msgr2=0x55d64592e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/716160839 shutdown_connections 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/716160839 wait complete. 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 Processor -- start 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- start start 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 0x55d64593a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d645851750 con 0x55d64593a530 2024-05-08T18:09:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06353b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 0x55d64593a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06353b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 0x55d64593a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:53114/0 (socket says 172.21.15.114:53114) 2024-05-08T18:09:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06353b9640 1 -- 172.21.15.114:0/2543483443 learned_addr learned my addr 172.21.15.114:0/2543483443 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06353b9640 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d64593ae90 con 0x55d64593a530 2024-05-08T18:09:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06353b9640 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 0x55d64593a950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0628000c10 tx=0x7f0628000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f0521e03640 1 -- 172.21.15.114:0/2543483443 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0628012030 con 0x55d64593a530 2024-05-08T18:09:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f0521e03640 1 -- 172.21.15.114:0/2543483443 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062801a700 con 0x55d64593a530 2024-05-08T18:09:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f0521e03640 1 -- 172.21.15.114:0/2543483443 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062801aa20 con 0x55d64593a530 2024-05-08T18:09:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d64593b120 con 0x55d64593a530 2024-05-08T18:09:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.251+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d64593dc00 con 0x55d64593a530 2024-05-08T18:09:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0521e03640 1 -- 172.21.15.114:0/2543483443 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0628015020 con 0x55d64593a530 2024-05-08T18:09:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0521e03640 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f051c038440 0x7f051c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0521e03640 1 -- 172.21.15.114:0/2543483443 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f0628020070 con 0x55d64593a530 2024-05-08T18:09:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f051c038440 0x7f051c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d64593f8f0 0x55d645941ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6459422b0 con 0x55d64593f8f0 2024-05-08T18:09:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0635bba640 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d64593f8f0 0x55d645941ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f051c038440 0x7f051c03a900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f062c0ad000 tx=0x7f062c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0635bba640 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d64593f8f0 0x55d645941ce0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0635bba640 1 -- 172.21.15.114:0/2543483443 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f063000a4d0 con 0x55d64593f8f0 2024-05-08T18:09:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d64593eed0 con 0x55d64593f8f0 2024-05-08T18:09:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0635bba640 1 -- 172.21.15.114:0/2543483443 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f063000a4d0 con 0x55d64593f8f0 2024-05-08T18:09:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6459440f0 con 0x55d64593f8f0 2024-05-08T18:09:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0635bba640 1 -- 172.21.15.114:0/2543483443 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f063000a4d0 con 0x55d64593f8f0 2024-05-08T18:09:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645943260 con 0x55d64593f8f0 2024-05-08T18:09:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f0635bba640 1 -- 172.21.15.114:0/2543483443 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f063000a4d0 con 0x55d64593f8f0 2024-05-08T18:09:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.255+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6459436b0 con 0x55d64593f8f0 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f0635bba640 1 -- 172.21.15.114:0/2543483443 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f063000a4d0 con 0x55d64593f8f0 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f06378a5980 1 Processor -- start 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f06378a5980 1 -- start start 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f06378a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 0x55d645952e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f06378a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d645751fc0 con 0x55d645952a10 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f0634bb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 0x55d645952e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f0634bb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 0x55d645952e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57600/0 (socket says 172.21.15.114:57600) 2024-05-08T18:09:09.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f0634bb8640 1 -- 172.21.15.114:0/2531736045 learned_addr learned my addr 172.21.15.114:0/2531736045 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f0634bb8640 1 -- 172.21.15.114:0/2531736045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d645953370 con 0x55d645952a10 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 0x55d645952e30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f062c0ae040 tx=0x7f062c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f051affd640 1 -- 172.21.15.114:0/2531736045 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0c6070 con 0x55d645952a10 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f051affd640 1 -- 172.21.15.114:0/2531736045 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c0c1540 con 0x55d645952a10 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d645953e10 con 0x55d645952a10 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f051affd640 1 -- 172.21.15.114:0/2531736045 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0b0040 con 0x55d645952a10 2024-05-08T18:09:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d645954280 con 0x55d645952a10 2024-05-08T18:09:09.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f051affd640 1 -- 172.21.15.114:0/2531736045 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f062c0c9070 con 0x55d645952a10 2024-05-08T18:09:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f051affd640 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05100383f0 0x7f051003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.259+0000 7f051affd640 1 -- 172.21.15.114:0/2531736045 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f062c0be030 con 0x55d645952a10 2024-05-08T18:09:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0635bba640 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05100383f0 0x7f051003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 Processor -- start 2024-05-08T18:09:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- start start 2024-05-08T18:09:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0635bba640 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05100383f0 0x7f051003a8b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55d645942d80 tx=0x7f0630005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d64595ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d645933620 con 0x55d64595fae0 2024-05-08T18:09:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d64595ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d64595ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57602/0 (socket says 172.21.15.114:57602) 2024-05-08T18:09:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 -- 172.21.15.114:0/990789275 learned_addr learned my addr 172.21.15.114:0/990789275 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 -- 172.21.15.114:0/990789275 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6459604d0 con 0x55d64595fae0 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 --2- 172.21.15.114:0/990789275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d64595ff00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f062c0e91f0 tx=0x7f062c006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03e83f54f9b3561 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0518ff9640 1 -- 172.21.15.114:0/990789275 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0d9020 con 0x55d64595fae0 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0518ff9640 1 -- 172.21.15.114:0/990789275 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c0c9c80 con 0x55d64595fae0 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0518ff9640 1 -- 172.21.15.114:0/990789275 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0b75e0 con 0x55d64595fae0 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- 172.21.15.114:0/990789275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 msgr2=0x55d64595ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 --2- 172.21.15.114:0/990789275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d64595ff00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f062c0e91f0 tx=0x7f062c006760 comp rx=0 tx=0).stop 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- 172.21.15.114:0/990789275 shutdown_connections 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 --2- 172.21.15.114:0/990789275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d64595ff00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- 172.21.15.114:0/990789275 >> 172.21.15.114:0/990789275 conn(0x55d64595be70 msgr2=0x55d645959ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- 172.21.15.114:0/990789275 shutdown_connections 2024-05-08T18:09:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- 172.21.15.114:0/990789275 wait complete. 2024-05-08T18:09:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 Processor -- start 2024-05-08T18:09:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- start start 2024-05-08T18:09:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d645967050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f06378a5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d645960c20 con 0x55d64595fae0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d645967050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d645967050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57608/0 (socket says 172.21.15.114:57608) 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.263+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 learned_addr learned my addr 172.21.15.114:0/2355665901 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d645967590 con 0x55d64595fae0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d645967050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f062c006d10 tx=0x7f062c0e9150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0506ffd640 1 -- 172.21.15.114:0/2355665901 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0ef070 con 0x55d64595fae0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0506ffd640 1 -- 172.21.15.114:0/2355665901 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c0b5e70 con 0x55d64595fae0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d645967820 con 0x55d64595fae0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0506ffd640 1 -- 172.21.15.114:0/2355665901 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062c0c96e0 con 0x55d64595fae0 2024-05-08T18:09:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d64596a500 con 0x55d64595fae0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0506ffd640 1 -- 172.21.15.114:0/2355665901 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f062c0f2070 con 0x55d64595fae0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0506ffd640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05000383f0 0x7f050003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0506ffd640 1 -- 172.21.15.114:0/2355665901 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f062c0a8070 con 0x55d64595fae0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0635bba640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05000383f0 0x7f050003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d645972400 0x55d6459748a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645974ff0 con 0x55d645972400 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06353b9640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d645972400 0x55d6459748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f0635bba640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05000383f0 0x7f050003a8b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55d64593ee20 tx=0x7f063001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06353b9640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d645972400 0x55d6459748a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0628008030 con 0x55d645972400 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 20 realm 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.267+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645975400 con 0x55d645972400 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0628008030 con 0x55d645972400 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645975ca0 con 0x55d645972400 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0628008030 con 0x55d645972400 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645976040 con 0x55d645972400 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0628008030 con 0x55d645972400 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645976890 con 0x55d645972400 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0628008030 con 0x55d645972400 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:09.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 20 searching for the correct realm 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d645978600 0x55d64597a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d645978600 0x55d64597a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d645978600 0x55d64597a9f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0634bb8640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f062c0f4060 0x7f062c0e0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f062c0f4060 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0635bba640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f062c0f4060 0x7f062c0e0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0635bba640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f062c0f4060 0x7f062c0e0440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063001f070 con 0x7f062c0f4060 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0635bba640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0630031040 0x7f0630032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06353b9640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0630031040 0x7f0630032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.271+0000 7f06353b9640 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0630031040 0x7f0630032940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628008030 con 0x7f0630031040 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628008030 con 0x55d645972400 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x55d645972400 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x7f0630031040 2024-05-08T18:09:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x7f0630031040 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f062c0f4060 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063001f070 con 0x7f062c0f4060 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x55d645972400 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x7f0630031040 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x55d645972400 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.275+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f062c0f4060 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f063001f070 con 0x7f062c0f4060 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x7f0630031040 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x55d645972400 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0628037040 con 0x55d645972400 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628037040 con 0x7f0630031040 2024-05-08T18:09:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f062c0f4060 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063001f070 con 0x7f062c0f4060 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.279+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0628037040 con 0x55d645972400 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f062c0f4060 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063001f070 con 0x7f062c0f4060 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645978600 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f0630031040 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x55d645972400 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d64597af30 con 0x7f062c0f4060 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.283+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f063001f070 con 0x7f062c0f4060 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645977240 con 0x55d645972400 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645977ae0 con 0x55d645972400 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645976e80 con 0x55d645972400 2024-05-08T18:09:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 zone default found 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 4 Realm: () 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 zonegroup default 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d645977ae0 con 0x7f0630031040 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d64597cd40 con 0x55d645978600 2024-05-08T18:09:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d64597d0e0 con 0x55d645978600 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 started sync module instance, tier type = 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597c1e0 con 0x7f062c0f4060 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0630040040 con 0x7f062c0f4060 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94378778936784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597be40 con 0x7f062c0f4060 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.287+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597dfc0 con 0x55d645972400 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.291+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94378778936784] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0630040040 con 0x7f062c0f4060 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.291+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.291+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94378778940656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597dfc0 con 0x55d645972400 2024-05-08T18:09:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.291+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597e980 con 0x55d645978600 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94378778944720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597f220 con 0x55d645978600 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597fc20 con 0x7f062c0f4060 2024-05-08T18:09:09.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94378778940656] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0630040040 con 0x7f062c0f4060 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94378778942224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645980010 con 0x7f062c0f4060 2024-05-08T18:09:09.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6459809d0 con 0x55d645972400 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94378778944720] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94378778942224] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0630040040 con 0x7f062c0f4060 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94378778949424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645980520 con 0x55d645972400 2024-05-08T18:09:09.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.295+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645980d70 con 0x7f0630031040 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.299+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94378778949424] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.299+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.299+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94378778952992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645981190 con 0x7f0630031040 2024-05-08T18:09:09.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.299+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6459819e0 con 0x7f0630031040 2024-05-08T18:09:09.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94378778956032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645981ad0 con 0x7f0630031040 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6459825d0 con 0x7f0630031040 2024-05-08T18:09:09.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94378778952992] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94378778956032] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94378778960064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645981520 con 0x7f0630031040 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=0 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=1 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=2 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=3 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=4 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=5 2024-05-08T18:09:09.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.303+0000 7f06378a5980 20 add_watcher() i=6 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94378778960064] v30'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 add_watcher() i=7 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6459855c0 con 0x55d645972400 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94378778954048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645982a40 con 0x55d645972400 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94378778954048] v30'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f04eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 5 note: GC not initialized 2024-05-08T18:09:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f04ea7e4640 20 reqs_thread_entry: start 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 Filter name: none 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f045bfff640 20 reqs_thread_entry: start 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d6459a8a00 con 0x55d645972400 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.307+0000 7f06378a5980 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f04eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94378778954048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d6459a7450 con 0x55d645972400 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94378778954048] v30'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94378778936784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d645980940 con 0x7f062c0f4060 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94378778936784] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0630040040 con 0x7f062c0f4060 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f06378a5980 20 remove_watcher() i=0 2024-05-08T18:09:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f06378a5980 2 removed watcher, disabling cache 2024-05-08T18:09:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.311+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94378778940656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597c5d0 con 0x55d645972400 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.315+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94378778940656] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.315+0000 7f06378a5980 20 remove_watcher() i=1 2024-05-08T18:09:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.315+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94378778944720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597c5d0 con 0x55d645978600 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.315+0000 7f0634bb8640 1 -- 172.21.15.114:0/2355665901 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94378778944720] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f062c0f1030 con 0x55d645978600 2024-05-08T18:09:09.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.315+0000 7f06378a5980 20 remove_watcher() i=2 2024-05-08T18:09:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.315+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94378778942224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597e4d0 con 0x7f062c0f4060 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.319+0000 7f0635bba640 1 -- 172.21.15.114:0/2355665901 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94378778942224] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0630040040 con 0x7f062c0f4060 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.319+0000 7f06378a5980 20 remove_watcher() i=3 2024-05-08T18:09:09.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.319+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94378778949424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597e4d0 con 0x55d645972400 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.319+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94378778949424] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x55d645972400 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.319+0000 7f06378a5980 20 remove_watcher() i=4 2024-05-08T18:09:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.319+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94378778952992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597f730 con 0x7f0630031040 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.323+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94378778952992] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.323+0000 7f06378a5980 20 remove_watcher() i=5 2024-05-08T18:09:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.323+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94378778956032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597e4d0 con 0x7f0630031040 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.323+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94378778956032] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.323+0000 7f06378a5980 20 remove_watcher() i=6 2024-05-08T18:09:09.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.323+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94378778960064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d64597f730 con 0x7f0630031040 2024-05-08T18:09:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94378778960064] v30'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0628056040 con 0x7f0630031040 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 20 remove_watcher() i=7 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0630031040 msgr2=0x7f0630032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0630031040 0x7f0630032940 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d645972400 msgr2=0x55d6459748a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d645972400 0x55d6459748a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f062c0f4060 msgr2=0x7f062c0e0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f062c0f4060 0x7f062c0e0440 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d645978600 msgr2=0x55d64597a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d645978600 0x55d64597a9f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05000383f0 msgr2=0x7f050003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05000383f0 0x7f050003a8b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x55d64593ee20 tx=0x7f063001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 msgr2=0x55d645967050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2355665901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64595fae0 0x55d645967050 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f062c006d10 tx=0x7f062c0e9150 comp rx=0 tx=0).stop 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 reap_dead start 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06353b9640 1 -- 172.21.15.114:0/2355665901 reap_dead start 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 shutdown_connections 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 >> 172.21.15.114:0/2355665901 conn(0x55d64595be70 msgr2=0x55d645961340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 shutdown_connections 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2355665901 wait complete. 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05100383f0 msgr2=0x7f051003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05100383f0 0x7f051003a8b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x55d645942d80 tx=0x7f0630005850 comp rx=0 tx=0).stop 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 msgr2=0x55d645952e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 0x55d645952e30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f062c0ae040 tx=0x7f062c018020 comp rx=0 tx=0).stop 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 shutdown_connections 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f05100383f0 0x7f051003a8b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2531736045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d645952a10 0x55d645952e30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 >> 172.21.15.114:0/2531736045 conn(0x55d645947820 msgr2=0x55d645948330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 shutdown_connections 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2531736045 wait complete. 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d64593f8f0 msgr2=0x55d645941ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d64593f8f0 0x55d645941ce0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f051c038440 msgr2=0x7f051c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f051c038440 0x7f051c03a900 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f062c0ad000 tx=0x7f062c0a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 msgr2=0x55d64593a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 0x55d64593a950 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0628000c10 tx=0x7f0628000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 shutdown_connections 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d64593f8f0 0x55d645941ce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f051c038440 0x7f051c03a900 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 --2- 172.21.15.114:0/2543483443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d64593a530 0x55d64593a950 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 >> 172.21.15.114:0/2543483443 conn(0x55d645844640 msgr2=0x55d64592d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 shutdown_connections 2024-05-08T18:09:09.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.327+0000 7f06378a5980 1 -- 172.21.15.114:0/2543483443 wait complete. 2024-05-08T18:09:09.339 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:09.339 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T18:09:09.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T18:09:09.339 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-08T18:09:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f5331c3b980 1 Processor -- start 2024-05-08T18:09:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f5331c3b980 1 -- start start 2024-05-08T18:09:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f5331c3b980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c651eee2c0 0x55c651ef06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f5331c3b980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c651d96710 con 0x55c651ee9d60 2024-05-08T18:09:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f5331c3b980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c651daaf00 con 0x55c651eee2c0 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532ef4e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c651eee2c0 0x55c651ef06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532f74f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c651ee9d60 0x55c651eea140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34544/0 (socket says 172.21.15.114:34544) 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532f74f640 1 -- 172.21.15.114:0/2612543850 learned_addr learned my addr 172.21.15.114:0/2612543850 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532e74d640 1 -- 172.21.15.114:0/2612543850 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506732809 0 0) 0x55c651d96710 con 0x55c651ee9d60 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532e74d640 1 -- 172.21.15.114:0/2612543850 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5318001e20 con 0x55c651ee9d60 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532ef4e640 1 -- 172.21.15.114:0/2612543850 >> v1:172.21.15.53:6789/0 conn(0x55c651ee9d60 legacy=0x55c651eea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.419+0000 7f532ef4e640 1 -- 172.21.15.114:0/2612543850 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c651d72ae0 con 0x55c651eee2c0 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f532ef4e640 1 --2- 172.21.15.114:0/2612543850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651eee2c0 0x55c651ef06b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f532400a480 tx=0x7f532401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8546b718b624cad5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f532e74d640 1 -- 172.21.15.114:0/2612543850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240b0070 con 0x55c651eee2c0 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f532e74d640 1 -- 172.21.15.114:0/2612543850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240ab540 con 0x55c651eee2c0 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f532e74d640 1 -- 172.21.15.114:0/2612543850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240ab840 con 0x55c651eee2c0 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 -- 172.21.15.114:0/2612543850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651eee2c0 msgr2=0x55c651ef06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 --2- 172.21.15.114:0/2612543850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651eee2c0 0x55c651ef06b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f532400a480 tx=0x7f532401b280 comp rx=0 tx=0).stop 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 -- 172.21.15.114:0/2612543850 shutdown_connections 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 --2- 172.21.15.114:0/2612543850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651eee2c0 0x55c651ef06b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 -- 172.21.15.114:0/2612543850 >> 172.21.15.114:0/2612543850 conn(0x55c651ee5630 msgr2=0x55c651ee7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 -- 172.21.15.114:0/2612543850 shutdown_connections 2024-05-08T18:09:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.423+0000 7f5331c3b980 1 -- 172.21.15.114:0/2612543850 wait complete. 2024-05-08T18:09:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 Processor -- start 2024-05-08T18:09:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- start start 2024-05-08T18:09:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fd4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c651deef80 con 0x55c651ee9d60 2024-05-08T18:09:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f532f74f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fd4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f532f74f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fd4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57628/0 (socket says 172.21.15.114:57628) 2024-05-08T18:09:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f532f74f640 1 -- 172.21.15.114:0/969768544 learned_addr learned my addr 172.21.15.114:0/969768544 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f532f74f640 1 -- 172.21.15.114:0/969768544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c651db6da0 con 0x55c651ee9d60 2024-05-08T18:09:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f532f74f640 1 --2- 172.21.15.114:0/969768544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fd4e80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5320001e40 tx=0x7f532000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8851fc055babbfd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f521d60a640 1 -- 172.21.15.114:0/969768544 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5320009470 con 0x55c651ee9d60 2024-05-08T18:09:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f521d60a640 1 -- 172.21.15.114:0/969768544 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5320009610 con 0x55c651ee9d60 2024-05-08T18:09:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f521d60a640 1 -- 172.21.15.114:0/969768544 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53200098f0 con 0x55c651ee9d60 2024-05-08T18:09:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- 172.21.15.114:0/969768544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 msgr2=0x55c651fd4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 --2- 172.21.15.114:0/969768544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fd4e80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5320001e40 tx=0x7f532000b920 comp rx=0 tx=0).stop 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- 172.21.15.114:0/969768544 shutdown_connections 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 --2- 172.21.15.114:0/969768544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fd4e80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- 172.21.15.114:0/969768544 >> 172.21.15.114:0/969768544 conn(0x55c651ee5630 msgr2=0x55c651fd0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- 172.21.15.114:0/969768544 shutdown_connections 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.439+0000 7f5331c3b980 1 -- 172.21.15.114:0/969768544 wait complete. 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 Processor -- start 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 -- start start 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fdb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c651ef36e0 con 0x55c651ee9d60 2024-05-08T18:09:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f532f74f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fdb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f532f74f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fdb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57642/0 (socket says 172.21.15.114:57642) 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f532f74f640 1 -- 172.21.15.114:0/408295888 learned_addr learned my addr 172.21.15.114:0/408295888 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f532f74f640 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c651fdb820 con 0x55c651ee9d60 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f532f74f640 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fdb2e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5320000c10 tx=0x7f532000d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f521be07640 1 -- 172.21.15.114:0/408295888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5320009470 con 0x55c651ee9d60 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c651fdbab0 con 0x55c651ee9d60 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c651fde6f0 con 0x55c651ee9d60 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f521be07640 1 -- 172.21.15.114:0/408295888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5320016a10 con 0x55c651ee9d60 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f521be07640 1 -- 172.21.15.114:0/408295888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5320016cf0 con 0x55c651ee9d60 2024-05-08T18:09:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f521be07640 1 -- 172.21.15.114:0/408295888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5320029060 con 0x55c651ee9d60 2024-05-08T18:09:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f521be07640 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5214038440 0x7f521403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f521be07640 1 -- 172.21.15.114:0/408295888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f5320011030 con 0x55c651ee9d60 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f532ef4e640 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5214038440 0x7f521403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c651fe01c0 0x55c651fe25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.443+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c651fe2c00 con 0x55c651fe01c0 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c651fe01c0 0x55c651fe25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ef4e640 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5214038440 0x7f521403a900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53240ad000 tx=0x7f53240a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c651fe01c0 0x55c651fe25b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 -- 172.21.15.114:0/408295888 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f532800a4d0 con 0x55c651fe01c0 2024-05-08T18:09:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c651fdf910 con 0x55c651fe01c0 2024-05-08T18:09:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 -- 172.21.15.114:0/408295888 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f532800a4d0 con 0x55c651fe01c0 2024-05-08T18:09:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c651fe4a20 con 0x55c651fe01c0 2024-05-08T18:09:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 -- 172.21.15.114:0/408295888 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f532800a4d0 con 0x55c651fe01c0 2024-05-08T18:09:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c651fe3b90 con 0x55c651fe01c0 2024-05-08T18:09:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 -- 172.21.15.114:0/408295888 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f532800a4d0 con 0x55c651fe01c0 2024-05-08T18:09:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c651fe3fe0 con 0x55c651fe01c0 2024-05-08T18:09:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ff50640 1 -- 172.21.15.114:0/408295888 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f532800a4d0 con 0x55c651fe01c0 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 Processor -- start 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 -- start start 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 0x55c651ff3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f5331c3b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c651df2fc0 con 0x55c651ff3350 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ef4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 0x55c651ff3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ef4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 0x55c651ff3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57650/0 (socket says 172.21.15.114:57650) 2024-05-08T18:09:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ef4e640 1 -- 172.21.15.114:0/2630926447 learned_addr learned my addr 172.21.15.114:0/2630926447 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.447+0000 7f532ef4e640 1 -- 172.21.15.114:0/2630926447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c651ff3cb0 con 0x55c651ff3350 2024-05-08T18:09:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ef4e640 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 0x55c651ff3770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f532400a480 tx=0x7f5324018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5219602640 1 -- 172.21.15.114:0/2630926447 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240c8070 con 0x55c651ff3350 2024-05-08T18:09:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5219602640 1 -- 172.21.15.114:0/2630926447 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240b1040 con 0x55c651ff3350 2024-05-08T18:09:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c651ff4750 con 0x55c651ff3350 2024-05-08T18:09:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5219602640 1 -- 172.21.15.114:0/2630926447 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240b0050 con 0x55c651ff3350 2024-05-08T18:09:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c651ff4bc0 con 0x55c651ff3350 2024-05-08T18:09:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5219602640 1 -- 172.21.15.114:0/2630926447 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f53240cb070 con 0x55c651ff3350 2024-05-08T18:09:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5219602640 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f52080383f0 0x7f520803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5219602640 1 -- 172.21.15.114:0/2630926447 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f53240c0070 con 0x55c651ff3350 2024-05-08T18:09:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ff50640 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f52080383f0 0x7f520803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5331c3b980 1 Processor -- start 2024-05-08T18:09:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5331c3b980 1 -- start start 2024-05-08T18:09:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5331c3b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c652000830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ff50640 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f52080383f0 0x7f520803a8b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55c651fe36b0 tx=0x7f5328005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f5331c3b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c651fd55d0 con 0x55c652000450 2024-05-08T18:09:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ef4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c652000830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ef4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c652000830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57656/0 (socket says 172.21.15.114:57656) 2024-05-08T18:09:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ef4e640 1 -- 172.21.15.114:0/693184488 learned_addr learned my addr 172.21.15.114:0/693184488 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ef4e640 1 -- 172.21.15.114:0/693184488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c652000e00 con 0x55c652000450 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.451+0000 7f532ef4e640 1 --2- 172.21.15.114:0/693184488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c652000830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53240ab800 tx=0x7f53240b5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277793a3991e038b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5212ffd640 1 -- 172.21.15.114:0/693184488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240b63e0 con 0x55c652000450 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5212ffd640 1 -- 172.21.15.114:0/693184488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240b6580 con 0x55c652000450 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5212ffd640 1 -- 172.21.15.114:0/693184488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240e1fe0 con 0x55c652000450 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/693184488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 msgr2=0x55c652000830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 --2- 172.21.15.114:0/693184488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c652000830 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f53240ab800 tx=0x7f53240b5ad0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/693184488 shutdown_connections 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 --2- 172.21.15.114:0/693184488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c652000830 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/693184488 >> 172.21.15.114:0/693184488 conn(0x55c651ffc790 msgr2=0x55c651ffa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/693184488 shutdown_connections 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/693184488 wait complete. 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 Processor -- start 2024-05-08T18:09:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- start start 2024-05-08T18:09:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c65200bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c6520015c0 con 0x55c652000450 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f532ef4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c65200bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f532ef4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c65200bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57668/0 (socket says 172.21.15.114:57668) 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 learned_addr learned my addr 172.21.15.114:0/3950910191 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c65200c2c0 con 0x55c652000450 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f532ef4e640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c65200bd80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f53240b8740 tx=0x7f53240e9080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f52117fa640 1 -- 172.21.15.114:0/3950910191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240df070 con 0x55c652000450 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c65200c550 con 0x55c652000450 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f52117fa640 1 -- 172.21.15.114:0/3950910191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53240ea7c0 con 0x55c652000450 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f52117fa640 1 -- 172.21.15.114:0/3950910191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53240b63e0 con 0x55c652000450 2024-05-08T18:09:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.455+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c65200c550 con 0x55c652000450 2024-05-08T18:09:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f52117fa640 1 -- 172.21.15.114:0/3950910191 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f53240f1060 con 0x55c652000450 2024-05-08T18:09:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f52117fa640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f51f80383f0 0x7f51f803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f52117fa640 1 -- 172.21.15.114:0/3950910191 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f53240a8070 con 0x55c652000450 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ff50640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f51f80383f0 0x7f51f803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c6520170b0 0x55c652019550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c652019ca0 con 0x55c6520170b0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c6520170b0 0x55c652019550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ff50640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f51f80383f0 0x7f51f803a8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c651fdf860 tx=0x7f532801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c6520170b0 0x55c652019550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 realm 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201a0b0 con 0x55c6520170b0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201a980 con 0x55c6520170b0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201ad20 con 0x55c6520170b0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201b570 con 0x55c6520170b0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 20 searching for the correct realm 2024-05-08T18:09:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c65201cfe0 0x55c65201f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ef4e640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c65201cfe0 0x55c65201f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ef4e640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c65201cfe0 0x55c65201f4a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ef4e640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f53240cd060 0x7f53240db450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f53240cd060 2024-05-08T18:09:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.459+0000 7f532ff50640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f53240cd060 0x7f53240db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532ff50640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f53240cd060 0x7f53240db450 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532801f070 con 0x7f53240cd060 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532ff50640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5328031040 0x7f5328032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5328031040 0x7f5328032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5328031040 0x7f5328032940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f53240cd060 2024-05-08T18:09:09.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.463+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532801f070 con 0x7f53240cd060 2024-05-08T18:09:09.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f53240cd060 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f532801f070 con 0x7f53240cd060 2024-05-08T18:09:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.467+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f53240cd060 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532801f070 con 0x7f53240cd060 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f53240cd060 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532801f070 con 0x7f53240cd060 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.471+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c65201cfe0 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f5328031040 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x55c6520170b0 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fb70 con 0x7f53240cd060 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f532801f070 con 0x7f53240cd060 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201bdc0 con 0x55c6520170b0 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201c1b0 con 0x55c6520170b0 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201fff0 con 0x55c6520170b0 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 zone default found 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 4 Realm: () 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 zonegroup default 2024-05-08T18:09:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65201ba00 con 0x7f5328031040 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c652021f00 con 0x55c65201cfe0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c6520222d0 con 0x55c65201cfe0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 started sync module instance, tier type = 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.475+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520213a0 con 0x7f53240cd060 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94310267754384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652021000 con 0x7f53240cd060 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520231e0 con 0x55c6520170b0 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94310267754384] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94310267758352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520231e0 con 0x55c6520170b0 2024-05-08T18:09:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.479+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652023ba0 con 0x55c65201cfe0 2024-05-08T18:09:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94310267762416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520243f0 con 0x55c65201cfe0 2024-05-08T18:09:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652024db0 con 0x7f53240cd060 2024-05-08T18:09:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94310267758352] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94310267767040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652024d20 con 0x7f53240cd060 2024-05-08T18:09:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652025b40 con 0x55c6520170b0 2024-05-08T18:09:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.483+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94310267762416] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94310267767040] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94310267764544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652025650 con 0x55c6520170b0 2024-05-08T18:09:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520263e0 con 0x7f5328031040 2024-05-08T18:09:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94310267771920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520264e0 con 0x7f5328031040 2024-05-08T18:09:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652026ea0 con 0x7f5328031040 2024-05-08T18:09:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.487+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94310267764544] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.491+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94310267771920] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.491+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.491+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94310267772976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652026450 con 0x7f5328031040 2024-05-08T18:09:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.491+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652027350 con 0x7f5328031040 2024-05-08T18:09:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.491+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94310267772976] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94310267775472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520272c0 con 0x7f5328031040 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=0 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=1 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=2 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=3 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=4 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=5 2024-05-08T18:09:09.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=6 2024-05-08T18:09:09.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94310267775472] v30'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 20 add_watcher() i=7 2024-05-08T18:09:09.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:09.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65202a6c0 con 0x55c6520170b0 2024-05-08T18:09:09.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94310267776992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652027b80 con 0x55c6520170b0 2024-05-08T18:09:09.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.495+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94310267776992] v30'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f51e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 5 note: GC not initialized 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f51e57e2640 20 reqs_thread_entry: start 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 Filter name: none 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f51de7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65204e0d0 con 0x55c6520170b0 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c65204ee60 con 0x7f53240cd060 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-08T18:09:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652054be0 con 0x55c6520170b0 2024-05-08T18:09:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v30'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94310267962960 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c652051750 con 0x55c6520170b0 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94310267764544 notify 128849018887 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55c651fde6f0 con 0x55c6520170b0 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94310267764544 notifier 4387 bl.length()=849 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5212ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(65 notify.4 [notify cookie 94310267962960 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.499+0000 7f5212ffd640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f51f4003eb0 con 0x55c6520170b0 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94310267962960 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c651fdbab0 con 0x55c6520170b0 2024-05-08T18:09:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652054650 con 0x7f53240cd060 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f5331c3b980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f5331c3b980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f5331c3b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94310267962960 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c652051750 con 0x7f53240cd060 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== watch-notify(notify (1) cookie 94310267754384 notify 128849018883 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f5328014420 con 0x7f53240cd060 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.0 [notify cookie 94310267962960 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f52127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94310267754384 notifier 4387 bl.length()=166 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f52127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f52127fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f52127fc640 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f5158003410 con 0x7f53240cd060 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.503+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== watch-notify(notify_complete (2) cookie 94310267962960 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5328024860 con 0x7f53240cd060 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:09:09.503308Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f51e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94310267776992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c65204bdc0 con 0x55c6520170b0 2024-05-08T18:09:09.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94310267776992] v30'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94310267754384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c65204bdc0 con 0x7f53240cd060 2024-05-08T18:09:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94310267754384] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f5331c3b980 20 remove_watcher() i=0 2024-05-08T18:09:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f5331c3b980 2 removed watcher, disabling cache 2024-05-08T18:09:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.507+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94310267758352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c65204bdc0 con 0x55c6520170b0 2024-05-08T18:09:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.511+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94310267758352] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.511+0000 7f5331c3b980 20 remove_watcher() i=1 2024-05-08T18:09:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.511+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94310267762416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c65204bdc0 con 0x55c65201cfe0 2024-05-08T18:09:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.511+0000 7f532ef4e640 1 -- 172.21.15.114:0/3950910191 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94310267762416] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f53240ca030 con 0x55c65201cfe0 2024-05-08T18:09:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.511+0000 7f5331c3b980 20 remove_watcher() i=2 2024-05-08T18:09:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.511+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94310267767040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520236f0 con 0x7f53240cd060 2024-05-08T18:09:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.515+0000 7f532ff50640 1 -- 172.21.15.114:0/3950910191 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94310267767040] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5328040040 con 0x7f53240cd060 2024-05-08T18:09:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.515+0000 7f5331c3b980 20 remove_watcher() i=3 2024-05-08T18:09:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.515+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94310267764544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652024900 con 0x55c6520170b0 2024-05-08T18:09:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.515+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94310267764544] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x55c6520170b0 2024-05-08T18:09:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.515+0000 7f5331c3b980 20 remove_watcher() i=4 2024-05-08T18:09:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.515+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94310267771920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c6520236f0 con 0x7f5328031040 2024-05-08T18:09:09.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.519+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94310267771920] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.519+0000 7f5331c3b980 20 remove_watcher() i=5 2024-05-08T18:09:09.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.519+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94310267772976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652023f40 con 0x7f5328031040 2024-05-08T18:09:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.519+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94310267772976] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.519+0000 7f5331c3b980 20 remove_watcher() i=6 2024-05-08T18:09:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.519+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94310267775472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c652024900 con 0x7f5328031040 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94310267775472] v30'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5320008040 con 0x7f5328031040 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 20 remove_watcher() i=7 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5328031040 msgr2=0x7f5328032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5328031040 0x7f5328032940 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c6520170b0 msgr2=0x55c652019550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c6520170b0 0x55c652019550 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f53240cd060 msgr2=0x7f53240db450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f53240cd060 0x7f53240db450 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c65201cfe0 msgr2=0x55c65201f4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c65201cfe0 0x55c65201f4a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f51f80383f0 msgr2=0x7f51f803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f51f80383f0 0x7f51f803a8b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x55c651fdf860 tx=0x7f532801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 msgr2=0x55c65200bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c65200bd80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f53240b8740 tx=0x7f53240e9080 comp rx=0 tx=0).stop 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f532f74f640 1 -- 172.21.15.114:0/3950910191 reap_dead start 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 shutdown_connections 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/3950910191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c652000450 0x55c65200bd80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 >> 172.21.15.114:0/3950910191 conn(0x55c651ffc790 msgr2=0x55c651ff9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 shutdown_connections 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/3950910191 wait complete. 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f52080383f0 msgr2=0x7f520803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f52080383f0 0x7f520803a8b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x55c651fe36b0 tx=0x7f5328005850 comp rx=0 tx=0).stop 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 msgr2=0x55c651ff3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 0x55c651ff3770 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f532400a480 tx=0x7f5324018020 comp rx=0 tx=0).stop 2024-05-08T18:09:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 shutdown_connections 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f52080383f0 0x7f520803a8b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/2630926447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ff3350 0x55c651ff3770 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 >> 172.21.15.114:0/2630926447 conn(0x55c651fe8160 msgr2=0x55c651fe8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 shutdown_connections 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/2630926447 wait complete. 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c651fe01c0 msgr2=0x55c651fe25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c651fe01c0 0x55c651fe25b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5214038440 msgr2=0x7f521403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5214038440 0x7f521403a900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f53240ad000 tx=0x7f53240a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 msgr2=0x55c651fdb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fdb2e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5320000c10 tx=0x7f532000d050 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 shutdown_connections 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c651fe01c0 0x55c651fe25b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5214038440 0x7f521403a900 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 --2- 172.21.15.114:0/408295888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c651ee9d60 0x55c651fdb2e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 >> 172.21.15.114:0/408295888 conn(0x55c651ee5630 msgr2=0x55c651fcf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 shutdown_connections 2024-05-08T18:09:09.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.523+0000 7f5331c3b980 1 -- 172.21.15.114:0/408295888 wait complete. 2024-05-08T18:09:09.535 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:09:09.503308Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:09.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:09:09.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:09:09.536 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:09:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f357f980 1 Processor -- start 2024-05-08T18:09:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f357f980 1 -- start start 2024-05-08T18:09:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f357f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5617cb38b7e0 0x5617cb41bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f357f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617cb2c2710 con 0x5617cb41c4f0 2024-05-08T18:09:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f357f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5617cb2d6f00 con 0x5617cb38b7e0 2024-05-08T18:09:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f1093640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5617cb38b7e0 0x5617cb41bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f0892640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5617cb41c4f0 0x5617cb41e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34558/0 (socket says 172.21.15.114:34558) 2024-05-08T18:09:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f1093640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5617cb38b7e0 0x5617cb41bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57670/0 (socket says 172.21.15.114:57670) 2024-05-08T18:09:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f0892640 1 -- 172.21.15.114:0/1922335983 learned_addr learned my addr 172.21.15.114:0/1922335983 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.615+0000 7fb0f1093640 1 -- 172.21.15.114:0/1922335983 >> v1:172.21.15.53:6789/0 conn(0x5617cb41c4f0 legacy=0x5617cb41e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f1093640 1 -- 172.21.15.114:0/1922335983 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cb29eae0 con 0x5617cb38b7e0 2024-05-08T18:09:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f1093640 1 --2- 172.21.15.114:0/1922335983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb41bfb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400a420 tx=0x7fb0e401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8939733a909496b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1922335983 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e40af070 con 0x5617cb38b7e0 2024-05-08T18:09:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1922335983 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e40aa530 con 0x5617cb38b7e0 2024-05-08T18:09:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0ebfff640 1 -- 172.21.15.114:0/1922335983 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e40aa850 con 0x5617cb38b7e0 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 -- 172.21.15.114:0/1922335983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 msgr2=0x5617cb41bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1922335983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb41bfb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400a420 tx=0x7fb0e401afd0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 -- 172.21.15.114:0/1922335983 shutdown_connections 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1922335983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb41bfb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 -- 172.21.15.114:0/1922335983 >> 172.21.15.114:0/1922335983 conn(0x5617cb411690 msgr2=0x5617cb413ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 -- 172.21.15.114:0/1922335983 shutdown_connections 2024-05-08T18:09:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.619+0000 7fb0f357f980 1 -- 172.21.15.114:0/1922335983 wait complete. 2024-05-08T18:09:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.635+0000 7fb0f357f980 1 Processor -- start 2024-05-08T18:09:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.635+0000 7fb0f357f980 1 -- start start 2024-05-08T18:09:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.635+0000 7fb0f357f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb5041e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.635+0000 7fb0f357f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5617cb31af80 con 0x5617cb38b7e0 2024-05-08T18:09:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.635+0000 7fb0f1093640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb5041e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb5041e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57678/0 (socket says 172.21.15.114:57678) 2024-05-08T18:09:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 -- 172.21.15.114:0/1052615685 learned_addr learned my addr 172.21.15.114:0/1052615685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 -- 172.21.15.114:0/1052615685 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cb2e2da0 con 0x5617cb38b7e0 2024-05-08T18:09:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 --2- 172.21.15.114:0/1052615685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb5041e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40aa500 tx=0x7fb0e40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653446868134e66f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fafdf606640 1 -- 172.21.15.114:0/1052615685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e40af040 con 0x5617cb38b7e0 2024-05-08T18:09:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fafdf606640 1 -- 172.21.15.114:0/1052615685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e40abb80 con 0x5617cb38b7e0 2024-05-08T18:09:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fafdf606640 1 -- 172.21.15.114:0/1052615685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e40b5470 con 0x5617cb38b7e0 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- 172.21.15.114:0/1052615685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 msgr2=0x5617cb5041e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1052615685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb5041e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40aa500 tx=0x7fb0e40033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- 172.21.15.114:0/1052615685 shutdown_connections 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1052615685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb5041e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- 172.21.15.114:0/1052615685 >> 172.21.15.114:0/1052615685 conn(0x5617cb411690 msgr2=0x5617cb4ffd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- 172.21.15.114:0/1052615685 shutdown_connections 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- 172.21.15.114:0/1052615685 wait complete. 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 Processor -- start 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- start start 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb50b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f357f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5617cb422a60 con 0x5617cb38b7e0 2024-05-08T18:09:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb50b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb50b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57680/0 (socket says 172.21.15.114:57680) 2024-05-08T18:09:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 -- 172.21.15.114:0/2745211394 learned_addr learned my addr 172.21.15.114:0/2745211394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cb50bab0 con 0x5617cb38b7e0 2024-05-08T18:09:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.639+0000 7fb0f1093640 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb50b570 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4017be0 tx=0x7fb0e4017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fafdde03640 1 -- 172.21.15.114:0/2745211394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e40b58f0 con 0x5617cb38b7e0 2024-05-08T18:09:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fafdde03640 1 -- 172.21.15.114:0/2745211394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0e40c6070 con 0x5617cb38b7e0 2024-05-08T18:09:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fafdde03640 1 -- 172.21.15.114:0/2745211394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0e40b5bc0 con 0x5617cb38b7e0 2024-05-08T18:09:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617cb50bd40 con 0x5617cb38b7e0 2024-05-08T18:09:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617cb50e9d0 con 0x5617cb38b7e0 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fafdde03640 1 -- 172.21.15.114:0/2745211394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb0e40c0440 con 0x5617cb38b7e0 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fafdde03640 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafd8038440 0x7fafd803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fafdde03640 1 -- 172.21.15.114:0/2745211394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb0e40bb070 con 0x5617cb38b7e0 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f0892640 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafd8038440 0x7fafd803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb41c4f0 0x5617cb5124b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb512b00 con 0x5617cb41c4f0 2024-05-08T18:09:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb41c4f0 0x5617cb5124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f0892640 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafd8038440 0x7fafd803a900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc001d80 tx=0x7fb0dc0012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb41c4f0 0x5617cb5124b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f1894640 1 -- 172.21.15.114:0/2745211394 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0ec0083f0 con 0x5617cb41c4f0 2024-05-08T18:09:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb50fbd0 con 0x5617cb41c4f0 2024-05-08T18:09:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f1894640 1 -- 172.21.15.114:0/2745211394 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0ec0083f0 con 0x5617cb41c4f0 2024-05-08T18:09:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb514970 con 0x5617cb41c4f0 2024-05-08T18:09:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f1894640 1 -- 172.21.15.114:0/2745211394 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0ec0083f0 con 0x5617cb41c4f0 2024-05-08T18:09:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.643+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb513ae0 con 0x5617cb41c4f0 2024-05-08T18:09:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f1894640 1 -- 172.21.15.114:0/2745211394 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0ec0083f0 con 0x5617cb41c4f0 2024-05-08T18:09:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb513f00 con 0x5617cb41c4f0 2024-05-08T18:09:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f1894640 1 -- 172.21.15.114:0/2745211394 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0ec0083f0 con 0x5617cb41c4f0 2024-05-08T18:09:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 Processor -- start 2024-05-08T18:09:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 -- start start 2024-05-08T18:09:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 0x5617cb5236e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5617cb31efc0 con 0x5617cb5232c0 2024-05-08T18:09:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f0892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 0x5617cb5236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f0892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 0x5617cb5236e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57694/0 (socket says 172.21.15.114:57694) 2024-05-08T18:09:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f0892640 1 -- 172.21.15.114:0/1267080514 learned_addr learned my addr 172.21.15.114:0/1267080514 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f0892640 1 -- 172.21.15.114:0/1267080514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cb523c20 con 0x5617cb5232c0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f0892640 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 0x5617cb5236e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00d660 tx=0x7fb0dc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fafd6ffd640 1 -- 172.21.15.114:0/1267080514 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc00c6b0 con 0x5617cb5232c0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fafd6ffd640 1 -- 172.21.15.114:0/1267080514 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00c850 con 0x5617cb5232c0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617cb5246c0 con 0x5617cb5232c0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fafd6ffd640 1 -- 172.21.15.114:0/1267080514 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc00cb30 con 0x5617cb5232c0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.647+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617cb524b90 con 0x5617cb5232c0 2024-05-08T18:09:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fafd6ffd640 1 -- 172.21.15.114:0/1267080514 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb0dc023020 con 0x5617cb5232c0 2024-05-08T18:09:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fafd6ffd640 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafcc0383f0 0x7fafcc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fafd6ffd640 1 -- 172.21.15.114:0/1267080514 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb0dc021020 con 0x5617cb5232c0 2024-05-08T18:09:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f1894640 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafcc0383f0 0x7fafcc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 Processor -- start 2024-05-08T18:09:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- start start 2024-05-08T18:09:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f1894640 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafcc0383f0 0x7fafcc03a8b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5617cb513e80 tx=0x7fb0ec003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb530920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5617cb504870 con 0x5617cb530500 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f0892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb530920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f0892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb530920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57708/0 (socket says 172.21.15.114:57708) 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f0892640 1 -- 172.21.15.114:0/1013537309 learned_addr learned my addr 172.21.15.114:0/1013537309 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f0892640 1 -- 172.21.15.114:0/1013537309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cb530ef0 con 0x5617cb530500 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f0892640 1 --2- 172.21.15.114:0/1013537309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb530920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc04f2c0 tx=0x7fb0dc0193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5d546c7f2fb5b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fafd4ff9640 1 -- 172.21.15.114:0/1013537309 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc01bcc0 con 0x5617cb530500 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fafd4ff9640 1 -- 172.21.15.114:0/1013537309 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc03e0d0 con 0x5617cb530500 2024-05-08T18:09:09.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fafd4ff9640 1 -- 172.21.15.114:0/1013537309 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc01be60 con 0x5617cb530500 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- 172.21.15.114:0/1013537309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 msgr2=0x5617cb530920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1013537309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb530920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc04f2c0 tx=0x7fb0dc0193e0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- 172.21.15.114:0/1013537309 shutdown_connections 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1013537309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb530920 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- 172.21.15.114:0/1013537309 >> 172.21.15.114:0/1013537309 conn(0x5617cb52c890 msgr2=0x5617cb52a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- 172.21.15.114:0/1013537309 shutdown_connections 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- 172.21.15.114:0/1013537309 wait complete. 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 Processor -- start 2024-05-08T18:09:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- start start 2024-05-08T18:09:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb537ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.651+0000 7fb0f357f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5617cb531640 con 0x5617cb530500 2024-05-08T18:09:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f0892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb537ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f0892640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb537ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57724/0 (socket says 172.21.15.114:57724) 2024-05-08T18:09:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 learned_addr learned my addr 172.21.15.114:0/2508318089 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617cb537ff0 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f0892640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb537ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0238a0 tx=0x7fb0dc04f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fafc2ffd640 1 -- 172.21.15.114:0/2508318089 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc04c070 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617cb538280 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fafc2ffd640 1 -- 172.21.15.114:0/2508318089 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc035070 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fafc2ffd640 1 -- 172.21.15.114:0/2508318089 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0dc01b8b0 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617cb538280 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fafc2ffd640 1 -- 172.21.15.114:0/2508318089 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb0dc03f050 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fafc2ffd640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafbc0383f0 0x7fafbc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fafc2ffd640 1 -- 172.21.15.114:0/2508318089 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb0dc005030 con 0x5617cb530500 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafbc0383f0 0x7fafbc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb542d50 0x5617cb5451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb545930 con 0x5617cb542d50 2024-05-08T18:09:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f1093640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb542d50 0x5617cb5451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafbc0383f0 0x7fafbc03a8b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5617cb513600 tx=0x7fb0ec01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f1093640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb542d50 0x5617cb5451e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 20 realm 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb545d40 con 0x5617cb542d50 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.655+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546610 con 0x5617cb542d50 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb5469b0 con 0x5617cb542d50 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546e10 con 0x5617cb542d50 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 20 searching for the correct realm 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5617cb548d80 0x5617cb54b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54b820 con 0x5617cb548d80 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f0892640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5617cb548d80 0x5617cb54b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f0892640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5617cb548d80 0x5617cb54b170 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f0892640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb0dc029bf0 0x7fb0dc0479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54b820 con 0x7fb0dc029bf0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb0dc029bf0 0x7fb0dc0479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb0dc029bf0 0x7fb0dc0479e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1894640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb0ec019040 0x7fb0ec019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54b820 con 0x7fb0ec019040 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb0ec019040 0x7fb0ec019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb0ec019040 0x7fb0ec019930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.659+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546e10 con 0x5617cb542d50 2024-05-08T18:09:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546e10 con 0x5617cb542d50 2024-05-08T18:09:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546e10 con 0x7fb0ec019040 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546e10 con 0x7fb0ec019040 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb542d50 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0ec019040 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb542d50 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.663+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0ec019040 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb542d50 2024-05-08T18:09:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb542d50 2024-05-08T18:09:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0ec019040 2024-05-08T18:09:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb542d50 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.667+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0ec019040 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0ec019040 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb548d80 2024-05-08T18:09:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0ec019040 2024-05-08T18:09:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x5617cb542d50 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7fb0e40e2040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb546e10 con 0x5617cb542d50 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.671+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb5476f0 con 0x5617cb542d50 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb5476f0 con 0x5617cb542d50 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 zone default found 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 4 Realm: () 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 zonegroup default 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb547b60 con 0x7fb0ec019040 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb547fa0 con 0x5617cb548d80 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54d680 con 0x5617cb548d80 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 started sync module instance, tier type = 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54cb20 con 0x7fb0dc029bf0 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94660195567216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54da20 con 0x7fb0dc029bf0 2024-05-08T18:09:09.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.675+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54e270 con 0x5617cb542d50 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94660195567216] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94660195569472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54df90 con 0x5617cb542d50 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54ea80 con 0x5617cb548d80 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94660195575120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54f320 con 0x5617cb548d80 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb54fd20 con 0x7fb0dc029bf0 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.679+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94660195569472] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94660195572256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb550110 con 0x7fb0dc029bf0 2024-05-08T18:09:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb550ad0 con 0x5617cb542d50 2024-05-08T18:09:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94660195575120] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94660195572256] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94660195579952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb550620 con 0x5617cb542d50 2024-05-08T18:09:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.683+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb551370 con 0x7fb0ec019040 2024-05-08T18:09:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94660195579952] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94660195577456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb551030 con 0x7fb0ec019040 2024-05-08T18:09:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb551880 con 0x7fb0ec019040 2024-05-08T18:09:09.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94660195577456] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94660195585168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb551680 con 0x7fb0ec019040 2024-05-08T18:09:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.687+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb552170 con 0x7fb0ec019040 2024-05-08T18:09:09.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94660195585168] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94660195589184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb552130 con 0x7fb0ec019040 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=0 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=1 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=2 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=3 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=4 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=5 2024-05-08T18:09:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f357f980 20 add_watcher() i=6 2024-05-08T18:09:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.691+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94660195589184] v30'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 add_watcher() i=7 2024-05-08T18:09:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555630 con 0x5617cb542d50 2024-05-08T18:09:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94660195586288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb552a40 con 0x5617cb542d50 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94660195586288] v30'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fafa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 5 note: GC not initialized 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fafa67e4640 20 reqs_thread_entry: start 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 Filter name: none 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7faf17fff640 20 reqs_thread_entry: start 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5617cb578b00 con 0x5617cb542d50 2024-05-08T18:09:09.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T18:09:09.697 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:09:09.503308Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fafa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.695+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94660195586288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb5790c0 con 0x5617cb542d50 2024-05-08T18:09:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94660195586288] v30'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94660195567216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x7fb0dc029bf0 2024-05-08T18:09:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94660195567216] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f357f980 20 remove_watcher() i=0 2024-05-08T18:09:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f357f980 2 removed watcher, disabling cache 2024-05-08T18:09:09.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94660195569472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x5617cb542d50 2024-05-08T18:09:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94660195569472] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f357f980 20 remove_watcher() i=1 2024-05-08T18:09:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.699+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94660195575120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x5617cb548d80 2024-05-08T18:09:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.703+0000 7fb0f0892640 1 -- 172.21.15.114:0/2508318089 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94660195575120] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0dc050b50 con 0x5617cb548d80 2024-05-08T18:09:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.703+0000 7fb0f357f980 20 remove_watcher() i=2 2024-05-08T18:09:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.703+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94660195572256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x7fb0dc029bf0 2024-05-08T18:09:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.703+0000 7fb0f1894640 1 -- 172.21.15.114:0/2508318089 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94660195572256] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0ec02f040 con 0x7fb0dc029bf0 2024-05-08T18:09:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.703+0000 7fb0f357f980 20 remove_watcher() i=3 2024-05-08T18:09:09.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.703+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94660195579952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x5617cb542d50 2024-05-08T18:09:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.707+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94660195579952] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x5617cb542d50 2024-05-08T18:09:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.707+0000 7fb0f357f980 20 remove_watcher() i=4 2024-05-08T18:09:09.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.707+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94660195577456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x7fb0ec019040 2024-05-08T18:09:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.707+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94660195577456] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.707+0000 7fb0f357f980 20 remove_watcher() i=5 2024-05-08T18:09:09.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.707+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94660195585168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x7fb0ec019040 2024-05-08T18:09:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94660195585168] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 20 remove_watcher() i=6 2024-05-08T18:09:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94660195589184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5617cb555080 con 0x7fb0ec019040 2024-05-08T18:09:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94660195589184] v30'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0e40b2040 con 0x7fb0ec019040 2024-05-08T18:09:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 20 remove_watcher() i=7 2024-05-08T18:09:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb0ec019040 msgr2=0x7fb0ec019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb0ec019040 0x7fb0ec019930 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb542d50 msgr2=0x5617cb5451e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb542d50 0x5617cb5451e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb0dc029bf0 msgr2=0x7fb0dc0479e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb0dc029bf0 0x7fb0dc0479e0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5617cb548d80 msgr2=0x5617cb54b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.711+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5617cb548d80 0x5617cb54b170 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafbc0383f0 msgr2=0x7fafbc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafbc0383f0 0x7fafbc03a8b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5617cb513600 tx=0x7fb0ec01b070 comp rx=0 tx=0).stop 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 msgr2=0x5617cb537ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f1093640 1 -- 172.21.15.114:0/2508318089 reap_dead start 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb537ab0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc0238a0 tx=0x7fb0dc04f220 comp rx=0 tx=0).stop 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 shutdown_connections 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2508318089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb530500 0x5617cb537ab0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 >> 172.21.15.114:0/2508318089 conn(0x5617cb52c890 msgr2=0x5617cb531d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 shutdown_connections 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2508318089 wait complete. 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafcc0383f0 msgr2=0x7fafcc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafcc0383f0 0x7fafcc03a8b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5617cb513e80 tx=0x7fb0ec003070 comp rx=0 tx=0).stop 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 msgr2=0x5617cb5236e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 0x5617cb5236e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00d660 tx=0x7fb0dc00da60 comp rx=0 tx=0).stop 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 shutdown_connections 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafcc0383f0 0x7fafcc03a8b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/1267080514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb5232c0 0x5617cb5236e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 >> 172.21.15.114:0/1267080514 conn(0x5617cb5180d0 msgr2=0x5617cb518be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 shutdown_connections 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/1267080514 wait complete. 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb41c4f0 msgr2=0x5617cb5124b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb41c4f0 0x5617cb5124b0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafd8038440 msgr2=0x7fafd803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafd8038440 0x7fafd803a900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc001d80 tx=0x7fb0dc0012e0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 msgr2=0x5617cb50b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb50b570 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4017be0 tx=0x7fb0e4017d70 comp rx=0 tx=0).stop 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 shutdown_connections 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5617cb41c4f0 0x5617cb5124b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fafd8038440 0x7fafd803a900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 --2- 172.21.15.114:0/2745211394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617cb38b7e0 0x5617cb50b570 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 >> 172.21.15.114:0/2745211394 conn(0x5617cb411690 msgr2=0x5617cb4fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 shutdown_connections 2024-05-08T18:09:09.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.715+0000 7fb0f357f980 1 -- 172.21.15.114:0/2745211394 wait complete. 2024-05-08T18:09:09.724 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:09:09.503308Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:09.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T18:09:09.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T18:09:09.725 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-08T18:09:09.801 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:09.801 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c40e4c980 1 Processor -- start 2024-05-08T18:09:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c40e4c980 1 -- start start 2024-05-08T18:09:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c40e4c980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564dbb480410 0x564dbb4807f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c40e4c980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564dbb32c710 con 0x564dbb480d30 2024-05-08T18:09:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c40e4c980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564dbb340f00 con 0x564dbb480410 2024-05-08T18:09:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c3e960640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564dbb480410 0x564dbb4807f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c3e960640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564dbb480410 0x564dbb4807f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57732/0 (socket says 172.21.15.114:57732) 2024-05-08T18:09:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c3e960640 1 -- 172.21.15.114:0/3681740254 learned_addr learned my addr 172.21.15.114:0/3681740254 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c3e15f640 1 --1- 172.21.15.114:0/3681740254 >> v1:172.21.15.53:6789/0 conn(0x564dbb480d30 0x564dbb481140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34564/0 (socket says 172.21.15.114:34564) 2024-05-08T18:09:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c3e960640 1 -- 172.21.15.114:0/3681740254 >> v1:172.21.15.53:6789/0 conn(0x564dbb480d30 legacy=0x564dbb481140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.803+0000 7f6c3e960640 1 -- 172.21.15.114:0/3681740254 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb308ae0 con 0x564dbb480410 2024-05-08T18:09:09.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c3e960640 1 --2- 172.21.15.114:0/3681740254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480410 0x564dbb4807f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000a4e0 tx=0x7f6c3001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4eeac544f56bee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c3d95e640 1 -- 172.21.15.114:0/3681740254 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300aa540 con 0x564dbb480410 2024-05-08T18:09:09.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c3d95e640 1 -- 172.21.15.114:0/3681740254 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c300aa6e0 con 0x564dbb480410 2024-05-08T18:09:09.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c3d95e640 1 -- 172.21.15.114:0/3681740254 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300aaa40 con 0x564dbb480410 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3681740254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480410 msgr2=0x564dbb4807f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3681740254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480410 0x564dbb4807f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000a4e0 tx=0x7f6c3001b090 comp rx=0 tx=0).stop 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3681740254 shutdown_connections 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3681740254 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480410 0x564dbb4807f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3681740254 >> 172.21.15.114:0/3681740254 conn(0x564dbb47add0 msgr2=0x564dbb47d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3681740254 shutdown_connections 2024-05-08T18:09:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.807+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3681740254 wait complete. 2024-05-08T18:09:09.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c40e4c980 1 Processor -- start 2024-05-08T18:09:09.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c40e4c980 1 -- start start 2024-05-08T18:09:09.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c40e4c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb56a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c40e4c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564dbb384f80 con 0x564dbb480d30 2024-05-08T18:09:09.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c3e960640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb56a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c3e960640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb56a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57748/0 (socket says 172.21.15.114:57748) 2024-05-08T18:09:09.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c3e960640 1 -- 172.21.15.114:0/3377683009 learned_addr learned my addr 172.21.15.114:0/3377683009 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.819+0000 7f6c3e960640 1 -- 172.21.15.114:0/3377683009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb34cda0 con 0x564dbb480d30 2024-05-08T18:09:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c3e960640 1 --2- 172.21.15.114:0/3377683009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb56a790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c30018cc0 tx=0x7f6c300033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84773001c806f85a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6b2ce09640 1 -- 172.21.15.114:0/3377683009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300b9030 con 0x564dbb480d30 2024-05-08T18:09:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6b2ce09640 1 -- 172.21.15.114:0/3377683009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c300aa9e0 con 0x564dbb480d30 2024-05-08T18:09:09.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6b2ce09640 1 -- 172.21.15.114:0/3377683009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300aad00 con 0x564dbb480d30 2024-05-08T18:09:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3377683009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 msgr2=0x564dbb56a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3377683009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb56a790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c30018cc0 tx=0x7f6c300033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3377683009 shutdown_connections 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3377683009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb56a790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3377683009 >> 172.21.15.114:0/3377683009 conn(0x564dbb47add0 msgr2=0x564dbb566280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3377683009 shutdown_connections 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3377683009 wait complete. 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 Processor -- start 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- start start 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb571c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564dbb47fba0 con 0x564dbb480d30 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c3e960640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb571c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c3e960640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb571c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57756/0 (socket says 172.21.15.114:57756) 2024-05-08T18:09:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c3e960640 1 -- 172.21.15.114:0/3767765186 learned_addr learned my addr 172.21.15.114:0/3767765186 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c3e960640 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb572160 con 0x564dbb480d30 2024-05-08T18:09:09.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c3e960640 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb571c20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c3001b570 tx=0x7f6c30017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6b2b606640 1 -- 172.21.15.114:0/3767765186 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300b9070 con 0x564dbb480d30 2024-05-08T18:09:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6b2b606640 1 -- 172.21.15.114:0/3767765186 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c300c2030 con 0x564dbb480d30 2024-05-08T18:09:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dbb5723f0 con 0x564dbb480d30 2024-05-08T18:09:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6b2b606640 1 -- 172.21.15.114:0/3767765186 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c300b5bb0 con 0x564dbb480d30 2024-05-08T18:09:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.823+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbb575080 con 0x564dbb480d30 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6b2b606640 1 -- 172.21.15.114:0/3767765186 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f6c300b3040 con 0x564dbb480d30 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6b2b606640 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b240383f0 0x7f6b2403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6b2b606640 1 -- 172.21.15.114:0/3767765186 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f6c30002050 con 0x564dbb480d30 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b240383f0 0x7f6b2403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb576b50 0x564dbb578f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb579520 con 0x564dbb576b50 2024-05-08T18:09:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb576b50 0x564dbb578f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b240383f0 0x7f6b2403a8b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800d450 tx=0x7f6c28008550 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb576b50 0x564dbb578f40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 -- 172.21.15.114:0/3767765186 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c380083f0 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb579e50 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 -- 172.21.15.114:0/3767765186 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c380083f0 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb57b200 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 -- 172.21.15.114:0/3767765186 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c380083f0 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb57a6a0 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 -- 172.21.15.114:0/3767765186 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c380083f0 con 0x564dbb576b50 2024-05-08T18:09:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb57aac0 con 0x564dbb576b50 2024-05-08T18:09:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c3f161640 1 -- 172.21.15.114:0/3767765186 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c380083f0 con 0x564dbb576b50 2024-05-08T18:09:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 Processor -- start 2024-05-08T18:09:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- start start 2024-05-08T18:09:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 0x564dbb58a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.827+0000 7f6c40e4c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564dbb388fc0 con 0x564dbb589d50 2024-05-08T18:09:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 0x564dbb58a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 0x564dbb58a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57762/0 (socket says 172.21.15.114:57762) 2024-05-08T18:09:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 -- 172.21.15.114:0/2171322331 learned_addr learned my addr 172.21.15.114:0/2171322331 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 -- 172.21.15.114:0/2171322331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb58a6b0 con 0x564dbb589d50 2024-05-08T18:09:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 0x564dbb58a170 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c28008790 tx=0x7f6c28000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6b28e01640 1 -- 172.21.15.114:0/2171322331 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2800be50 con 0x564dbb589d50 2024-05-08T18:09:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6b28e01640 1 -- 172.21.15.114:0/2171322331 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28015860 con 0x564dbb589d50 2024-05-08T18:09:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dbb58b150 con 0x564dbb589d50 2024-05-08T18:09:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6b28e01640 1 -- 172.21.15.114:0/2171322331 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28015b40 con 0x564dbb589d50 2024-05-08T18:09:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbb58b620 con 0x564dbb589d50 2024-05-08T18:09:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6b28e01640 1 -- 172.21.15.114:0/2171322331 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f6c2802b440 con 0x564dbb589d50 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6b28e01640 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b18038590 0x7f6b1803aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6b28e01640 1 -- 172.21.15.114:0/2171322331 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f6c2801e070 con 0x564dbb589d50 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3f161640 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b18038590 0x7f6b1803aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c40e4c980 1 Processor -- start 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3f161640 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b18038590 0x7f6b1803aa50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x564dbb57aa40 tx=0x7f6c38003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c40e4c980 1 -- start start 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c40e4c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb59b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c40e4c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564dbb56ae20 con 0x564dbb59b340 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb59b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb59b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57772/0 (socket says 172.21.15.114:57772) 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.831+0000 7f6c3e15f640 1 -- 172.21.15.114:0/2133127591 learned_addr learned my addr 172.21.15.114:0/2133127591 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 -- 172.21.15.114:0/2133127591 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb59bd30 con 0x564dbb59b340 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/2133127591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb59b760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c2802aa20 tx=0x7f6c2802aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318a70f829d7dcf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6b227fc640 1 -- 172.21.15.114:0/2133127591 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28046070 con 0x564dbb59b340 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6b227fc640 1 -- 172.21.15.114:0/2133127591 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28020dc0 con 0x564dbb59b340 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6b227fc640 1 -- 172.21.15.114:0/2133127591 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c2802a4d0 con 0x564dbb59b340 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2133127591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 msgr2=0x564dbb59b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/2133127591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb59b760 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c2802aa20 tx=0x7f6c2802aa90 comp rx=0 tx=0).stop 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2133127591 shutdown_connections 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/2133127591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb59b760 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2133127591 >> 172.21.15.114:0/2133127591 conn(0x564dbb5932c0 msgr2=0x564dbb591320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2133127591 shutdown_connections 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2133127591 wait complete. 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 Processor -- start 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- start start 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb5a28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564dbb59c480 con 0x564dbb59b340 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb5a28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb5a28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57782/0 (socket says 172.21.15.114:57782) 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 learned_addr learned my addr 172.21.15.114:0/888744909 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dbb5a2df0 con 0x564dbb59b340 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb5a28b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c28015fd0 tx=0x7f6c28050de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6b20ff9640 1 -- 172.21.15.114:0/888744909 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28046070 con 0x564dbb59b340 2024-05-08T18:09:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564dbb5a3080 con 0x564dbb59b340 2024-05-08T18:09:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6b20ff9640 1 -- 172.21.15.114:0/888744909 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c28047040 con 0x564dbb59b340 2024-05-08T18:09:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6b20ff9640 1 -- 172.21.15.114:0/888744909 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c28006c90 con 0x564dbb59b340 2024-05-08T18:09:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.835+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dbb5a5d60 con 0x564dbb59b340 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6b20ff9640 1 -- 172.21.15.114:0/888744909 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f6c2802b730 con 0x564dbb59b340 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6b20ff9640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b080383f0 0x7f6b0803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6b20ff9640 1 -- 172.21.15.114:0/888744909 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f6c28012070 con 0x564dbb59b340 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3f161640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b080383f0 0x7f6b0803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb5addb0 0x564dbb5b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b09a0 con 0x564dbb5addb0 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb5addb0 0x564dbb5b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3f161640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b080383f0 0x7f6b0803a8b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800f010 tx=0x7f6c3801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb5addb0 0x564dbb5b0250 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 realm 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b0db0 con 0x564dbb5addb0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b1680 con 0x564dbb5addb0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b1a20 con 0x564dbb5addb0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b2270 con 0x564dbb5addb0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 20 searching for the correct realm 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564dbb5b3fe0 0x564dbb5b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x564dbb5b3fe0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564dbb5b3fe0 0x564dbb5b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564dbb5b3fe0 0x564dbb5b63d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e15f640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6c28052be0 0x7f6c280520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x7f6c28052be0 2024-05-08T18:09:09.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.839+0000 7f6c3f161640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6c28052be0 0x7f6c280520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3f161640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6c28052be0 0x7f6c280520d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3f161640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f6c38019040 0x7f6c38019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x7f6c38019040 2024-05-08T18:09:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f6c38019040 0x7f6c38019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f6c38019040 0x7f6c38019930 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x564dbb5addb0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x564dbb5addb0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x7f6c38019040 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b6910 con 0x7f6c38019040 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c28052be0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.843+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5addb0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c38019040 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5addb0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c28052be0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c38019040 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5addb0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5addb0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.847+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c38019040 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c28052be0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5addb0 2024-05-08T18:09:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c300ce070 con 0x564dbb5addb0 2024-05-08T18:09:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c38019040 2024-05-08T18:09:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ce070 con 0x7f6c38019040 2024-05-08T18:09:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c38019040 2024-05-08T18:09:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c28052be0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5b3fe0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c38019040 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.851+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x564dbb5addb0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f6c300e2040 con 0x7f6c28052be0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b2ac0 con 0x564dbb5addb0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b2eb0 con 0x564dbb5addb0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b2eb0 con 0x564dbb5addb0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 zone default found 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 4 Realm: () 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 zonegroup default 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b26d0 con 0x7f6c38019040 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b8720 con 0x564dbb5b3fe0 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b8ac0 con 0x564dbb5b3fe0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 started sync module instance, tier type = 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b7bc0 con 0x7f6c28052be0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94891855804176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b8e60 con 0x7f6c28052be0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.855+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b9820 con 0x564dbb5addb0 2024-05-08T18:09:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94891855804176] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94891855806432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b9820 con 0x564dbb5addb0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5ba1e0 con 0x564dbb5b3fe0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94891855806432] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.859+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94891855811440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b9790 con 0x564dbb5b3fe0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5baee0 con 0x7f6c28052be0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94891855817536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bb630 con 0x7f6c28052be0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bc150 con 0x564dbb5addb0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94891855817536] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94891855811440] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94891855816064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bc110 con 0x564dbb5addb0 2024-05-08T18:09:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.863+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bc540 con 0x7f6c38019040 2024-05-08T18:09:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94891855816064] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94891855821856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bc4d0 con 0x7f6c38019040 2024-05-08T18:09:09.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bcf50 con 0x7f6c38019040 2024-05-08T18:09:09.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94891855825568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bd370 con 0x7f6c38019040 2024-05-08T18:09:09.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.867+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bddb0 con 0x7f6c38019040 2024-05-08T18:09:09.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94891855821856] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94891855829120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bdd70 con 0x7f6c38019040 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=0 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=1 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=2 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=3 2024-05-08T18:09:09.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=4 2024-05-08T18:09:09.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=5 2024-05-08T18:09:09.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94891855825568] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=6 2024-05-08T18:09:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94891855829120] v30'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 20 add_watcher() i=7 2024-05-08T18:09:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.871+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bb0f0 con 0x564dbb5addb0 2024-05-08T18:09:09.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94891855826624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bb0f0 con 0x564dbb5addb0 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94891855826624] v30'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 5 note: GC not initialized 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6a6ffff640 20 reqs_thread_entry: start 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 20 Filter name: none 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6a6dffb640 20 reqs_thread_entry: start 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e4650 con 0x564dbb5addb0 2024-05-08T18:09:09.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T18:09:09.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:09.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:09.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:09.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5eb240 con 0x564dbb5addb0 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v30'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94891856014512 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e6990 con 0x564dbb5addb0 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94891855816064 notify 128849018888 ret 0) ==== 800+0+0 (crc 0 0 0) 0x564dbb575080 con 0x564dbb5addb0 2024-05-08T18:09:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6b227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94891855816064 notifier 4401 bl.length()=758 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6b227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6b227fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 94891856014512 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6b227fc640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6b04003eb0 con 0x564dbb5addb0 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.875+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94891856014512 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564dbb5723f0 con 0x564dbb5addb0 2024-05-08T18:09:09.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5eacb0 con 0x564dbb5addb0 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(66 foo:foo1 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c40e4c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94891856014512 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e64e0 con 0x7f6c28052be0 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== watch-notify(notify (1) cookie 94891855804176 notify 128849018884 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f6c38010040 con 0x7f6c28052be0 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6b227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94891855804176 notifier 4401 bl.length()=159 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.0 [notify cookie 94891856014512 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6b227fc640 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f6b04003eb0 con 0x7f6c28052be0 2024-05-08T18:09:09.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== watch-notify(notify_complete (2) cookie 94891856014512 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6c380267b0 con 0x7f6c28052be0 2024-05-08T18:09:09.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.881 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:09:09.503308Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6af57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94891855826624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e2380 con 0x564dbb5addb0 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94891855826624] v30'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.879+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94891855804176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e2380 con 0x7f6c28052be0 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94891855804176] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c40e4c980 20 remove_watcher() i=0 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c40e4c980 2 removed watcher, disabling cache 2024-05-08T18:09:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94891855806432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e2380 con 0x564dbb5addb0 2024-05-08T18:09:09.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94891855806432] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c40e4c980 20 remove_watcher() i=1 2024-05-08T18:09:09.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.883+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94891855811440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5e2380 con 0x564dbb5b3fe0 2024-05-08T18:09:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c3e15f640 1 -- 172.21.15.114:0/888744909 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94891855811440] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c28028020 con 0x564dbb5b3fe0 2024-05-08T18:09:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c40e4c980 20 remove_watcher() i=2 2024-05-08T18:09:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94891855817536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b9370 con 0x7f6c28052be0 2024-05-08T18:09:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c3f161640 1 -- 172.21.15.114:0/888744909 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94891855817536] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c3802f040 con 0x7f6c28052be0 2024-05-08T18:09:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c40e4c980 20 remove_watcher() i=3 2024-05-08T18:09:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94891855816064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bab40 con 0x564dbb5addb0 2024-05-08T18:09:09.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94891855816064] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x564dbb5addb0 2024-05-08T18:09:09.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c40e4c980 20 remove_watcher() i=4 2024-05-08T18:09:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.887+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94891855821856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5b9370 con 0x7f6c38019040 2024-05-08T18:09:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.891+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94891855821856] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.891+0000 7f6c40e4c980 20 remove_watcher() i=5 2024-05-08T18:09:09.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.891+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94891855825568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bab40 con 0x7f6c38019040 2024-05-08T18:09:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.891+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94891855825568] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 20 remove_watcher() i=6 2024-05-08T18:09:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94891855829120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x564dbb5bbc20 con 0x7f6c38019040 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94891855829120] v30'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c300ef040 con 0x7f6c38019040 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 20 remove_watcher() i=7 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f6c38019040 msgr2=0x7f6c38019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f6c38019040 0x7f6c38019930 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb5addb0 msgr2=0x564dbb5b0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb5addb0 0x564dbb5b0250 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6c28052be0 msgr2=0x7f6c280520d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f6c28052be0 0x7f6c280520d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564dbb5b3fe0 msgr2=0x564dbb5b63d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564dbb5b3fe0 0x564dbb5b63d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b080383f0 msgr2=0x7f6b0803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b080383f0 0x7f6b0803a8b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800f010 tx=0x7f6c3801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 msgr2=0x564dbb5a28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c3e960640 1 -- 172.21.15.114:0/888744909 reap_dead start 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb5a28b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6c28015fd0 tx=0x7f6c28050de0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 shutdown_connections 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/888744909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb59b340 0x564dbb5a28b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 >> 172.21.15.114:0/888744909 conn(0x564dbb5932c0 msgr2=0x564dbb59cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 shutdown_connections 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/888744909 wait complete. 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b18038590 msgr2=0x7f6b1803aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b18038590 0x7f6b1803aa50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x564dbb57aa40 tx=0x7f6c38003070 comp rx=0 tx=0).stop 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 msgr2=0x564dbb58a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 0x564dbb58a170 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c28008790 tx=0x7f6c28000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 shutdown_connections 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b18038590 0x7f6b1803aa50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/2171322331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb589d50 0x564dbb58a170 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 >> 172.21.15.114:0/2171322331 conn(0x564dbb57eb60 msgr2=0x564dbb57f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 shutdown_connections 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/2171322331 wait complete. 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb576b50 msgr2=0x564dbb578f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb576b50 0x564dbb578f40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b240383f0 msgr2=0x7f6b2403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b240383f0 0x7f6b2403a8b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800d450 tx=0x7f6c28008550 comp rx=0 tx=0).stop 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 msgr2=0x564dbb571c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb571c20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c3001b570 tx=0x7f6c30017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 shutdown_connections 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564dbb576b50 0x564dbb578f40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6b240383f0 0x7f6b2403a8b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 --2- 172.21.15.114:0/3767765186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564dbb480d30 0x564dbb571c20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 >> 172.21.15.114:0/3767765186 conn(0x564dbb47add0 msgr2=0x564dbb564d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 shutdown_connections 2024-05-08T18:09:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.895+0000 7f6c40e4c980 1 -- 172.21.15.114:0/3767765186 wait complete. 2024-05-08T18:09:09.906 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:09:09.503308Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:09.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T18:09:09.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T18:09:09.907 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-08T18:09:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:09.976 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa28656980 1 Processor -- start 2024-05-08T18:09:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa28656980 1 -- start start 2024-05-08T18:09:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa28656980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b6b634c840 0x55b6b634ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa28656980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b6b6281710 con 0x55b6b634b380 2024-05-08T18:09:09.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa28656980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b6b6295f00 con 0x55b6b634c840 2024-05-08T18:09:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa2616a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b6b634c840 0x55b6b634ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa2616a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b6b634c840 0x55b6b634ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57798/0 (socket says 172.21.15.114:57798) 2024-05-08T18:09:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.975+0000 7ffa2616a640 1 -- 172.21.15.114:0/1328211050 learned_addr learned my addr 172.21.15.114:0/1328211050 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa2616a640 1 -- 172.21.15.114:0/1328211050 >> v1:172.21.15.53:6789/0 conn(0x55b6b634b380 legacy=0x55b6b63e26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa2616a640 1 -- 172.21.15.114:0/1328211050 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b625dae0 con 0x55b6b634c840 2024-05-08T18:09:09.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa2616a640 1 --2- 172.21.15.114:0/1328211050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634c840 0x55b6b634ae40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000a4e0 tx=0x7ffa2001aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d38d945c9d0223 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa25168640 1 -- 172.21.15.114:0/1328211050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa200ab410 con 0x55b6b634c840 2024-05-08T18:09:09.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa25168640 1 -- 172.21.15.114:0/1328211050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa200a7070 con 0x55b6b634c840 2024-05-08T18:09:09.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa25168640 1 -- 172.21.15.114:0/1328211050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa200ab760 con 0x55b6b634c840 2024-05-08T18:09:09.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 -- 172.21.15.114:0/1328211050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634c840 msgr2=0x55b6b634ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 --2- 172.21.15.114:0/1328211050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634c840 0x55b6b634ae40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000a4e0 tx=0x7ffa2001aeb0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 -- 172.21.15.114:0/1328211050 shutdown_connections 2024-05-08T18:09:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 --2- 172.21.15.114:0/1328211050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634c840 0x55b6b634ae40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 -- 172.21.15.114:0/1328211050 >> 172.21.15.114:0/1328211050 conn(0x55b6b63d17d0 msgr2=0x55b6b63d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 -- 172.21.15.114:0/1328211050 shutdown_connections 2024-05-08T18:09:09.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.979+0000 7ffa28656980 1 -- 172.21.15.114:0/1328211050 wait complete. 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.991+0000 7ffa28656980 1 Processor -- start 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.991+0000 7ffa28656980 1 -- start start 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b6b62d9f80 con 0x55b6b634b380 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57800/0 (socket says 172.21.15.114:57800) 2024-05-08T18:09:09.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 -- 172.21.15.114:0/2290494987 learned_addr learned my addr 172.21.15.114:0/2290494987 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 -- 172.21.15.114:0/2290494987 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b62a1da0 con 0x55b6b634b380 2024-05-08T18:09:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 --2- 172.21.15.114:0/2290494987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64c8080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa20017ac0 tx=0x7ffa200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c51ad1ffb34d08b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ff914608640 1 -- 172.21.15.114:0/2290494987 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa200ab540 con 0x55b6b634b380 2024-05-08T18:09:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ff914608640 1 -- 172.21.15.114:0/2290494987 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa200ab6e0 con 0x55b6b634b380 2024-05-08T18:09:09.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ff914608640 1 -- 172.21.15.114:0/2290494987 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa200ab9e0 con 0x55b6b634b380 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- 172.21.15.114:0/2290494987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 msgr2=0x55b6b64c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 --2- 172.21.15.114:0/2290494987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64c8080 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffa20017ac0 tx=0x7ffa200033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- 172.21.15.114:0/2290494987 shutdown_connections 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 --2- 172.21.15.114:0/2290494987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64c8080 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- 172.21.15.114:0/2290494987 >> 172.21.15.114:0/2290494987 conn(0x55b6b63d17d0 msgr2=0x55b6b64c3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- 172.21.15.114:0/2290494987 shutdown_connections 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- 172.21.15.114:0/2290494987 wait complete. 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 Processor -- start 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- start start 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa28656980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b6b63e6870 con 0x55b6b634b380 2024-05-08T18:09:09.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:09.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57816/0 (socket says 172.21.15.114:57816) 2024-05-08T18:09:09.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.995+0000 7ffa2616a640 1 -- 172.21.15.114:0/797634438 learned_addr learned my addr 172.21.15.114:0/797634438 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2616a640 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b64cf880 con 0x55b6b634b380 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2616a640 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64cf340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffa20017ac0 tx=0x7ffa20017c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ff912e05640 1 -- 172.21.15.114:0/797634438 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa200c3020 con 0x55b6b634b380 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ff912e05640 1 -- 172.21.15.114:0/797634438 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa200bf470 con 0x55b6b634b380 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6b64cfb10 con 0x55b6b634b380 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ff912e05640 1 -- 172.21.15.114:0/797634438 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa200ab540 con 0x55b6b634b380 2024-05-08T18:09:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b64d27a0 con 0x55b6b634b380 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ff912e05640 1 -- 172.21.15.114:0/797634438 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ffa200c6020 con 0x55b6b634b380 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ff912e05640 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff90c038440 0x7ff90c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ff912e05640 1 -- 172.21.15.114:0/797634438 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ffa200ba040 con 0x55b6b634b380 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa25969640 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff90c038440 0x7ff90c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b634c840 0x55b6b64d63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b64d69c0 con 0x55b6b634c840 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2696b640 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b634c840 0x55b6b64d63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa25969640 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff90c038440 0x7ff90c03a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001e60 tx=0x7ffa1c0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2696b640 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b634c840 0x55b6b64d63f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2696b640 1 -- 172.21.15.114:0/797634438 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa180083f0 con 0x55b6b634c840 2024-05-08T18:09:10.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b64d7260 con 0x55b6b634c840 2024-05-08T18:09:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2696b640 1 -- 172.21.15.114:0/797634438 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa180083f0 con 0x55b6b634c840 2024-05-08T18:09:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b64d8610 con 0x55b6b634c840 2024-05-08T18:09:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:09.999+0000 7ffa2696b640 1 -- 172.21.15.114:0/797634438 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffa180083f0 con 0x55b6b634c840 2024-05-08T18:09:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b64d7ab0 con 0x55b6b634c840 2024-05-08T18:09:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa2696b640 1 -- 172.21.15.114:0/797634438 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa180083f0 con 0x55b6b634c840 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b64d7f00 con 0x55b6b634c840 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa2696b640 1 -- 172.21.15.114:0/797634438 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffa180083f0 con 0x55b6b634c840 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 Processor -- start 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 -- start start 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 0x55b6b64e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b6b62ddfc0 con 0x55b6b64e7120 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa25969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 0x55b6b64e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa25969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 0x55b6b64e7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57824/0 (socket says 172.21.15.114:57824) 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa25969640 1 -- 172.21.15.114:0/2115727359 learned_addr learned my addr 172.21.15.114:0/2115727359 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa25969640 1 -- 172.21.15.114:0/2115727359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b64e7a80 con 0x55b6b64e7120 2024-05-08T18:09:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa25969640 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 0x55b6b64e7540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c010f90 tx=0x7ffa1c00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ff90bfff640 1 -- 172.21.15.114:0/2115727359 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c00a040 con 0x55b6b64e7120 2024-05-08T18:09:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6b64e8520 con 0x55b6b64e7120 2024-05-08T18:09:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b64e89f0 con 0x55b6b64e7120 2024-05-08T18:09:10.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ff90bfff640 1 -- 172.21.15.114:0/2115727359 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c017050 con 0x55b6b64e7120 2024-05-08T18:09:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.003+0000 7ff90bfff640 1 -- 172.21.15.114:0/2115727359 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c00e7e0 con 0x55b6b64e7120 2024-05-08T18:09:10.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ff90bfff640 1 -- 172.21.15.114:0/2115727359 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ffa1c00e980 con 0x55b6b64e7120 2024-05-08T18:09:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ff90bfff640 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff9000383f0 0x7ff90003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ff90bfff640 1 -- 172.21.15.114:0/2115727359 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ffa1c0505f0 con 0x55b6b64e7120 2024-05-08T18:09:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa2696b640 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff9000383f0 0x7ff90003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 Processor -- start 2024-05-08T18:09:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- start start 2024-05-08T18:09:10.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa2696b640 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff9000383f0 0x7ff90003a8b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800e3f0 tx=0x7ffa18003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b6b64c8710 con 0x55b6b64f42d0 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64f46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57836/0 (socket says 172.21.15.114:57836) 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 -- 172.21.15.114:0/2615610423 learned_addr learned my addr 172.21.15.114:0/2615610423 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 -- 172.21.15.114:0/2615610423 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b64f4cc0 con 0x55b6b64f42d0 2024-05-08T18:09:10.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 --2- 172.21.15.114:0/2615610423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64f46f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c01cfd0 tx=0x7ffa1c023660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7c171e67b71d63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ff909ffb640 1 -- 172.21.15.114:0/2615610423 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c043070 con 0x55b6b64f42d0 2024-05-08T18:09:10.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ff909ffb640 1 -- 172.21.15.114:0/2615610423 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c04c070 con 0x55b6b64f42d0 2024-05-08T18:09:10.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ff909ffb640 1 -- 172.21.15.114:0/2615610423 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c01a310 con 0x55b6b64f42d0 2024-05-08T18:09:10.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- 172.21.15.114:0/2615610423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 msgr2=0x55b6b64f46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 --2- 172.21.15.114:0/2615610423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64f46f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c01cfd0 tx=0x7ffa1c023660 comp rx=0 tx=0).stop 2024-05-08T18:09:10.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- 172.21.15.114:0/2615610423 shutdown_connections 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 --2- 172.21.15.114:0/2615610423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64f46f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- 172.21.15.114:0/2615610423 >> 172.21.15.114:0/2615610423 conn(0x55b6b64f0660 msgr2=0x55b6b64ee6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- 172.21.15.114:0/2615610423 shutdown_connections 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- 172.21.15.114:0/2615610423 wait complete. 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 Processor -- start 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- start start 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64fb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa28656980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b6b64f5410 con 0x55b6b64f42d0 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64fb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64fb840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57850/0 (socket says 172.21.15.114:57850) 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.007+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 learned_addr learned my addr 172.21.15.114:0/3928021703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6b64fbd80 con 0x55b6b64f42d0 2024-05-08T18:09:10.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa25969640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64fb840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c025c50 tx=0x7ffa1c04e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ff8f7fff640 1 -- 172.21.15.114:0/3928021703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c043070 con 0x55b6b64f42d0 2024-05-08T18:09:10.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b6b64fc010 con 0x55b6b64f42d0 2024-05-08T18:09:10.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6b64fecf0 con 0x55b6b64f42d0 2024-05-08T18:09:10.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ff8f7fff640 1 -- 172.21.15.114:0/3928021703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1c044040 con 0x55b6b64f42d0 2024-05-08T18:09:10.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ff8f7fff640 1 -- 172.21.15.114:0/3928021703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa1c01cb40 con 0x55b6b64f42d0 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ff8f7fff640 1 -- 172.21.15.114:0/3928021703 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ffa1c035030 con 0x55b6b64f42d0 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ff8f7fff640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff8f00383f0 0x7ff8f003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ff8f7fff640 1 -- 172.21.15.114:0/3928021703 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7ffa1c033020 con 0x55b6b64f42d0 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2696b640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff8f00383f0 0x7ff8f003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b6506d50 0x55b6b6509210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6509960 con 0x55b6b6506d50 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2616a640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b6506d50 0x55b6b6509210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2696b640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff8f00383f0 0x7ff8f003a8b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800f010 tx=0x7ffa1801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2616a640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b6506d50 0x55b6b6509210 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 realm 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6509d70 con 0x55b6b6506d50 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650a610 con 0x55b6b6506d50 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650a9b0 con 0x55b6b6506d50 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.011+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650b200 con 0x55b6b6506d50 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa28656980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa28656980 20 searching for the correct realm 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b6b650cf70 0x55b6b650f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa25969640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b6b650cf70 0x55b6b650f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa25969640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b6b650cf70 0x55b6b650f360 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa25969640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffa1c01c030 0x7ffa1c040a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa1c01c030 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2696b640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffa1c01c030 0x7ffa1c040a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2696b640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffa1c01c030 0x7ffa1c040a60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2696b640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffa18019040 0x7ffa18019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffa18019040 0x7ffa18019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffa18019040 0x7ffa18019930 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.015+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa1c01c030 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa1c01c030 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.019+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa1c01c030 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.023+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa1c01c030 2024-05-08T18:09:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b650cf70 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa18019040 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x55b6b6506d50 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650f8a0 con 0x7ffa1c01c030 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650bb50 con 0x55b6b6506d50 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650c3a0 con 0x55b6b6506d50 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650fcd0 con 0x55b6b6506d50 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 zone default found 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 4 Realm: () 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 zonegroup default 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b650bfc0 con 0x7ffa18019040 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6511be0 con 0x55b6b650cf70 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.027+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6511f80 con 0x55b6b650cf70 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 20 started sync module instance, tier type = 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6511080 con 0x7ffa1c01c030 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94243231175840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6510ce0 con 0x7ffa1c01c030 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6512e60 con 0x55b6b6506d50 2024-05-08T18:09:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94243231175840] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94243231179664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6512e60 con 0x55b6b6506d50 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.031+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6513820 con 0x55b6b650cf70 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94243231179664] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94243231181232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6512dd0 con 0x55b6b650cf70 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6514520 con 0x7ffa1c01c030 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94243231187328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6514dc0 con 0x7ffa1c01c030 2024-05-08T18:09:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.035+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65157c0 con 0x55b6b6506d50 2024-05-08T18:09:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94243231187328] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94243231181232] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94243231185856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6514910 con 0x55b6b6506d50 2024-05-08T18:09:10.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6516060 con 0x7ffa18019040 2024-05-08T18:09:10.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94243231185856] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94243231191760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6514910 con 0x7ffa18019040 2024-05-08T18:09:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.039+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65164b0 con 0x7ffa18019040 2024-05-08T18:09:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94243231191760] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94243231193568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65164b0 con 0x7ffa18019040 2024-05-08T18:09:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6516e70 con 0x7ffa18019040 2024-05-08T18:09:10.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94243231197632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6517290 con 0x7ffa18019040 2024-05-08T18:09:10.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 20 add_watcher() i=0 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 20 add_watcher() i=1 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 20 add_watcher() i=2 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 20 add_watcher() i=3 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 20 add_watcher() i=4 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.043+0000 7ffa28656980 20 add_watcher() i=5 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94243231193568] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 add_watcher() i=6 2024-05-08T18:09:10.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94243231197632] v30'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 add_watcher() i=7 2024-05-08T18:09:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6516000 con 0x55b6b6506d50 2024-05-08T18:09:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94243231195136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65177a0 con 0x55b6b6506d50 2024-05-08T18:09:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94243231195136] v30'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ff8dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 5 note: GC not initialized 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ff8577fe640 20 reqs_thread_entry: start 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 Filter name: none 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ff8557fa640 20 reqs_thread_entry: start 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.047+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b653dcf0 con 0x55b6b6506d50 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 20 rados_obj.operate() r=0 bl.length=582 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b6544350 con 0x55b6b6506d50 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v30'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:10.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94243231382976 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b6b653fcf0 con 0x55b6b6506d50 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94243231185856 notify 128849018889 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55b6b64d27a0 con 0x55b6b6506d50 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ff909ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94243231185856 notifier 4408 bl.length()=732 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 94243231382976 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ff909ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ff909ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ff909ffb640 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7ff8ec003eb0 con 0x55b6b6506d50 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94243231382976 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b6b64cfb10 con 0x55b6b6506d50 2024-05-08T18:09:10.053 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T18:09:09.503308Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ff8dcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94243231195136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b653ba20 con 0x55b6b6506d50 2024-05-08T18:09:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94243231195136] v30'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.051+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94243231175840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b653ba20 con 0x7ffa1c01c030 2024-05-08T18:09:10.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94243231175840] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa28656980 20 remove_watcher() i=0 2024-05-08T18:09:10.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa28656980 2 removed watcher, disabling cache 2024-05-08T18:09:10.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94243231179664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b653ba20 con 0x55b6b6506d50 2024-05-08T18:09:10.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94243231179664] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa28656980 20 remove_watcher() i=1 2024-05-08T18:09:10.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.055+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94243231181232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b653ba20 con 0x55b6b650cf70 2024-05-08T18:09:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa25969640 1 -- 172.21.15.114:0/3928021703 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94243231181232] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1c00d040 con 0x55b6b650cf70 2024-05-08T18:09:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa28656980 20 remove_watcher() i=2 2024-05-08T18:09:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94243231187328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65129b0 con 0x7ffa1c01c030 2024-05-08T18:09:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa2696b640 1 -- 172.21.15.114:0/3928021703 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94243231187328] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa1802f040 con 0x7ffa1c01c030 2024-05-08T18:09:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa28656980 20 remove_watcher() i=3 2024-05-08T18:09:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94243231185856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65129b0 con 0x55b6b6506d50 2024-05-08T18:09:10.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94243231185856] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x55b6b6506d50 2024-05-08T18:09:10.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa28656980 20 remove_watcher() i=4 2024-05-08T18:09:10.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.059+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94243231191760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65129b0 con 0x7ffa18019040 2024-05-08T18:09:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.063+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94243231191760] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.063+0000 7ffa28656980 20 remove_watcher() i=5 2024-05-08T18:09:10.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.063+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94243231193568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65152d0 con 0x7ffa18019040 2024-05-08T18:09:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.063+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94243231193568] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.063+0000 7ffa28656980 20 remove_watcher() i=6 2024-05-08T18:09:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.063+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94243231197632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b6b65152d0 con 0x7ffa18019040 2024-05-08T18:09:10.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94243231197632] v30'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffa200bf930 con 0x7ffa18019040 2024-05-08T18:09:10.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 20 remove_watcher() i=7 2024-05-08T18:09:10.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffa18019040 msgr2=0x7ffa18019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffa18019040 0x7ffa18019930 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b6506d50 msgr2=0x55b6b6509210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b6506d50 0x55b6b6509210 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffa1c01c030 msgr2=0x7ffa1c040a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffa1c01c030 0x7ffa1c040a60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b6b650cf70 msgr2=0x55b6b650f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b6b650cf70 0x55b6b650f360 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff8f00383f0 msgr2=0x7ff8f003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff8f00383f0 0x7ff8f003a8b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800f010 tx=0x7ffa1801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa2616a640 1 -- 172.21.15.114:0/3928021703 reap_dead start 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 msgr2=0x55b6b64fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64fb840 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c025c50 tx=0x7ffa1c04e990 comp rx=0 tx=0).stop 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 shutdown_connections 2024-05-08T18:09:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/3928021703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64f42d0 0x55b6b64fb840 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 >> 172.21.15.114:0/3928021703 conn(0x55b6b64f0660 msgr2=0x55b6b64f5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 shutdown_connections 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/3928021703 wait complete. 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff9000383f0 msgr2=0x7ff90003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff9000383f0 0x7ff90003a8b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800e3f0 tx=0x7ffa18003070 comp rx=0 tx=0).stop 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 msgr2=0x55b6b64e7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 0x55b6b64e7540 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c010f90 tx=0x7ffa1c00f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 shutdown_connections 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff9000383f0 0x7ff90003a8b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/2115727359 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b64e7120 0x55b6b64e7540 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 >> 172.21.15.114:0/2115727359 conn(0x55b6b64dbf30 msgr2=0x55b6b64dca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 shutdown_connections 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/2115727359 wait complete. 2024-05-08T18:09:10.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b634c840 msgr2=0x55b6b64d63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b634c840 0x55b6b64d63f0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff90c038440 msgr2=0x7ff90c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff90c038440 0x7ff90c03a900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c001e60 tx=0x7ffa1c0013e0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 msgr2=0x55b6b64cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64cf340 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffa20017ac0 tx=0x7ffa20017c50 comp rx=0 tx=0).stop 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 shutdown_connections 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b6b634c840 0x55b6b64d63f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff90c038440 0x7ff90c03a900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 --2- 172.21.15.114:0/797634438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6b634b380 0x55b6b64cf340 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 >> 172.21.15.114:0/797634438 conn(0x55b6b63d17d0 msgr2=0x55b6b64c2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 shutdown_connections 2024-05-08T18:09:10.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.067+0000 7ffa28656980 1 -- 172.21.15.114:0/797634438 wait complete. 2024-05-08T18:09:10.077 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T18:09:09.503308Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:10.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T18:09:10.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T18:09:10.078 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-08T18:09:10.158 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:10.158 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:10.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf02a2a980 1 Processor -- start 2024-05-08T18:09:10.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf02a2a980 1 -- start start 2024-05-08T18:09:10.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf02a2a980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556b350b1090 0x556b350b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf02a2a980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b34f5a710 con 0x556b350b19b0 2024-05-08T18:09:10.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf02a2a980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x556b34f6ef00 con 0x556b350b1090 2024-05-08T18:09:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf0053e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x556b350b1090 0x556b350b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fceffd3d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x556b350b19b0 0x556b350b2320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34586/0 (socket says 172.21.15.114:34586) 2024-05-08T18:09:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fceffd3d640 1 -- 172.21.15.114:0/3620736253 learned_addr learned my addr 172.21.15.114:0/3620736253 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf0053e640 1 -- 172.21.15.114:0/3620736253 >> v1:172.21.15.53:6789/0 conn(0x556b350b19b0 legacy=0x556b350b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.159+0000 7fcf0053e640 1 -- 172.21.15.114:0/3620736253 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b34f36ae0 con 0x556b350b1090 2024-05-08T18:09:10.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf0053e640 1 --2- 172.21.15.114:0/3620736253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b350b1470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcef000a420 tx=0x7fcef001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e521defc92acbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fceff53c640 1 -- 172.21.15.114:0/3620736253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00af070 con 0x556b350b1090 2024-05-08T18:09:10.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fceff53c640 1 -- 172.21.15.114:0/3620736253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef00aa530 con 0x556b350b1090 2024-05-08T18:09:10.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fceff53c640 1 -- 172.21.15.114:0/3620736253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00aa850 con 0x556b350b1090 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3620736253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 msgr2=0x556b350b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3620736253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b350b1470 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcef000a420 tx=0x7fcef001afd0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3620736253 shutdown_connections 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3620736253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b350b1470 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3620736253 >> 172.21.15.114:0/3620736253 conn(0x556b35024770 msgr2=0x556b35024b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3620736253 shutdown_connections 2024-05-08T18:09:10.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.163+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3620736253 wait complete. 2024-05-08T18:09:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf02a2a980 1 Processor -- start 2024-05-08T18:09:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf02a2a980 1 -- start start 2024-05-08T18:09:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf02a2a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b3519c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf02a2a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b34fb2f80 con 0x556b350b1090 2024-05-08T18:09:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf0053e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b3519c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf0053e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b3519c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57876/0 (socket says 172.21.15.114:57876) 2024-05-08T18:09:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf0053e640 1 -- 172.21.15.114:0/19071919 learned_addr learned my addr 172.21.15.114:0/19071919 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf0053e640 1 -- 172.21.15.114:0/19071919 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b34f7ada0 con 0x556b350b1090 2024-05-08T18:09:10.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.175+0000 7fcf0053e640 1 --2- 172.21.15.114:0/19071919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b3519c800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcef000a420 tx=0x7fcef00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d625a8ad2dd103 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcdee60c640 1 -- 172.21.15.114:0/19071919 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00af050 con 0x556b350b1090 2024-05-08T18:09:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcdee60c640 1 -- 172.21.15.114:0/19071919 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef00b0040 con 0x556b350b1090 2024-05-08T18:09:10.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcdee60c640 1 -- 172.21.15.114:0/19071919 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00aac60 con 0x556b350b1090 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/19071919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 msgr2=0x556b3519c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/19071919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b3519c800 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcef000a420 tx=0x7fcef00033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/19071919 shutdown_connections 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/19071919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b3519c800 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/19071919 >> 172.21.15.114:0/19071919 conn(0x556b35024770 msgr2=0x556b35198390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/19071919 shutdown_connections 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/19071919 wait complete. 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 Processor -- start 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- start start 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b351a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b350bb090 con 0x556b350b1090 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf0053e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b351a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf0053e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b351a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57890/0 (socket says 172.21.15.114:57890) 2024-05-08T18:09:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf0053e640 1 -- 172.21.15.114:0/2125282825 learned_addr learned my addr 172.21.15.114:0/2125282825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf0053e640 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b351a4210 con 0x556b350b1090 2024-05-08T18:09:10.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf0053e640 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b351a3cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000f90 tx=0x7fcef0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcdece09640 1 -- 172.21.15.114:0/2125282825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00c5070 con 0x556b350b1090 2024-05-08T18:09:10.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b351a44a0 con 0x556b350b1090 2024-05-08T18:09:10.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b351a70e0 con 0x556b350b1090 2024-05-08T18:09:10.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcdece09640 1 -- 172.21.15.114:0/2125282825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef00c15b0 con 0x556b350b1090 2024-05-08T18:09:10.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.179+0000 7fcdece09640 1 -- 172.21.15.114:0/2125282825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef00cf060 con 0x556b350b1090 2024-05-08T18:09:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcdece09640 1 -- 172.21.15.114:0/2125282825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcef00c8070 con 0x556b350b1090 2024-05-08T18:09:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcdece09640 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcde80383f0 0x7fcde803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcdece09640 1 -- 172.21.15.114:0/2125282825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcef00bb070 con 0x556b350b1090 2024-05-08T18:09:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fceffd3d640 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcde80383f0 0x7fcde803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b350b19b0 0x556b351aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351ab270 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b350b19b0 0x556b351aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fceffd3d640 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcde80383f0 0x7fcde803a8b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcef4001d80 tx=0x7fcef40012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b350b19b0 0x556b351aad30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 -- 172.21.15.114:0/2125282825 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcef80083f0 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351abb10 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 -- 172.21.15.114:0/2125282825 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcef80083f0 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351acec0 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 -- 172.21.15.114:0/2125282825 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcef80083f0 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351ac360 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 -- 172.21.15.114:0/2125282825 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcef80083f0 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351ac780 con 0x556b350b19b0 2024-05-08T18:09:10.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf00d3f640 1 -- 172.21.15.114:0/2125282825 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcef80083f0 con 0x556b350b19b0 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 Processor -- start 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- start start 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 0x556b351bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fcf02a2a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b34fb6fc0 con 0x556b351bba10 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.183+0000 7fceffd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 0x556b351bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 0x556b351bbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57896/0 (socket says 172.21.15.114:57896) 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 -- 172.21.15.114:0/919202189 learned_addr learned my addr 172.21.15.114:0/919202189 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 -- 172.21.15.114:0/919202189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b351bc370 con 0x556b351bba10 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 0x556b351bbe30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcef400d660 tx=0x7fcef400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcde5ffb640 1 -- 172.21.15.114:0/919202189 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef400c6b0 con 0x556b351bba10 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b351bce10 con 0x556b351bba10 2024-05-08T18:09:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b351bd2e0 con 0x556b351bba10 2024-05-08T18:09:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcde5ffb640 1 -- 172.21.15.114:0/919202189 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef400c850 con 0x556b351bba10 2024-05-08T18:09:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcde5ffb640 1 -- 172.21.15.114:0/919202189 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef400cb30 con 0x556b351bba10 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcde5ffb640 1 -- 172.21.15.114:0/919202189 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcef4023020 con 0x556b351bba10 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcde5ffb640 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd80383f0 0x7fcdd803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcde5ffb640 1 -- 172.21.15.114:0/919202189 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcef4021020 con 0x556b351bba10 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd80383f0 0x7fcdd803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf02a2a980 1 Processor -- start 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf02a2a980 1 -- start start 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd80383f0 0x7fcdd803a8b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x556b351ac700 tx=0x7fcef8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf02a2a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351c9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fcf02a2a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b3519ce90 con 0x556b351c8c40 2024-05-08T18:09:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57906/0 (socket says 172.21.15.114:57906) 2024-05-08T18:09:10.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.187+0000 7fceffd3d640 1 -- 172.21.15.114:0/3587401893 learned_addr learned my addr 172.21.15.114:0/3587401893 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 -- 172.21.15.114:0/3587401893 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b351c9630 con 0x556b351c8c40 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 --2- 172.21.15.114:0/3587401893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351c9060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcef404f270 tx=0x7fcef40233d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf6e7c137f86864 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcddf7fe640 1 -- 172.21.15.114:0/3587401893 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef401bcc0 con 0x556b351c8c40 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcddf7fe640 1 -- 172.21.15.114:0/3587401893 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef403e0d0 con 0x556b351c8c40 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcddf7fe640 1 -- 172.21.15.114:0/3587401893 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef401be60 con 0x556b351c8c40 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3587401893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 msgr2=0x556b351c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3587401893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351c9060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcef404f270 tx=0x7fcef40233d0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3587401893 shutdown_connections 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3587401893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351c9060 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3587401893 >> 172.21.15.114:0/3587401893 conn(0x556b351c4fd0 msgr2=0x556b351c3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3587401893 shutdown_connections 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3587401893 wait complete. 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 Processor -- start 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- start start 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351d01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556b351c9d40 con 0x556b351c8c40 2024-05-08T18:09:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351d01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351d01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57922/0 (socket says 172.21.15.114:57922) 2024-05-08T18:09:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 learned_addr learned my addr 172.21.15.114:0/3054783831 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b351d0710 con 0x556b351c8c40 2024-05-08T18:09:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fceffd3d640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351d01d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcef40248b0 tx=0x7fcef404f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcdddffb640 1 -- 172.21.15.114:0/3054783831 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef404c030 con 0x556b351c8c40 2024-05-08T18:09:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b351d09a0 con 0x556b351c8c40 2024-05-08T18:09:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcdddffb640 1 -- 172.21.15.114:0/3054783831 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcef401b550 con 0x556b351c8c40 2024-05-08T18:09:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcdddffb640 1 -- 172.21.15.114:0/3054783831 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcef401b870 con 0x556b351c8c40 2024-05-08T18:09:10.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.191+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b351d3680 con 0x556b351c8c40 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcdddffb640 1 -- 172.21.15.114:0/3054783831 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcef4047040 con 0x556b351c8c40 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcdddffb640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd00383f0 0x7fcdd003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcdddffb640 1 -- 172.21.15.114:0/3054783831 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcef4045020 con 0x556b351c8c40 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd00383f0 0x7fcdd003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b351db490 0x556b351dd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351de070 con 0x556b351db490 2024-05-08T18:09:10.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b351db490 0x556b351dd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd00383f0 0x7fcdd003a8b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcef800f010 tx=0x7fcef801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b351db490 0x556b351dd920 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 realm 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351de480 con 0x556b351db490 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351ded50 con 0x556b351db490 2024-05-08T18:09:10.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351df0f0 con 0x556b351db490 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 20 searching for the correct realm 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556b351e16b0 0x556b351e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351e3fe0 con 0x556b351e16b0 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fceffd3d640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556b351e16b0 0x556b351e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fceffd3d640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556b351e16b0 0x556b351e3aa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fceffd3d640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcef405d040 0x7fcef4030a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351e3fe0 con 0x7fcef405d040 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcef405d040 0x7fcef4030a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.195+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcef405d040 0x7fcef4030a50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf00d3f640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcef8019040 0x7fcef8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351e3fe0 con 0x7fcef8019040 2024-05-08T18:09:10.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcef8019040 0x7fcef8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcef8019040 0x7fcef8019930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x7fcef8019040 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x7fcef8019040 2024-05-08T18:09:10.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x7fcef8019040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef405d040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.199+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x7fcef8019040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef405d040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x7fcef8019040 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcef00c7030 con 0x556b351db490 2024-05-08T18:09:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.203+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef405d040 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef405d040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351e16b0 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef8019040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x556b351db490 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556b351df940 con 0x7fcef405d040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351e0190 con 0x556b351db490 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.207+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351e0580 con 0x556b351db490 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351e0580 con 0x556b351db490 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 zone default found 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 4 Realm: () 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 zonegroup default 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351dfdc0 con 0x7fcef8019040 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351dfdc0 con 0x556b351e16b0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351e5ee0 con 0x556b351e16b0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 started sync module instance, tier type = 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e5290 con 0x7fcef405d040 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93918941042304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e67f0 con 0x7fcef405d040 2024-05-08T18:09:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e7040 con 0x556b351db490 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.211+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93918941042304] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93918941045568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e6c10 con 0x556b351db490 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e7700 con 0x556b351e16b0 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93918941045568] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93918941046624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e6b80 con 0x556b351e16b0 2024-05-08T18:09:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.215+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e8490 con 0x7fcef405d040 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93918941052832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e8d30 con 0x7fcef405d040 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e9770 con 0x556b351db490 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93918941046624] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93918941052832] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93918941057600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e8880 con 0x556b351db490 2024-05-08T18:09:10.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.219+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351ea010 con 0x7fcef8019040 2024-05-08T18:09:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93918941057600] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93918941051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351e9d30 con 0x7fcef8019040 2024-05-08T18:09:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351ea580 con 0x7fcef8019040 2024-05-08T18:09:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93918941051632] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93918941059472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351ea380 con 0x7fcef8019040 2024-05-08T18:09:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.223+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351eae40 con 0x7fcef8019040 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93918941063440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351eb2b0 con 0x7fcef8019040 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=0 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=1 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=2 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=3 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=4 2024-05-08T18:09:10.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=5 2024-05-08T18:09:10.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93918941059472] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=6 2024-05-08T18:09:10.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93918941063440] v30'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 20 add_watcher() i=7 2024-05-08T18:09:10.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:10.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b351eb2b0 con 0x556b351db490 2024-05-08T18:09:10.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.227+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93918941064704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b351eb220 con 0x556b351db490 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93918941064704] v30'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcdb67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 5 note: GC not initialized 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcdb57e2640 20 reqs_thread_entry: start 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 20 Filter name: none 2024-05-08T18:09:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcd26ffd640 20 reqs_thread_entry: start 2024-05-08T18:09:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b35211cb0 con 0x556b351db490 2024-05-08T18:09:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T18:09:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b35218410 con 0x556b351db490 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v30'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93918941249152 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b35213b80 con 0x556b351db490 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 93918941057600 notify 128849018890 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fcef00e2040 con 0x556b351db490 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcddf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 93918941057600 notifier 4415 bl.length()=567 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcddf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:10.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcddf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:10.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcddf7fe640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fcdc4003eb0 con 0x556b351db490 2024-05-08T18:09:10.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 93918941249152 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 93918941249152 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556b351a70e0 con 0x556b351db490 2024-05-08T18:09:10.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.231+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b35217e80 con 0x7fcef405d040 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 foo:foo2 [delete] v30'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf02a2a980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93918941249152 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556b352136d0 con 0x7fcef405d040 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== watch-notify(notify (1) cookie 93918941042304 notify 128849018885 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fcef8010040 con 0x7fcef405d040 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcddeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93918941042304 notifier 4415 bl.length()=159 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcddeffd640 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fcd340032d0 con 0x7fcef405d040 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [notify cookie 93918941249152 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== watch-notify(notify_complete (2) cookie 93918941249152 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcef8026b00 con 0x7fcef405d040 2024-05-08T18:09:10.237 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:10.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcdb67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.235+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93918941064704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x556b351db490 2024-05-08T18:09:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93918941064704] v30'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93918941042304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x7fcef405d040 2024-05-08T18:09:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93918941042304] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf02a2a980 20 remove_watcher() i=0 2024-05-08T18:09:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf02a2a980 2 removed watcher, disabling cache 2024-05-08T18:09:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93918941045568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x556b351db490 2024-05-08T18:09:10.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93918941045568] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf02a2a980 20 remove_watcher() i=1 2024-05-08T18:09:10.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.239+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93918941046624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x556b351e16b0 2024-05-08T18:09:10.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.243+0000 7fceffd3d640 1 -- 172.21.15.114:0/3054783831 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93918941046624] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef4019770 con 0x556b351e16b0 2024-05-08T18:09:10.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.243+0000 7fcf02a2a980 20 remove_watcher() i=2 2024-05-08T18:09:10.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.243+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93918941052832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x7fcef405d040 2024-05-08T18:09:10.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.243+0000 7fcf00d3f640 1 -- 172.21.15.114:0/3054783831 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93918941052832] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef802f040 con 0x7fcef405d040 2024-05-08T18:09:10.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.243+0000 7fcf02a2a980 20 remove_watcher() i=3 2024-05-08T18:09:10.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.243+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93918941057600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x556b351db490 2024-05-08T18:09:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.247+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93918941057600] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x556b351db490 2024-05-08T18:09:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.247+0000 7fcf02a2a980 20 remove_watcher() i=4 2024-05-08T18:09:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.247+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93918941051632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x7fcef8019040 2024-05-08T18:09:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.247+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93918941051632] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.247+0000 7fcf02a2a980 20 remove_watcher() i=5 2024-05-08T18:09:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.247+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93918941059472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x7fcef8019040 2024-05-08T18:09:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93918941059472] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 20 remove_watcher() i=6 2024-05-08T18:09:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93918941063440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556b3520f9e0 con 0x7fcef8019040 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93918941063440] v30'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcef00f0040 con 0x7fcef8019040 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 20 remove_watcher() i=7 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcef8019040 msgr2=0x7fcef8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcef8019040 0x7fcef8019930 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b351db490 msgr2=0x556b351dd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b351db490 0x556b351dd920 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcef405d040 msgr2=0x7fcef4030a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcef405d040 0x7fcef4030a50 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556b351e16b0 msgr2=0x556b351e3aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x556b351e16b0 0x556b351e3aa0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd00383f0 msgr2=0x7fcdd003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd00383f0 0x7fcdd003a8b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcef800f010 tx=0x7fcef801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 msgr2=0x556b351d01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf0053e640 1 -- 172.21.15.114:0/3054783831 reap_dead start 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351d01d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcef40248b0 tx=0x7fcef404f200 comp rx=0 tx=0).stop 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 shutdown_connections 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/3054783831 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351c8c40 0x556b351d01d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 >> 172.21.15.114:0/3054783831 conn(0x556b351c4fd0 msgr2=0x556b351c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 shutdown_connections 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/3054783831 wait complete. 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd80383f0 msgr2=0x7fcdd803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd80383f0 0x7fcdd803a8b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x556b351ac700 tx=0x7fcef8003070 comp rx=0 tx=0).stop 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 msgr2=0x556b351bbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 0x556b351bbe30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcef400d660 tx=0x7fcef400da60 comp rx=0 tx=0).stop 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 shutdown_connections 2024-05-08T18:09:10.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcdd80383f0 0x7fcdd803a8b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/919202189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b351bba10 0x556b351bbe30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 >> 172.21.15.114:0/919202189 conn(0x556b351b0820 msgr2=0x556b351b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 shutdown_connections 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/919202189 wait complete. 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b350b19b0 msgr2=0x556b351aad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b350b19b0 0x556b351aad30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcde80383f0 msgr2=0x7fcde803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcde80383f0 0x7fcde803a8b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcef4001d80 tx=0x7fcef40012e0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 msgr2=0x556b351a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b351a3cd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000f90 tx=0x7fcef0019810 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 shutdown_connections 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x556b350b19b0 0x556b351aad30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcde80383f0 0x7fcde803a8b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 --2- 172.21.15.114:0/2125282825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b350b1090 0x556b351a3cd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 >> 172.21.15.114:0/2125282825 conn(0x556b35024770 msgr2=0x556b35196ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 shutdown_connections 2024-05-08T18:09:10.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.251+0000 7fcf02a2a980 1 -- 172.21.15.114:0/2125282825 wait complete. 2024-05-08T18:09:10.262 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:10.262 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:09:10.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:09:10.262 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T18:09:10.338 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:10.339 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb36b9c7980 1 Processor -- start 2024-05-08T18:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb36b9c7980 1 -- start start 2024-05-08T18:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb36b9c7980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fd2915f0f0 0x55fd2915f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb36b9c7980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd29008710 con 0x55fd2915fa10 2024-05-08T18:09:10.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb36b9c7980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fd2901cf00 con 0x55fd2915f0f0 2024-05-08T18:09:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb3694db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fd2915f0f0 0x55fd2915f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb3694db640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fd2915f0f0 0x55fd2915f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57926/0 (socket says 172.21.15.114:57926) 2024-05-08T18:09:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb3694db640 1 -- 172.21.15.114:0/821859215 learned_addr learned my addr 172.21.15.114:0/821859215 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb368cda640 1 --1- 172.21.15.114:0/821859215 >> v1:172.21.15.53:6789/0 conn(0x55fd2915fa10 0x55fd29160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34598/0 (socket says 172.21.15.114:34598) 2024-05-08T18:09:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb3694db640 1 -- 172.21.15.114:0/821859215 >> v1:172.21.15.53:6789/0 conn(0x55fd2915fa10 legacy=0x55fd29160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.339+0000 7fb3694db640 1 -- 172.21.15.114:0/821859215 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd28fe4ae0 con 0x55fd2915f0f0 2024-05-08T18:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb3694db640 1 --2- 172.21.15.114:0/821859215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2915f4d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb36400a5c0 tx=0x7fb36401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcccf8b4b68b0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb35bfff640 1 -- 172.21.15.114:0/821859215 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640a6070 con 0x55fd2915f0f0 2024-05-08T18:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb35bfff640 1 -- 172.21.15.114:0/821859215 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640af070 con 0x55fd2915f0f0 2024-05-08T18:09:10.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb35bfff640 1 -- 172.21.15.114:0/821859215 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640aa5c0 con 0x55fd2915f0f0 2024-05-08T18:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 -- 172.21.15.114:0/821859215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 msgr2=0x55fd2915f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/821859215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2915f4d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb36400a5c0 tx=0x7fb36401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 -- 172.21.15.114:0/821859215 shutdown_connections 2024-05-08T18:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/821859215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2915f4d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 -- 172.21.15.114:0/821859215 >> 172.21.15.114:0/821859215 conn(0x55fd290d27d0 msgr2=0x55fd290d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 -- 172.21.15.114:0/821859215 shutdown_connections 2024-05-08T18:09:10.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.343+0000 7fb36b9c7980 1 -- 172.21.15.114:0/821859215 wait complete. 2024-05-08T18:09:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.355+0000 7fb36b9c7980 1 Processor -- start 2024-05-08T18:09:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.355+0000 7fb36b9c7980 1 -- start start 2024-05-08T18:09:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.355+0000 7fb36b9c7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2924a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.355+0000 7fb36b9c7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd29060f80 con 0x55fd2915f0f0 2024-05-08T18:09:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2924a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2924a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57932/0 (socket says 172.21.15.114:57932) 2024-05-08T18:09:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 -- 172.21.15.114:0/3039548686 learned_addr learned my addr 172.21.15.114:0/3039548686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 -- 172.21.15.114:0/3039548686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd29028da0 con 0x55fd2915f0f0 2024-05-08T18:09:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 --2- 172.21.15.114:0/3039548686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2924a810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb3640199f0 tx=0x7fb364003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10ce7f1a86e52b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb257606640 1 -- 172.21.15.114:0/3039548686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640aaa00 con 0x55fd2915f0f0 2024-05-08T18:09:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb257606640 1 -- 172.21.15.114:0/3039548686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640aaba0 con 0x55fd2915f0f0 2024-05-08T18:09:10.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb257606640 1 -- 172.21.15.114:0/3039548686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640bd3f0 con 0x55fd2915f0f0 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3039548686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 msgr2=0x55fd2924a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3039548686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2924a810 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb3640199f0 tx=0x7fb364003030 comp rx=0 tx=0).stop 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3039548686 shutdown_connections 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3039548686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd2924a810 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3039548686 >> 172.21.15.114:0/3039548686 conn(0x55fd290d27d0 msgr2=0x55fd292463a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3039548686 shutdown_connections 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3039548686 wait complete. 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 Processor -- start 2024-05-08T18:09:10.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- start start 2024-05-08T18:09:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd29251b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb36b9c7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd291690f0 con 0x55fd2915f0f0 2024-05-08T18:09:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd29251b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd29251b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57934/0 (socket says 172.21.15.114:57934) 2024-05-08T18:09:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 -- 172.21.15.114:0/2396265123 learned_addr learned my addr 172.21.15.114:0/2396265123 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd29252070 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.359+0000 7fb3694db640 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd29251b30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb36401b170 tx=0x7fb3640180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb255e03640 1 -- 172.21.15.114:0/2396265123 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640bd7c0 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd29252300 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd29254f90 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb255e03640 1 -- 172.21.15.114:0/2396265123 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3640bd960 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb255e03640 1 -- 172.21.15.114:0/2396265123 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3640bdc40 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb255e03640 1 -- 172.21.15.114:0/2396265123 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb3640ce020 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb255e03640 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb250038440 0x7fb25003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb255e03640 1 -- 172.21.15.114:0/2396265123 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb3640cc020 con 0x55fd2915f0f0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb368cda640 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb250038440 0x7fb25003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd2915fa10 0x55fd29258a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd292590c0 con 0x55fd2915fa10 2024-05-08T18:09:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd2915fa10 0x55fd29258a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb368cda640 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb250038440 0x7fb25003a900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb360001e90 tx=0x7fb3600013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd2915fa10 0x55fd29258a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 -- 172.21.15.114:0/2396265123 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb35c00a4d0 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd29259960 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 -- 172.21.15.114:0/2396265123 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb35c00a4d0 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2925ad10 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 -- 172.21.15.114:0/2396265123 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb35c00a4d0 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2925a1b0 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 -- 172.21.15.114:0/2396265123 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb35c00a4d0 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2925a600 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.363+0000 7fb369cdc640 1 -- 172.21.15.114:0/2396265123 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb35c00a4d0 con 0x55fd2915fa10 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 Processor -- start 2024-05-08T18:09:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 -- start start 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 0x55fd29269c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd29064fc0 con 0x55fd29269820 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb368cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 0x55fd29269c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb368cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 0x55fd29269c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57944/0 (socket says 172.21.15.114:57944) 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb368cda640 1 -- 172.21.15.114:0/2339769697 learned_addr learned my addr 172.21.15.114:0/2339769697 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb368cda640 1 -- 172.21.15.114:0/2339769697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2926a180 con 0x55fd29269820 2024-05-08T18:09:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb368cda640 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 0x55fd29269c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb36000e670 tx=0x7fb36000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb24effd640 1 -- 172.21.15.114:0/2339769697 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb360022070 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd2926ac20 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2926b0f0 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb24effd640 1 -- 172.21.15.114:0/2339769697 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36000d660 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb24effd640 1 -- 172.21.15.114:0/2339769697 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb360006070 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb24effd640 1 -- 172.21.15.114:0/2339769697 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb360025070 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb24effd640 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb240038490 0x7fb24003a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb24effd640 1 -- 172.21.15.114:0/2339769697 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb3600500e0 con 0x55fd29269820 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb369cdc640 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb240038490 0x7fb24003a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 Processor -- start 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb369cdc640 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb240038490 0x7fb24003a950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55fd29259840 tx=0x7fb35c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 -- start start 2024-05-08T18:09:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd29276e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.367+0000 7fb36b9c7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd2924aea0 con 0x55fd29276a00 2024-05-08T18:09:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd29276e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd29276e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57958/0 (socket says 172.21.15.114:57958) 2024-05-08T18:09:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 -- 172.21.15.114:0/2641895247 learned_addr learned my addr 172.21.15.114:0/2641895247 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 -- 172.21.15.114:0/2641895247 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd292773f0 con 0x55fd29276a00 2024-05-08T18:09:10.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 --2- 172.21.15.114:0/2641895247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd29276e20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb36000ef50 tx=0x7fb36000db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf8b054ee21d842 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb24cff9640 1 -- 172.21.15.114:0/2641895247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36003d070 con 0x55fd29276a00 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb24cff9640 1 -- 172.21.15.114:0/2641895247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36003d210 con 0x55fd29276a00 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb24cff9640 1 -- 172.21.15.114:0/2641895247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb360047a60 con 0x55fd29276a00 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2641895247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 msgr2=0x55fd29276e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2641895247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd29276e20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb36000ef50 tx=0x7fb36000db60 comp rx=0 tx=0).stop 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2641895247 shutdown_connections 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2641895247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd29276e20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2641895247 >> 172.21.15.114:0/2641895247 conn(0x55fd29272d90 msgr2=0x55fd29270df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2641895247 shutdown_connections 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2641895247 wait complete. 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 Processor -- start 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- start start 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd2927df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd29277b40 con 0x55fd29276a00 2024-05-08T18:09:10.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd2927df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd2927df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57966/0 (socket says 172.21.15.114:57966) 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 learned_addr learned my addr 172.21.15.114:0/3729078258 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd2927e4b0 con 0x55fd29276a00 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb368cda640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd2927df70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb360026860 tx=0x7fb360026f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb23effd640 1 -- 172.21.15.114:0/3729078258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb360031070 con 0x55fd29276a00 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd2927e4b0 con 0x55fd29276a00 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb23effd640 1 -- 172.21.15.114:0/3729078258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36000c4c0 con 0x55fd29276a00 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb23effd640 1 -- 172.21.15.114:0/3729078258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb36000c670 con 0x55fd29276a00 2024-05-08T18:09:10.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.371+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd2927e4b0 con 0x55fd29276a00 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb23effd640 1 -- 172.21.15.114:0/3729078258 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb36001a320 con 0x55fd29276a00 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb23effd640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb23effd640 1 -- 172.21.15.114:0/3729078258 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb360036c30 con 0x55fd29276a00 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb369cdc640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd29289020 0x55fd2928b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928bc10 con 0x55fd29289020 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd29289020 0x55fd2928b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb369cdc640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55fd292560d0 tx=0x7fb35c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd29289020 0x55fd2928b4c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 realm 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928c020 con 0x55fd29289020 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928c8c0 con 0x55fd29289020 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928cc60 con 0x55fd29289020 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928d4b0 con 0x55fd29289020 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 20 searching for the correct realm 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fd2928f220 0x55fd29291610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb368cda640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fd2928f220 0x55fd29291610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb368cda640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fd2928f220 0x55fd29291610 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb368cda640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb360051040 0x7fb360027660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb360051040 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.375+0000 7fb369cdc640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb360051040 0x7fb360027660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb369cdc640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb360051040 0x7fb360027660 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c01f070 con 0x7fb360051040 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb369cdc640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb35c031040 0x7fb35c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb35c031040 0x7fb35c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb35c031040 0x7fb35c032940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x7fb35c031040 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x7fb35c031040 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x7fb35c031040 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb360051040 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c01f070 con 0x7fb360051040 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.379+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x7fb35c031040 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb360051040 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb35c01f070 con 0x7fb360051040 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x7fb35c031040 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640a9de0 con 0x7fb35c031040 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.383+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb360051040 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c01f070 con 0x7fb360051040 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3640a9de0 con 0x55fd29289020 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb360051040 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c01f070 con 0x7fb360051040 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd2928f220 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb35c031040 2024-05-08T18:09:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x55fd29289020 2024-05-08T18:09:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55fd29291b50 con 0x7fb360051040 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb35c01f070 con 0x7fb360051040 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928de60 con 0x55fd29289020 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.387+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928daa0 con 0x55fd29289020 2024-05-08T18:09:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928e780 con 0x55fd29289020 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 zone default found 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 4 Realm: () 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 zonegroup default 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2928e780 con 0x7fb35c031040 2024-05-08T18:09:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd29293960 con 0x55fd2928f220 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd29293d00 con 0x55fd2928f220 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 started sync module instance, tier type = 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29292e00 con 0x7fb360051040 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94545805652464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29292a60 con 0x7fb360051040 2024-05-08T18:09:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29294be0 con 0x55fd29289020 2024-05-08T18:09:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.391+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94545805652464] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94545805656336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29294be0 con 0x55fd29289020 2024-05-08T18:09:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292955f0 con 0x55fd2928f220 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94545805656336] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94545805657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29294b50 con 0x55fd2928f220 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.395+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29296380 con 0x7fb360051040 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94545805663888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29296c20 con 0x7fb360051040 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29297660 con 0x55fd29289020 2024-05-08T18:09:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94545805657904] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94545805663888] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94545805668656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29296770 con 0x55fd29289020 2024-05-08T18:09:10.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.399+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29297f00 con 0x7fb35c031040 2024-05-08T18:09:10.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94545805668656] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94545805662688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29297c40 con 0x7fb35c031040 2024-05-08T18:09:10.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29298490 con 0x7fb35c031040 2024-05-08T18:09:10.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94545805662688] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94545805670560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292982b0 con 0x7fb35c031040 2024-05-08T18:09:10.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.403+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29298d70 con 0x7fb35c031040 2024-05-08T18:09:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94545805670560] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94545805674560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29298d30 con 0x7fb35c031040 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=0 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=1 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=2 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=3 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=4 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=5 2024-05-08T18:09:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.407+0000 7fb36b9c7980 20 add_watcher() i=6 2024-05-08T18:09:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94545805674560] v30'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 add_watcher() i=7 2024-05-08T18:09:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd2929c190 con 0x55fd29289020 2024-05-08T18:09:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94545805671680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29299680 con 0x55fd29289020 2024-05-08T18:09:10.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94545805671680] v30'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb21f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 5 note: GC not initialized 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb21e7e4640 20 reqs_thread_entry: start 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 Filter name: none 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb18ffff640 20 reqs_thread_entry: start 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd292bf700 con 0x55fd29289020 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd292c00f0 con 0x55fd29289020 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:10.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55fd292c1100 con 0x7fb360051040 2024-05-08T18:09:10.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb21f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.411+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94545805671680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292bd490 con 0x55fd29289020 2024-05-08T18:09:10.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94545805671680] v30'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94545805652464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292bd490 con 0x7fb360051040 2024-05-08T18:09:10.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94545805652464] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb36b9c7980 20 remove_watcher() i=0 2024-05-08T18:09:10.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb36b9c7980 2 removed watcher, disabling cache 2024-05-08T18:09:10.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94545805656336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292bd490 con 0x55fd29289020 2024-05-08T18:09:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94545805656336] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb36b9c7980 20 remove_watcher() i=1 2024-05-08T18:09:10.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.415+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94545805657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292bd490 con 0x55fd2928f220 2024-05-08T18:09:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.419+0000 7fb368cda640 1 -- 172.21.15.114:0/3729078258 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94545805657904] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb360024030 con 0x55fd2928f220 2024-05-08T18:09:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.419+0000 7fb36b9c7980 20 remove_watcher() i=2 2024-05-08T18:09:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.419+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94545805663888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292931f0 con 0x7fb360051040 2024-05-08T18:09:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.419+0000 7fb369cdc640 1 -- 172.21.15.114:0/3729078258 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94545805663888] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb35c040040 con 0x7fb360051040 2024-05-08T18:09:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.419+0000 7fb36b9c7980 20 remove_watcher() i=3 2024-05-08T18:09:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.419+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94545805668656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29294110 con 0x55fd29289020 2024-05-08T18:09:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.423+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94545805668656] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x55fd29289020 2024-05-08T18:09:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.423+0000 7fb36b9c7980 20 remove_watcher() i=4 2024-05-08T18:09:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.423+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94545805662688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29294730 con 0x7fb35c031040 2024-05-08T18:09:10.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.423+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94545805662688] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.423+0000 7fb36b9c7980 20 remove_watcher() i=5 2024-05-08T18:09:10.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.423+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94545805670560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd292931f0 con 0x7fb35c031040 2024-05-08T18:09:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94545805670560] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 20 remove_watcher() i=6 2024-05-08T18:09:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94545805674560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55fd29297130 con 0x7fb35c031040 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94545805674560] v30'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3640f5040 con 0x7fb35c031040 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 20 remove_watcher() i=7 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb35c031040 msgr2=0x7fb35c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb35c031040 0x7fb35c032940 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd29289020 msgr2=0x55fd2928b4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd29289020 0x55fd2928b4c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb360051040 msgr2=0x7fb360027660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb360051040 0x7fb360027660 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fd2928f220 msgr2=0x55fd29291610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55fd2928f220 0x55fd29291610 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 msgr2=0x7fb23403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55fd292560d0 tx=0x7fb35c01f000 comp rx=0 tx=0).stop 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 msgr2=0x55fd2927df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb3694db640 1 -- 172.21.15.114:0/3729078258 reap_dead start 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd2927df70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb360026860 tx=0x7fb360026f10 comp rx=0 tx=0).stop 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 shutdown_connections 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/3729078258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29276a00 0x55fd2927df70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 >> 172.21.15.114:0/3729078258 conn(0x55fd29272d90 msgr2=0x55fd29278260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 shutdown_connections 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/3729078258 wait complete. 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb240038490 msgr2=0x7fb24003a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb240038490 0x7fb24003a950 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55fd29259840 tx=0x7fb35c005850 comp rx=0 tx=0).stop 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 msgr2=0x55fd29269c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 0x55fd29269c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb36000e670 tx=0x7fb36000ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 shutdown_connections 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb240038490 0x7fb24003a950 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2339769697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd29269820 0x55fd29269c40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 >> 172.21.15.114:0/2339769697 conn(0x55fd2925e630 msgr2=0x55fd2925f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 shutdown_connections 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.427+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2339769697 wait complete. 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd2915fa10 msgr2=0x55fd29258a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd2915fa10 0x55fd29258a70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb250038440 msgr2=0x7fb25003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb250038440 0x7fb25003a900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb360001e90 tx=0x7fb3600013f0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 msgr2=0x55fd29251b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd29251b30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb36401b170 tx=0x7fb3640180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 shutdown_connections 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd2915fa10 0x55fd29258a70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb250038440 0x7fb25003a900 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 --2- 172.21.15.114:0/2396265123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd2915f0f0 0x55fd29251b30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 >> 172.21.15.114:0/2396265123 conn(0x55fd290d27d0 msgr2=0x55fd29244eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 shutdown_connections 2024-05-08T18:09:10.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.431+0000 7fb36b9c7980 1 -- 172.21.15.114:0/2396265123 wait complete. 2024-05-08T18:09:10.439 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-05-08T18:09:10.439 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:09:10.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T18:09:10.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T18:09:10.439 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T18:09:10.512 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:10.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.511+0000 7f08bab18980 1 Processor -- start 2024-05-08T18:09:10.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.511+0000 7f08bab18980 1 -- start start 2024-05-08T18:09:10.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08bab18980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c4fd56afd0 0x55c4fd5695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08bab18980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c4fd4a0710 con 0x55c4fd569b10 2024-05-08T18:09:10.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08bab18980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c4fd4b4f00 con 0x55c4fd56afd0 2024-05-08T18:09:10.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08b862c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c4fd56afd0 0x55c4fd5695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08b862c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c4fd56afd0 0x55c4fd5695d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57970/0 (socket says 172.21.15.114:57970) 2024-05-08T18:09:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08b862c640 1 -- 172.21.15.114:0/1126580264 learned_addr learned my addr 172.21.15.114:0/1126580264 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08b862c640 1 -- 172.21.15.114:0/1126580264 >> v1:172.21.15.53:6789/0 conn(0x55c4fd569b10 legacy=0x55c4fd5fced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.515+0000 7f08b862c640 1 -- 172.21.15.114:0/1126580264 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fd47cae0 con 0x55c4fd56afd0 2024-05-08T18:09:10.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08b862c640 1 --2- 172.21.15.114:0/1126580264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd56afd0 0x55c4fd5695d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f08a800a5c0 tx=0x7f08a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ead6aa79bb73adf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08b762a640 1 -- 172.21.15.114:0/1126580264 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80a6070 con 0x55c4fd56afd0 2024-05-08T18:09:10.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08b762a640 1 -- 172.21.15.114:0/1126580264 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80af070 con 0x55c4fd56afd0 2024-05-08T18:09:10.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08b762a640 1 -- 172.21.15.114:0/1126580264 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80aa5c0 con 0x55c4fd56afd0 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 -- 172.21.15.114:0/1126580264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd56afd0 msgr2=0x55c4fd5695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 --2- 172.21.15.114:0/1126580264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd56afd0 0x55c4fd5695d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f08a800a5c0 tx=0x7f08a801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 -- 172.21.15.114:0/1126580264 shutdown_connections 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 --2- 172.21.15.114:0/1126580264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd56afd0 0x55c4fd5695d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 -- 172.21.15.114:0/1126580264 >> 172.21.15.114:0/1126580264 conn(0x55c4fd5f07a0 msgr2=0x55c4fd5f2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 -- 172.21.15.114:0/1126580264 shutdown_connections 2024-05-08T18:09:10.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.519+0000 7f08bab18980 1 -- 172.21.15.114:0/1126580264 wait complete. 2024-05-08T18:09:10.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08bab18980 1 Processor -- start 2024-05-08T18:09:10.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08bab18980 1 -- start start 2024-05-08T18:09:10.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08bab18980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08bab18980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4fd4f8f80 con 0x55c4fd569b10 2024-05-08T18:09:10.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08b862c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08b862c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57978/0 (socket says 172.21.15.114:57978) 2024-05-08T18:09:10.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08b862c640 1 -- 172.21.15.114:0/3918413898 learned_addr learned my addr 172.21.15.114:0/3918413898 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08b862c640 1 -- 172.21.15.114:0/3918413898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fd4c0da0 con 0x55c4fd569b10 2024-05-08T18:09:10.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f08b862c640 1 --2- 172.21.15.114:0/3918413898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e2810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08a80199f0 tx=0x7f08a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4914cfa7c6480e7a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f07a660c640 1 -- 172.21.15.114:0/3918413898 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80aaa00 con 0x55c4fd569b10 2024-05-08T18:09:10.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f07a660c640 1 -- 172.21.15.114:0/3918413898 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80aaba0 con 0x55c4fd569b10 2024-05-08T18:09:10.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.531+0000 7f07a660c640 1 -- 172.21.15.114:0/3918413898 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80bd3f0 con 0x55c4fd569b10 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3918413898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 msgr2=0x55c4fd6e2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 --2- 172.21.15.114:0/3918413898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e2810 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f08a80199f0 tx=0x7f08a8003030 comp rx=0 tx=0).stop 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3918413898 shutdown_connections 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 --2- 172.21.15.114:0/3918413898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e2810 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3918413898 >> 172.21.15.114:0/3918413898 conn(0x55c4fd5f07a0 msgr2=0x55c4fd6de3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3918413898 shutdown_connections 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3918413898 wait complete. 2024-05-08T18:09:10.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 Processor -- start 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- start start 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4fd6010b0 con 0x55c4fd569b10 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08b862c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08b862c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57982/0 (socket says 172.21.15.114:57982) 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08b862c640 1 -- 172.21.15.114:0/3489596726 learned_addr learned my addr 172.21.15.114:0/3489596726 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08b862c640 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fd6ea070 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08b862c640 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e9b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f08a801b170 tx=0x7f08a80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f07a4e09640 1 -- 172.21.15.114:0/3489596726 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80bd7c0 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4fd6ea300 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f07a4e09640 1 -- 172.21.15.114:0/3489596726 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80bd960 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4fd6ecf90 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f07a4e09640 1 -- 172.21.15.114:0/3489596726 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08a80bdc40 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f07a4e09640 1 -- 172.21.15.114:0/3489596726 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f08a80ce020 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f07a4e09640 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07a00383f0 0x7f07a003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f07a4e09640 1 -- 172.21.15.114:0/3489596726 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f08a80cc020 con 0x55c4fd569b10 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.535+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07a00383f0 0x7f07a003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd56afd0 0x55c4fd6f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd6f1080 con 0x55c4fd56afd0 2024-05-08T18:09:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd56afd0 0x55c4fd6f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07a00383f0 0x7f07a003a8b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08ac001e60 tx=0x7f08ac0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd56afd0 0x55c4fd6f0a90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3489596726 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08b000a4d0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd6f1960 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3489596726 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08b000a4d0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd6f2d10 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3489596726 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f08b000a4d0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd6f21b0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3489596726 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08b000a4d0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd6f25d0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3489596726 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f08b000a4d0 con 0x55c4fd56afd0 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 Processor -- start 2024-05-08T18:09:10.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- start start 2024-05-08T18:09:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 0x55c4fd701c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08bab18980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4fd4fcfc0 con 0x55c4fd701860 2024-05-08T18:09:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b7e2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 0x55c4fd701c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b7e2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 0x55c4fd701c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:57996/0 (socket says 172.21.15.114:57996) 2024-05-08T18:09:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b7e2b640 1 -- 172.21.15.114:0/2460765543 learned_addr learned my addr 172.21.15.114:0/2460765543 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b7e2b640 1 -- 172.21.15.114:0/2460765543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fd7021c0 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.539+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 0x55c4fd701c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f08ac010f90 tx=0x7f08ac00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f079dffb640 1 -- 172.21.15.114:0/2460765543 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ac00a040 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4fd702c60 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f079dffb640 1 -- 172.21.15.114:0/2460765543 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ac017050 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f079dffb640 1 -- 172.21.15.114:0/2460765543 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ac00e7e0 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4fd703130 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f079dffb640 1 -- 172.21.15.114:0/2460765543 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f08ac00e9d0 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f079dffb640 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07900383f0 0x7f079003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f079dffb640 1 -- 172.21.15.114:0/2460765543 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f08ac050600 con 0x55c4fd701860 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07900383f0 0x7f079003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08bab18980 1 Processor -- start 2024-05-08T18:09:10.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08bab18980 1 -- start start 2024-05-08T18:09:10.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07900383f0 0x7f079003a8b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55c4fd6f2550 tx=0x7f08b0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08bab18980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd70eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08bab18980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4fd6e2ea0 con 0x55c4fd70ea80 2024-05-08T18:09:10.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b7e2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd70eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b7e2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd70eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58012/0 (socket says 172.21.15.114:58012) 2024-05-08T18:09:10.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b7e2b640 1 -- 172.21.15.114:0/974399767 learned_addr learned my addr 172.21.15.114:0/974399767 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b7e2b640 1 -- 172.21.15.114:0/974399767 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fd70f470 con 0x55c4fd70ea80 2024-05-08T18:09:10.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.543+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/974399767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd70eea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f08ac01cfd0 tx=0x7f08ac04ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c69c51756706b47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f07977fe640 1 -- 172.21.15.114:0/974399767 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ac043070 con 0x55c4fd70ea80 2024-05-08T18:09:10.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f07977fe640 1 -- 172.21.15.114:0/974399767 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ac00ecc0 con 0x55c4fd70ea80 2024-05-08T18:09:10.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f07977fe640 1 -- 172.21.15.114:0/974399767 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ac01a310 con 0x55c4fd70ea80 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- 172.21.15.114:0/974399767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 msgr2=0x55c4fd70eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 --2- 172.21.15.114:0/974399767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd70eea0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f08ac01cfd0 tx=0x7f08ac04ef20 comp rx=0 tx=0).stop 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- 172.21.15.114:0/974399767 shutdown_connections 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 --2- 172.21.15.114:0/974399767 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd70eea0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- 172.21.15.114:0/974399767 >> 172.21.15.114:0/974399767 conn(0x55c4fd70ae10 msgr2=0x55c4fd708e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- 172.21.15.114:0/974399767 shutdown_connections 2024-05-08T18:09:10.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- 172.21.15.114:0/974399767 wait complete. 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 Processor -- start 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- start start 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd716030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08bab18980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c4fd70fbc0 con 0x55c4fd70ea80 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08b7e2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd716030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08b7e2b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd716030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58028/0 (socket says 172.21.15.114:58028) 2024-05-08T18:09:10.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.547+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 learned_addr learned my addr 172.21.15.114:0/3439330462 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4fd716570 con 0x55c4fd70ea80 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd716030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f08ac04d930 tx=0x7f08ac04e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f0795ffb640 1 -- 172.21.15.114:0/3439330462 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ac033070 con 0x55c4fd70ea80 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c4fd716800 con 0x55c4fd70ea80 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f0795ffb640 1 -- 172.21.15.114:0/3439330462 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ac044040 con 0x55c4fd70ea80 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f0795ffb640 1 -- 172.21.15.114:0/3439330462 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08ac043070 con 0x55c4fd70ea80 2024-05-08T18:09:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4fd7194e0 con 0x55c4fd70ea80 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f0795ffb640 1 -- 172.21.15.114:0/3439330462 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f08ac04d2d0 con 0x55c4fd70ea80 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f0795ffb640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07880383a0 0x7f078803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f0795ffb640 1 -- 172.21.15.114:0/3439330462 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f08ac038c30 con 0x55c4fd70ea80 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07880383a0 0x7f078803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd7214e0 0x55c4fd7239a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd7240f0 con 0x55c4fd7214e0 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd7214e0 0x55c4fd7239a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07880383a0 0x7f078803a860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55c4fd6f17e0 tx=0x7f08b001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd7214e0 0x55c4fd7239a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 realm 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd724500 con 0x55c4fd7214e0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd724da0 con 0x55c4fd7214e0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd725140 con 0x55c4fd7214e0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd725990 con 0x55c4fd7214e0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 20 searching for the correct realm 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c4fd727700 0x55c4fd729af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.551+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c4fd727700 0x55c4fd729af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c4fd727700 0x55c4fd729af0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b7e2b640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f08ac03dc20 0x7f08ac0390d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08ac03dc20 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f08ac03dc20 0x7f08ac0390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f08ac03dc20 0x7f08ac0390d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08b001f070 con 0x7f08ac03dc20 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b8e2d640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f08b0031040 0x7f08b0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f08b0031040 0x7f08b0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f08b0031040 0x7f08b0032940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80a9de0 con 0x7f08b0031040 2024-05-08T18:09:10.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80a9de0 con 0x55c4fd7214e0 2024-05-08T18:09:10.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.555+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80a9de0 con 0x7f08b0031040 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x7f08b0031040 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08ac03dc20 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08b001f070 con 0x7f08ac03dc20 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x55c4fd7214e0 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x7f08b0031040 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x55c4fd7214e0 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08ac03dc20 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f08b001f070 con 0x7f08ac03dc20 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x7f08b0031040 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.559+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x55c4fd7214e0 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f08a80ec040 con 0x55c4fd7214e0 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80ec040 con 0x7f08b0031040 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08ac03dc20 2024-05-08T18:09:10.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08b001f070 con 0x7f08ac03dc20 2024-05-08T18:09:10.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f08a80ec040 con 0x55c4fd7214e0 2024-05-08T18:09:10.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.563+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08ac03dc20 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08b001f070 con 0x7f08ac03dc20 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd727700 2024-05-08T18:09:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08b0031040 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x55c4fd7214e0 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72a030 con 0x7f08ac03dc20 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f08b001f070 con 0x7f08ac03dc20 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd726340 con 0x55c4fd7214e0 2024-05-08T18:09:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd726be0 con 0x55c4fd7214e0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd725f80 con 0x55c4fd7214e0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 zone default found 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 4 Realm: () 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 zonegroup default 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd726be0 con 0x7f08b0031040 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72be40 con 0x55c4fd727700 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72c1e0 con 0x55c4fd727700 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 started sync module instance, tier type = 2024-05-08T18:09:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.567+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72b2e0 con 0x7f08ac03dc20 2024-05-08T18:09:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94304554104576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72cac0 con 0x7f08ac03dc20 2024-05-08T18:09:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72d310 con 0x55c4fd7214e0 2024-05-08T18:09:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94304554104576] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94304554108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72cfc0 con 0x55c4fd7214e0 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.571+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72dae0 con 0x55c4fd727700 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94304554108432] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94304554112432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72ded0 con 0x55c4fd727700 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72e890 con 0x7f08ac03dc20 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94304554116336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72efa0 con 0x7f08ac03dc20 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72fac0 con 0x55c4fd7214e0 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.575+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94304554116336] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94304554112432] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94304554109488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72fa80 con 0x55c4fd7214e0 2024-05-08T18:09:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd730360 con 0x7f08b0031040 2024-05-08T18:09:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94304554109488] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94304554120592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72ff30 con 0x7f08b0031040 2024-05-08T18:09:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.579+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd7307e0 con 0x7f08b0031040 2024-05-08T18:09:10.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94304554120592] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94304554123056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd730e90 con 0x7f08b0031040 2024-05-08T18:09:10.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72fac0 con 0x7f08b0031040 2024-05-08T18:09:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94304554123056] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94304554125792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd7312b0 con 0x7f08b0031040 2024-05-08T18:09:10.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=0 2024-05-08T18:09:10.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=1 2024-05-08T18:09:10.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=2 2024-05-08T18:09:10.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=3 2024-05-08T18:09:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=4 2024-05-08T18:09:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=5 2024-05-08T18:09:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.583+0000 7f08bab18980 20 add_watcher() i=6 2024-05-08T18:09:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94304554125792] v30'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 20 add_watcher() i=7 2024-05-08T18:09:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd734550 con 0x55c4fd7214e0 2024-05-08T18:09:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94304554127216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd731840 con 0x55c4fd7214e0 2024-05-08T18:09:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94304554127216] v30'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f076e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 5 note: GC not initialized 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f076d7e2640 20 reqs_thread_entry: start 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f08bab18980 20 Filter name: none 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.587+0000 7f06deffd640 20 reqs_thread_entry: start 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd757b00 con 0x55c4fd7214e0 2024-05-08T18:09:10.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd7584f0 con 0x55c4fd7214e0 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd759500 con 0x7f08ac03dc20 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f076e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94304554127216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd71bac0 con 0x55c4fd7214e0 2024-05-08T18:09:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94304554127216] v30'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94304554104576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd730f70 con 0x7f08ac03dc20 2024-05-08T18:09:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94304554104576] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 20 remove_watcher() i=0 2024-05-08T18:09:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 2 removed watcher, disabling cache 2024-05-08T18:09:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.591+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94304554108432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72b700 con 0x55c4fd7214e0 2024-05-08T18:09:10.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.595+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94304554108432] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.595+0000 7f08bab18980 20 remove_watcher() i=1 2024-05-08T18:09:10.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.595+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94304554112432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72b700 con 0x55c4fd727700 2024-05-08T18:09:10.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08b7e2b640 1 -- 172.21.15.114:0/3439330462 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94304554112432] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08ac00d040 con 0x55c4fd727700 2024-05-08T18:09:10.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08bab18980 20 remove_watcher() i=2 2024-05-08T18:09:10.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94304554116336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72d5b0 con 0x7f08ac03dc20 2024-05-08T18:09:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08b8e2d640 1 -- 172.21.15.114:0/3439330462 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94304554116336] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08b0040040 con 0x7f08ac03dc20 2024-05-08T18:09:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08bab18980 20 remove_watcher() i=3 2024-05-08T18:09:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94304554109488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72e4f0 con 0x55c4fd7214e0 2024-05-08T18:09:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94304554109488] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x55c4fd7214e0 2024-05-08T18:09:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08bab18980 20 remove_watcher() i=4 2024-05-08T18:09:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.599+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94304554120592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72e4f0 con 0x7f08b0031040 2024-05-08T18:09:10.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.603+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94304554120592] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.603+0000 7f08bab18980 20 remove_watcher() i=5 2024-05-08T18:09:10.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.603+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94304554123056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72cac0 con 0x7f08b0031040 2024-05-08T18:09:10.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.603+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94304554123056] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.603+0000 7f08bab18980 20 remove_watcher() i=6 2024-05-08T18:09:10.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.603+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94304554125792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c4fd72cac0 con 0x7f08b0031040 2024-05-08T18:09:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94304554125792] v30'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f08a80f5040 con 0x7f08b0031040 2024-05-08T18:09:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 20 remove_watcher() i=7 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f08b0031040 msgr2=0x7f08b0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f08b0031040 0x7f08b0032940 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd7214e0 msgr2=0x55c4fd7239a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd7214e0 0x55c4fd7239a0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f08ac03dc20 msgr2=0x7f08ac0390d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f08ac03dc20 0x7f08ac0390d0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c4fd727700 msgr2=0x55c4fd729af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c4fd727700 0x55c4fd729af0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07880383a0 msgr2=0x7f078803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07880383a0 0x7f078803a860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55c4fd6f17e0 tx=0x7f08b001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08b862c640 1 -- 172.21.15.114:0/3439330462 reap_dead start 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 msgr2=0x55c4fd716030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd716030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f08ac04d930 tx=0x7f08ac04e9a0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 shutdown_connections 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3439330462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd70ea80 0x55c4fd716030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 >> 172.21.15.114:0/3439330462 conn(0x55c4fd70ae10 msgr2=0x55c4fd7102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 shutdown_connections 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3439330462 wait complete. 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07900383f0 msgr2=0x7f079003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07900383f0 0x7f079003a8b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55c4fd6f2550 tx=0x7f08b0005850 comp rx=0 tx=0).stop 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 msgr2=0x55c4fd701c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 0x55c4fd701c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f08ac010f90 tx=0x7f08ac00f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 shutdown_connections 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07900383f0 0x7f079003a8b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/2460765543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd701860 0x55c4fd701c80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 >> 172.21.15.114:0/2460765543 conn(0x55c4fd6f6670 msgr2=0x55c4fd6f7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 shutdown_connections 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/2460765543 wait complete. 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd56afd0 msgr2=0x55c4fd6f0a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd56afd0 0x55c4fd6f0a90 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07a00383f0 msgr2=0x7f07a003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07a00383f0 0x7f07a003a8b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f08ac001e60 tx=0x7f08ac0013e0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 msgr2=0x55c4fd6e9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e9b30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f08a801b170 tx=0x7f08a80180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 shutdown_connections 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c4fd56afd0 0x55c4fd6f0a90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f07a00383f0 0x7f07a003a8b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 --2- 172.21.15.114:0/3489596726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c4fd569b10 0x55c4fd6e9b30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 >> 172.21.15.114:0/3489596726 conn(0x55c4fd5f07a0 msgr2=0x55c4fd6dceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 shutdown_connections 2024-05-08T18:09:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.607+0000 7f08bab18980 1 -- 172.21.15.114:0/3489596726 wait complete. 2024-05-08T18:09:10.618 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-05-08T18:09:10.618 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:09:10.637 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:10.638 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T18:09:10.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T18:09:10.638 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T18:09:10.694 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:10.694 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f16025f2980 1 Processor -- start 2024-05-08T18:09:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f16025f2980 1 -- start start 2024-05-08T18:09:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f16025f2980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56308e403d70 0x56308e404150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f16025f2980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56308e2b0710 con 0x56308e404690 2024-05-08T18:09:10.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f16025f2980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56308e2c4f00 con 0x56308e403d70 2024-05-08T18:09:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f1600106640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56308e403d70 0x56308e404150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f1600106640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56308e403d70 0x56308e404150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58032/0 (socket says 172.21.15.114:58032) 2024-05-08T18:09:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f15ff905640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56308e404690 0x56308e4050a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34618/0 (socket says 172.21.15.114:34618) 2024-05-08T18:09:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f1600106640 1 -- 172.21.15.114:0/1661144026 learned_addr learned my addr 172.21.15.114:0/1661144026 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f1600106640 1 -- 172.21.15.114:0/1661144026 >> v1:172.21.15.53:6789/0 conn(0x56308e404690 legacy=0x56308e4050a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.695+0000 7f1600106640 1 -- 172.21.15.114:0/1661144026 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308e28cae0 con 0x56308e403d70 2024-05-08T18:09:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f1600106640 1 --2- 172.21.15.114:0/1661144026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e403d70 0x56308e404150 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f15f000a5c0 tx=0x7f15f001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85326322494d61ff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f15ff104640 1 -- 172.21.15.114:0/1661144026 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00a6070 con 0x56308e403d70 2024-05-08T18:09:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f15ff104640 1 -- 172.21.15.114:0/1661144026 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00af070 con 0x56308e403d70 2024-05-08T18:09:10.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f15ff104640 1 -- 172.21.15.114:0/1661144026 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00aa5c0 con 0x56308e403d70 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 -- 172.21.15.114:0/1661144026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e403d70 msgr2=0x56308e404150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 --2- 172.21.15.114:0/1661144026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e403d70 0x56308e404150 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f15f000a5c0 tx=0x7f15f001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 -- 172.21.15.114:0/1661144026 shutdown_connections 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 --2- 172.21.15.114:0/1661144026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e403d70 0x56308e404150 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 -- 172.21.15.114:0/1661144026 >> 172.21.15.114:0/1661144026 conn(0x56308e3ff640 msgr2=0x56308e401a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 -- 172.21.15.114:0/1661144026 shutdown_connections 2024-05-08T18:09:10.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.699+0000 7f16025f2980 1 -- 172.21.15.114:0/1661144026 wait complete. 2024-05-08T18:09:10.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.711+0000 7f16025f2980 1 Processor -- start 2024-05-08T18:09:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.711+0000 7f16025f2980 1 -- start start 2024-05-08T18:09:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.711+0000 7f16025f2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e40dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.711+0000 7f16025f2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56308e308f80 con 0x56308e404690 2024-05-08T18:09:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e40dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e40dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58038/0 (socket says 172.21.15.114:58038) 2024-05-08T18:09:10.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 -- 172.21.15.114:0/3674921524 learned_addr learned my addr 172.21.15.114:0/3674921524 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 -- 172.21.15.114:0/3674921524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308e2d0da0 con 0x56308e404690 2024-05-08T18:09:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 --2- 172.21.15.114:0/3674921524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e40dc80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15f0018f70 tx=0x7f15f0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d68bfed1aa03ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f14ee60c640 1 -- 172.21.15.114:0/3674921524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00aa990 con 0x56308e404690 2024-05-08T18:09:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f14ee60c640 1 -- 172.21.15.114:0/3674921524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f00aab30 con 0x56308e404690 2024-05-08T18:09:10.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f14ee60c640 1 -- 172.21.15.114:0/3674921524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00aae10 con 0x56308e404690 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- 172.21.15.114:0/3674921524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 msgr2=0x56308e40dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 --2- 172.21.15.114:0/3674921524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e40dc80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15f0018f70 tx=0x7f15f0003030 comp rx=0 tx=0).stop 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- 172.21.15.114:0/3674921524 shutdown_connections 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 --2- 172.21.15.114:0/3674921524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e40dc80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- 172.21.15.114:0/3674921524 >> 172.21.15.114:0/3674921524 conn(0x56308e3ff640 msgr2=0x56308e4ec210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- 172.21.15.114:0/3674921524 shutdown_connections 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- 172.21.15.114:0/3674921524 wait complete. 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 Processor -- start 2024-05-08T18:09:10.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- start start 2024-05-08T18:09:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e4f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f16025f2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56308e40be00 con 0x56308e404690 2024-05-08T18:09:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e4f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e4f9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58054/0 (socket says 172.21.15.114:58054) 2024-05-08T18:09:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 -- 172.21.15.114:0/1828357503 learned_addr learned my addr 172.21.15.114:0/1828357503 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308e4fa240 con 0x56308e404690 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.715+0000 7f1600106640 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e4f9d00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f15f0018f70 tx=0x7f15f00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f14ece09640 1 -- 172.21.15.114:0/1828357503 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00bd8c0 con 0x56308e404690 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56308e4fa4d0 con 0x56308e404690 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56308e4fd160 con 0x56308e404690 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f14ece09640 1 -- 172.21.15.114:0/1828357503 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f0000e50 con 0x56308e404690 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f14ece09640 1 -- 172.21.15.114:0/1828357503 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f00bdb90 con 0x56308e404690 2024-05-08T18:09:10.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f14ece09640 1 -- 172.21.15.114:0/1828357503 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f15f00ce030 con 0x56308e404690 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f14ece09640 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14e80383f0 0x7f14e803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f14ece09640 1 -- 172.21.15.114:0/1828357503 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f15f00cc020 con 0x56308e404690 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f15ff905640 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14e80383f0 0x7f14e803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e4fec30 0x56308e501020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e501670 con 0x56308e4fec30 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f1600907640 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e4fec30 0x56308e501020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f15ff905640 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14e80383f0 0x7f14e803a8b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15f4001e90 tx=0x7f15f40013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f1600907640 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e4fec30 0x56308e501020 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f1600907640 1 -- 172.21.15.114:0/1828357503 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f800a4d0 con 0x56308e4fec30 2024-05-08T18:09:10.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e501f10 con 0x56308e4fec30 2024-05-08T18:09:10.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f1600907640 1 -- 172.21.15.114:0/1828357503 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15f800a4d0 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e5032c0 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f1600907640 1 -- 172.21.15.114:0/1828357503 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f15f800a4d0 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e502760 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f1600907640 1 -- 172.21.15.114:0/1828357503 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15f800a4d0 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.719+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e502bb0 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f1600907640 1 -- 172.21.15.114:0/1828357503 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f15f800a4d0 con 0x56308e4fec30 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 Processor -- start 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 -- start start 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 0x56308e5121f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56308e30cfc0 con 0x56308e511dd0 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f15ff905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 0x56308e5121f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f15ff905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 0x56308e5121f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58064/0 (socket says 172.21.15.114:58064) 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f15ff905640 1 -- 172.21.15.114:0/2179013627 learned_addr learned my addr 172.21.15.114:0/2179013627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f15ff905640 1 -- 172.21.15.114:0/2179013627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308e512730 con 0x56308e511dd0 2024-05-08T18:09:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f15ff905640 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 0x56308e5121f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f15f400e670 tx=0x7f15f400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f14e5ffb640 1 -- 172.21.15.114:0/2179013627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f4022070 con 0x56308e511dd0 2024-05-08T18:09:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56308e5131d0 con 0x56308e511dd0 2024-05-08T18:09:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56308e5136a0 con 0x56308e511dd0 2024-05-08T18:09:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f14e5ffb640 1 -- 172.21.15.114:0/2179013627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f400d660 con 0x56308e511dd0 2024-05-08T18:09:10.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f14e5ffb640 1 -- 172.21.15.114:0/2179013627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f4006070 con 0x56308e511dd0 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f14e5ffb640 1 -- 172.21.15.114:0/2179013627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f15f4025070 con 0x56308e511dd0 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f14e5ffb640 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d80383f0 0x7f14d803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f14e5ffb640 1 -- 172.21.15.114:0/2179013627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f15f4050070 con 0x56308e511dd0 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f1600907640 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d80383f0 0x7f14d803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 Processor -- start 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f1600907640 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d80383f0 0x7f14d803a8b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56308e501df0 tx=0x7f15f8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 -- start start 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.723+0000 7f16025f2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e51f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56308e40e310 con 0x56308e51f000 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e51f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e51f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58078/0 (socket says 172.21.15.114:58078) 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 -- 172.21.15.114:0/302043001 learned_addr learned my addr 172.21.15.114:0/302043001 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 -- 172.21.15.114:0/302043001 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308e51f9f0 con 0x56308e51f000 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 --2- 172.21.15.114:0/302043001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e51f420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15f404e480 tx=0x7f15f4048e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70414a47dc1f490 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f14df7fe640 1 -- 172.21.15.114:0/302043001 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f400dcc0 con 0x56308e51f000 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f14df7fe640 1 -- 172.21.15.114:0/302043001 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f4025c80 con 0x56308e51f000 2024-05-08T18:09:10.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f14df7fe640 1 -- 172.21.15.114:0/302043001 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f400de60 con 0x56308e51f000 2024-05-08T18:09:10.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/302043001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 msgr2=0x56308e51f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 --2- 172.21.15.114:0/302043001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e51f420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f15f404e480 tx=0x7f15f4048e90 comp rx=0 tx=0).stop 2024-05-08T18:09:10.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/302043001 shutdown_connections 2024-05-08T18:09:10.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 --2- 172.21.15.114:0/302043001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e51f420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/302043001 >> 172.21.15.114:0/302043001 conn(0x56308e51b390 msgr2=0x56308e5193f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/302043001 shutdown_connections 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/302043001 wait complete. 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 Processor -- start 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- start start 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e526570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56308e520140 con 0x56308e51f000 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e526570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e526570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58094/0 (socket says 172.21.15.114:58094) 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 learned_addr learned my addr 172.21.15.114:0/3384754422 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308e526ab0 con 0x56308e51f000 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f15ff905640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e526570 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f15f400ccc0 tx=0x7f15f404e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f14ddffb640 1 -- 172.21.15.114:0/3384754422 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f4025e30 con 0x56308e51f000 2024-05-08T18:09:10.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56308e526ab0 con 0x56308e51f000 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56308e526ab0 con 0x56308e51f000 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f14ddffb640 1 -- 172.21.15.114:0/3384754422 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f403ea30 con 0x56308e51f000 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.727+0000 7f14ddffb640 1 -- 172.21.15.114:0/3384754422 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f15f403ebe0 con 0x56308e51f000 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f14ddffb640 1 -- 172.21.15.114:0/3384754422 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f15f400c2b0 con 0x56308e51f000 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f14ddffb640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d00383f0 0x7f14d003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f14ddffb640 1 -- 172.21.15.114:0/3384754422 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f15f4043070 con 0x56308e51f000 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600907640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d00383f0 0x7f14d003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e531660 0x56308e533af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e534240 con 0x56308e531660 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e531660 0x56308e533af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600907640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d00383f0 0x7f14d003a8b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x56308e4fe2a0 tx=0x7f15f801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e531660 0x56308e533af0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 realm 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e534650 con 0x56308e531660 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e534ef0 con 0x56308e531660 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e535290 con 0x56308e531660 2024-05-08T18:09:10.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e535ae0 con 0x56308e531660 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 20 searching for the correct realm 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56308e537850 0x56308e539c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f15ff905640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56308e537850 0x56308e539c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f15ff905640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56308e537850 0x56308e539c40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f15ff905640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f15f4027060 0x7f15f4034a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f4027060 2024-05-08T18:09:10.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.731+0000 7f1600907640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f15f4027060 0x7f15f4034a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600907640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f15f4027060 0x7f15f4034a20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f801f070 con 0x7f15f4027060 2024-05-08T18:09:10.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600907640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f15f8031040 0x7f15f8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f15f8031040 0x7f15f8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f15f8031040 0x7f15f8032940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x7f15f8031040 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x7f15f8031040 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x7f15f8031040 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f4027060 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f801f070 con 0x7f15f4027060 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.735+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x7f15f8031040 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f4027060 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f15f801f070 con 0x7f15f4027060 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x7f15f8031040 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00c6d20 con 0x7f15f8031040 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.739+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f4027060 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f801f070 con 0x7f15f4027060 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f15f00c6d20 con 0x56308e531660 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f4027060 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f801f070 con 0x7f15f4027060 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e537850 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f8031040 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x56308e531660 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a180 con 0x7f15f4027060 2024-05-08T18:09:10.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f15f801f070 con 0x7f15f4027060 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.743+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e536460 con 0x56308e531660 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e536d00 con 0x56308e531660 2024-05-08T18:09:10.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e5360a0 con 0x56308e531660 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 zone default found 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 4 Realm: () 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 zonegroup default 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e53a5b0 con 0x7f15f8031040 2024-05-08T18:09:10.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e53c440 con 0x56308e537850 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e53c7e0 con 0x56308e537850 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 started sync module instance, tier type = 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:10.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53b880 con 0x7f15f4027060 2024-05-08T18:09:10.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94766546271392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53d030 con 0x7f15f4027060 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.747+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53d880 con 0x56308e531660 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94766546271392] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94766546275200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53d450 con 0x56308e531660 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53deb0 con 0x56308e537850 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94766546278800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53e750 con 0x56308e537850 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53f110 con 0x7f15f4027060 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.751+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94766546275200] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94766546283616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53f080 con 0x7f15f4027060 2024-05-08T18:09:10.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53fea0 con 0x56308e531660 2024-05-08T18:09:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94766546278800] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94766546283616] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94766546281120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53fea0 con 0x56308e531660 2024-05-08T18:09:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.755+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e5402d0 con 0x7f15f8031040 2024-05-08T18:09:10.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94766546281120] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94766546288560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53f9b0 con 0x7f15f8031040 2024-05-08T18:09:10.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e540ce0 con 0x7f15f8031040 2024-05-08T18:09:10.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94766546290736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e541100 con 0x7f15f8031040 2024-05-08T18:09:10.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e541b40 con 0x7f15f8031040 2024-05-08T18:09:10.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.759+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94766546288560] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94766546290736] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94766546294288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e540c50 con 0x7f15f8031040 2024-05-08T18:09:10.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=0 2024-05-08T18:09:10.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=1 2024-05-08T18:09:10.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=2 2024-05-08T18:09:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=3 2024-05-08T18:09:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=4 2024-05-08T18:09:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=5 2024-05-08T18:09:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.763+0000 7f16025f2980 20 add_watcher() i=6 2024-05-08T18:09:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94766546294288] v30'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 add_watcher() i=7 2024-05-08T18:09:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e544c40 con 0x56308e531660 2024-05-08T18:09:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94766546285824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e5420c0 con 0x56308e531660 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94766546285824] v30'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f14b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 5 note: GC not initialized 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f14b57e2640 20 reqs_thread_entry: start 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 Filter name: none 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1426ffd640 20 reqs_thread_entry: start 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e567f60 con 0x56308e531660 2024-05-08T18:09:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e568950 con 0x56308e531660 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56308e569960 con 0x7f15f4027060 2024-05-08T18:09:10.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.767+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f14b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94766546285824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e565cf0 con 0x56308e531660 2024-05-08T18:09:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94766546285824] v30'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94766546271392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e565cf0 con 0x7f15f4027060 2024-05-08T18:09:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94766546271392] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f16025f2980 20 remove_watcher() i=0 2024-05-08T18:09:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f16025f2980 2 removed watcher, disabling cache 2024-05-08T18:09:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.771+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94766546275200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e565cf0 con 0x56308e531660 2024-05-08T18:09:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94766546275200] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f16025f2980 20 remove_watcher() i=1 2024-05-08T18:09:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94766546278800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e565cf0 con 0x56308e537850 2024-05-08T18:09:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f15ff905640 1 -- 172.21.15.114:0/3384754422 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94766546278800] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f405a040 con 0x56308e537850 2024-05-08T18:09:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f16025f2980 20 remove_watcher() i=2 2024-05-08T18:09:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94766546283616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53bca0 con 0x7f15f4027060 2024-05-08T18:09:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f1600907640 1 -- 172.21.15.114:0/3384754422 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94766546283616] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f8040040 con 0x7f15f4027060 2024-05-08T18:09:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f16025f2980 20 remove_watcher() i=3 2024-05-08T18:09:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.775+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94766546281120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53cb80 con 0x56308e531660 2024-05-08T18:09:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.779+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94766546281120] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x56308e531660 2024-05-08T18:09:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.779+0000 7f16025f2980 20 remove_watcher() i=4 2024-05-08T18:09:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.779+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94766546288560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53ec60 con 0x7f15f8031040 2024-05-08T18:09:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.779+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94766546288560] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.779+0000 7f16025f2980 20 remove_watcher() i=5 2024-05-08T18:09:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.779+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94766546290736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53bca0 con 0x7f15f8031040 2024-05-08T18:09:10.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.783+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94766546290736] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.783+0000 7f16025f2980 20 remove_watcher() i=6 2024-05-08T18:09:10.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.783+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94766546294288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56308e53e2a0 con 0x7f15f8031040 2024-05-08T18:09:10.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94766546294288] v30'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f15f00f9040 con 0x7f15f8031040 2024-05-08T18:09:10.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 20 remove_watcher() i=7 2024-05-08T18:09:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f15f8031040 msgr2=0x7f15f8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f15f8031040 0x7f15f8032940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e531660 msgr2=0x56308e533af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e531660 0x56308e533af0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f15f4027060 msgr2=0x7f15f4034a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f15f4027060 0x7f15f4034a20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56308e537850 msgr2=0x56308e539c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56308e537850 0x56308e539c40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d00383f0 msgr2=0x7f14d003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d00383f0 0x7f14d003a8b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x56308e4fe2a0 tx=0x7f15f801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 msgr2=0x56308e526570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/3384754422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e51f000 0x56308e526570 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f15f400ccc0 tx=0x7f15f404e410 comp rx=0 tx=0).stop 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 reap_dead start 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f1600106640 1 -- 172.21.15.114:0/3384754422 reap_dead start 2024-05-08T18:09:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 shutdown_connections 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 >> 172.21.15.114:0/3384754422 conn(0x56308e51b390 msgr2=0x56308e520860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 shutdown_connections 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/3384754422 wait complete. 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d80383f0 msgr2=0x7f14d803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d80383f0 0x7f14d803a8b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56308e501df0 tx=0x7f15f8005850 comp rx=0 tx=0).stop 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 msgr2=0x56308e5121f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 0x56308e5121f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f15f400e670 tx=0x7f15f400ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 shutdown_connections 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14d80383f0 0x7f14d803a8b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/2179013627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e511dd0 0x56308e5121f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 >> 172.21.15.114:0/2179013627 conn(0x56308e506be0 msgr2=0x56308e5076f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 shutdown_connections 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/2179013627 wait complete. 2024-05-08T18:09:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e4fec30 msgr2=0x56308e501020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e4fec30 0x56308e501020 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14e80383f0 msgr2=0x7f14e803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14e80383f0 0x7f14e803a8b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f15f4001e90 tx=0x7f15f40013f0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 msgr2=0x56308e4f9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e4f9d00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f15f0018f70 tx=0x7f15f00180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 shutdown_connections 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56308e4fec30 0x56308e501020 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f14e80383f0 0x7f14e803a8b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 --2- 172.21.15.114:0/1828357503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308e404690 0x56308e4f9d00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 >> 172.21.15.114:0/1828357503 conn(0x56308e3ff640 msgr2=0x56308e40c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 shutdown_connections 2024-05-08T18:09:10.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.787+0000 7f16025f2980 1 -- 172.21.15.114:0/1828357503 wait complete. 2024-05-08T18:09:10.796 INFO:teuthology.orchestra.run.smithi114.stdout:["myfoo"] 2024-05-08T18:09:10.796 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T18:09:10.800 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:10.800 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T18:09:10.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T18:09:10.800 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T18:09:10.862 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:10.862 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dcaed6980 1 Processor -- start 2024-05-08T18:09:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dcaed6980 1 -- start start 2024-05-08T18:09:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dcaed6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5608724afef0 0x5608724b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dcaed6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56087235b710 con 0x5608724b0810 2024-05-08T18:09:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dcaed6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56087236ff00 con 0x5608724afef0 2024-05-08T18:09:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dc89ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5608724afef0 0x5608724b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dc89ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5608724afef0 0x5608724b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58096/0 (socket says 172.21.15.114:58096) 2024-05-08T18:09:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dc89ea640 1 -- 172.21.15.114:0/917774316 learned_addr learned my addr 172.21.15.114:0/917774316 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dc89ea640 1 -- 172.21.15.114:0/917774316 >> v1:172.21.15.53:6789/0 conn(0x5608724b0810 legacy=0x5608724b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.863+0000 7f8dc89ea640 1 -- 172.21.15.114:0/917774316 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560872337ae0 con 0x5608724afef0 2024-05-08T18:09:10.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/917774316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608724b02d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8db800a4e0 tx=0x7f8db801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1e5fce01d0d843 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dc79e8640 1 -- 172.21.15.114:0/917774316 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80aa540 con 0x5608724afef0 2024-05-08T18:09:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dc79e8640 1 -- 172.21.15.114:0/917774316 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80aa6e0 con 0x5608724afef0 2024-05-08T18:09:10.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dc79e8640 1 -- 172.21.15.114:0/917774316 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80aaa40 con 0x5608724afef0 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 -- 172.21.15.114:0/917774316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 msgr2=0x5608724b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/917774316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608724b02d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8db800a4e0 tx=0x7f8db801b090 comp rx=0 tx=0).stop 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 -- 172.21.15.114:0/917774316 shutdown_connections 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/917774316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608724b02d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 -- 172.21.15.114:0/917774316 >> 172.21.15.114:0/917774316 conn(0x5608724ab7c0 msgr2=0x5608724adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 -- 172.21.15.114:0/917774316 shutdown_connections 2024-05-08T18:09:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.867+0000 7f8dcaed6980 1 -- 172.21.15.114:0/917774316 wait complete. 2024-05-08T18:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dcaed6980 1 Processor -- start 2024-05-08T18:09:10.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dcaed6980 1 -- start start 2024-05-08T18:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dcaed6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x560872426650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dcaed6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608723b3f80 con 0x5608724afef0 2024-05-08T18:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dc89ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x560872426650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dc89ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x560872426650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58102/0 (socket says 172.21.15.114:58102) 2024-05-08T18:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dc89ea640 1 -- 172.21.15.114:0/1977053024 learned_addr learned my addr 172.21.15.114:0/1977053024 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.879+0000 7f8dc89ea640 1 -- 172.21.15.114:0/1977053024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56087237bda0 con 0x5608724afef0 2024-05-08T18:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/1977053024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x560872426650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8db8017ca0 tx=0x7f8db80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b77eea74fe63f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8cb6e0d640 1 -- 172.21.15.114:0/1977053024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80b9070 con 0x5608724afef0 2024-05-08T18:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8cb6e0d640 1 -- 172.21.15.114:0/1977053024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80aaa80 con 0x5608724afef0 2024-05-08T18:09:10.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8cb6e0d640 1 -- 172.21.15.114:0/1977053024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80aad60 con 0x5608724afef0 2024-05-08T18:09:10.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1977053024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 msgr2=0x560872426650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/1977053024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x560872426650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8db8017ca0 tx=0x7f8db80033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1977053024 shutdown_connections 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/1977053024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x560872426650 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1977053024 >> 172.21.15.114:0/1977053024 conn(0x5608724ab7c0 msgr2=0x5608725971e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1977053024 shutdown_connections 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1977053024 wait complete. 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 Processor -- start 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- start start 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608725a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608724b9ef0 con 0x5608724afef0 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dc89ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608725a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dc89ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608725a4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58112/0 (socket says 172.21.15.114:58112) 2024-05-08T18:09:10.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dc89ea640 1 -- 172.21.15.114:0/3474006313 learned_addr learned my addr 172.21.15.114:0/3474006313 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dc89ea640 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608725a5070 con 0x5608724afef0 2024-05-08T18:09:10.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608725a4b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8db8017ca0 tx=0x7f8db8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8cb560a640 1 -- 172.21.15.114:0/3474006313 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80b9070 con 0x5608724afef0 2024-05-08T18:09:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608725a5300 con 0x5608724afef0 2024-05-08T18:09:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608725a7f90 con 0x5608724afef0 2024-05-08T18:09:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8cb560a640 1 -- 172.21.15.114:0/3474006313 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8db80c7410 con 0x5608724afef0 2024-05-08T18:09:10.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.883+0000 7f8cb560a640 1 -- 172.21.15.114:0/3474006313 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8db80c76f0 con 0x5608724afef0 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8cb560a640 1 -- 172.21.15.114:0/3474006313 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8db80b3040 con 0x5608724afef0 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8cb560a640 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8cb00383f0 0x7f8cb003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8cb560a640 1 -- 172.21.15.114:0/3474006313 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f8db80c4070 con 0x5608724afef0 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8cb00383f0 0x7f8cb003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608724b0810 0x5608725abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725ac120 con 0x5608724b0810 2024-05-08T18:09:10.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608724b0810 0x5608725abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8cb00383f0 0x7f8cb003a8b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc001ec0 tx=0x7f8dbc001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608724b0810 0x5608725abbe0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 -- 172.21.15.114:0/3474006313 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8dc00083f0 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725ac970 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 -- 172.21.15.114:0/3474006313 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8dc00083f0 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725add20 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 -- 172.21.15.114:0/3474006313 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8dc00083f0 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725ad1c0 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 -- 172.21.15.114:0/3474006313 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8dc00083f0 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725ad5e0 con 0x5608724b0810 2024-05-08T18:09:10.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc91eb640 1 -- 172.21.15.114:0/3474006313 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8dc00083f0 con 0x5608724b0810 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 Processor -- start 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- start start 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 0x5608725bcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dcaed6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608723b7fc0 con 0x5608725bc870 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc81e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 0x5608725bcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc81e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 0x5608725bcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58128/0 (socket says 172.21.15.114:58128) 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.887+0000 7f8dc81e9640 1 -- 172.21.15.114:0/852769776 learned_addr learned my addr 172.21.15.114:0/852769776 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc81e9640 1 -- 172.21.15.114:0/852769776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608725bd1d0 con 0x5608725bc870 2024-05-08T18:09:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 0x5608725bcc90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc010fd0 tx=0x7f8dbc00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8cae7fc640 1 -- 172.21.15.114:0/852769776 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc00a040 con 0x5608725bc870 2024-05-08T18:09:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608725bdc70 con 0x5608725bc870 2024-05-08T18:09:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8cae7fc640 1 -- 172.21.15.114:0/852769776 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc017050 con 0x5608725bc870 2024-05-08T18:09:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8cae7fc640 1 -- 172.21.15.114:0/852769776 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc00e6b0 con 0x5608725bc870 2024-05-08T18:09:10.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608725be140 con 0x5608725bc870 2024-05-08T18:09:10.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8cae7fc640 1 -- 172.21.15.114:0/852769776 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8dbc00e8e0 con 0x5608725bc870 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8cae7fc640 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8ca00383f0 0x7f8ca003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8cae7fc640 1 -- 172.21.15.114:0/852769776 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f8dbc0506b0 con 0x5608725bc870 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8ca00383f0 0x7f8ca003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dcaed6980 1 Processor -- start 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dcaed6980 1 -- start start 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8ca00383f0 0x7f8ca003a8b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5608725ad560 tx=0x7f8dc0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dcaed6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dcaed6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560872426ce0 con 0x5608725c9a50 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc81e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc81e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58130/0 (socket says 172.21.15.114:58130) 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc81e9640 1 -- 172.21.15.114:0/1040026435 learned_addr learned my addr 172.21.15.114:0/1040026435 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.891+0000 7f8dc81e9640 1 -- 172.21.15.114:0/1040026435 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608725ca440 con 0x5608725c9a50 2024-05-08T18:09:10.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/1040026435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725c9e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc04ea30 tx=0x7f8dbc01ae40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d58279597d986d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8c9ffff640 1 -- 172.21.15.114:0/1040026435 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc01c410 con 0x5608725c9a50 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8c9ffff640 1 -- 172.21.15.114:0/1040026435 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc04c070 con 0x5608725c9a50 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8c9ffff640 1 -- 172.21.15.114:0/1040026435 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc01a310 con 0x5608725c9a50 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1040026435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 msgr2=0x5608725c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/1040026435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725c9e70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc04ea30 tx=0x7f8dbc01ae40 comp rx=0 tx=0).stop 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1040026435 shutdown_connections 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/1040026435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725c9e70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1040026435 >> 172.21.15.114:0/1040026435 conn(0x5608725c5de0 msgr2=0x5608725c3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1040026435 shutdown_connections 2024-05-08T18:09:10.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/1040026435 wait complete. 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 Processor -- start 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- start start 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608725cab90 con 0x5608725c9a50 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dc81e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dc81e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58134/0 (socket says 172.21.15.114:58134) 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 learned_addr learned my addr 172.21.15.114:0/473068162 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608725d1500 con 0x5608725c9a50 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725d0fc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc01cc40 tx=0x7f8dbc04e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8c9e7fc640 1 -- 172.21.15.114:0/473068162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc034070 con 0x5608725c9a50 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608725d1790 con 0x5608725c9a50 2024-05-08T18:09:10.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8c9e7fc640 1 -- 172.21.15.114:0/473068162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dbc0500d0 con 0x5608725c9a50 2024-05-08T18:09:10.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608725d4470 con 0x5608725c9a50 2024-05-08T18:09:10.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.895+0000 7f8c9e7fc640 1 -- 172.21.15.114:0/473068162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8dbc050410 con 0x5608725c9a50 2024-05-08T18:09:10.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8c9e7fc640 1 -- 172.21.15.114:0/473068162 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8dbc037070 con 0x5608725c9a50 2024-05-08T18:09:10.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8c9e7fc640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c940383a0 0x7f8c9403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8c9e7fc640 1 -- 172.21.15.114:0/473068162 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f8dbc030cc0 con 0x5608725c9a50 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c940383a0 0x7f8c9403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608725dc4e0 0x5608725de980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725df0d0 con 0x5608725dc4e0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608725dc4e0 0x5608725de980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c940383a0 0x7f8c9403a860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000f010 tx=0x7f8dc001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608725dc4e0 0x5608725de980 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 realm 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725df4e0 con 0x5608725dc4e0 2024-05-08T18:09:10.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725dfdb0 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e0150 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e05f0 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 20 searching for the correct realm 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608725e2560 0x5608725e4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608725e2560 0x5608725e4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608725e2560 0x5608725e4950 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc81e9640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8dbc039060 0x7f8dbc03d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8dbc039060 0x7f8dbc03d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.899+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8dbc039060 0x7f8dbc03d540 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc91eb640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8dc0019040 0x7f8dc0019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8dc0019040 0x7f8dc0019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8dc0019040 0x7f8dc0019930 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x7f8dc0019040 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x7f8dc0019040 2024-05-08T18:09:10.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x7f8dc0019040 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.903+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x7f8dc0019040 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x7f8dc0019040 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80cd060 con 0x7f8dc0019040 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.907+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8db80cd060 con 0x5608725dc4e0 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725e2560 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dc0019040 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.911+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e4fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:10.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e0fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e0c10 con 0x5608725dc4e0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:10.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e18f0 con 0x5608725dc4e0 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 zone default found 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 4 Realm: () 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 zonegroup default 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e18f0 con 0x7f8dc0019040 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e6e10 con 0x5608725e2560 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725e71b0 con 0x5608725e2560 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 started sync module instance, tier type = 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dbc039060 2024-05-08T18:09:10.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94594278516384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e5f10 con 0x7f8dbc039060 2024-05-08T18:09:10.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.915+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e8070 con 0x5608725dc4e0 2024-05-08T18:09:10.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94594278516384] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94594278520224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e8070 con 0x5608725dc4e0 2024-05-08T18:09:10.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e8a30 con 0x5608725e2560 2024-05-08T18:09:10.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94594278520224] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94594278521792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e7fe0 con 0x5608725e2560 2024-05-08T18:09:10.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.919+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e9770 con 0x7f8dbc039060 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94594278527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725ea010 con 0x7f8dbc039060 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725eaa30 con 0x5608725dc4e0 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94594278521792] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94594278527616] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94594278532384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e9b60 con 0x5608725dc4e0 2024-05-08T18:09:10.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.923+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725eb300 con 0x7f8dc0019040 2024-05-08T18:09:10.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94594278532384] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94594278526416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e9b60 con 0x7f8dc0019040 2024-05-08T18:09:10.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725eb720 con 0x7f8dc0019040 2024-05-08T18:09:10.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94594278535792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725ebb40 con 0x7f8dc0019040 2024-05-08T18:09:10.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.927+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725ec640 con 0x7f8dc0019040 2024-05-08T18:09:10.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94594278526416] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94594278535792] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94594278539568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725eac00 con 0x7f8dc0019040 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=0 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=1 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=2 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=3 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=4 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=5 2024-05-08T18:09:10.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.931+0000 7f8dcaed6980 20 add_watcher() i=6 2024-05-08T18:09:10.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94594278539568] v30'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 20 add_watcher() i=7 2024-05-08T18:09:10.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:10.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5608725ef630 con 0x5608725dc4e0 2024-05-08T18:09:10.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94594278536848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725ecab0 con 0x5608725dc4e0 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94594278536848] v30'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8c7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 5 note: GC not initialized 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8c7dfe3640 20 reqs_thread_entry: start 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 20 Filter name: none 2024-05-08T18:09:10.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8bef7fe640 20 reqs_thread_entry: start 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560872612490 con 0x5608725e2560 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560872612490 con 0x5608725e2560 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x560872612490 con 0x5608725dc4e0 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e0fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e0fd0 con 0x7f8dbc039060 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.935+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725dc4e0 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dbc039060 2024-05-08T18:09:10.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725dc4e0 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.939+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dbc039060 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725dc4e0 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725dc4e0 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dbc039060 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725dc4e0 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.943+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dbc039060 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dc0019040 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725dc4e0 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(91 [pgnls start_epoch 30 out=127b] v30'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x5608725e2560 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5608725e62b0 con 0x7f8dbc039060 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got myfoo 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dcaed6980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:10.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8c7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94594278536848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e0fd0 con 0x5608725dc4e0 2024-05-08T18:09:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94594278536848] v30'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.947+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94594278516384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725eb690 con 0x7f8dbc039060 2024-05-08T18:09:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94594278516384] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dcaed6980 20 remove_watcher() i=0 2024-05-08T18:09:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dcaed6980 2 removed watcher, disabling cache 2024-05-08T18:09:10.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94594278520224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e66a0 con 0x5608725dc4e0 2024-05-08T18:09:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94594278520224] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dcaed6980 20 remove_watcher() i=1 2024-05-08T18:09:10.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.951+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94594278521792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e66a0 con 0x5608725e2560 2024-05-08T18:09:10.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dc81e9640 1 -- 172.21.15.114:0/473068162 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94594278521792] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dbc036030 con 0x5608725e2560 2024-05-08T18:09:10.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dcaed6980 20 remove_watcher() i=2 2024-05-08T18:09:10.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94594278527616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e7bc0 con 0x7f8dbc039060 2024-05-08T18:09:10.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dc91eb640 1 -- 172.21.15.114:0/473068162 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94594278527616] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8dc002f040 con 0x7f8dbc039060 2024-05-08T18:09:10.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dcaed6980 20 remove_watcher() i=3 2024-05-08T18:09:10.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94594278532384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e7bc0 con 0x5608725dc4e0 2024-05-08T18:09:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94594278532384] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x5608725dc4e0 2024-05-08T18:09:10.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dcaed6980 20 remove_watcher() i=4 2024-05-08T18:09:10.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.955+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94594278526416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725ea520 con 0x7f8dc0019040 2024-05-08T18:09:10.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.959+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94594278526416] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.959+0000 7f8dcaed6980 20 remove_watcher() i=5 2024-05-08T18:09:10.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.959+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94594278535792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725e7bc0 con 0x7f8dc0019040 2024-05-08T18:09:10.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.959+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94594278535792] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.959+0000 7f8dcaed6980 20 remove_watcher() i=6 2024-05-08T18:09:10.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.959+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94594278539568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5608725ea520 con 0x7f8dc0019040 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94594278539568] v30'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8db80f9040 con 0x7f8dc0019040 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 20 remove_watcher() i=7 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8dc0019040 msgr2=0x7f8dc0019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8dc0019040 0x7f8dc0019930 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608725dc4e0 msgr2=0x5608725de980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608725dc4e0 0x5608725de980 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8dbc039060 msgr2=0x7f8dbc03d540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8dbc039060 0x7f8dbc03d540 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608725e2560 msgr2=0x5608725e4950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608725e2560 0x5608725e4950 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c940383a0 msgr2=0x7f8c9403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8c940383a0 0x7f8c9403a860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000f010 tx=0x7f8dc001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 msgr2=0x5608725d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dc89ea640 1 -- 172.21.15.114:0/473068162 reap_dead start 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725d0fc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc01cc40 tx=0x7f8dbc04e990 comp rx=0 tx=0).stop 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 shutdown_connections 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/473068162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725c9a50 0x5608725d0fc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 >> 172.21.15.114:0/473068162 conn(0x5608725c5de0 msgr2=0x5608725cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 shutdown_connections 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/473068162 wait complete. 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8ca00383f0 msgr2=0x7f8ca003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8ca00383f0 0x7f8ca003a8b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x5608725ad560 tx=0x7f8dc0003070 comp rx=0 tx=0).stop 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 msgr2=0x5608725bcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 0x5608725bcc90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc010fd0 tx=0x7f8dbc00f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 shutdown_connections 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8ca00383f0 0x7f8ca003a8b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/852769776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608725bc870 0x5608725bcc90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 >> 172.21.15.114:0/852769776 conn(0x5608725b1680 msgr2=0x5608725b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 shutdown_connections 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/852769776 wait complete. 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608724b0810 msgr2=0x5608725abbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608724b0810 0x5608725abbe0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8cb00383f0 msgr2=0x7f8cb003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8cb00383f0 0x7f8cb003a8b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc001ec0 tx=0x7f8dbc001440 comp rx=0 tx=0).stop 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 msgr2=0x5608725a4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608725a4b30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8db8017ca0 tx=0x7f8db8017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 shutdown_connections 2024-05-08T18:09:10.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608724b0810 0x5608725abbe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8cb00383f0 0x7f8cb003a8b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 --2- 172.21.15.114:0/3474006313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608724afef0 0x5608725a4b30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 >> 172.21.15.114:0/3474006313 conn(0x5608724ab7c0 msgr2=0x5608724250c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 shutdown_connections 2024-05-08T18:09:10.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:10.963+0000 7f8dcaed6980 1 -- 172.21.15.114:0/3474006313 wait complete. 2024-05-08T18:09:10.974 INFO:teuthology.orchestra.run.smithi114.stdout:["myfoo"] 2024-05-08T18:09:10.974 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T18:09:10.989 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:11.002 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:11.014 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:11.059 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-08T18:09:11.129 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:11.202 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:11.275 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:11.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:09:11.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:09:11.275 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:09:11.312 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:11.312 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.311+0000 7f68df60e980 1 Processor -- start 2024-05-08T18:09:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.311+0000 7f68df60e980 1 -- start start 2024-05-08T18:09:11.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.311+0000 7f68df60e980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c0b1c55820 0x55c0b1ce5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.311+0000 7f68df60e980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0b1b8c710 con 0x55c0b1ce64b0 2024-05-08T18:09:11.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.311+0000 7f68df60e980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c0b1ba0f00 con 0x55c0b1c55820 2024-05-08T18:09:11.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dd122640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c0b1c55820 0x55c0b1ce5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dc921640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c0b1ce64b0 0x55c0b1ce88a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34630/0 (socket says 172.21.15.114:34630) 2024-05-08T18:09:11.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dd122640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c0b1c55820 0x55c0b1ce5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58150/0 (socket says 172.21.15.114:58150) 2024-05-08T18:09:11.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dc921640 1 -- 172.21.15.114:0/4263301196 learned_addr learned my addr 172.21.15.114:0/4263301196 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:11.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dd122640 1 -- 172.21.15.114:0/4263301196 >> v1:172.21.15.53:6789/0 conn(0x55c0b1ce64b0 legacy=0x55c0b1ce88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dd122640 1 -- 172.21.15.114:0/4263301196 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b1b68ae0 con 0x55c0b1c55820 2024-05-08T18:09:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68dd122640 1 --2- 172.21.15.114:0/4263301196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1ce5f70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68d000a420 tx=0x7f68d001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d6f77e0ecb5c54 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68d7fff640 1 -- 172.21.15.114:0/4263301196 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d00af070 con 0x55c0b1c55820 2024-05-08T18:09:11.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68d7fff640 1 -- 172.21.15.114:0/4263301196 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d00aa530 con 0x55c0b1c55820 2024-05-08T18:09:11.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.315+0000 7f68d7fff640 1 -- 172.21.15.114:0/4263301196 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d00aa850 con 0x55c0b1c55820 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 -- 172.21.15.114:0/4263301196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 msgr2=0x55c0b1ce5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 --2- 172.21.15.114:0/4263301196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1ce5f70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f68d000a420 tx=0x7f68d001afd0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 -- 172.21.15.114:0/4263301196 shutdown_connections 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 --2- 172.21.15.114:0/4263301196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1ce5f70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 -- 172.21.15.114:0/4263301196 >> 172.21.15.114:0/4263301196 conn(0x55c0b1cdb690 msgr2=0x55c0b1cddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 -- 172.21.15.114:0/4263301196 shutdown_connections 2024-05-08T18:09:11.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.319+0000 7f68df60e980 1 -- 172.21.15.114:0/4263301196 wait complete. 2024-05-08T18:09:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 Processor -- start 2024-05-08T18:09:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- start start 2024-05-08T18:09:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1dce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0b1be4f80 con 0x55c0b1c55820 2024-05-08T18:09:11.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1dce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1dce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58158/0 (socket says 172.21.15.114:58158) 2024-05-08T18:09:11.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 -- 172.21.15.114:0/1708600733 learned_addr learned my addr 172.21.15.114:0/1708600733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 -- 172.21.15.114:0/1708600733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b1bacda0 con 0x55c0b1c55820 2024-05-08T18:09:11.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 --2- 172.21.15.114:0/1708600733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1dce190 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68d000a420 tx=0x7f68d00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b9e98b4841466f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f67cb606640 1 -- 172.21.15.114:0/1708600733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d00af050 con 0x55c0b1c55820 2024-05-08T18:09:11.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f67cb606640 1 -- 172.21.15.114:0/1708600733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d00b0040 con 0x55c0b1c55820 2024-05-08T18:09:11.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f67cb606640 1 -- 172.21.15.114:0/1708600733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d00aac60 con 0x55c0b1c55820 2024-05-08T18:09:11.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- 172.21.15.114:0/1708600733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 msgr2=0x55c0b1dce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 --2- 172.21.15.114:0/1708600733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1dce190 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f68d000a420 tx=0x7f68d00033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- 172.21.15.114:0/1708600733 shutdown_connections 2024-05-08T18:09:11.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 --2- 172.21.15.114:0/1708600733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1c55820 0x55c0b1dce190 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- 172.21.15.114:0/1708600733 >> 172.21.15.114:0/1708600733 conn(0x55c0b1cdb690 msgr2=0x55c0b1dc9d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- 172.21.15.114:0/1708600733 shutdown_connections 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- 172.21.15.114:0/1708600733 wait complete. 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 Processor -- start 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- start start 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 0x55c0b1dd5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68df60e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0b1ceca80 con 0x55c0b1ce64b0 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 0x55c0b1dd5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 0x55c0b1dd5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58164/0 (socket says 172.21.15.114:58164) 2024-05-08T18:09:11.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.335+0000 7f68dd122640 1 -- 172.21.15.114:0/154399110 learned_addr learned my addr 172.21.15.114:0/154399110 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dd122640 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b1dd5b50 con 0x55c0b1ce64b0 2024-05-08T18:09:11.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dd122640 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 0x55c0b1dd5610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f68d00aa500 tx=0x7f68d0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f67c9e03640 1 -- 172.21.15.114:0/154399110 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d00c5030 con 0x55c0b1ce64b0 2024-05-08T18:09:11.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f67c9e03640 1 -- 172.21.15.114:0/154399110 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68d00c15b0 con 0x55c0b1ce64b0 2024-05-08T18:09:11.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0b1dd5de0 con 0x55c0b1ce64b0 2024-05-08T18:09:11.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f67c9e03640 1 -- 172.21.15.114:0/154399110 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68d00c1890 con 0x55c0b1ce64b0 2024-05-08T18:09:11.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0b1dd8a70 con 0x55c0b1ce64b0 2024-05-08T18:09:11.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f67c9e03640 1 -- 172.21.15.114:0/154399110 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f68d00c8070 con 0x55c0b1ce64b0 2024-05-08T18:09:11.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f67c9e03640 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67c40383f0 0x7f67c403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f67c9e03640 1 -- 172.21.15.114:0/154399110 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f68d00c6070 con 0x55c0b1ce64b0 2024-05-08T18:09:11.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dc921640 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67c40383f0 0x7f67c403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1dda6b0 0x55c0b1ddcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1ddcfe0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dd923640 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1dda6b0 0x55c0b1ddcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dc921640 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67c40383f0 0x7f67c403a8b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f68c8004180 tx=0x7f68c8001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dd923640 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1dda6b0 0x55c0b1ddcaa0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68dd923640 1 -- 172.21.15.114:0/154399110 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d80083f0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.339+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1dd9c90 con 0x55c0b1dda6b0 2024-05-08T18:09:11.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dd923640 1 -- 172.21.15.114:0/154399110 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68d80083f0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1dded90 con 0x55c0b1dda6b0 2024-05-08T18:09:11.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dd923640 1 -- 172.21.15.114:0/154399110 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f68d80083f0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1dddfc0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dd923640 1 -- 172.21.15.114:0/154399110 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68d80083f0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1dde3e0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dd923640 1 -- 172.21.15.114:0/154399110 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f68d80083f0 con 0x55c0b1dda6b0 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 Processor -- start 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- start start 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 0x55c0b1dedb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0b1be8fc0 con 0x55c0b1ded710 2024-05-08T18:09:11.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dc921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 0x55c0b1dedb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dc921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 0x55c0b1dedb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58174/0 (socket says 172.21.15.114:58174) 2024-05-08T18:09:11.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dc921640 1 -- 172.21.15.114:0/3703431005 learned_addr learned my addr 172.21.15.114:0/3703431005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dc921640 1 -- 172.21.15.114:0/3703431005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b1dee070 con 0x55c0b1ded710 2024-05-08T18:09:11.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68dc921640 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 0x55c0b1dedb30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68c800d660 tx=0x7f68c800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f67c2ffd640 1 -- 172.21.15.114:0/3703431005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c800c6b0 con 0x55c0b1ded710 2024-05-08T18:09:11.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0b1deeb10 con 0x55c0b1ded710 2024-05-08T18:09:11.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f67c2ffd640 1 -- 172.21.15.114:0/3703431005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c800c850 con 0x55c0b1ded710 2024-05-08T18:09:11.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f67c2ffd640 1 -- 172.21.15.114:0/3703431005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c800cb30 con 0x55c0b1ded710 2024-05-08T18:09:11.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.343+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0b1deefe0 con 0x55c0b1ded710 2024-05-08T18:09:11.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f67c2ffd640 1 -- 172.21.15.114:0/3703431005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f68c8023020 con 0x55c0b1ded710 2024-05-08T18:09:11.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f67c2ffd640 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67b40383f0 0x7f67b403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f67c2ffd640 1 -- 172.21.15.114:0/3703431005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f68c8021020 con 0x55c0b1ded710 2024-05-08T18:09:11.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dd923640 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67b40383f0 0x7f67b403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68df60e980 1 Processor -- start 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68df60e980 1 -- start start 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dd923640 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67b40383f0 0x7f67b403a8b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c0b1dde360 tx=0x7f68d8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68df60e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1dfad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68df60e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0b1dce820 con 0x55c0b1dfa950 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dc921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1dfad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dc921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1dfad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58182/0 (socket says 172.21.15.114:58182) 2024-05-08T18:09:11.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dc921640 1 -- 172.21.15.114:0/46562029 learned_addr learned my addr 172.21.15.114:0/46562029 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dc921640 1 -- 172.21.15.114:0/46562029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b1dfb340 con 0x55c0b1dfa950 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68dc921640 1 --2- 172.21.15.114:0/46562029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1dfad70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f68c804f2f0 tx=0x7f68c80193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd70328fac511d22 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f67c0ff9640 1 -- 172.21.15.114:0/46562029 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c801bcc0 con 0x55c0b1dfa950 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f67c0ff9640 1 -- 172.21.15.114:0/46562029 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c803e0d0 con 0x55c0b1dfa950 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f67c0ff9640 1 -- 172.21.15.114:0/46562029 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c801be60 con 0x55c0b1dfa950 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68df60e980 1 -- 172.21.15.114:0/46562029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 msgr2=0x55c0b1dfad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.347+0000 7f68df60e980 1 --2- 172.21.15.114:0/46562029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1dfad70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f68c804f2f0 tx=0x7f68c80193e0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- 172.21.15.114:0/46562029 shutdown_connections 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 --2- 172.21.15.114:0/46562029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1dfad70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- 172.21.15.114:0/46562029 >> 172.21.15.114:0/46562029 conn(0x55c0b1df6ce0 msgr2=0x55c0b1df4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- 172.21.15.114:0/46562029 shutdown_connections 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- 172.21.15.114:0/46562029 wait complete. 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 Processor -- start 2024-05-08T18:09:11.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- start start 2024-05-08T18:09:11.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1e01ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c0b1dfba50 con 0x55c0b1dfa950 2024-05-08T18:09:11.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68dc921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1e01ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68dc921640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1e01ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58190/0 (socket says 172.21.15.114:58190) 2024-05-08T18:09:11.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 learned_addr learned my addr 172.21.15.114:0/314762844 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0b1e02420 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68dc921640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1e01ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f68c800dfd0 tx=0x7f68c804f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f67b2ffd640 1 -- 172.21.15.114:0/314762844 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c8032020 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0b1e026b0 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f67b2ffd640 1 -- 172.21.15.114:0/314762844 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68c801b420 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f67b2ffd640 1 -- 172.21.15.114:0/314762844 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68c801b700 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0b1e026b0 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f67b2ffd640 1 -- 172.21.15.114:0/314762844 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f68c8035020 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f67b2ffd640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67a80383f0 0x7f67a803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f67b2ffd640 1 -- 172.21.15.114:0/314762844 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f68c8005030 con 0x55c0b1dfa950 2024-05-08T18:09:11.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.351+0000 7f68dd923640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67a80383f0 0x7f67a803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1e0d1c0 0x55c0b1e0f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e0fdb0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1e0d1c0 0x55c0b1e0f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd923640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67a80383f0 0x7f67a803a8b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68d800f010 tx=0x7f68d801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1e0d1c0 0x55c0b1e0f660 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 realm 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e101c0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e10a90 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e10e30 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e11290 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 20 searching for the correct realm 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c0b1e13200 0x55c0b1e155f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dc921640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c0b1e13200 0x55c0b1e155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dc921640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c0b1e13200 0x55c0b1e155f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dc921640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f68c8037020 0x7f68c804f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68c8037020 2024-05-08T18:09:11.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd923640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f68c8037020 0x7f68c804f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd923640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f68c8037020 0x7f68c804f8a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd923640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f68d8019040 0x7f68d8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.355+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f68d8019040 0x7f68d8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f68d8019040 0x7f68d8019930 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68c8037020 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.359+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68c8037020 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.363+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68c8037020 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68c8037020 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e13200 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.367+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68d8019040 2024-05-08T18:09:11.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e15c70 con 0x7f68c8037020 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e11c70 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e12510 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e118b0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 zone default found 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 4 Realm: () 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:11.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 zonegroup default 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e12510 con 0x7f68d8019040 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e17ab0 con 0x55c0b1e13200 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e17e50 con 0x55c0b1e13200 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 started sync module instance, tier type = 2024-05-08T18:09:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.371+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e16f50 con 0x7f68c8037020 2024-05-08T18:09:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94286106424128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e186a0 con 0x7f68c8037020 2024-05-08T18:09:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e18ef0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94286106424128] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94286106427888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e18b00 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.375+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e19620 con 0x55c0b1e13200 2024-05-08T18:09:11.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94286106431728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e19ec0 con 0x55c0b1e13200 2024-05-08T18:09:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1a8c0 con 0x7f68c8037020 2024-05-08T18:09:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94286106427888] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94286106428944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1acb0 con 0x7f68c8037020 2024-05-08T18:09:11.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1b670 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94286106431728] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.379+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94286106428944] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94286106436560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1b1c0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1ba10 con 0x7f68d8019040 2024-05-08T18:09:11.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94286106440400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1be00 con 0x7f68d8019040 2024-05-08T18:09:11.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1c8f0 con 0x7f68d8019040 2024-05-08T18:09:11.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.383+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94286106436560] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94286106444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1c8b0 con 0x7f68d8019040 2024-05-08T18:09:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1d2f0 con 0x7f68d8019040 2024-05-08T18:09:11.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94286106440400] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94286106444736] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94286106434064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1b770 con 0x7f68d8019040 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=0 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=1 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=2 2024-05-08T18:09:11.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=3 2024-05-08T18:09:11.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=4 2024-05-08T18:09:11.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=5 2024-05-08T18:09:11.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.387+0000 7f68df60e980 20 add_watcher() i=6 2024-05-08T18:09:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94286106434064] v30'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 20 add_watcher() i=7 2024-05-08T18:09:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:11.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e202e0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94286106447296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e1d760 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94286106447296] v30'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f67937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.391+0000 7f68df60e980 5 note: GC not initialized 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f67927e4640 20 reqs_thread_entry: start 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 Filter name: none 2024-05-08T18:09:11.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f6703fff640 20 reqs_thread_entry: start 2024-05-08T18:09:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e43a80 con 0x7f68c8037020 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e44410 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e45ae0 con 0x7f68c8037020 2024-05-08T18:09:11.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e45ae0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 4.2 4:43f4944a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e473d0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 4.33 4:cc48b6a6:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e49dc0 con 0x7f68d8019040 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 4.10 4:09fd83a7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4c9e0 con 0x55c0b1e13200 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 4.3c 4:3f857315:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4f590 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 4.6 4:62dffd56:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e52160 con 0x55c0b1e13200 2024-05-08T18:09:11.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 4.31 4:8ce771c4:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4c9e0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e56ee0 con 0x55c0b1e13200 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 4.2e 4:776f9cc7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4c3b0 con 0x55c0b1e13200 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(70 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 4.18 4:1b5001e2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4f0e0 con 0x7f68c8037020 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 4.c 4:30553688:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4bdd0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 4.33 4:ce643036:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e50940 con 0x7f68d8019040 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(71 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(74 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(73 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68c8045070 con 0x55c0b1e13200 2024-05-08T18:09:11.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(72 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68c8073060 con 0x55c0b1e13200 2024-05-08T18:09:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(67 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.395+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(75 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(76 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f67937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94286106447296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e4c3b0 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94286106447296] v30'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94286106424128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x7f68c8037020 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94286106424128] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68df60e980 20 remove_watcher() i=0 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68df60e980 2 removed watcher, disabling cache 2024-05-08T18:09:11.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.399+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94286106427888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.403+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94286106427888] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.403+0000 7f68df60e980 20 remove_watcher() i=1 2024-05-08T18:09:11.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.403+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94286106431728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x55c0b1e13200 2024-05-08T18:09:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68dc921640 1 -- 172.21.15.114:0/314762844 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94286106431728] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68c8073060 con 0x55c0b1e13200 2024-05-08T18:09:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68df60e980 20 remove_watcher() i=2 2024-05-08T18:09:11.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94286106428944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x7f68c8037020 2024-05-08T18:09:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68dd923640 1 -- 172.21.15.114:0/314762844 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94286106428944] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d802f040 con 0x7f68c8037020 2024-05-08T18:09:11.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68df60e980 20 remove_watcher() i=3 2024-05-08T18:09:11.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94286106436560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94286106436560] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x55c0b1e0d1c0 2024-05-08T18:09:11.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68df60e980 20 remove_watcher() i=4 2024-05-08T18:09:11.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.407+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94286106440400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x7f68d8019040 2024-05-08T18:09:11.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.411+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94286106440400] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.411+0000 7f68df60e980 20 remove_watcher() i=5 2024-05-08T18:09:11.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.411+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94286106444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x7f68d8019040 2024-05-08T18:09:11.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94286106444736] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 20 remove_watcher() i=6 2024-05-08T18:09:11.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94286106434064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55c0b1e41440 con 0x7f68d8019040 2024-05-08T18:09:11.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94286106434064] v30'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f68d00b2070 con 0x7f68d8019040 2024-05-08T18:09:11.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 20 remove_watcher() i=7 2024-05-08T18:09:11.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f68d8019040 msgr2=0x7f68d8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f68d8019040 0x7f68d8019930 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1e0d1c0 msgr2=0x55c0b1e0f660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1e0d1c0 0x55c0b1e0f660 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f68c8037020 msgr2=0x7f68c804f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f68c8037020 0x7f68c804f8a0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c0b1e13200 msgr2=0x55c0b1e155f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c0b1e13200 0x55c0b1e155f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67a80383f0 msgr2=0x7f67a803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67a80383f0 0x7f67a803a8b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f68d800f010 tx=0x7f68d801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 msgr2=0x55c0b1e01ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68dd122640 1 -- 172.21.15.114:0/314762844 reap_dead start 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1e01ee0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f68c800dfd0 tx=0x7f68c804f250 comp rx=0 tx=0).stop 2024-05-08T18:09:11.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 shutdown_connections 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/314762844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1dfa950 0x55c0b1e01ee0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 >> 172.21.15.114:0/314762844 conn(0x55c0b1df6ce0 msgr2=0x55c0b1df4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 shutdown_connections 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/314762844 wait complete. 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67b40383f0 msgr2=0x7f67b403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67b40383f0 0x7f67b403a8b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55c0b1dde360 tx=0x7f68d8003070 comp rx=0 tx=0).stop 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 msgr2=0x55c0b1dedb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 0x55c0b1dedb30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68c800d660 tx=0x7f68c800da60 comp rx=0 tx=0).stop 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 shutdown_connections 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67b40383f0 0x7f67b403a8b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 --2- 172.21.15.114:0/3703431005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ded710 0x55c0b1dedb30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 >> 172.21.15.114:0/3703431005 conn(0x55c0b1de2520 msgr2=0x55c0b1de3030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 shutdown_connections 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.415+0000 7f68df60e980 1 -- 172.21.15.114:0/3703431005 wait complete. 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1dda6b0 msgr2=0x55c0b1ddcaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1dda6b0 0x55c0b1ddcaa0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67c40383f0 msgr2=0x7f67c403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67c40383f0 0x7f67c403a8b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f68c8004180 tx=0x7f68c8001340 comp rx=0 tx=0).stop 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 msgr2=0x55c0b1dd5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 0x55c0b1dd5610 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f68d00aa500 tx=0x7f68d0019810 comp rx=0 tx=0).stop 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 shutdown_connections 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c0b1dda6b0 0x55c0b1ddcaa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f67c40383f0 0x7f67c403a8b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 --2- 172.21.15.114:0/154399110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0b1ce64b0 0x55c0b1dd5610 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 >> 172.21.15.114:0/154399110 conn(0x55c0b1cdb690 msgr2=0x55c0b1dc8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 shutdown_connections 2024-05-08T18:09:11.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.419+0000 7f68df60e980 1 -- 172.21.15.114:0/154399110 wait complete. 2024-05-08T18:09:11.429 INFO:teuthology.orchestra.run.smithi114.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"50b0c397-f53b-4292-89b3-02a592fb10e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","marker":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:09:10.633535Z","creation_time":"2024-05-08T18:09:10.628914Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:09:11.429 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:09:10.633535Z', 'creation_time': '2024-05-08T18:09:10.628914Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:09:11.430 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:09:11.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T18:09:11.430 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T18:09:11.514 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:11.514 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bded1980 1 Processor -- start 2024-05-08T18:09:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bded1980 1 -- start start 2024-05-08T18:09:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bded1980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558d772405b0 0x558d772429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bded1980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d770e5710 con 0x558d7723c0f0 2024-05-08T18:09:11.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bded1980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558d770f9f00 con 0x558d772405b0 2024-05-08T18:09:11.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bb1e4640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558d772405b0 0x558d772429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bb9e5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558d7723c0f0 0x558d7723c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34644/0 (socket says 172.21.15.114:34644) 2024-05-08T18:09:11.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bb9e5640 1 -- 172.21.15.114:0/1654706944 learned_addr learned my addr 172.21.15.114:0/1654706944 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:11.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bb1e4640 1 -- 172.21.15.114:0/1654706944 >> v1:172.21.15.53:6789/0 conn(0x558d7723c0f0 legacy=0x558d7723c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.515+0000 7f64bb1e4640 1 -- 172.21.15.114:0/1654706944 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d770c1ae0 con 0x558d772405b0 2024-05-08T18:09:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/1654706944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d772405b0 0x558d772429a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f64b000a480 tx=0x7f64b001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0110d08febf748 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64ba9e3640 1 -- 172.21.15.114:0/1654706944 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00b0070 con 0x558d772405b0 2024-05-08T18:09:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64ba9e3640 1 -- 172.21.15.114:0/1654706944 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b00ab540 con 0x558d772405b0 2024-05-08T18:09:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64ba9e3640 1 -- 172.21.15.114:0/1654706944 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00ab840 con 0x558d772405b0 2024-05-08T18:09:11.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 -- 172.21.15.114:0/1654706944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d772405b0 msgr2=0x558d772429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 --2- 172.21.15.114:0/1654706944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d772405b0 0x558d772429a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f64b000a480 tx=0x7f64b001b280 comp rx=0 tx=0).stop 2024-05-08T18:09:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 -- 172.21.15.114:0/1654706944 shutdown_connections 2024-05-08T18:09:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 --2- 172.21.15.114:0/1654706944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d772405b0 0x558d772429a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 -- 172.21.15.114:0/1654706944 >> 172.21.15.114:0/1654706944 conn(0x558d771af7d0 msgr2=0x558d771afbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 -- 172.21.15.114:0/1654706944 shutdown_connections 2024-05-08T18:09:11.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.519+0000 7f64bded1980 1 -- 172.21.15.114:0/1654706944 wait complete. 2024-05-08T18:09:11.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bded1980 1 Processor -- start 2024-05-08T18:09:11.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bded1980 1 -- start start 2024-05-08T18:09:11.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bded1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d77327160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bded1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558d7713df80 con 0x558d7723c0f0 2024-05-08T18:09:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bb9e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d77327160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bb9e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d77327160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58202/0 (socket says 172.21.15.114:58202) 2024-05-08T18:09:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2106690679 learned_addr learned my addr 172.21.15.114:0/2106690679 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.535+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2106690679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d77105da0 con 0x558d7723c0f0 2024-05-08T18:09:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bb9e5640 1 --2- 172.21.15.114:0/2106690679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d77327160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f64ac001e00 tx=0x7f64ac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a99dc79ac55a0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f63a9e0b640 1 -- 172.21.15.114:0/2106690679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac012020 con 0x558d7723c0f0 2024-05-08T18:09:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f63a9e0b640 1 -- 172.21.15.114:0/2106690679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac00e690 con 0x558d7723c0f0 2024-05-08T18:09:11.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f63a9e0b640 1 -- 172.21.15.114:0/2106690679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac00ea10 con 0x558d7723c0f0 2024-05-08T18:09:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- 172.21.15.114:0/2106690679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 msgr2=0x558d77327160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 --2- 172.21.15.114:0/2106690679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d77327160 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f64ac001e00 tx=0x7f64ac00b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- 172.21.15.114:0/2106690679 shutdown_connections 2024-05-08T18:09:11.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 --2- 172.21.15.114:0/2106690679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d77327160 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- 172.21.15.114:0/2106690679 >> 172.21.15.114:0/2106690679 conn(0x558d771af7d0 msgr2=0x558d77322cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- 172.21.15.114:0/2106690679 shutdown_connections 2024-05-08T18:09:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- 172.21.15.114:0/2106690679 wait complete. 2024-05-08T18:09:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 Processor -- start 2024-05-08T18:09:11.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- start start 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d7732e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bded1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558d772459d0 con 0x558d7723c0f0 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bb9e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d7732e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bb9e5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d7732e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58218/0 (socket says 172.21.15.114:58218) 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2156615508 learned_addr learned my addr 172.21.15.114:0/2156615508 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7732eb80 con 0x558d7723c0f0 2024-05-08T18:09:11.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f64bb9e5640 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d7732e640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x558d77327ff0 tx=0x7f64ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f63a3fff640 1 -- 172.21.15.114:0/2156615508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac012030 con 0x558d7723c0f0 2024-05-08T18:09:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.539+0000 7f63a3fff640 1 -- 172.21.15.114:0/2156615508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac01a7a0 con 0x558d7723c0f0 2024-05-08T18:09:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f63a3fff640 1 -- 172.21.15.114:0/2156615508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64ac01aaa0 con 0x558d7723c0f0 2024-05-08T18:09:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d7732ee10 con 0x558d7723c0f0 2024-05-08T18:09:11.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d77331af0 con 0x558d7723c0f0 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f63a3fff640 1 -- 172.21.15.114:0/2156615508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f64ac015020 con 0x558d7723c0f0 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f63a3fff640 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63a4038380 0x7f63a403a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f63a3fff640 1 -- 172.21.15.114:0/2156615508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f64ac020030 con 0x558d7723c0f0 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63a4038380 0x7f63a403a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d772405b0 0x558d773355d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77335c40 con 0x558d772405b0 2024-05-08T18:09:11.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d772405b0 0x558d773355d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63a4038380 0x7f63a403a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64b00ad000 tx=0x7f64b00a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d772405b0 0x558d773355d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2156615508 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64b400a4d0 con 0x558d772405b0 2024-05-08T18:09:11.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77332d10 con 0x558d772405b0 2024-05-08T18:09:11.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.543+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2156615508 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64b400a4d0 con 0x558d772405b0 2024-05-08T18:09:11.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77337ad0 con 0x558d772405b0 2024-05-08T18:09:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2156615508 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64b400a4d0 con 0x558d772405b0 2024-05-08T18:09:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77336d00 con 0x558d772405b0 2024-05-08T18:09:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2156615508 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64b400a4d0 con 0x558d772405b0 2024-05-08T18:09:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77337150 con 0x558d772405b0 2024-05-08T18:09:11.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2156615508 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64b400a4d0 con 0x558d772405b0 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 Processor -- start 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 -- start start 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 0x558d773467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bded1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558d77141fc0 con 0x558d77346390 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bb1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 0x558d773467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bb1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 0x558d773467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58234/0 (socket says 172.21.15.114:58234) 2024-05-08T18:09:11.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2709983950 learned_addr learned my addr 172.21.15.114:0/2709983950 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2709983950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d77346cf0 con 0x558d77346390 2024-05-08T18:09:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 0x558d773467b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f64b00ab510 tx=0x7f64b0018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.547+0000 7f63a17fa640 1 -- 172.21.15.114:0/2709983950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00c6070 con 0x558d77346390 2024-05-08T18:09:11.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f63a17fa640 1 -- 172.21.15.114:0/2709983950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b00b7740 con 0x558d77346390 2024-05-08T18:09:11.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f63a17fa640 1 -- 172.21.15.114:0/2709983950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00b0040 con 0x558d77346390 2024-05-08T18:09:11.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d77347790 con 0x558d77346390 2024-05-08T18:09:11.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d77347c00 con 0x558d77346390 2024-05-08T18:09:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f63a17fa640 1 -- 172.21.15.114:0/2709983950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f64b00c9070 con 0x558d77346390 2024-05-08T18:09:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f63a17fa640 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6394038440 0x7f639403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f63a17fa640 1 -- 172.21.15.114:0/2709983950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f64b00be030 con 0x558d77346390 2024-05-08T18:09:11.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6394038440 0x7f639403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bded1980 1 Processor -- start 2024-05-08T18:09:11.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bded1980 1 -- start start 2024-05-08T18:09:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bded1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d77353850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bded1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558d773278b0 con 0x558d77353470 2024-05-08T18:09:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6394038440 0x7f639403a900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x558d77336820 tx=0x7f64b4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bb1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d77353850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bb1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d77353850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58248/0 (socket says 172.21.15.114:58248) 2024-05-08T18:09:11.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bb1e4640 1 -- 172.21.15.114:0/894003567 learned_addr learned my addr 172.21.15.114:0/894003567 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bb1e4640 1 -- 172.21.15.114:0/894003567 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d77353e20 con 0x558d77353470 2024-05-08T18:09:11.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/894003567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d77353850 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007000 tx=0x7f64b0006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a37a1ad8bd0e132 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.551+0000 7f639affd640 1 -- 172.21.15.114:0/894003567 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00dd070 con 0x558d77353470 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f639affd640 1 -- 172.21.15.114:0/894003567 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b00b7a20 con 0x558d77353470 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f639affd640 1 -- 172.21.15.114:0/894003567 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00b7d20 con 0x558d77353470 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/894003567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 msgr2=0x558d77353850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 --2- 172.21.15.114:0/894003567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d77353850 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007000 tx=0x7f64b0006760 comp rx=0 tx=0).stop 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/894003567 shutdown_connections 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 --2- 172.21.15.114:0/894003567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d77353850 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/894003567 >> 172.21.15.114:0/894003567 conn(0x558d7734f7b0 msgr2=0x558d7734d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/894003567 shutdown_connections 2024-05-08T18:09:11.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/894003567 wait complete. 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 Processor -- start 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- start start 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d7735a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558d773545e0 con 0x558d77353470 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bb1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d7735a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bb1e4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d7735a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58252/0 (socket says 172.21.15.114:58252) 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 learned_addr learned my addr 172.21.15.114:0/2141699882 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7735af30 con 0x558d77353470 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d7735a9f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007000 tx=0x7f64b00e9180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f63997fa640 1 -- 172.21.15.114:0/2141699882 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00dd050 con 0x558d77353470 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f63997fa640 1 -- 172.21.15.114:0/2141699882 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b00de040 con 0x558d77353470 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d7735b1c0 con 0x558d77353470 2024-05-08T18:09:11.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f63997fa640 1 -- 172.21.15.114:0/2141699882 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b00ea810 con 0x558d77353470 2024-05-08T18:09:11.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.555+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7735dea0 con 0x558d77353470 2024-05-08T18:09:11.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f63997fa640 1 -- 172.21.15.114:0/2141699882 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f64b00ea9b0 con 0x558d77353470 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f63997fa640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63840383f0 0x7f638403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f63997fa640 1 -- 172.21.15.114:0/2141699882 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f64b00a8070 con 0x558d77353470 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63840383f0 0x7f638403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d77365eb0 0x558d77368350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77368aa0 con 0x558d77365eb0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d77365eb0 0x558d77368350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63840383f0 0x7f638403a8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x558d77332c30 tx=0x7f64b401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d77365eb0 0x558d77368350 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 realm 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77368eb0 con 0x558d77365eb0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77369780 con 0x558d77365eb0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77369b20 con 0x558d77365eb0 2024-05-08T18:09:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77369fc0 con 0x558d77365eb0 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 20 searching for the correct realm 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558d7736bf30 0x558d7736e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558d7736bf30 0x558d7736e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558d7736bf30 0x558d7736e320 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb1e4640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f64b00cb060 0x7f64b00d7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.559+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b00cb060 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f64b00cb060 0x7f64b00d7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f64b00cb060 0x7f64b00d7a30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b401f070 con 0x7f64b00cb060 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bc1e6640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f64b4031040 0x7f64b4032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f64b4031040 0x7f64b4032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f64b4031040 0x7f64b4032430 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.563+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b00cb060 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b401f070 con 0x7f64b00cb060 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b00cb060 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f64b401f070 con 0x7f64b00cb060 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.567+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b00cb060 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b401f070 con 0x7f64b00cb060 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b00cb060 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b401f070 con 0x7f64b00cb060 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.571+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d7736bf30 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b4031040 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x558d77365eb0 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558d7736e9a0 con 0x7f64b00cb060 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b401f070 con 0x7f64b00cb060 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7736aa00 con 0x558d77365eb0 2024-05-08T18:09:11.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7736a640 con 0x558d77365eb0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7736b320 con 0x558d77365eb0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 zone default found 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 4 Realm: () 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:11.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:11.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:11.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 zonegroup default 2024-05-08T18:09:11.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7736b320 con 0x7f64b4031040 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773707e0 con 0x558d7736bf30 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d77370b80 con 0x558d7736bf30 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 started sync module instance, tier type = 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.575+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7736fc80 con 0x7f64b00cb060 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94066078842992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d773713d0 con 0x7f64b00cb060 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77371c20 con 0x558d77365eb0 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94066078842992] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94066078846752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d773717f0 con 0x558d77365eb0 2024-05-08T18:09:11.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.579+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d773722f0 con 0x558d7736bf30 2024-05-08T18:09:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94066078846752] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94066078847808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77371760 con 0x558d7736bf30 2024-05-08T18:09:11.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77373040 con 0x7f64b00cb060 2024-05-08T18:09:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94066078854336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d773738e0 con 0x7f64b00cb060 2024-05-08T18:09:11.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.583+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d773742e0 con 0x558d77365eb0 2024-05-08T18:09:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.587+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94066078847808] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.587+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94066078854336] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.587+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.587+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94066078852832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77373430 con 0x558d77365eb0 2024-05-08T18:09:11.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.587+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77374b80 con 0x7f64b4031040 2024-05-08T18:09:11.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.587+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94066078852832] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94066078858736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77373430 con 0x7f64b4031040 2024-05-08T18:09:11.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77375010 con 0x7f64b4031040 2024-05-08T18:09:11.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94066078858736] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94066078862048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77374fd0 con 0x7f64b4031040 2024-05-08T18:09:11.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.591+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d773759d0 con 0x7f64b4031040 2024-05-08T18:09:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94066078864608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77375df0 con 0x7f64b4031040 2024-05-08T18:09:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=0 2024-05-08T18:09:11.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=1 2024-05-08T18:09:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=2 2024-05-08T18:09:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=3 2024-05-08T18:09:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=4 2024-05-08T18:09:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=5 2024-05-08T18:09:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94066078862048] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=6 2024-05-08T18:09:11.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94066078864608] v30'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 20 add_watcher() i=7 2024-05-08T18:09:11.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:11.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773744c0 con 0x558d77365eb0 2024-05-08T18:09:11.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.595+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94066078860480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d77376330 con 0x558d77365eb0 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94066078860480] v30'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f6371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 5 note: GC not initialized 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f6370fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 Filter name: none 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f62ea7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739c320 con 0x558d77365eb0 2024-05-08T18:09:11.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739cd10 con 0x558d77365eb0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739dd20 con 0x7f64b00cb060 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739b470 con 0x7f64b00cb060 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739dd20 con 0x558d77365eb0 2024-05-08T18:09:11.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 4.2 4:43f4944a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739d6e0 con 0x558d77365eb0 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:68 4.33 4:cc48b6a6:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773a2450 con 0x7f64b4031040 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 4.10 4:09fd83a7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773a5030 con 0x558d7736bf30 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 4.3c 4:3f857315:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773a79c0 con 0x558d77365eb0 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 4.6 4:62dffd56:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773aa590 con 0x558d7736bf30 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 4.31 4:8ce771c4:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773ace00 con 0x558d77365eb0 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.599+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773af670 con 0x558d7736bf30 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:74 4.2e 4:776f9cc7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773af6b0 con 0x558d7736bf30 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(67 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(71 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(72 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:75 4.18 4:1b5001e2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773aa0a0 con 0x7f64b00cb060 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(70 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 4.c 4:30553688:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d773a4af0 con 0x558d77365eb0 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 4.33 4:ce643036:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558d7739fe40 con 0x7f64b4031040 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(68 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(73 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(76 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(75 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(74 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(77 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f6371fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94066078860480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x558d77365eb0 2024-05-08T18:09:11.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94066078860480] v30'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.603+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94066078842992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x7f64b00cb060 2024-05-08T18:09:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94066078842992] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bded1980 20 remove_watcher() i=0 2024-05-08T18:09:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bded1980 2 removed watcher, disabling cache 2024-05-08T18:09:11.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94066078846752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x558d77365eb0 2024-05-08T18:09:11.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94066078846752] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bded1980 20 remove_watcher() i=1 2024-05-08T18:09:11.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.607+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94066078847808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x558d7736bf30 2024-05-08T18:09:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.611+0000 7f64bb1e4640 1 -- 172.21.15.114:0/2141699882 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94066078847808] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b00e8020 con 0x558d7736bf30 2024-05-08T18:09:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.611+0000 7f64bded1980 20 remove_watcher() i=2 2024-05-08T18:09:11.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.611+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94066078854336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x7f64b00cb060 2024-05-08T18:09:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.611+0000 7f64bc1e6640 1 -- 172.21.15.114:0/2141699882 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94066078854336] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b4040040 con 0x7f64b00cb060 2024-05-08T18:09:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.611+0000 7f64bded1980 20 remove_watcher() i=3 2024-05-08T18:09:11.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.611+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94066078852832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x558d77365eb0 2024-05-08T18:09:11.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.615+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94066078852832] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x558d77365eb0 2024-05-08T18:09:11.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.615+0000 7f64bded1980 20 remove_watcher() i=4 2024-05-08T18:09:11.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.615+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94066078858736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x7f64b4031040 2024-05-08T18:09:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.615+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94066078858736] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.615+0000 7f64bded1980 20 remove_watcher() i=5 2024-05-08T18:09:11.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.615+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94066078862048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x7f64b4031040 2024-05-08T18:09:11.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94066078862048] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 20 remove_watcher() i=6 2024-05-08T18:09:11.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94066078864608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558d7738cc80 con 0x7f64b4031040 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94066078864608] v30'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64ac008030 con 0x7f64b4031040 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 20 remove_watcher() i=7 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f64b4031040 msgr2=0x7f64b4032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f64b4031040 0x7f64b4032430 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d77365eb0 msgr2=0x558d77368350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d77365eb0 0x558d77368350 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f64b00cb060 msgr2=0x7f64b00d7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f64b00cb060 0x7f64b00d7a30 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558d7736bf30 msgr2=0x558d7736e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558d7736bf30 0x558d7736e320 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63840383f0 msgr2=0x7f638403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63840383f0 0x7f638403a8b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x558d77332c30 tx=0x7f64b401f000 comp rx=0 tx=0).stop 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 msgr2=0x558d7735a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 --2- 172.21.15.114:0/2141699882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77353470 0x558d7735a9f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f64b0007000 tx=0x7f64b00e9180 comp rx=0 tx=0).stop 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 reap_dead start 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bb9e5640 1 -- 172.21.15.114:0/2141699882 reap_dead start 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 shutdown_connections 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 >> 172.21.15.114:0/2141699882 conn(0x558d7734f7b0 msgr2=0x558d7734ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.619+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 shutdown_connections 2024-05-08T18:09:11.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2141699882 wait complete. 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6394038440 msgr2=0x7f639403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6394038440 0x7f639403a900 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x558d77336820 tx=0x7f64b4005850 comp rx=0 tx=0).stop 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 msgr2=0x558d773467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 0x558d773467b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f64b00ab510 tx=0x7f64b0018020 comp rx=0 tx=0).stop 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 shutdown_connections 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6394038440 0x7f639403a900 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2709983950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d77346390 0x558d773467b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 >> 172.21.15.114:0/2709983950 conn(0x558d7733b1a0 msgr2=0x558d7733bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 shutdown_connections 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2709983950 wait complete. 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d772405b0 msgr2=0x558d773355d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d772405b0 0x558d773355d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63a4038380 msgr2=0x7f63a403a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63a4038380 0x7f63a403a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64b00ad000 tx=0x7f64b00a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 msgr2=0x558d7732e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d7732e640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x558d77327ff0 tx=0x7f64ac000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 shutdown_connections 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558d772405b0 0x558d773355d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f63a4038380 0x7f63a403a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 --2- 172.21.15.114:0/2156615508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d7723c0f0 0x558d7732e640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 >> 172.21.15.114:0/2156615508 conn(0x558d771af7d0 msgr2=0x558d77321800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 shutdown_connections 2024-05-08T18:09:11.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.623+0000 7f64bded1980 1 -- 172.21.15.114:0/2156615508 wait complete. 2024-05-08T18:09:11.634 INFO:teuthology.orchestra.run.smithi114.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"50b0c397-f53b-4292-89b3-02a592fb10e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","marker":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:09:10.633535Z","creation_time":"2024-05-08T18:09:10.628914Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-08T18:09:11.634 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:09:10.633535Z', 'creation_time': '2024-05-08T18:09:10.628914Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T18:09:11.642 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:09:11.642 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:09:11.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:09:11.643 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:09:11.709 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:11.709 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:11.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f5231691980 1 Processor -- start 2024-05-08T18:09:11.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f5231691980 1 -- start start 2024-05-08T18:09:11.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f5231691980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558cc67dd820 0x558cc6869960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f5231691980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558cc6714710 con 0x558cc6869ea0 2024-05-08T18:09:11.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f5231691980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558cc6728f00 con 0x558cc67dd820 2024-05-08T18:09:11.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522f1a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558cc67dd820 0x558cc6869960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522f1a5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558cc67dd820 0x558cc6869960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58256/0 (socket says 172.21.15.114:58256) 2024-05-08T18:09:11.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522e9a4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558cc6869ea0 0x558cc686c2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34660/0 (socket says 172.21.15.114:34660) 2024-05-08T18:09:11.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522f1a5640 1 -- 172.21.15.114:0/2495387171 learned_addr learned my addr 172.21.15.114:0/2495387171 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522f1a5640 1 -- 172.21.15.114:0/2495387171 >> v1:172.21.15.53:6789/0 conn(0x558cc6869ea0 legacy=0x558cc686c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522f1a5640 1 -- 172.21.15.114:0/2495387171 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc66f0ae0 con 0x558cc67dd820 2024-05-08T18:09:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.711+0000 7f522f1a5640 1 --2- 172.21.15.114:0/2495387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6869960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f522000a4e0 tx=0x7f522001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d03b8fcaabf0aad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f522e1a3640 1 -- 172.21.15.114:0/2495387171 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52200aa540 con 0x558cc67dd820 2024-05-08T18:09:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f522e1a3640 1 -- 172.21.15.114:0/2495387171 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200aa6e0 con 0x558cc67dd820 2024-05-08T18:09:11.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f522e1a3640 1 -- 172.21.15.114:0/2495387171 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52200aaa40 con 0x558cc67dd820 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 -- 172.21.15.114:0/2495387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 msgr2=0x558cc6869960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 --2- 172.21.15.114:0/2495387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6869960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f522000a4e0 tx=0x7f522001b090 comp rx=0 tx=0).stop 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 -- 172.21.15.114:0/2495387171 shutdown_connections 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 --2- 172.21.15.114:0/2495387171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6869960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 -- 172.21.15.114:0/2495387171 >> 172.21.15.114:0/2495387171 conn(0x558cc6863690 msgr2=0x558cc6865ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 -- 172.21.15.114:0/2495387171 shutdown_connections 2024-05-08T18:09:11.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.715+0000 7f5231691980 1 -- 172.21.15.114:0/2495387171 wait complete. 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 Processor -- start 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- start start 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc695aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558cc676cf80 con 0x558cc67dd820 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc695aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc695aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58262/0 (socket says 172.21.15.114:58262) 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 -- 172.21.15.114:0/1951411934 learned_addr learned my addr 172.21.15.114:0/1951411934 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 -- 172.21.15.114:0/1951411934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc6734da0 con 0x558cc67dd820 2024-05-08T18:09:11.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 --2- 172.21.15.114:0/1951411934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc695aa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5220017ca0 tx=0x7f52200033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ed61f083c0210e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f511d60a640 1 -- 172.21.15.114:0/1951411934 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52200b9070 con 0x558cc67dd820 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f511d60a640 1 -- 172.21.15.114:0/1951411934 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200aaa80 con 0x558cc67dd820 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f511d60a640 1 -- 172.21.15.114:0/1951411934 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52200aad60 con 0x558cc67dd820 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- 172.21.15.114:0/1951411934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 msgr2=0x558cc695aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 --2- 172.21.15.114:0/1951411934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc695aa00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5220017ca0 tx=0x7f52200033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- 172.21.15.114:0/1951411934 shutdown_connections 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 --2- 172.21.15.114:0/1951411934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc695aa00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- 172.21.15.114:0/1951411934 >> 172.21.15.114:0/1951411934 conn(0x558cc6863690 msgr2=0x558cc6956590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- 172.21.15.114:0/1951411934 shutdown_connections 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- 172.21.15.114:0/1951411934 wait complete. 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 Processor -- start 2024-05-08T18:09:11.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- start start 2024-05-08T18:09:11.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6961cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f5231691980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558cc68792a0 con 0x558cc67dd820 2024-05-08T18:09:11.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6961cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6961cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58268/0 (socket says 172.21.15.114:58268) 2024-05-08T18:09:11.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.731+0000 7f522f1a5640 1 -- 172.21.15.114:0/579560070 learned_addr learned my addr 172.21.15.114:0/579560070 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522f1a5640 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc6962200 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522f1a5640 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6961cc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5220017ca0 tx=0x7f5220017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f511be07640 1 -- 172.21.15.114:0/579560070 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52200b9070 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f511be07640 1 -- 172.21.15.114:0/579560070 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52200b5d40 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc6962490 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f511be07640 1 -- 172.21.15.114:0/579560070 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52200c7580 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc6965120 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f511be07640 1 -- 172.21.15.114:0/579560070 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f52200b3040 con 0x558cc67dd820 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f511be07640 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5114038440 0x7f511403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f511be07640 1 -- 172.21.15.114:0/579560070 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f52200c4070 con 0x558cc67dd820 2024-05-08T18:09:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522e9a4640 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5114038440 0x7f511403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6869ea0 0x558cc6968d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69692f0 con 0x558cc6869ea0 2024-05-08T18:09:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522f9a6640 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6869ea0 0x558cc6968d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522e9a4640 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5114038440 0x7f511403a900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5218001e40 tx=0x7f52180013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522f9a6640 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6869ea0 0x558cc6968d70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f522f9a6640 1 -- 172.21.15.114:0/579560070 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52280083f0 con 0x558cc6869ea0 2024-05-08T18:09:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.735+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc6969bc0 con 0x558cc6869ea0 2024-05-08T18:09:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522f9a6640 1 -- 172.21.15.114:0/579560070 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52280083f0 con 0x558cc6869ea0 2024-05-08T18:09:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc696af70 con 0x558cc6869ea0 2024-05-08T18:09:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522f9a6640 1 -- 172.21.15.114:0/579560070 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f52280083f0 con 0x558cc6869ea0 2024-05-08T18:09:11.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc696a410 con 0x558cc6869ea0 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522f9a6640 1 -- 172.21.15.114:0/579560070 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52280083f0 con 0x558cc6869ea0 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc696a830 con 0x558cc6869ea0 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522f9a6640 1 -- 172.21.15.114:0/579560070 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f52280083f0 con 0x558cc6869ea0 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 Processor -- start 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- start start 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 0x558cc6979ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558cc6770fc0 con 0x558cc6979aa0 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522e9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 0x558cc6979ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522e9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 0x558cc6979ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58280/0 (socket says 172.21.15.114:58280) 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522e9a4640 1 -- 172.21.15.114:0/3183277991 learned_addr learned my addr 172.21.15.114:0/3183277991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522e9a4640 1 -- 172.21.15.114:0/3183277991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc697a400 con 0x558cc6979aa0 2024-05-08T18:09:11.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f522e9a4640 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 0x558cc6979ec0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f521800e670 tx=0x7f521800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5119602640 1 -- 172.21.15.114:0/3183277991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5218022070 con 0x558cc6979aa0 2024-05-08T18:09:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5119602640 1 -- 172.21.15.114:0/3183277991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521800d660 con 0x558cc6979aa0 2024-05-08T18:09:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5119602640 1 -- 172.21.15.114:0/3183277991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5218006070 con 0x558cc6979aa0 2024-05-08T18:09:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc697aea0 con 0x558cc6979aa0 2024-05-08T18:09:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.739+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc697b370 con 0x558cc6979aa0 2024-05-08T18:09:11.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5119602640 1 -- 172.21.15.114:0/3183277991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5218025070 con 0x558cc6979aa0 2024-05-08T18:09:11.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5119602640 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5108038490 0x7f510803a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5119602640 1 -- 172.21.15.114:0/3183277991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f521804ffc0 con 0x558cc6979aa0 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522f9a6640 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5108038490 0x7f510803a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5231691980 1 Processor -- start 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5231691980 1 -- start start 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522f9a6640 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5108038490 0x7f510803a950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x558cc696a7b0 tx=0x7f5228003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5231691980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc6987050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5231691980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558cc695b090 con 0x558cc6986c70 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522e9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc6987050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522e9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc6987050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58282/0 (socket says 172.21.15.114:58282) 2024-05-08T18:09:11.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522e9a4640 1 -- 172.21.15.114:0/7498570 learned_addr learned my addr 172.21.15.114:0/7498570 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522e9a4640 1 -- 172.21.15.114:0/7498570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc6987620 con 0x558cc6986c70 2024-05-08T18:09:11.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f522e9a4640 1 --2- 172.21.15.114:0/7498570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc6987050 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5218027030 tx=0x7f521800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0744901032e679 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5112ffd640 1 -- 172.21.15.114:0/7498570 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52180242c0 con 0x558cc6986c70 2024-05-08T18:09:11.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5112ffd640 1 -- 172.21.15.114:0/7498570 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5218024460 con 0x558cc6986c70 2024-05-08T18:09:11.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5112ffd640 1 -- 172.21.15.114:0/7498570 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5218024740 con 0x558cc6986c70 2024-05-08T18:09:11.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5231691980 1 -- 172.21.15.114:0/7498570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 msgr2=0x558cc6987050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.743+0000 7f5231691980 1 --2- 172.21.15.114:0/7498570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc6987050 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5218027030 tx=0x7f521800db60 comp rx=0 tx=0).stop 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- 172.21.15.114:0/7498570 shutdown_connections 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 --2- 172.21.15.114:0/7498570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc6987050 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- 172.21.15.114:0/7498570 >> 172.21.15.114:0/7498570 conn(0x558cc6982fb0 msgr2=0x558cc6981010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- 172.21.15.114:0/7498570 shutdown_connections 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- 172.21.15.114:0/7498570 wait complete. 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 Processor -- start 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- start start 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc698e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558cc6987de0 con 0x558cc6986c70 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f522e9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc698e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f522e9a4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc698e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58292/0 (socket says 172.21.15.114:58292) 2024-05-08T18:09:11.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 learned_addr learned my addr 172.21.15.114:0/1910490296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc698e6e0 con 0x558cc6986c70 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f522e9a4640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc698e1a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5218026860 tx=0x7f521804e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f51117fa640 1 -- 172.21.15.114:0/1910490296 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52180242c0 con 0x558cc6986c70 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc698e970 con 0x558cc6986c70 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f51117fa640 1 -- 172.21.15.114:0/1910490296 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521801a7c0 con 0x558cc6986c70 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc698e970 con 0x558cc6986c70 2024-05-08T18:09:11.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f51117fa640 1 -- 172.21.15.114:0/1910490296 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f521803e9f0 con 0x558cc6986c70 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.747+0000 7f51117fa640 1 -- 172.21.15.114:0/1910490296 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f521803eb90 con 0x558cc6986c70 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f51117fa640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f50f80383f0 0x7f50f803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f51117fa640 1 -- 172.21.15.114:0/1910490296 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f5218045030 con 0x558cc6986c70 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f9a6640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f50f80383f0 0x7f50f803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6999470 0x558cc699b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699c080 con 0x558cc6999470 2024-05-08T18:09:11.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6999470 0x558cc699b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f9a6640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f50f80383f0 0x7f50f803a8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x558cc6969a40 tx=0x7f522801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6999470 0x558cc699b930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 realm 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699c490 con 0x558cc6999470 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699cd30 con 0x558cc6999470 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d0d0 con 0x558cc6999470 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 20 searching for the correct realm 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558cc699f690 0x558cc69a1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a1fc0 con 0x558cc699f690 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522e9a4640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558cc699f690 0x558cc69a1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522e9a4640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558cc699f690 0x558cc69a1a80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522e9a4640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5218027060 0x7f5218027980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a1fc0 con 0x7f5218027060 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f9a6640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5218027060 0x7f5218027980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.751+0000 7f522f9a6640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5218027060 0x7f5218027980 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f9a6640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5228019040 0x7f5228019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a1fc0 con 0x7f5228019040 2024-05-08T18:09:11.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5228019040 0x7f5228019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5228019040 0x7f5228019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x7f5228019040 2024-05-08T18:09:11.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x7f5228019040 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x7f5228019040 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5218027060 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.755+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x7f5228019040 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5218027060 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x7f5228019040 2024-05-08T18:09:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.759+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200cd060 con 0x7f5228019040 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5218027060 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f52200cd060 con 0x558cc6999470 2024-05-08T18:09:11.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5218027060 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.763+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc699f690 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5228019040 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x558cc6999470 2024-05-08T18:09:11.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558cc699d920 con 0x7f5218027060 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699e170 con 0x558cc6999470 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699e560 con 0x558cc6999470 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699e560 con 0x558cc6999470 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 zone default found 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 4 Realm: () 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 zonegroup default 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699e980 con 0x7f5228019040 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc699eda0 con 0x558cc699f690 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.767+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a3dd0 con 0x558cc699f690 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 20 started sync module instance, tier type = 2024-05-08T18:09:11.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:11.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a3270 con 0x7f5218027060 2024-05-08T18:09:11.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063115777632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a2ed0 con 0x7f5218027060 2024-05-08T18:09:11.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a4b50 con 0x558cc6999470 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063115777632] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063115780464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a4b10 con 0x558cc6999470 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.771+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a5560 con 0x558cc699f690 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063115784368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a5db0 con 0x558cc699f690 2024-05-08T18:09:11.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a6770 con 0x7f5218027060 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063115780464] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063115788992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a66e0 con 0x7f5218027060 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.775+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a74f0 con 0x558cc6999470 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063115784368] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063115788992] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063115786496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a7040 con 0x558cc6999470 2024-05-08T18:09:11.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a7d90 con 0x7f5228019040 2024-05-08T18:09:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063115794192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a7fe0 con 0x7f5228019040 2024-05-08T18:09:11.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.779+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a8830 con 0x7f5228019040 2024-05-08T18:09:11.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.783+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063115786496] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.783+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.783+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063115796448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a88b0 con 0x7f5228019040 2024-05-08T18:09:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.783+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a9180 con 0x7f5228019040 2024-05-08T18:09:11.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.783+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063115794192] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.783+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063115796448] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063115795248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a88b0 con 0x7f5228019040 2024-05-08T18:09:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=0 2024-05-08T18:09:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=1 2024-05-08T18:09:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=2 2024-05-08T18:09:11.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=3 2024-05-08T18:09:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=4 2024-05-08T18:09:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=5 2024-05-08T18:09:11.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=6 2024-05-08T18:09:11.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063115795248] v30'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 20 add_watcher() i=7 2024-05-08T18:09:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69ac280 con 0x558cc6999470 2024-05-08T18:09:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.787+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063115797504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69a9700 con 0x558cc6999470 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063115797504] v30'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f50e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 5 note: GC not initialized 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f50e4fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:11.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 Filter name: none 2024-05-08T18:09:11.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f505e7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:11.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69cf950 con 0x7f5218027060 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69d02e0 con 0x558cc6999470 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:11.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69d19b0 con 0x7f5218027060 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69d19b0 con 0x558cc6999470 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 4.2 4:43f4944a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69d32a0 con 0x558cc6999470 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 4.33 4:cc48b6a6:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69d5cb0 con 0x7f5228019040 2024-05-08T18:09:11.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 4.10 4:09fd83a7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69d86b0 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 4.3c 4:3f857315:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69daf20 con 0x558cc6999470 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 4.6 4:62dffd56:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69ddb40 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 4.31 4:8ce771c4:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e05b0 con 0x558cc6999470 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e32b0 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 4.2e 4:776f9cc7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 4.18 4:1b5001e2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e8a80 con 0x7f5218027060 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 4.c 4:30553688:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69eb940 con 0x558cc6999470 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 4.33 4:ce643036:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558cc69ee790 con 0x7f5228019040 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.791+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(70 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(67 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(74 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(72 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(73 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(75 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(71 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(76 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f50e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063115797504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x558cc6999470 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94063115797504] v30'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.795+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063115777632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x7f5218027060 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94063115777632] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f5231691980 20 remove_watcher() i=0 2024-05-08T18:09:11.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f5231691980 2 removed watcher, disabling cache 2024-05-08T18:09:11.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063115780464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x558cc6999470 2024-05-08T18:09:11.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94063115780464] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f5231691980 20 remove_watcher() i=1 2024-05-08T18:09:11.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.799+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063115784368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x558cc699f690 2024-05-08T18:09:11.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.803+0000 7f522e9a4640 1 -- 172.21.15.114:0/1910490296 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94063115784368] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5218024030 con 0x558cc699f690 2024-05-08T18:09:11.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.803+0000 7f5231691980 20 remove_watcher() i=2 2024-05-08T18:09:11.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.803+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063115788992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x7f5218027060 2024-05-08T18:09:11.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.803+0000 7f522f9a6640 1 -- 172.21.15.114:0/1910490296 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94063115788992] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f522802f040 con 0x7f5218027060 2024-05-08T18:09:11.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.803+0000 7f5231691980 20 remove_watcher() i=3 2024-05-08T18:09:11.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.803+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063115786496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x558cc6999470 2024-05-08T18:09:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.807+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94063115786496] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x558cc6999470 2024-05-08T18:09:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.807+0000 7f5231691980 20 remove_watcher() i=4 2024-05-08T18:09:11.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.807+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063115794192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x7f5228019040 2024-05-08T18:09:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.807+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94063115794192] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.807+0000 7f5231691980 20 remove_watcher() i=5 2024-05-08T18:09:11.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.807+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063115796448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x7f5228019040 2024-05-08T18:09:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94063115796448] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 20 remove_watcher() i=6 2024-05-08T18:09:11.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063115795248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558cc69e5cc0 con 0x7f5228019040 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94063115795248] v30'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f52200f1040 con 0x7f5228019040 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 20 remove_watcher() i=7 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5228019040 msgr2=0x7f5228019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5228019040 0x7f5228019930 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6999470 msgr2=0x558cc699b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6999470 0x558cc699b930 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5218027060 msgr2=0x7f5218027980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5218027060 0x7f5218027980 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558cc699f690 msgr2=0x558cc69a1a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558cc699f690 0x558cc69a1a80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f50f80383f0 msgr2=0x7f50f803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f50f80383f0 0x7f50f803a8b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x558cc6969a40 tx=0x7f522801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f522f1a5640 1 -- 172.21.15.114:0/1910490296 reap_dead start 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 msgr2=0x558cc698e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc698e1a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5218026860 tx=0x7f521804e2a0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 shutdown_connections 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 --2- 172.21.15.114:0/1910490296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6986c70 0x558cc698e1a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 >> 172.21.15.114:0/1910490296 conn(0x558cc6982fb0 msgr2=0x558cc6980610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 shutdown_connections 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.811+0000 7f5231691980 1 -- 172.21.15.114:0/1910490296 wait complete. 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5108038490 msgr2=0x7f510803a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5108038490 0x7f510803a950 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x558cc696a7b0 tx=0x7f5228003070 comp rx=0 tx=0).stop 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 msgr2=0x558cc6979ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 0x558cc6979ec0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f521800e670 tx=0x7f521800ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 shutdown_connections 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5108038490 0x7f510803a950 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/3183277991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc6979aa0 0x558cc6979ec0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 >> 172.21.15.114:0/3183277991 conn(0x558cc696e8b0 msgr2=0x558cc696f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 shutdown_connections 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/3183277991 wait complete. 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6869ea0 msgr2=0x558cc6968d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6869ea0 0x558cc6968d70 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5114038440 msgr2=0x7f511403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5114038440 0x7f511403a900 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5218001e40 tx=0x7f52180013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 msgr2=0x558cc6961cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6961cc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5220017ca0 tx=0x7f5220017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 shutdown_connections 2024-05-08T18:09:11.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558cc6869ea0 0x558cc6968d70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5114038440 0x7f511403a900 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 --2- 172.21.15.114:0/579560070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558cc67dd820 0x558cc6961cc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 >> 172.21.15.114:0/579560070 conn(0x558cc6863690 msgr2=0x558cc69550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 shutdown_connections 2024-05-08T18:09:11.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.815+0000 7f5231691980 1 -- 172.21.15.114:0/579560070 wait complete. 2024-05-08T18:09:11.825 INFO:teuthology.orchestra.run.smithi114.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"50b0c397-f53b-4292-89b3-02a592fb10e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","marker":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:09:10.633535Z","creation_time":"2024-05-08T18:09:10.628914Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:09:11.825 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:09:10.633535Z', 'creation_time': '2024-05-08T18:09:10.628914Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:09:11.825 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T18:09:11.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T18:09:11.826 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-08T18:09:11.898 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:11.898 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:11.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f344a02e980 1 Processor -- start 2024-05-08T18:09:11.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f344a02e980 1 -- start start 2024-05-08T18:09:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f344a02e980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5565905257d0 0x556590527bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f344a02e980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565903ca710 con 0x55659051f530 2024-05-08T18:09:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f344a02e980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5565903def00 con 0x5565905257d0 2024-05-08T18:09:11.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f3447341640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5565905257d0 0x556590527bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f3447341640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5565905257d0 0x556590527bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58306/0 (socket says 172.21.15.114:58306) 2024-05-08T18:09:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f3447b42640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55659051f530 0x55659051f910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34666/0 (socket says 172.21.15.114:34666) 2024-05-08T18:09:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f3447341640 1 -- 172.21.15.114:0/3935747274 learned_addr learned my addr 172.21.15.114:0/3935747274 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f3447341640 1 -- 172.21.15.114:0/3935747274 >> v1:172.21.15.53:6789/0 conn(0x55659051f530 legacy=0x55659051f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.899+0000 7f3447341640 1 -- 172.21.15.114:0/3935747274 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565903a6ae0 con 0x5565905257d0 2024-05-08T18:09:11.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f3447341640 1 --2- 172.21.15.114:0/3935747274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565905257d0 0x556590527bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f343000a5c0 tx=0x7f343001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc982f486444c83 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f3446b40640 1 -- 172.21.15.114:0/3935747274 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b1070 con 0x5565905257d0 2024-05-08T18:09:11.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f3446b40640 1 -- 172.21.15.114:0/3935747274 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300a8070 con 0x5565905257d0 2024-05-08T18:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f3446b40640 1 -- 172.21.15.114:0/3935747274 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300ac5b0 con 0x5565905257d0 2024-05-08T18:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 -- 172.21.15.114:0/3935747274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565905257d0 msgr2=0x556590527bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 --2- 172.21.15.114:0/3935747274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565905257d0 0x556590527bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f343000a5c0 tx=0x7f343001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 -- 172.21.15.114:0/3935747274 shutdown_connections 2024-05-08T18:09:11.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 --2- 172.21.15.114:0/3935747274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565905257d0 0x556590527bc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 -- 172.21.15.114:0/3935747274 >> 172.21.15.114:0/3935747274 conn(0x556590518dd0 msgr2=0x55659051b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 -- 172.21.15.114:0/3935747274 shutdown_connections 2024-05-08T18:09:11.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.903+0000 7f344a02e980 1 -- 172.21.15.114:0/3935747274 wait complete. 2024-05-08T18:09:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f344a02e980 1 Processor -- start 2024-05-08T18:09:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f344a02e980 1 -- start start 2024-05-08T18:09:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f344a02e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x55659060c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f344a02e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556590422f80 con 0x55659051f530 2024-05-08T18:09:11.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3447b42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x55659060c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3447b42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x55659060c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58318/0 (socket says 172.21.15.114:58318) 2024-05-08T18:09:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3447b42640 1 -- 172.21.15.114:0/3302364015 learned_addr learned my addr 172.21.15.114:0/3302364015 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3447b42640 1 -- 172.21.15.114:0/3302364015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565903eada0 con 0x55659051f530 2024-05-08T18:09:11.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3447b42640 1 --2- 172.21.15.114:0/3302364015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x55659060c300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f343800b270 tx=0x7f343800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87209b6d3ef80aa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3335e0b640 1 -- 172.21.15.114:0/3302364015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f343800e5d0 con 0x55659051f530 2024-05-08T18:09:11.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3335e0b640 1 -- 172.21.15.114:0/3302364015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343800e770 con 0x55659051f530 2024-05-08T18:09:11.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.919+0000 7f3335e0b640 1 -- 172.21.15.114:0/3302364015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f343800ea70 con 0x55659051f530 2024-05-08T18:09:11.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/3302364015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 msgr2=0x55659060c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 --2- 172.21.15.114:0/3302364015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x55659060c300 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f343800b270 tx=0x7f343800b670 comp rx=0 tx=0).stop 2024-05-08T18:09:11.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/3302364015 shutdown_connections 2024-05-08T18:09:11.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 --2- 172.21.15.114:0/3302364015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x55659060c300 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/3302364015 >> 172.21.15.114:0/3302364015 conn(0x556590518dd0 msgr2=0x556590607e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/3302364015 shutdown_connections 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/3302364015 wait complete. 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 Processor -- start 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- start start 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x5565906137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55659052ab90 con 0x55659051f530 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f3447b42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x5565906137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f3447b42640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x5565906137e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58324/0 (socket says 172.21.15.114:58324) 2024-05-08T18:09:11.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f3447b42640 1 -- 172.21.15.114:0/2727564701 learned_addr learned my addr 172.21.15.114:0/2727564701 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f3447b42640 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556590613d20 con 0x55659051f530 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f3447b42640 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x5565906137e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f343800b6b0 tx=0x7f3438000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f332ffff640 1 -- 172.21.15.114:0/2727564701 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f343800fa40 con 0x55659051f530 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556590613fb0 con 0x55659051f530 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f332ffff640 1 -- 172.21.15.114:0/2727564701 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f343800fbe0 con 0x55659051f530 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f332ffff640 1 -- 172.21.15.114:0/2727564701 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f343801a480 con 0x55659051f530 2024-05-08T18:09:11.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.923+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556590616c90 con 0x55659051f530 2024-05-08T18:09:11.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f332ffff640 1 -- 172.21.15.114:0/2727564701 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3438017070 con 0x55659051f530 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f332ffff640 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33300383f0 0x7f333003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f332ffff640 1 -- 172.21.15.114:0/2727564701 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f3438015020 con 0x55659051f530 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3447341640 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33300383f0 0x7f333003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5565905257d0 0x55659061a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659061ae20 con 0x5565905257d0 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5565905257d0 0x55659061a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3447341640 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33300383f0 0x7f333003a8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f34300ae000 tx=0x7f34300a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5565905257d0 0x55659061a7b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 -- 172.21.15.114:0/2727564701 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f344000a4d0 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590617eb0 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 -- 172.21.15.114:0/2727564701 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f344000a4d0 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659061cc60 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 -- 172.21.15.114:0/2727564701 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f344000a4d0 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659061be90 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 -- 172.21.15.114:0/2727564701 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f344000a4d0 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659061c2e0 con 0x5565905257d0 2024-05-08T18:09:11.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f3448343640 1 -- 172.21.15.114:0/2727564701 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f344000a4d0 con 0x5565905257d0 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 Processor -- start 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- start start 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 0x55659062b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.927+0000 7f344a02e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556590426fc0 con 0x55659062b520 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3447341640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 0x55659062b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3447341640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 0x55659062b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58332/0 (socket says 172.21.15.114:58332) 2024-05-08T18:09:11.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3447341640 1 -- 172.21.15.114:0/323950597 learned_addr learned my addr 172.21.15.114:0/323950597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3447341640 1 -- 172.21.15.114:0/323950597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55659062be80 con 0x55659062b520 2024-05-08T18:09:11.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3447341640 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 0x55659062b940 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f34300af040 tx=0x7f34300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f332d7fa640 1 -- 172.21.15.114:0/323950597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b1040 con 0x55659062b520 2024-05-08T18:09:11.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f332d7fa640 1 -- 172.21.15.114:0/323950597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300c7070 con 0x55659062b520 2024-05-08T18:09:11.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f332d7fa640 1 -- 172.21.15.114:0/323950597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b76f0 con 0x55659062b520 2024-05-08T18:09:11.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55659062c920 con 0x55659062b520 2024-05-08T18:09:11.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659062cd30 con 0x55659062b520 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f332d7fa640 1 -- 172.21.15.114:0/323950597 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f34300aa070 con 0x55659062b520 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f332d7fa640 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33200383f0 0x7f332003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f332d7fa640 1 -- 172.21.15.114:0/323950597 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f34300eb460 con 0x55659062b520 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3448343640 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33200383f0 0x7f332003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f344a02e980 1 Processor -- start 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f344a02e980 1 -- start start 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3448343640 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33200383f0 0x7f332003a8b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55659061b9b0 tx=0x7f3440005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f344a02e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x5565906389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f344a02e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55659060ca50 con 0x556590638590 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.931+0000 7f3447341640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x5565906389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x5565906389b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58344/0 (socket says 172.21.15.114:58344) 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 -- 172.21.15.114:0/855963751 learned_addr learned my addr 172.21.15.114:0/855963751 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 -- 172.21.15.114:0/855963751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556590638f80 con 0x556590638590 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 --2- 172.21.15.114:0/855963751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x5565906389b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3430006e50 tx=0x7f3430006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6fa6cb58bc3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3326ffd640 1 -- 172.21.15.114:0/855963751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300db070 con 0x556590638590 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3326ffd640 1 -- 172.21.15.114:0/855963751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300b6590 con 0x556590638590 2024-05-08T18:09:11.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3326ffd640 1 -- 172.21.15.114:0/855963751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b5370 con 0x556590638590 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- 172.21.15.114:0/855963751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 msgr2=0x5565906389b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 --2- 172.21.15.114:0/855963751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x5565906389b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3430006e50 tx=0x7f3430006ae0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- 172.21.15.114:0/855963751 shutdown_connections 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 --2- 172.21.15.114:0/855963751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x5565906389b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- 172.21.15.114:0/855963751 >> 172.21.15.114:0/855963751 conn(0x556590634920 msgr2=0x556590632980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- 172.21.15.114:0/855963751 shutdown_connections 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- 172.21.15.114:0/855963751 wait complete. 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 Processor -- start 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- start start 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x55659063fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f344a02e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x556590639690 con 0x556590638590 2024-05-08T18:09:11.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x55659063fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x55659063fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58356/0 (socket says 172.21.15.114:58356) 2024-05-08T18:09:11.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 learned_addr learned my addr 172.21.15.114:0/1044721966 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556590640080 con 0x556590638590 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.935+0000 7f3447341640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x55659063fb40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f34300b8040 tx=0x7f34300e9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f33257fa640 1 -- 172.21.15.114:0/1044721966 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300b5370 con 0x556590638590 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556590640310 con 0x556590638590 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f33257fa640 1 -- 172.21.15.114:0/1044721966 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34300e9400 con 0x556590638590 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f33257fa640 1 -- 172.21.15.114:0/1044721966 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34300e95b0 con 0x556590638590 2024-05-08T18:09:11.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556590642ff0 con 0x556590638590 2024-05-08T18:09:11.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f33257fa640 1 -- 172.21.15.114:0/1044721966 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f34300de070 con 0x556590638590 2024-05-08T18:09:11.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f33257fa640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33100383f0 0x7f331003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f33257fa640 1 -- 172.21.15.114:0/1044721966 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f34300e6070 con 0x556590638590 2024-05-08T18:09:11.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55659064afe0 0x55659064d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3448343640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33100383f0 0x7f331003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064dbd0 con 0x55659064afe0 2024-05-08T18:09:11.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3447b42640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55659064afe0 0x55659064d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3448343640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33100383f0 0x7f331003a8b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x556590617dd0 tx=0x7f344001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3447b42640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55659064afe0 0x55659064d480 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 realm 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064dfe0 con 0x55659064afe0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064e880 con 0x55659064afe0 2024-05-08T18:09:11.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064ec20 con 0x55659064afe0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.939+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064f470 con 0x55659064afe0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f344a02e980 20 searching for the correct realm 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5565906511e0 0x5565906535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447341640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5565906511e0 0x5565906535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447341640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5565906511e0 0x5565906535d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447341640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f34300e9020 0x7f34300f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f34300e9020 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3448343640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f34300e9020 0x7f34300f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3448343640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f34300e9020 0x7f34300f4430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344001f070 con 0x7f34300e9020 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3448343640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3440031040 0x7f3440032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3440031040 0x7f3440032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3440031040 0x7f3440032940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.943+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f34300e9020 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344001f070 con 0x7f34300e9020 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f34300e9020 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f344001f070 con 0x7f34300e9020 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.947+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f34300e9020 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344001f070 con 0x7f34300e9020 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.951+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f34300e9020 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344001f070 con 0x7f34300e9020 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x5565906511e0 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f3440031040 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x55659064afe0 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x556590653b10 con 0x7f34300e9020 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f344001f070 con 0x7f34300e9020 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064fdf0 con 0x55659064afe0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659064fa00 con 0x55659064afe0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.955+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590650760 con 0x55659064afe0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:11.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 zone default found 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 4 Realm: () 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 zonegroup default 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590653f40 con 0x7f3440031040 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590655dd0 con 0x5565906511e0 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590656170 con 0x5565906511e0 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 started sync module instance, tier type = 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590655210 con 0x7f34300e9020 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93894702618160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565906569c0 con 0x7f34300e9020 2024-05-08T18:09:11.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.959+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590657210 con 0x55659064afe0 2024-05-08T18:09:11.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93894702618160] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93894702621968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590656de0 con 0x55659064afe0 2024-05-08T18:09:11.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590657820 con 0x5565906511e0 2024-05-08T18:09:11.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93894702625520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565906580c0 con 0x5565906511e0 2024-05-08T18:09:11.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.963+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590658ac0 con 0x7f34300e9020 2024-05-08T18:09:11.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93894702621968] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93894702623024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590658eb0 con 0x7f34300e9020 2024-05-08T18:09:11.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590659870 con 0x55659064afe0 2024-05-08T18:09:11.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93894702625520] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93894702623024] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93894702630352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565906593c0 con 0x55659064afe0 2024-05-08T18:09:11.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.967+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659065a110 con 0x7f3440031040 2024-05-08T18:09:11.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.971+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93894702630352] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.971+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.971+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93894702627856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5565906593c0 con 0x7f3440031040 2024-05-08T18:09:11.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.971+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659065a5d0 con 0x7f3440031040 2024-05-08T18:09:11.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.971+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93894702627856] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93894702637216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659065a590 con 0x7f3440031040 2024-05-08T18:09:11.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659065af50 con 0x7f3440031040 2024-05-08T18:09:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93894702637216] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93894702635568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659065af50 con 0x7f3440031040 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=0 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=1 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=2 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=3 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=4 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=5 2024-05-08T18:09:11.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.975+0000 7f344a02e980 20 add_watcher() i=6 2024-05-08T18:09:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93894702635568] v30'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 add_watcher() i=7 2024-05-08T18:09:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659065e280 con 0x55659064afe0 2024-05-08T18:09:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93894702640144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55659065b4e0 con 0x55659064afe0 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93894702640144] v30'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f32fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 5 note: GC not initialized 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f32fcfe1640 20 reqs_thread_entry: start 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 Filter name: none 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f32767fc640 20 reqs_thread_entry: start 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565906818d0 con 0x55659064afe0 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.979+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590682e20 con 0x7f34300e9020 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590682e20 con 0x55659064afe0 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:11.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 4.2 4:43f4944a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565906848e0 con 0x55659064afe0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:66 4.33 4:cc48b6a6:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5565906873c0 con 0x7f3440031040 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 4.10 4:09fd83a7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659068a110 con 0x5565906511e0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 4.3c 4:3f857315:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659068ca70 con 0x55659064afe0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 4.6 4:62dffd56:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659068f720 con 0x5565906511e0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 4.31 4:8ce771c4:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590692010 con 0x55659064afe0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590694880 con 0x5565906511e0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 4.2e 4:776f9cc7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590697490 con 0x5565906511e0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 4.18 4:1b5001e2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590692010 con 0x7f34300e9020 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 4.c 4:30553688:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590692010 con 0x55659064afe0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 4.33 4:ce643036:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55659069eb50 con 0x7f3440031040 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(72 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(70 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(67 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(71 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(66 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(73 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(74 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:11.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.983+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590686db0 con 0x7f34300e9020 2024-05-08T18:09:11.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590686db0 con 0x7f34300e9020 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f344a02e980 20 rados->read ofs=0 len=0 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590686db0 con 0x55659064afe0 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f344a02e980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x7f34300e9020 2024-05-08T18:09:11.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f32fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:11.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.987+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93894702640144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x55659064afe0 2024-05-08T18:09:11.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.991+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93894702640144] v30'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.991+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93894702618160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x7f34300e9020 2024-05-08T18:09:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.991+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93894702618160] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.991+0000 7f344a02e980 20 remove_watcher() i=0 2024-05-08T18:09:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.991+0000 7f344a02e980 2 removed watcher, disabling cache 2024-05-08T18:09:11.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.991+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93894702621968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x55659064afe0 2024-05-08T18:09:11.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93894702621968] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f344a02e980 20 remove_watcher() i=1 2024-05-08T18:09:11.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93894702625520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x5565906511e0 2024-05-08T18:09:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f3447341640 1 -- 172.21.15.114:0/1044721966 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93894702625520] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34300dd030 con 0x5565906511e0 2024-05-08T18:09:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f344a02e980 20 remove_watcher() i=2 2024-05-08T18:09:11.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93894702623024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x7f34300e9020 2024-05-08T18:09:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f3448343640 1 -- 172.21.15.114:0/1044721966 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93894702623024] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3440040040 con 0x7f34300e9020 2024-05-08T18:09:11.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f344a02e980 20 remove_watcher() i=3 2024-05-08T18:09:11.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.995+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93894702630352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x55659064afe0 2024-05-08T18:09:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.999+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93894702630352] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x55659064afe0 2024-05-08T18:09:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.999+0000 7f344a02e980 20 remove_watcher() i=4 2024-05-08T18:09:11.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.999+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93894702627856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x7f3440031040 2024-05-08T18:09:12.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.999+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93894702627856] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:12.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.999+0000 7f344a02e980 20 remove_watcher() i=5 2024-05-08T18:09:12.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:11.999+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93894702637216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x7f3440031040 2024-05-08T18:09:12.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.003+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93894702637216] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:12.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.003+0000 7f344a02e980 20 remove_watcher() i=6 2024-05-08T18:09:12.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.003+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93894702635568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x556590696e00 con 0x7f3440031040 2024-05-08T18:09:12.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.003+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93894702635568] v30'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f343802e070 con 0x7f3440031040 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.003+0000 7f344a02e980 20 remove_watcher() i=7 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3440031040 msgr2=0x7f3440032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3440031040 0x7f3440032940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55659064afe0 msgr2=0x55659064d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55659064afe0 0x55659064d480 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f34300e9020 msgr2=0x7f34300f4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f34300e9020 0x7f34300f4430 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5565906511e0 msgr2=0x5565906535d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5565906511e0 0x5565906535d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33100383f0 msgr2=0x7f331003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33100383f0 0x7f331003a8b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x556590617dd0 tx=0x7f344001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f3447b42640 1 -- 172.21.15.114:0/1044721966 reap_dead start 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 msgr2=0x55659063fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x55659063fb40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f34300b8040 tx=0x7f34300e9800 comp rx=0 tx=0).stop 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 shutdown_connections 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/1044721966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556590638590 0x55659063fb40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 >> 172.21.15.114:0/1044721966 conn(0x556590634920 msgr2=0x556590631f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 shutdown_connections 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/1044721966 wait complete. 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33200383f0 msgr2=0x7f332003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33200383f0 0x7f332003a8b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55659061b9b0 tx=0x7f3440005850 comp rx=0 tx=0).stop 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 msgr2=0x55659062b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 0x55659062b940 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f34300af040 tx=0x7f34300180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 shutdown_connections 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33200383f0 0x7f332003a8b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/323950597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659062b520 0x55659062b940 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 >> 172.21.15.114:0/323950597 conn(0x556590620330 msgr2=0x556590620e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 shutdown_connections 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/323950597 wait complete. 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5565905257d0 msgr2=0x55659061a7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5565905257d0 0x55659061a7b0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33300383f0 msgr2=0x7f333003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33300383f0 0x7f333003a8b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f34300ae000 tx=0x7f34300a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 msgr2=0x5565906137e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x5565906137e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f343800b6b0 tx=0x7f3438000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 shutdown_connections 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5565905257d0 0x55659061a7b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f33300383f0 0x7f333003a8b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 --2- 172.21.15.114:0/2727564701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55659051f530 0x5565906137e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 >> 172.21.15.114:0/2727564701 conn(0x556590518dd0 msgr2=0x5565906069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 shutdown_connections 2024-05-08T18:09:12.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.007+0000 7f344a02e980 1 -- 172.21.15.114:0/2727564701 wait complete. 2024-05-08T18:09:12.017 INFO:teuthology.orchestra.run.smithi114.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-08T18:09:11.989617Z","last_stats_update":"2024-05-08T18:09:11.987604Z"} 2024-05-08T18:09:12.018 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-08T18:09:11.989617Z', 'last_stats_update': '2024-05-08T18:09:11.987604Z'} 2024-05-08T18:09:12.024 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:12.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T18:09:12.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T18:09:12.025 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:12.095 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25dca6980 1 Processor -- start 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25dca6980 1 -- start start 2024-05-08T18:09:12.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25dca6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8ac0f0f10 0x55a8ac0f12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25dca6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a8abf9c710 con 0x55a8ac0f1830 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25dca6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55a8abfb0f00 con 0x55a8ac0f0f10 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25b7ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8ac0f0f10 0x55a8ac0f12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25afb9640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55a8ac0f1830 0x55a8ac0f21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34682/0 (socket says 172.21.15.114:34682) 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25b7ba640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55a8ac0f0f10 0x55a8ac0f12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58370/0 (socket says 172.21.15.114:58370) 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25afb9640 1 -- 172.21.15.114:0/2519440012 learned_addr learned my addr 172.21.15.114:0/2519440012 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25b7ba640 1 -- 172.21.15.114:0/2519440012 >> v1:172.21.15.53:6789/0 conn(0x55a8ac0f1830 legacy=0x55a8ac0f21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.095+0000 7fa25b7ba640 1 -- 172.21.15.114:0/2519440012 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8abf78ae0 con 0x55a8ac0f0f10 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/2519440012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac0f12f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa25400a420 tx=0x7fa25401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b8510242bcbfb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25a7b8640 1 -- 172.21.15.114:0/2519440012 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2540af070 con 0x55a8ac0f0f10 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25a7b8640 1 -- 172.21.15.114:0/2519440012 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2540aa530 con 0x55a8ac0f0f10 2024-05-08T18:09:12.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25a7b8640 1 -- 172.21.15.114:0/2519440012 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2540aa850 con 0x55a8ac0f0f10 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 -- 172.21.15.114:0/2519440012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 msgr2=0x55a8ac0f12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 --2- 172.21.15.114:0/2519440012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac0f12f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa25400a420 tx=0x7fa25401afd0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 -- 172.21.15.114:0/2519440012 shutdown_connections 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 --2- 172.21.15.114:0/2519440012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac0f12f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 -- 172.21.15.114:0/2519440012 >> 172.21.15.114:0/2519440012 conn(0x55a8ac0ec7e0 msgr2=0x55a8ac0eec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 -- 172.21.15.114:0/2519440012 shutdown_connections 2024-05-08T18:09:12.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.099+0000 7fa25dca6980 1 -- 172.21.15.114:0/2519440012 wait complete. 2024-05-08T18:09:12.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25dca6980 1 Processor -- start 2024-05-08T18:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25dca6980 1 -- start start 2024-05-08T18:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25dca6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1dc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25dca6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8abff4f80 con 0x55a8ac0f0f10 2024-05-08T18:09:12.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25b7ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1dc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25b7ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1dc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58384/0 (socket says 172.21.15.114:58384) 2024-05-08T18:09:12.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25b7ba640 1 -- 172.21.15.114:0/944557528 learned_addr learned my addr 172.21.15.114:0/944557528 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.115+0000 7fa25b7ba640 1 -- 172.21.15.114:0/944557528 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8abfbcda0 con 0x55a8ac0f0f10 2024-05-08T18:09:12.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/944557528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1dc6e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa2540ad040 tx=0x7fa2540033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a90ce584775592c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa14960a640 1 -- 172.21.15.114:0/944557528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2540af050 con 0x55a8ac0f0f10 2024-05-08T18:09:12.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa14960a640 1 -- 172.21.15.114:0/944557528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2540b0040 con 0x55a8ac0f0f10 2024-05-08T18:09:12.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa14960a640 1 -- 172.21.15.114:0/944557528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2540aaca0 con 0x55a8ac0f0f10 2024-05-08T18:09:12.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/944557528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 msgr2=0x55a8ac1dc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 --2- 172.21.15.114:0/944557528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1dc6e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa2540ad040 tx=0x7fa2540033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/944557528 shutdown_connections 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 --2- 172.21.15.114:0/944557528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1dc6e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/944557528 >> 172.21.15.114:0/944557528 conn(0x55a8ac0ec7e0 msgr2=0x55a8ac1d8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/944557528 shutdown_connections 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/944557528 wait complete. 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 Processor -- start 2024-05-08T18:09:12.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- start start 2024-05-08T18:09:12.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8ac0faf10 con 0x55a8ac0f0f10 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25b7ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25b7ba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1e39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58392/0 (socket says 172.21.15.114:58392) 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25b7ba640 1 -- 172.21.15.114:0/4218786562 learned_addr learned my addr 172.21.15.114:0/4218786562 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25b7ba640 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ac1e3f20 con 0x55a8ac0f0f10 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1e39e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa254019680 tx=0x7fa254019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa147e07640 1 -- 172.21.15.114:0/4218786562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2540c5070 con 0x55a8ac0f0f10 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa147e07640 1 -- 172.21.15.114:0/4218786562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2540aae40 con 0x55a8ac0f0f10 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8ac1e41b0 con 0x55a8ac0f0f10 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa147e07640 1 -- 172.21.15.114:0/4218786562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2540aaca0 con 0x55a8ac0f0f10 2024-05-08T18:09:12.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.119+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ac1e6e40 con 0x55a8ac0f0f10 2024-05-08T18:09:12.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa147e07640 1 -- 172.21.15.114:0/4218786562 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa2540c1690 con 0x55a8ac0f0f10 2024-05-08T18:09:12.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa147e07640 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1400383f0 0x7fa14003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa147e07640 1 -- 172.21.15.114:0/4218786562 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fa2540bb070 con 0x55a8ac0f0f10 2024-05-08T18:09:12.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25afb9640 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1400383f0 0x7fa14003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac0f1830 0x55a8ac1ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac1eafb0 con 0x55a8ac0f1830 2024-05-08T18:09:12.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac0f1830 0x55a8ac1ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25afb9640 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1400383f0 0x7fa14003a8b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa244001d80 tx=0x7fa2440012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac0f1830 0x55a8ac1ea940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25bfbb640 1 -- 172.21.15.114:0/4218786562 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa24c0083f0 con 0x55a8ac0f1830 2024-05-08T18:09:12.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac1e8040 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25bfbb640 1 -- 172.21.15.114:0/4218786562 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa24c0083f0 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac1ecdd0 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25bfbb640 1 -- 172.21.15.114:0/4218786562 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa24c0083f0 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac1ec000 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25bfbb640 1 -- 172.21.15.114:0/4218786562 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa24c0083f0 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.123+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac1ec420 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25bfbb640 1 -- 172.21.15.114:0/4218786562 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa24c0083f0 con 0x55a8ac0f1830 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25dca6980 1 Processor -- start 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25dca6980 1 -- start start 2024-05-08T18:09:12.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25dca6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 0x55a8ac065f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25dca6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8abff8fc0 con 0x55a8ac067a70 2024-05-08T18:09:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25afb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 0x55a8ac065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25afb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 0x55a8ac065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58404/0 (socket says 172.21.15.114:58404) 2024-05-08T18:09:12.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25afb9640 1 -- 172.21.15.114:0/2925734666 learned_addr learned my addr 172.21.15.114:0/2925734666 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25afb9640 1 -- 172.21.15.114:0/2925734666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ac066450 con 0x55a8ac067a70 2024-05-08T18:09:12.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25afb9640 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 0x55a8ac065f10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa24400d660 tx=0x7fa24400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa145602640 1 -- 172.21.15.114:0/2925734666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24400c6b0 con 0x55a8ac067a70 2024-05-08T18:09:12.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8ac0666e0 con 0x55a8ac067a70 2024-05-08T18:09:12.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa145602640 1 -- 172.21.15.114:0/2925734666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24400c850 con 0x55a8ac067a70 2024-05-08T18:09:12.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa145602640 1 -- 172.21.15.114:0/2925734666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24400cb30 con 0x55a8ac067a70 2024-05-08T18:09:12.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ac066bb0 con 0x55a8ac067a70 2024-05-08T18:09:12.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa145602640 1 -- 172.21.15.114:0/2925734666 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa244023020 con 0x55a8ac067a70 2024-05-08T18:09:12.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa145602640 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1340383f0 0x7fa13403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa145602640 1 -- 172.21.15.114:0/2925734666 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fa244021020 con 0x55a8ac067a70 2024-05-08T18:09:12.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.127+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1340383f0 0x7fa13403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 Processor -- start 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- start start 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1340383f0 0x7fa13403a8b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a8ac1ec3a0 tx=0x7fa24c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac20afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8ac1dcd70 con 0x55a8ac20ab80 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac20afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac20afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58406/0 (socket says 172.21.15.114:58406) 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 -- 172.21.15.114:0/79331466 learned_addr learned my addr 172.21.15.114:0/79331466 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 -- 172.21.15.114:0/79331466 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ac20b570 con 0x55a8ac20ab80 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 --2- 172.21.15.114:0/79331466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac20afa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa24404f2c0 tx=0x7fa2440193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f8906b03c22cab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa13effd640 1 -- 172.21.15.114:0/79331466 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24401bcc0 con 0x55a8ac20ab80 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa13effd640 1 -- 172.21.15.114:0/79331466 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa24403e0d0 con 0x55a8ac20ab80 2024-05-08T18:09:12.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa13effd640 1 -- 172.21.15.114:0/79331466 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24401be60 con 0x55a8ac20ab80 2024-05-08T18:09:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- 172.21.15.114:0/79331466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 msgr2=0x55a8ac20afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 --2- 172.21.15.114:0/79331466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac20afa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa24404f2c0 tx=0x7fa2440193e0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- 172.21.15.114:0/79331466 shutdown_connections 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 --2- 172.21.15.114:0/79331466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac20afa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- 172.21.15.114:0/79331466 >> 172.21.15.114:0/79331466 conn(0x55a8ac206f10 msgr2=0x55a8ac204f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- 172.21.15.114:0/79331466 shutdown_connections 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- 172.21.15.114:0/79331466 wait complete. 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 Processor -- start 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- start start 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac212150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25dca6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55a8ac20bcc0 con 0x55a8ac20ab80 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac212150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac212150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58422/0 (socket says 172.21.15.114:58422) 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.131+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 learned_addr learned my addr 172.21.15.114:0/796890600 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8ac212690 con 0x55a8ac20ab80 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25afb9640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac212150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa2440238a0 tx=0x7fa24404f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa13d7fa640 1 -- 172.21.15.114:0/796890600 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24404c070 con 0x55a8ac20ab80 2024-05-08T18:09:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a8ac212920 con 0x55a8ac20ab80 2024-05-08T18:09:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa13d7fa640 1 -- 172.21.15.114:0/796890600 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa244035070 con 0x55a8ac20ab80 2024-05-08T18:09:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa13d7fa640 1 -- 172.21.15.114:0/796890600 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa24401b890 con 0x55a8ac20ab80 2024-05-08T18:09:12.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8ac212920 con 0x55a8ac20ab80 2024-05-08T18:09:12.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa13d7fa640 1 -- 172.21.15.114:0/796890600 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa24403f050 con 0x55a8ac20ab80 2024-05-08T18:09:12.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa13d7fa640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1240383f0 0x7fa12403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa13d7fa640 1 -- 172.21.15.114:0/796890600 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fa244005030 con 0x55a8ac20ab80 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1240383f0 0x7fa12403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac21d400 0x55a8ac21f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac220010 con 0x55a8ac21d400 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac21d400 0x55a8ac21f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1240383f0 0x7fa12403a8b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00f010 tx=0x7fa24c01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac21d400 0x55a8ac21f8c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 realm 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac220420 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac220cf0 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.135+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac221090 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac2218e0 con 0x55a8ac21d400 2024-05-08T18:09:12.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 20 searching for the correct realm 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55a8ac223650 0x55a8ac225a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25afb9640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55a8ac223650 0x55a8ac225a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25afb9640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55a8ac223650 0x55a8ac225a40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24403fd60 con 0x55a8ac223650 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25afb9640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa24403f340 0x7fa244040070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24403f340 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa24403f340 0x7fa244040070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa24403f340 0x7fa244040070 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25bfbb640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa24c019040 0x7fa24c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa24c019040 0x7fa24c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.139+0000 7fa25b7ba640 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa24c019040 0x7fa24c019930 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24403f340 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.143+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24403f340 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24403f340 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.147+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24403f340 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac223650 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24c019040 2024-05-08T18:09:12.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x55a8ac21d400 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac225f80 con 0x7fa24403f340 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac222230 con 0x55a8ac21d400 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.151+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac222ad0 con 0x55a8ac21d400 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac222ad0 con 0x55a8ac21d400 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 zone default found 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 4 Realm: () 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:12.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 zonegroup default 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac2263b0 con 0x7fa24c019040 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac227d90 con 0x55a8ac223650 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac228220 con 0x55a8ac223650 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 started sync module instance, tier type = 2024-05-08T18:09:12.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:12.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac227230 con 0x7fa24403f340 2024-05-08T18:09:12.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94182930806304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac228b30 con 0x7fa24403f340 2024-05-08T18:09:12.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.155+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac229380 con 0x55a8ac21d400 2024-05-08T18:09:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94182930806304] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94182930810496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac228f50 con 0x55a8ac21d400 2024-05-08T18:09:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac229a10 con 0x55a8ac223650 2024-05-08T18:09:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94182930810496] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94182930811552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac228ec0 con 0x55a8ac223650 2024-05-08T18:09:12.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.159+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22a7a0 con 0x7fa24403f340 2024-05-08T18:09:12.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94182930817712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22b040 con 0x7fa24403f340 2024-05-08T18:09:12.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22ba60 con 0x55a8ac21d400 2024-05-08T18:09:12.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94182930811552] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94182930817712] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94182930822480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22ab90 con 0x55a8ac21d400 2024-05-08T18:09:12.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.163+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22c300 con 0x7fa24c019040 2024-05-08T18:09:12.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94182930824288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22c530 con 0x7fa24c019040 2024-05-08T18:09:12.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22cd80 con 0x7fa24c019040 2024-05-08T18:09:12.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94182930822480] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94182930824288] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94182930825344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22c950 con 0x7fa24c019040 2024-05-08T18:09:12.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.167+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22d1a0 con 0x7fa24c019040 2024-05-08T18:09:12.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94182930828080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22d560 con 0x7fa24c019040 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=0 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=1 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=2 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=3 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=4 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=5 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94182930825344] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=6 2024-05-08T18:09:12.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94182930828080] v30'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 20 add_watcher() i=7 2024-05-08T18:09:12.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:12.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.171+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22c4a0 con 0x55a8ac21d400 2024-05-08T18:09:12.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94182930826400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac22daa0 con 0x55a8ac21d400 2024-05-08T18:09:12.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94182930826400] v30'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:12.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 5 note: GC not initialized 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa110fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 Filter name: none 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa08a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac253f40 con 0x55a8ac21d400 2024-05-08T18:09:12.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac253a90 con 0x7fa24403f340 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:12.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.175+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac257c70 con 0x55a8ac21d400 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:09:12.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac259160 con 0x7fa24403f340 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac258cb0 con 0x7fa24403f340 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:12.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T18:09:12.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:12.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.179+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac25f190 con 0x7fa24403f340 2024-05-08T18:09:12.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25dca6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:09:12.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25dca6980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25dca6980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:12.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94182931016864 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac25c620 con 0x7fa24c019040 2024-05-08T18:09:12.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== watch-notify(notify (1) cookie 94182930825344 notify 128849018881 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55a8ac257250 con 0x7fa24c019040 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa13effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94182930825344 notifier 4478 bl.length()=338 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa13effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa13effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(68 notify.6 [notify cookie 94182931016864 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa13effd640 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fa120003eb0 con 0x7fa24c019040 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.183+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== watch-notify(notify_complete (2) cookie 94182931016864 notify 128849018881 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa2540dc040 con 0x7fa24c019040 2024-05-08T18:09:12.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94182930826400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x55a8ac21d400 2024-05-08T18:09:12.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94182930826400] v30'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94182930806304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x7fa24403f340 2024-05-08T18:09:12.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94182930806304] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25dca6980 20 remove_watcher() i=0 2024-05-08T18:09:12.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25dca6980 2 removed watcher, disabling cache 2024-05-08T18:09:12.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.187+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94182930810496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x55a8ac21d400 2024-05-08T18:09:12.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.191+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94182930810496] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.191+0000 7fa25dca6980 20 remove_watcher() i=1 2024-05-08T18:09:12.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.191+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94182930811552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x55a8ac223650 2024-05-08T18:09:12.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.191+0000 7fa25afb9640 1 -- 172.21.15.114:0/796890600 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94182930811552] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa244050b70 con 0x55a8ac223650 2024-05-08T18:09:12.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.191+0000 7fa25dca6980 20 remove_watcher() i=2 2024-05-08T18:09:12.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.191+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94182930817712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x7fa24403f340 2024-05-08T18:09:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.195+0000 7fa25bfbb640 1 -- 172.21.15.114:0/796890600 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94182930817712] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa24c02f040 con 0x7fa24403f340 2024-05-08T18:09:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.195+0000 7fa25dca6980 20 remove_watcher() i=3 2024-05-08T18:09:12.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.195+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94182930822480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x55a8ac21d400 2024-05-08T18:09:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.195+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94182930822480] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x55a8ac21d400 2024-05-08T18:09:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.195+0000 7fa25dca6980 20 remove_watcher() i=4 2024-05-08T18:09:12.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.195+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94182930824288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x7fa24c019040 2024-05-08T18:09:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.199+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94182930824288] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.199+0000 7fa25dca6980 20 remove_watcher() i=5 2024-05-08T18:09:12.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.199+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94182930825344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x7fa24c019040 2024-05-08T18:09:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.199+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94182930825344] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.199+0000 7fa25dca6980 20 remove_watcher() i=6 2024-05-08T18:09:12.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.199+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94182930828080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55a8ac251c70 con 0x7fa24c019040 2024-05-08T18:09:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94182930828080] v30'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2540d0070 con 0x7fa24c019040 2024-05-08T18:09:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 20 remove_watcher() i=7 2024-05-08T18:09:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa24c019040 msgr2=0x7fa24c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa24c019040 0x7fa24c019930 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac21d400 msgr2=0x55a8ac21f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac21d400 0x55a8ac21f8c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa24403f340 msgr2=0x7fa244040070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa24403f340 0x7fa244040070 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55a8ac223650 msgr2=0x55a8ac225a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55a8ac223650 0x55a8ac225a40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1240383f0 msgr2=0x7fa12403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1240383f0 0x7fa12403a8b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa24c00f010 tx=0x7fa24c01b070 comp rx=0 tx=0).stop 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 msgr2=0x55a8ac212150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25b7ba640 1 -- 172.21.15.114:0/796890600 reap_dead start 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac212150 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa2440238a0 tx=0x7fa24404f220 comp rx=0 tx=0).stop 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 shutdown_connections 2024-05-08T18:09:12.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/796890600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac20ab80 0x55a8ac212150 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 >> 172.21.15.114:0/796890600 conn(0x55a8ac206f10 msgr2=0x55a8ac20c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 shutdown_connections 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/796890600 wait complete. 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1340383f0 msgr2=0x7fa13403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1340383f0 0x7fa13403a8b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a8ac1ec3a0 tx=0x7fa24c003070 comp rx=0 tx=0).stop 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 msgr2=0x55a8ac065f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 0x55a8ac065f10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa24400d660 tx=0x7fa24400da60 comp rx=0 tx=0).stop 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 shutdown_connections 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1340383f0 0x7fa13403a8b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/2925734666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac067a70 0x55a8ac065f10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 >> 172.21.15.114:0/2925734666 conn(0x55a8ac1f0550 msgr2=0x55a8ac1f1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 shutdown_connections 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/2925734666 wait complete. 2024-05-08T18:09:12.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac0f1830 msgr2=0x55a8ac1ea940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac0f1830 0x55a8ac1ea940 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1400383f0 msgr2=0x7fa14003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1400383f0 0x7fa14003a8b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa244001d80 tx=0x7fa2440012e0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 msgr2=0x55a8ac1e39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1e39e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa254019680 tx=0x7fa254019810 comp rx=0 tx=0).stop 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 shutdown_connections 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55a8ac0f1830 0x55a8ac1ea940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1400383f0 0x7fa14003a8b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 --2- 172.21.15.114:0/4218786562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8ac0f0f10 0x55a8ac1e39e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 >> 172.21.15.114:0/4218786562 conn(0x55a8ac0ec7e0 msgr2=0x55a8ac1d6d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 shutdown_connections 2024-05-08T18:09:12.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.203+0000 7fa25dca6980 1 -- 172.21.15.114:0/4218786562 wait complete. 2024-05-08T18:09:12.215 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:09:12.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:09:12.215 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T18:09:12.305 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:12.306 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:12.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bde7dd980 1 Processor -- start 2024-05-08T18:09:12.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bde7dd980 1 -- start start 2024-05-08T18:09:12.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bde7dd980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626673c02d0 0x5626673c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bde7dd980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562667267710 con 0x562667330860 2024-05-08T18:09:12.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bde7dd980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56266727bf00 con 0x5626673c02d0 2024-05-08T18:09:12.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bdbaf0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626673c02d0 0x5626673c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bdbaf0640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5626673c02d0 0x5626673c26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58436/0 (socket says 172.21.15.114:58436) 2024-05-08T18:09:12.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/763208397 learned_addr learned my addr 172.21.15.114:0/763208397 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bdc2f1640 1 --1- 172.21.15.114:0/763208397 >> v1:172.21.15.53:6789/0 conn(0x562667330860 0x5626673bebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34694/0 (socket says 172.21.15.114:34694) 2024-05-08T18:09:12.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/763208397 >> v1:172.21.15.53:6789/0 conn(0x562667330860 legacy=0x5626673bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.307+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/763208397 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562667243ae0 con 0x5626673c02d0 2024-05-08T18:09:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/763208397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626673c02d0 0x5626673c26c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400a5c0 tx=0x7f7bc401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcefbd154b35a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bdb2ef640 1 -- 172.21.15.114:0/763208397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40a6070 con 0x5626673c02d0 2024-05-08T18:09:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bdb2ef640 1 -- 172.21.15.114:0/763208397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc40af070 con 0x5626673c02d0 2024-05-08T18:09:12.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bdb2ef640 1 -- 172.21.15.114:0/763208397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40aa5c0 con 0x5626673c02d0 2024-05-08T18:09:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 -- 172.21.15.114:0/763208397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626673c02d0 msgr2=0x5626673c26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/763208397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626673c02d0 0x5626673c26c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400a5c0 tx=0x7f7bc401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 -- 172.21.15.114:0/763208397 shutdown_connections 2024-05-08T18:09:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/763208397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626673c02d0 0x5626673c26c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 -- 172.21.15.114:0/763208397 >> 172.21.15.114:0/763208397 conn(0x5626673b66d0 msgr2=0x5626673b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 -- 172.21.15.114:0/763208397 shutdown_connections 2024-05-08T18:09:12.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.311+0000 7f7bde7dd980 1 -- 172.21.15.114:0/763208397 wait complete. 2024-05-08T18:09:12.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bde7dd980 1 Processor -- start 2024-05-08T18:09:12.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bde7dd980 1 -- start start 2024-05-08T18:09:12.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bde7dd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bde7dd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626672bff80 con 0x562667330860 2024-05-08T18:09:12.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bdc2f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bdc2f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58446/0 (socket says 172.21.15.114:58446) 2024-05-08T18:09:12.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/2970098739 learned_addr learned my addr 172.21.15.114:0/2970098739 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/2970098739 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562667287da0 con 0x562667330860 2024-05-08T18:09:12.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7bdc2f1640 1 --2- 172.21.15.114:0/2970098739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674a71e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40016f0 tx=0x7f7bd4001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c1f165289a3401 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7aca60c640 1 -- 172.21.15.114:0/2970098739 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd4003460 con 0x562667330860 2024-05-08T18:09:12.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7aca60c640 1 -- 172.21.15.114:0/2970098739 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd4003620 con 0x562667330860 2024-05-08T18:09:12.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.327+0000 7f7aca60c640 1 -- 172.21.15.114:0/2970098739 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd4003940 con 0x562667330860 2024-05-08T18:09:12.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2970098739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 msgr2=0x5626674a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2970098739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674a71e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40016f0 tx=0x7f7bd4001bb0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2970098739 shutdown_connections 2024-05-08T18:09:12.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2970098739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674a71e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2970098739 >> 172.21.15.114:0/2970098739 conn(0x5626673b66d0 msgr2=0x5626674a2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2970098739 shutdown_connections 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2970098739 wait complete. 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 Processor -- start 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- start start 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626673c37a0 con 0x562667330860 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bdc2f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bdc2f1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58462/0 (socket says 172.21.15.114:58462) 2024-05-08T18:09:12.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/2837896112 learned_addr learned my addr 172.21.15.114:0/2837896112 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626674aeaf0 con 0x562667330860 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bdc2f1640 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674ae5b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40012f0 tx=0x7f7bd4001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7ac8e09640 1 -- 172.21.15.114:0/2837896112 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd4022020 con 0x562667330860 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626674aed80 con 0x562667330860 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7ac8e09640 1 -- 172.21.15.114:0/2837896112 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd4006820 con 0x562667330860 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7ac8e09640 1 -- 172.21.15.114:0/2837896112 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd4003e10 con 0x562667330860 2024-05-08T18:09:12.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.331+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626674b1a10 con 0x562667330860 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7ac8e09640 1 -- 172.21.15.114:0/2837896112 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7bd4025020 con 0x562667330860 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7ac8e09640 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ac40383a0 0x7f7ac403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7ac8e09640 1 -- 172.21.15.114:0/2837896112 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7bd404e830 con 0x562667330860 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ac40383a0 0x7f7ac403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674b3650 0x5626674b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674b5f80 con 0x5626674b3650 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674b3650 0x5626674b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ac40383a0 0x7f7ac403a860 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40ae000 tx=0x7f7bc40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674b3650 0x5626674b5a40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/2837896112 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bcc0083f0 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674b2c10 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/2837896112 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7bcc0083f0 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674b7d60 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/2837896112 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7bcc0083f0 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674b6ed0 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/2837896112 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7bcc0083f0 con 0x5626674b3650 2024-05-08T18:09:12.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674b72f0 con 0x5626674b3650 2024-05-08T18:09:12.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/2837896112 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7bcc0083f0 con 0x5626674b3650 2024-05-08T18:09:12.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 Processor -- start 2024-05-08T18:09:12.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- start start 2024-05-08T18:09:12.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 0x5626674c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.335+0000 7f7bde7dd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626672c3fc0 con 0x5626674c66b0 2024-05-08T18:09:12.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdbaf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 0x5626674c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdbaf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 0x5626674c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58470/0 (socket says 172.21.15.114:58470) 2024-05-08T18:09:12.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1711493218 learned_addr learned my addr 172.21.15.114:0/1711493218 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1711493218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626674c7010 con 0x5626674c66b0 2024-05-08T18:09:12.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 0x5626674c6ad0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4096f40 tx=0x7f7bc40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7ac1ffb640 1 -- 172.21.15.114:0/1711493218 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40b39c0 con 0x5626674c66b0 2024-05-08T18:09:12.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7ac1ffb640 1 -- 172.21.15.114:0/1711493218 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc40b3b60 con 0x5626674c66b0 2024-05-08T18:09:12.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7ac1ffb640 1 -- 172.21.15.114:0/1711493218 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40c8430 con 0x5626674c66b0 2024-05-08T18:09:12.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626674c7ab0 con 0x5626674c66b0 2024-05-08T18:09:12.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626674c7f20 con 0x5626674c66b0 2024-05-08T18:09:12.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7ac1ffb640 1 -- 172.21.15.114:0/1711493218 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7bc40d1440 con 0x5626674c66b0 2024-05-08T18:09:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7ac1ffb640 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ab4038440 0x7f7ab403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7ac1ffb640 1 -- 172.21.15.114:0/1711493218 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7bc40ebf90 con 0x5626674c66b0 2024-05-08T18:09:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ab4038440 0x7f7ab403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bde7dd980 1 Processor -- start 2024-05-08T18:09:12.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bde7dd980 1 -- start start 2024-05-08T18:09:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ab4038440 0x7f7ab403a900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5626674b7270 tx=0x7f7bcc003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bde7dd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.339+0000 7f7bde7dd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626674a78d0 con 0x5626674d3720 2024-05-08T18:09:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58482/0 (socket says 172.21.15.114:58482) 2024-05-08T18:09:12.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1155322630 learned_addr learned my addr 172.21.15.114:0/1155322630 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1155322630 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626674d4110 con 0x5626674d3720 2024-05-08T18:09:12.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/1155322630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674d3b40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40ea2e0 tx=0x7f7bc40ea5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8fb37d8866802c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7ab37fe640 1 -- 172.21.15.114:0/1155322630 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40e7030 con 0x5626674d3720 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7ab37fe640 1 -- 172.21.15.114:0/1155322630 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc40bd5a0 con 0x5626674d3720 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7ab37fe640 1 -- 172.21.15.114:0/1155322630 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40d1860 con 0x5626674d3720 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1155322630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 msgr2=0x5626674d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1155322630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674d3b40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40ea2e0 tx=0x7f7bc40ea5c0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1155322630 shutdown_connections 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1155322630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674d3b40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1155322630 >> 172.21.15.114:0/1155322630 conn(0x5626674cfab0 msgr2=0x5626674cdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1155322630 shutdown_connections 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1155322630 wait complete. 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 Processor -- start 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- start start 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674dac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bde7dd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5626674d4860 con 0x5626674d3720 2024-05-08T18:09:12.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674dac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674dac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58488/0 (socket says 172.21.15.114:58488) 2024-05-08T18:09:12.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 learned_addr learned my addr 172.21.15.114:0/1077797679 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626674db170 con 0x5626674d3720 2024-05-08T18:09:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.343+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674dac30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40ea600 tx=0x7f7bc40ea270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7ab1ffb640 1 -- 172.21.15.114:0/1077797679 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40d1a30 con 0x5626674d3720 2024-05-08T18:09:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626674db400 con 0x5626674d3720 2024-05-08T18:09:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626674de0e0 con 0x5626674d3720 2024-05-08T18:09:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7ab1ffb640 1 -- 172.21.15.114:0/1077797679 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc40be640 con 0x5626674d3720 2024-05-08T18:09:12.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7ab1ffb640 1 -- 172.21.15.114:0/1077797679 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc40c7c10 con 0x5626674d3720 2024-05-08T18:09:12.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7ab1ffb640 1 -- 172.21.15.114:0/1077797679 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7bc40bf980 con 0x5626674d3720 2024-05-08T18:09:12.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7ab1ffb640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7aa40383f0 0x7f7aa403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7ab1ffb640 1 -- 172.21.15.114:0/1077797679 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7bc40e1070 con 0x5626674d3720 2024-05-08T18:09:12.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7aa40383f0 0x7f7aa403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674e61a0 0x5626674e8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674e8d90 con 0x5626674e61a0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdc2f1640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674e61a0 0x5626674e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7aa40383f0 0x7f7aa403a8b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc008fd0 tx=0x7f7bcc01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdc2f1640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674e61a0 0x5626674e8640 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 realm 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674e91a0 con 0x5626674e61a0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674e9a40 con 0x5626674e61a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674e9de0 con 0x5626674e61a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.347+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674ea630 con 0x5626674e61a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bde7dd980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bde7dd980 20 searching for the correct realm 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5626674ec3a0 0x5626674ee790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5626674ec3a0 0x5626674ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5626674ec3a0 0x5626674ee790 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdbaf0640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x5626673c02d0 0x7f7bc40c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626673c02d0 2024-05-08T18:09:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x5626673c02d0 0x7f7bc40c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x5626673c02d0 0x7f7bc40c85d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdcaf2640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7bcc019040 0x7f7bcc019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7bcc019040 0x7f7bcc019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7bcc019040 0x7f7bcc019930 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.351+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626673c02d0 2024-05-08T18:09:12.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626673c02d0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.355+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626673c02d0 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.359+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626673c02d0 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674ec3a0 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x7f7bcc019040 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626674e61a0 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5626674eecd0 con 0x5626673c02d0 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:12.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674eaf10 con 0x5626674e61a0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.363+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674eb7b0 con 0x5626674e61a0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674eb7b0 con 0x5626674e61a0 2024-05-08T18:09:12.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 zone default found 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 4 Realm: () 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 zonegroup default 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674ef100 con 0x7f7bcc019040 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674f0b10 con 0x5626674ec3a0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674f0ff0 con 0x5626674ec3a0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 started sync module instance, tier type = 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674eff80 con 0x5626673c02d0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94722941977456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f1900 con 0x5626673c02d0 2024-05-08T18:09:12.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.367+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f2150 con 0x5626674e61a0 2024-05-08T18:09:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.371+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94722941977456] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.371+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.371+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94722941981776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f1d20 con 0x5626674e61a0 2024-05-08T18:09:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.371+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f2810 con 0x5626674ec3a0 2024-05-08T18:09:12.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.371+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94722941981776] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94722941982832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f1c90 con 0x5626674ec3a0 2024-05-08T18:09:12.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f3560 con 0x5626673c02d0 2024-05-08T18:09:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94722941989312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f3cb0 con 0x5626673c02d0 2024-05-08T18:09:12.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f47d0 con 0x5626674e61a0 2024-05-08T18:09:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94722941982832] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94722941989312] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94722941993632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f4790 con 0x5626674e61a0 2024-05-08T18:09:12.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.375+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f5070 con 0x7f7bcc019040 2024-05-08T18:09:12.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94722941993632] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94722941987840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f4c40 con 0x7f7bcc019040 2024-05-08T18:09:12.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f5510 con 0x7f7bcc019040 2024-05-08T18:09:12.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94722941987840] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94722941994896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f56f0 con 0x7f7bcc019040 2024-05-08T18:09:12.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.379+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f5f40 con 0x7f7bcc019040 2024-05-08T18:09:12.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94722941999312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f6320 con 0x7f7bcc019040 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=0 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=1 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=2 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=3 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=4 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=5 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94722941994896] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=6 2024-05-08T18:09:12.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94722941999312] v30'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 20 add_watcher() i=7 2024-05-08T18:09:12.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5626674f4c30 con 0x5626674e61a0 2024-05-08T18:09:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.383+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94722941996016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5626674f6800 con 0x5626674e61a0 2024-05-08T18:09:12.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94722941996016] v30'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7a927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 5 note: GC not initialized 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7a917e2640 20 reqs_thread_entry: start 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 Filter name: none 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7a02ffd640 20 reqs_thread_entry: start 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56266751cdb0 con 0x7f7bcc019040 2024-05-08T18:09:12.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x56266751b3f0 con 0x7f7bcc019040 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:09:12.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.387+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751bc90 con 0x7f7bcc019040 2024-05-08T18:09:12.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v30'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bde7dd980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:09:12.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bde7dd980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:12.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bde7dd980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:09:12.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94722942154720 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562667520850 con 0x7f7bcc019040 2024-05-08T18:09:12.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== watch-notify(notify (1) cookie 94722941987840 notify 128849018882 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56266751c030 con 0x7f7bcc019040 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7ab37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94722941987840 notifier 4485 bl.length()=556 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(65 notify.5 [notify cookie 94722942154720 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7ab37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7ab37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7ab37fe640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7aa0003eb0 con 0x7f7bcc019040 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== watch-notify(notify_complete (2) cookie 94722942154720 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56266751c800 con 0x7f7bcc019040 2024-05-08T18:09:12.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.391+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751e380 con 0x7f7bcc019040 2024-05-08T18:09:12.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bde7dd980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:09:12.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bde7dd980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:12.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bde7dd980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:09:12.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94722942154640 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x562667520850 con 0x5626674ec3a0 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== watch-notify(notify (1) cookie 94722941982832 notify 128849018882 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5626674db400 con 0x5626674ec3a0 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7ab37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94722941982832 notifier 4485 bl.length()=177 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7ab37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7ab37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7ab37fe640 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7aa0003eb0 con 0x5626674ec3a0 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(68 notify.2 [notify cookie 94722942154640 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== watch-notify(notify_complete (2) cookie 94722942154640 notify 128849018882 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626674db170 con 0x5626674ec3a0 2024-05-08T18:09:12.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.395+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.398 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:09:12.392998Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:12.392985Z","tags":[],"group_ids":[]} 2024-05-08T18:09:12.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7a927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94722941996016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x5626674e61a0 2024-05-08T18:09:12.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94722941996016] v30'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94722941977456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x5626673c02d0 2024-05-08T18:09:12.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94722941977456] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bde7dd980 20 remove_watcher() i=0 2024-05-08T18:09:12.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bde7dd980 2 removed watcher, disabling cache 2024-05-08T18:09:12.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.399+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94722941981776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x5626674e61a0 2024-05-08T18:09:12.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94722941981776] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bde7dd980 20 remove_watcher() i=1 2024-05-08T18:09:12.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94722941982832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x5626674ec3a0 2024-05-08T18:09:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bdbaf0640 1 -- 172.21.15.114:0/1077797679 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94722941982832] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bc40ce020 con 0x5626674ec3a0 2024-05-08T18:09:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bde7dd980 20 remove_watcher() i=2 2024-05-08T18:09:12.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94722941989312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x5626673c02d0 2024-05-08T18:09:12.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bdcaf2640 1 -- 172.21.15.114:0/1077797679 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94722941989312] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bcc02f040 con 0x5626673c02d0 2024-05-08T18:09:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bde7dd980 20 remove_watcher() i=3 2024-05-08T18:09:12.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.403+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94722941993632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x5626674e61a0 2024-05-08T18:09:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.407+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94722941993632] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x5626674e61a0 2024-05-08T18:09:12.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.407+0000 7f7bde7dd980 20 remove_watcher() i=4 2024-05-08T18:09:12.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.407+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94722941987840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x7f7bcc019040 2024-05-08T18:09:12.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.407+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94722941987840] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.407+0000 7f7bde7dd980 20 remove_watcher() i=5 2024-05-08T18:09:12.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.411+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94722941994896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x7f7bcc019040 2024-05-08T18:09:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.411+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94722941994896] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.411+0000 7f7bde7dd980 20 remove_watcher() i=6 2024-05-08T18:09:12.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.411+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94722941999312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x56266751aa50 con 0x7f7bcc019040 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.411+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94722941999312] v30'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7bd401b040 con 0x7f7bcc019040 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.411+0000 7f7bde7dd980 20 remove_watcher() i=7 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7bcc019040 msgr2=0x7f7bcc019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7bcc019040 0x7f7bcc019930 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674e61a0 msgr2=0x5626674e8640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674e61a0 0x5626674e8640 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x5626673c02d0 msgr2=0x7f7bc40c85d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x5626673c02d0 0x7f7bc40c85d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5626674ec3a0 msgr2=0x5626674ee790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5626674ec3a0 0x5626674ee790 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7aa40383f0 msgr2=0x7f7aa403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7aa40383f0 0x7f7aa403a8b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc008fd0 tx=0x7f7bcc01b070 comp rx=0 tx=0).stop 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bdc2f1640 1 -- 172.21.15.114:0/1077797679 reap_dead start 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 msgr2=0x5626674dac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674dac30 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40ea600 tx=0x7f7bc40ea270 comp rx=0 tx=0).stop 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 shutdown_connections 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1077797679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674d3720 0x5626674dac30 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 >> 172.21.15.114:0/1077797679 conn(0x5626674cfab0 msgr2=0x5626674d4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 shutdown_connections 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1077797679 wait complete. 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ab4038440 msgr2=0x7f7ab403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ab4038440 0x7f7ab403a900 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5626674b7270 tx=0x7f7bcc003070 comp rx=0 tx=0).stop 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 msgr2=0x5626674c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 0x5626674c6ad0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4096f40 tx=0x7f7bc40180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 shutdown_connections 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ab4038440 0x7f7ab403a900 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/1711493218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5626674c66b0 0x5626674c6ad0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 >> 172.21.15.114:0/1711493218 conn(0x5626674bb4c0 msgr2=0x5626674bbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 shutdown_connections 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/1711493218 wait complete. 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674b3650 msgr2=0x5626674b5a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674b3650 0x5626674b5a40 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ac40383a0 msgr2=0x7f7ac403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ac40383a0 0x7f7ac403a860 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7bc40ae000 tx=0x7f7bc40a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 msgr2=0x5626674ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674ae5b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40012f0 tx=0x7f7bd4001260 comp rx=0 tx=0).stop 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 shutdown_connections 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5626674b3650 0x5626674b5a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7ac40383a0 0x7f7ac403a860 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 --2- 172.21.15.114:0/2837896112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562667330860 0x5626674ae5b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 >> 172.21.15.114:0/2837896112 conn(0x5626673b66d0 msgr2=0x5626674a17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 shutdown_connections 2024-05-08T18:09:12.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.415+0000 7f7bde7dd980 1 -- 172.21.15.114:0/2837896112 wait complete. 2024-05-08T18:09:12.426 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:09:12.392998Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:12.392985Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:12.434 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:09:12.440 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:12.440 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-08T18:09:12.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-08T18:09:12.441 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-08T18:09:12.470 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:12.470 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:12.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55225eb980 1 Processor -- start 2024-05-08T18:09:12.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55225eb980 1 -- start start 2024-05-08T18:09:12.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55225eb980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x559579c333c0 0x559579c357b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55225eb980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559579ada710 con 0x559579c2ef00 2024-05-08T18:09:12.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55225eb980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x559579aeef00 con 0x559579c333c0 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55200ff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x559579c2ef00 0x559579c2f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34698/0 (socket says 172.21.15.114:34698) 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f55200ff640 1 -- 172.21.15.114:0/1674807923 learned_addr learned my addr 172.21.15.114:0/1674807923 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f551f8fe640 1 --2- 172.21.15.114:0/1674807923 >> v2:172.21.15.53:3300/0 conn(0x559579c333c0 0x559579c357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f551f0fd640 1 -- 172.21.15.114:0/1674807923 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609482855 0 0) 0x559579ada710 con 0x559579c2ef00 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f551f0fd640 1 -- 172.21.15.114:0/1674807923 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f550c001e20 con 0x559579c2ef00 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f551f8fe640 1 -- 172.21.15.114:0/1674807923 >> v1:172.21.15.53:6789/0 conn(0x559579c2ef00 legacy=0x559579c2f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.471+0000 7f551f8fe640 1 -- 172.21.15.114:0/1674807923 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559579ab6ae0 con 0x559579c333c0 2024-05-08T18:09:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f551f8fe640 1 --2- 172.21.15.114:0/1674807923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c333c0 0x559579c357b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f550800a480 tx=0x7f550801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8004b2d068de6efb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f551f0fd640 1 -- 172.21.15.114:0/1674807923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080b0070 con 0x559579c333c0 2024-05-08T18:09:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f551f0fd640 1 -- 172.21.15.114:0/1674807923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55080ab540 con 0x559579c333c0 2024-05-08T18:09:12.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f551f0fd640 1 -- 172.21.15.114:0/1674807923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080ab820 con 0x559579c333c0 2024-05-08T18:09:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 -- 172.21.15.114:0/1674807923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c333c0 msgr2=0x559579c357b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 --2- 172.21.15.114:0/1674807923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c333c0 0x559579c357b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f550800a480 tx=0x7f550801b280 comp rx=0 tx=0).stop 2024-05-08T18:09:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 -- 172.21.15.114:0/1674807923 shutdown_connections 2024-05-08T18:09:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 --2- 172.21.15.114:0/1674807923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c333c0 0x559579c357b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 -- 172.21.15.114:0/1674807923 >> 172.21.15.114:0/1674807923 conn(0x559579c2a7d0 msgr2=0x559579c2cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 -- 172.21.15.114:0/1674807923 shutdown_connections 2024-05-08T18:09:12.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.475+0000 7f55225eb980 1 -- 172.21.15.114:0/1674807923 wait complete. 2024-05-08T18:09:12.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55225eb980 1 Processor -- start 2024-05-08T18:09:12.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55225eb980 1 -- start start 2024-05-08T18:09:12.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55225eb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d19dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55225eb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559579b32f80 con 0x559579c2ef00 2024-05-08T18:09:12.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55200ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d19dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55200ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d19dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58496/0 (socket says 172.21.15.114:58496) 2024-05-08T18:09:12.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55200ff640 1 -- 172.21.15.114:0/3735714178 learned_addr learned my addr 172.21.15.114:0/3735714178 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55200ff640 1 -- 172.21.15.114:0/3735714178 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559579afada0 con 0x559579c2ef00 2024-05-08T18:09:12.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55200ff640 1 --2- 172.21.15.114:0/3735714178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d19dd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5518001e40 tx=0x7f551800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c274f7c7909e0e1f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f540e60c640 1 -- 172.21.15.114:0/3735714178 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5518012020 con 0x559579c2ef00 2024-05-08T18:09:12.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f540e60c640 1 -- 172.21.15.114:0/3735714178 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551800e690 con 0x559579c2ef00 2024-05-08T18:09:12.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f540e60c640 1 -- 172.21.15.114:0/3735714178 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551800e9b0 con 0x559579c2ef00 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55225eb980 1 -- 172.21.15.114:0/3735714178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 msgr2=0x559579d19dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.491+0000 7f55225eb980 1 --2- 172.21.15.114:0/3735714178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d19dd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5518001e40 tx=0x7f551800b790 comp rx=0 tx=0).stop 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- 172.21.15.114:0/3735714178 shutdown_connections 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 --2- 172.21.15.114:0/3735714178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d19dd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- 172.21.15.114:0/3735714178 >> 172.21.15.114:0/3735714178 conn(0x559579c2a7d0 msgr2=0x559579d15960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- 172.21.15.114:0/3735714178 shutdown_connections 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- 172.21.15.114:0/3735714178 wait complete. 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 Processor -- start 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- start start 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d21290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559579c387e0 con 0x559579c2ef00 2024-05-08T18:09:12.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55200ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d21290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55200ff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d21290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58504/0 (socket says 172.21.15.114:58504) 2024-05-08T18:09:12.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55200ff640 1 -- 172.21.15.114:0/1636734472 learned_addr learned my addr 172.21.15.114:0/1636734472 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55200ff640 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559579d217d0 con 0x559579c2ef00 2024-05-08T18:09:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55200ff640 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d21290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x559579d1ac60 tx=0x7f55180040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f540ce09640 1 -- 172.21.15.114:0/1636734472 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5518012030 con 0x559579c2ef00 2024-05-08T18:09:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f540ce09640 1 -- 172.21.15.114:0/1636734472 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f551801a770 con 0x559579c2ef00 2024-05-08T18:09:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f540ce09640 1 -- 172.21.15.114:0/1636734472 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f551801aa70 con 0x559579c2ef00 2024-05-08T18:09:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559579d21a60 con 0x559579c2ef00 2024-05-08T18:09:12.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.495+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559579d246f0 con 0x559579c2ef00 2024-05-08T18:09:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f540ce09640 1 -- 172.21.15.114:0/1636734472 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5518015020 con 0x559579c2ef00 2024-05-08T18:09:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f540ce09640 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5408038440 0x7f540803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f540ce09640 1 -- 172.21.15.114:0/1636734472 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f5518020070 con 0x559579c2ef00 2024-05-08T18:09:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f551f8fe640 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5408038440 0x7f540803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579c333c0 0x559579d281d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d287f0 con 0x559579c333c0 2024-05-08T18:09:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579c333c0 0x559579d281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f551f8fe640 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5408038440 0x7f540803a900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f55080ad000 tx=0x7f55080a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579c333c0 0x559579d281d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 -- 172.21.15.114:0/1636734472 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551000a4d0 con 0x559579c333c0 2024-05-08T18:09:12.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d25910 con 0x559579c333c0 2024-05-08T18:09:12.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 -- 172.21.15.114:0/1636734472 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f551000a4d0 con 0x559579c333c0 2024-05-08T18:09:12.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d2a640 con 0x559579c333c0 2024-05-08T18:09:12.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 -- 172.21.15.114:0/1636734472 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f551000a4d0 con 0x559579c333c0 2024-05-08T18:09:12.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d29870 con 0x559579c333c0 2024-05-08T18:09:12.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 -- 172.21.15.114:0/1636734472 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f551000a4d0 con 0x559579c333c0 2024-05-08T18:09:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d29c90 con 0x559579c333c0 2024-05-08T18:09:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f5520900640 1 -- 172.21.15.114:0/1636734472 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f551000a4d0 con 0x559579c333c0 2024-05-08T18:09:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 Processor -- start 2024-05-08T18:09:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- start start 2024-05-08T18:09:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 0x559579d393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.499+0000 7f55225eb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559579b36fc0 con 0x559579d38fc0 2024-05-08T18:09:12.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f551f8fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 0x559579d393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f551f8fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 0x559579d393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58518/0 (socket says 172.21.15.114:58518) 2024-05-08T18:09:12.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f551f8fe640 1 -- 172.21.15.114:0/1041106694 learned_addr learned my addr 172.21.15.114:0/1041106694 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f551f8fe640 1 -- 172.21.15.114:0/1041106694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559579d39920 con 0x559579d38fc0 2024-05-08T18:09:12.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f551f8fe640 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 0x559579d393e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f55080ae040 tx=0x7f5508018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5405ffb640 1 -- 172.21.15.114:0/1041106694 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080c7070 con 0x559579d38fc0 2024-05-08T18:09:12.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5405ffb640 1 -- 172.21.15.114:0/1041106694 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55080abd10 con 0x559579d38fc0 2024-05-08T18:09:12.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559579d3a3c0 con 0x559579d38fc0 2024-05-08T18:09:12.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5405ffb640 1 -- 172.21.15.114:0/1041106694 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080b0040 con 0x559579d38fc0 2024-05-08T18:09:12.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559579d3a830 con 0x559579d38fc0 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5405ffb640 1 -- 172.21.15.114:0/1041106694 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f55080ca070 con 0x559579d38fc0 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5405ffb640 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f80383f0 0x7f53f803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5405ffb640 1 -- 172.21.15.114:0/1041106694 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f55080a8070 con 0x559579d38fc0 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5520900640 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f80383f0 0x7f53f803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f55225eb980 1 Processor -- start 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f5520900640 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f80383f0 0x7f53f803a8b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x559579d29c10 tx=0x7f5510005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f55225eb980 1 -- start start 2024-05-08T18:09:12.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f55225eb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579ba58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.503+0000 7f55225eb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559579d1a520 con 0x559579ba5490 2024-05-08T18:09:12.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579ba58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579ba58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58530/0 (socket says 172.21.15.114:58530) 2024-05-08T18:09:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 -- 172.21.15.114:0/3046831507 learned_addr learned my addr 172.21.15.114:0/3046831507 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 -- 172.21.15.114:0/3046831507 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559579ba3ce0 con 0x559579ba5490 2024-05-08T18:09:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 --2- 172.21.15.114:0/3046831507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579ba58b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f55080e9340 tx=0x7f55080aa470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c882315494f79e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f53ff7fe640 1 -- 172.21.15.114:0/3046831507 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080d4020 con 0x559579ba5490 2024-05-08T18:09:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f53ff7fe640 1 -- 172.21.15.114:0/3046831507 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55080c1db0 con 0x559579ba5490 2024-05-08T18:09:12.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f53ff7fe640 1 -- 172.21.15.114:0/3046831507 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080e6070 con 0x559579ba5490 2024-05-08T18:09:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- 172.21.15.114:0/3046831507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 msgr2=0x559579ba58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 --2- 172.21.15.114:0/3046831507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579ba58b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f55080e9340 tx=0x7f55080aa470 comp rx=0 tx=0).stop 2024-05-08T18:09:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- 172.21.15.114:0/3046831507 shutdown_connections 2024-05-08T18:09:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 --2- 172.21.15.114:0/3046831507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579ba58b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- 172.21.15.114:0/3046831507 >> 172.21.15.114:0/3046831507 conn(0x559579d42420 msgr2=0x559579d40480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- 172.21.15.114:0/3046831507 shutdown_connections 2024-05-08T18:09:12.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- 172.21.15.114:0/3046831507 wait complete. 2024-05-08T18:09:12.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 Processor -- start 2024-05-08T18:09:12.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- start start 2024-05-08T18:09:12.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579d4f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f55225eb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x559579ba4180 con 0x559579ba5490 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579d4f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579d4f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58544/0 (socket says 172.21.15.114:58544) 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 learned_addr learned my addr 172.21.15.114:0/4170926770 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.507+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559579d4fd80 con 0x559579ba5490 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f551f8fe640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579d4f840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55080aa4b0 tx=0x7f55080e92a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f53fdffb640 1 -- 172.21.15.114:0/4170926770 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55080e6070 con 0x559579ba5490 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559579d50010 con 0x559579ba5490 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f53fdffb640 1 -- 172.21.15.114:0/4170926770 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55080e7040 con 0x559579ba5490 2024-05-08T18:09:12.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559579d50010 con 0x559579ba5490 2024-05-08T18:09:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f53fdffb640 1 -- 172.21.15.114:0/4170926770 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5508002910 con 0x559579ba5490 2024-05-08T18:09:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f53fdffb640 1 -- 172.21.15.114:0/4170926770 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f55080d7020 con 0x559579ba5490 2024-05-08T18:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f53fdffb640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f00383f0 0x7f53f003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f53fdffb640 1 -- 172.21.15.114:0/4170926770 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f55080b90a0 con 0x559579ba5490 2024-05-08T18:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f5520900640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f00383f0 0x7f53f003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579d5aaf0 0x559579d5cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5d6e0 con 0x559579d5aaf0 2024-05-08T18:09:12.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55200ff640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579d5aaf0 0x559579d5cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f5520900640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f00383f0 0x7f53f003a8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x559579d29390 tx=0x7f551001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55200ff640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579d5aaf0 0x559579d5cf90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 realm 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5daf0 con 0x559579d5aaf0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5e390 con 0x559579d5aaf0 2024-05-08T18:09:12.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5e730 con 0x559579d5aaf0 2024-05-08T18:09:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.511+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5dfe0 con 0x559579d5aaf0 2024-05-08T18:09:12.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55225eb980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55225eb980 20 searching for the correct realm 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559579d60b50 0x559579d62f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f551f8fe640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559579d60b50 0x559579d62f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f551f8fe640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559579d60b50 0x559579d62f40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f551f8fe640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f55080d9050 0x7f55080f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f55080d9050 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f5520900640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f55080d9050 0x7f55080f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f5520900640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f55080d9050 0x7f55080f3430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551001f070 con 0x7f55080d9050 2024-05-08T18:09:12.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f5520900640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5510031040 0x7f5510032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5510031040 0x7f5510032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5510031040 0x7f5510032430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x7f5510031040 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.515+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x7f5510031040 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x7f5510031040 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f55080d9050 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551001f070 con 0x7f55080d9050 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x7f5510031040 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f55080d9050 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f551001f070 con 0x7f55080d9050 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.519+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x7f5510031040 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551803d040 con 0x7f5510031040 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f55080d9050 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551001f070 con 0x7f55080d9050 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f551803d040 con 0x559579d5aaf0 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.523+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f55080d9050 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551001f070 con 0x7f55080d9050 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d60b50 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f5510031040 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x559579d5aaf0 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x559579d635f0 con 0x7f55080d9050 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f551001f070 con 0x7f55080d9050 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:12.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5f620 con 0x559579d5aaf0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5fec0 con 0x559579d5aaf0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d5f260 con 0x559579d5aaf0 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 zone default found 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 4 Realm: () 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 zonegroup default 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.527+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d63a50 con 0x7f5510031040 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d658e0 con 0x559579d60b50 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d65c80 con 0x559579d60b50 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 started sync module instance, tier type = 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:12.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d64d20 con 0x7f55080d9050 2024-05-08T18:09:12.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94100482576704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d664d0 con 0x7f55080d9050 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d66d20 con 0x559579d5aaf0 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.531+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94100482576704] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94100482580512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d668f0 con 0x559579d5aaf0 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d672f0 con 0x559579d60b50 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94100482580512] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94100482581568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d66860 con 0x559579d60b50 2024-05-08T18:09:12.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.535+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d68040 con 0x7f55080d9050 2024-05-08T18:09:12.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94100482587808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d68790 con 0x7f55080d9050 2024-05-08T18:09:12.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d69290 con 0x559579d5aaf0 2024-05-08T18:09:12.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94100482581568] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94100482587808] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94100482592128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d69250 con 0x559579d5aaf0 2024-05-08T18:09:12.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.539+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d69b60 con 0x7f5510031040 2024-05-08T18:09:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94100482592128] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94100482586336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d69250 con 0x7f5510031040 2024-05-08T18:09:12.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6a100 con 0x7f5510031040 2024-05-08T18:09:12.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94100482586336] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94100482595920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6a070 con 0x7f5510031040 2024-05-08T18:09:12.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.543+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6aa30 con 0x7f5510031040 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94100482595920] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94100482594352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6aa30 con 0x7f5510031040 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=0 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=1 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=2 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=3 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=4 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=5 2024-05-08T18:09:12.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=6 2024-05-08T18:09:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94100482594352] v30'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 20 add_watcher() i=7 2024-05-08T18:09:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.547+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d6de50 con 0x559579d5aaf0 2024-05-08T18:09:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94100482598736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6b330 con 0x559579d5aaf0 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94100482598736] v30'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f53d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 5 note: GC not initialized 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f53d57e2640 20 reqs_thread_entry: start 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 20 Filter name: none 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f5346ffd640 20 reqs_thread_entry: start 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x559579d912b0 con 0x7f55080d9050 2024-05-08T18:09:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:12.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f53d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.551+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94100482598736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d703a0 con 0x559579d5aaf0 2024-05-08T18:09:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.555+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94100482598736] v30'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.555+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94100482576704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6a720 con 0x7f55080d9050 2024-05-08T18:09:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.555+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94100482576704] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.555+0000 7f55225eb980 20 remove_watcher() i=0 2024-05-08T18:09:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.555+0000 7f55225eb980 2 removed watcher, disabling cache 2024-05-08T18:09:12.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.555+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94100482580512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d65140 con 0x559579d5aaf0 2024-05-08T18:09:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94100482580512] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55225eb980 20 remove_watcher() i=1 2024-05-08T18:09:12.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94100482581568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d65140 con 0x559579d60b50 2024-05-08T18:09:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f551f8fe640 1 -- 172.21.15.114:0/4170926770 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94100482581568] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55080c9030 con 0x559579d60b50 2024-05-08T18:09:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55225eb980 20 remove_watcher() i=2 2024-05-08T18:09:12.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94100482587808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d6a720 con 0x7f55080d9050 2024-05-08T18:09:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f5520900640 1 -- 172.21.15.114:0/4170926770 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94100482587808] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5510040040 con 0x7f55080d9050 2024-05-08T18:09:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55225eb980 20 remove_watcher() i=3 2024-05-08T18:09:12.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.559+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94100482592128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d67ca0 con 0x559579d5aaf0 2024-05-08T18:09:12.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.563+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94100482592128] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x559579d5aaf0 2024-05-08T18:09:12.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.563+0000 7f55225eb980 20 remove_watcher() i=4 2024-05-08T18:09:12.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.563+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94100482586336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d67ca0 con 0x7f5510031040 2024-05-08T18:09:12.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.563+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94100482586336] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.563+0000 7f55225eb980 20 remove_watcher() i=5 2024-05-08T18:09:12.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.563+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94100482595920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d676e0 con 0x7f5510031040 2024-05-08T18:09:12.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.567+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94100482595920] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.567+0000 7f55225eb980 20 remove_watcher() i=6 2024-05-08T18:09:12.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.567+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94100482594352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x559579d69c50 con 0x7f5510031040 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.567+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94100482594352] v30'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5518056040 con 0x7f5510031040 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.567+0000 7f55225eb980 20 remove_watcher() i=7 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5510031040 msgr2=0x7f5510032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5510031040 0x7f5510032430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579d5aaf0 msgr2=0x559579d5cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579d5aaf0 0x559579d5cf90 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f55080d9050 msgr2=0x7f55080f3430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f55080d9050 0x7f55080f3430 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559579d60b50 msgr2=0x559579d62f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x559579d60b50 0x559579d62f40 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f00383f0 msgr2=0x7f53f003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f00383f0 0x7f53f003a8b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x559579d29390 tx=0x7f551001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 msgr2=0x559579d4f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/4170926770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579ba5490 0x559579d4f840 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55080aa4b0 tx=0x7f55080e92a0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 reap_dead start 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55200ff640 1 -- 172.21.15.114:0/4170926770 reap_dead start 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 shutdown_connections 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 >> 172.21.15.114:0/4170926770 conn(0x559579d42420 msgr2=0x559579d3fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 shutdown_connections 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/4170926770 wait complete. 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f80383f0 msgr2=0x7f53f803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f80383f0 0x7f53f803a8b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x559579d29c10 tx=0x7f5510005850 comp rx=0 tx=0).stop 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 msgr2=0x559579d393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 0x559579d393e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f55080ae040 tx=0x7f5508018020 comp rx=0 tx=0).stop 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 shutdown_connections 2024-05-08T18:09:12.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f53f80383f0 0x7f53f803a8b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1041106694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579d38fc0 0x559579d393e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 >> 172.21.15.114:0/1041106694 conn(0x559579d2ddd0 msgr2=0x559579d2e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 shutdown_connections 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1041106694 wait complete. 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579c333c0 msgr2=0x559579d281d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579c333c0 0x559579d281d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5408038440 msgr2=0x7f540803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5408038440 0x7f540803a900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f55080ad000 tx=0x7f55080a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 msgr2=0x559579d21290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d21290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x559579d1ac60 tx=0x7f55180040f0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 shutdown_connections 2024-05-08T18:09:12.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x559579c333c0 0x559579d281d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5408038440 0x7f540803a900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 --2- 172.21.15.114:0/1636734472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559579c2ef00 0x559579d21290 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 >> 172.21.15.114:0/1636734472 conn(0x559579c2a7d0 msgr2=0x559579d14470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 shutdown_connections 2024-05-08T18:09:12.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.571+0000 7f55225eb980 1 -- 172.21.15.114:0/1636734472 wait complete. 2024-05-08T18:09:12.582 INFO:teuthology.orchestra.run.smithi114.stdout:{"key":"bucket:myfoo","ver":{"tag":"_JCxoUZrxdq25uavl0O6T5iW","ver":2},"mtime":"2024-05-08T18:09:12.184276Z","data":{"bucket":{"name":"myfoo","marker":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","bucket_id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-08T18:09:10.628914Z","linked":false,"has_bucket_info":false}} 2024-05-08T18:09:12.582 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_JCxoUZrxdq25uavl0O6T5iW', 'ver': 2}, 'mtime': '2024-05-08T18:09:12.184276Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'bucket_id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-08T18:09:10.628914Z', 'linked': False, 'has_bucket_info': False}} 2024-05-08T18:09:12.582 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1'] 2024-05-08T18:09:12.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1'] 2024-05-08T18:09:12.583 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:12.663 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:12.664 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb7514980 1 Processor -- start 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb7514980 1 -- start start 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb7514980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5644edd3f7c0 0x5644eddcdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb7514980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644edc76710 con 0x5644eddce050 2024-05-08T18:09:12.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb7514980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5644edc8af00 con 0x5644edd3f7c0 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb5028640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5644edd3f7c0 0x5644eddcdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb5028640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5644edd3f7c0 0x5644eddcdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58548/0 (socket says 172.21.15.114:58548) 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.663+0000 7fcbb5028640 1 -- 172.21.15.114:0/1672644384 learned_addr learned my addr 172.21.15.114:0/1672644384 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb5028640 1 -- 172.21.15.114:0/1672644384 >> v1:172.21.15.53:6789/0 conn(0x5644eddce050 legacy=0x5644eddd0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb5028640 1 -- 172.21.15.114:0/1672644384 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644edc52ae0 con 0x5644edd3f7c0 2024-05-08T18:09:12.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb5028640 1 --2- 172.21.15.114:0/1672644384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcdb10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcba800a5c0 tx=0x7fcba801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ae4c49376c0ef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcba7fff640 1 -- 172.21.15.114:0/1672644384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba80a6070 con 0x5644edd3f7c0 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcba7fff640 1 -- 172.21.15.114:0/1672644384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba80af070 con 0x5644edd3f7c0 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcba7fff640 1 -- 172.21.15.114:0/1672644384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba80aa5c0 con 0x5644edd3f7c0 2024-05-08T18:09:12.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 -- 172.21.15.114:0/1672644384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 msgr2=0x5644eddcdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 --2- 172.21.15.114:0/1672644384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcdb10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcba800a5c0 tx=0x7fcba801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 -- 172.21.15.114:0/1672644384 shutdown_connections 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 --2- 172.21.15.114:0/1672644384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcdb10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 -- 172.21.15.114:0/1672644384 >> 172.21.15.114:0/1672644384 conn(0x5644eddc5630 msgr2=0x5644eddc7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 -- 172.21.15.114:0/1672644384 shutdown_connections 2024-05-08T18:09:12.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.667+0000 7fcbb7514980 1 -- 172.21.15.114:0/1672644384 wait complete. 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb7514980 1 Processor -- start 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb7514980 1 -- start start 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb7514980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb7514980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5644edccef80 con 0x5644edd3f7c0 2024-05-08T18:09:12.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb5028640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb5028640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58560/0 (socket says 172.21.15.114:58560) 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.683+0000 7fcbb5028640 1 -- 172.21.15.114:0/764403358 learned_addr learned my addr 172.21.15.114:0/764403358 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 -- 172.21.15.114:0/764403358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644edc96da0 con 0x5644edd3f7c0 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 --2- 172.21.15.114:0/764403358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcb270 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcba800a5c0 tx=0x7fcba8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7699f19f0fc744 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcaa3606640 1 -- 172.21.15.114:0/764403358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba80aa9f0 con 0x5644edd3f7c0 2024-05-08T18:09:12.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcaa3606640 1 -- 172.21.15.114:0/764403358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba80aab90 con 0x5644edd3f7c0 2024-05-08T18:09:12.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcaa3606640 1 -- 172.21.15.114:0/764403358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba80bd3f0 con 0x5644edd3f7c0 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/764403358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 msgr2=0x5644eddcb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 --2- 172.21.15.114:0/764403358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcb270 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcba800a5c0 tx=0x7fcba8003030 comp rx=0 tx=0).stop 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/764403358 shutdown_connections 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 --2- 172.21.15.114:0/764403358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644eddcb270 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/764403358 >> 172.21.15.114:0/764403358 conn(0x5644eddc5630 msgr2=0x5644edeb1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/764403358 shutdown_connections 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/764403358 wait complete. 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 Processor -- start 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- start start 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644edebf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5644eddd2670 con 0x5644edd3f7c0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644edebf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644edebf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58570/0 (socket says 172.21.15.114:58570) 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 -- 172.21.15.114:0/2260231075 learned_addr learned my addr 172.21.15.114:0/2260231075 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644edebfb30 con 0x5644edd3f7c0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb5028640 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644edebf5f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcba801b380 tx=0x7fcba80180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcaa1e03640 1 -- 172.21.15.114:0/2260231075 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba80c6750 con 0x5644edd3f7c0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644edebfdc0 con 0x5644edd3f7c0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcaa1e03640 1 -- 172.21.15.114:0/2260231075 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcba80cc070 con 0x5644edd3f7c0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644edec2a00 con 0x5644edd3f7c0 2024-05-08T18:09:12.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.687+0000 7fcaa1e03640 1 -- 172.21.15.114:0/2260231075 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcba80c6a20 con 0x5644edd3f7c0 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcaa1e03640 1 -- 172.21.15.114:0/2260231075 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcba80c6bc0 con 0x5644edd3f7c0 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcaa1e03640 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca9c038440 0x7fca9c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcaa1e03640 1 -- 172.21.15.114:0/2260231075 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcba80ea280 con 0x5644edd3f7c0 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb4827640 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca9c038440 0x7fca9c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644eddce050 0x5644edec64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edec6b50 con 0x5644eddce050 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644eddce050 0x5644edec64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb4827640 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca9c038440 0x7fca9c03a900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001ec0 tx=0x7fcbac001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644eddce050 0x5644edec64e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 -- 172.21.15.114:0/2260231075 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcbb000a4d0 con 0x5644eddce050 2024-05-08T18:09:12.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edec7430 con 0x5644eddce050 2024-05-08T18:09:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 -- 172.21.15.114:0/2260231075 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcbb000a4d0 con 0x5644eddce050 2024-05-08T18:09:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edec87e0 con 0x5644eddce050 2024-05-08T18:09:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 -- 172.21.15.114:0/2260231075 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcbb000a4d0 con 0x5644eddce050 2024-05-08T18:09:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edec7c80 con 0x5644eddce050 2024-05-08T18:09:12.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 -- 172.21.15.114:0/2260231075 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcbb000a4d0 con 0x5644eddce050 2024-05-08T18:09:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edec80d0 con 0x5644eddce050 2024-05-08T18:09:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.691+0000 7fcbb5829640 1 -- 172.21.15.114:0/2260231075 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcbb000a4d0 con 0x5644eddce050 2024-05-08T18:09:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb7514980 1 Processor -- start 2024-05-08T18:09:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb7514980 1 -- start start 2024-05-08T18:09:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb7514980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 0x5644eded7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb7514980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5644edcd2fc0 con 0x5644eded72f0 2024-05-08T18:09:12.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb4827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 0x5644eded7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb4827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 0x5644eded7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58576/0 (socket says 172.21.15.114:58576) 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb4827640 1 -- 172.21.15.114:0/224515317 learned_addr learned my addr 172.21.15.114:0/224515317 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb4827640 1 -- 172.21.15.114:0/224515317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644eded7c50 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb4827640 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 0x5644eded7710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcbac010fd0 tx=0x7fcbac00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fca9affd640 1 -- 172.21.15.114:0/224515317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac00a040 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644eded86f0 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644eded8bc0 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fca9affd640 1 -- 172.21.15.114:0/224515317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac017050 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.695+0000 7fca9affd640 1 -- 172.21.15.114:0/224515317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac00e6b0 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fca9affd640 1 -- 172.21.15.114:0/224515317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcbac00e850 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fca9affd640 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca8c0383f0 0x7fca8c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fca9affd640 1 -- 172.21.15.114:0/224515317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcbac050700 con 0x5644eded72f0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb5829640 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca8c0383f0 0x7fca8c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 Processor -- start 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- start start 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edee48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5644eddcb900 con 0x5644edee4500 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb5829640 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca8c0383f0 0x7fca8c03a8b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5644edec7310 tx=0x7fcbb0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb4827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edee48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb4827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edee48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58580/0 (socket says 172.21.15.114:58580) 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb4827640 1 -- 172.21.15.114:0/2143626793 learned_addr learned my addr 172.21.15.114:0/2143626793 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb4827640 1 -- 172.21.15.114:0/2143626793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644edee4eb0 con 0x5644edee4500 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb4827640 1 --2- 172.21.15.114:0/2143626793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edee48e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001b90 tx=0x7fcbac023b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1874b4b94a3784dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fca98ff9640 1 -- 172.21.15.114:0/2143626793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac043070 con 0x5644edee4500 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fca98ff9640 1 -- 172.21.15.114:0/2143626793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac0234e0 con 0x5644edee4500 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fca98ff9640 1 -- 172.21.15.114:0/2143626793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac04ee60 con 0x5644edee4500 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- 172.21.15.114:0/2143626793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 msgr2=0x5644edee48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2143626793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edee48e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001b90 tx=0x7fcbac023b10 comp rx=0 tx=0).stop 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- 172.21.15.114:0/2143626793 shutdown_connections 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2143626793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edee48e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- 172.21.15.114:0/2143626793 >> 172.21.15.114:0/2143626793 conn(0x5644edee0840 msgr2=0x5644edede8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- 172.21.15.114:0/2143626793 shutdown_connections 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.699+0000 7fcbb7514980 1 -- 172.21.15.114:0/2143626793 wait complete. 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 Processor -- start 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 -- start start 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edeeba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5644edee5670 con 0x5644edee4500 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb4827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edeeba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb4827640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edeeba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58596/0 (socket says 172.21.15.114:58596) 2024-05-08T18:09:12.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 learned_addr learned my addr 172.21.15.114:0/74340686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644edeebf60 con 0x5644edee4500 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb4827640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edeeba20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00fcf0 tx=0x7fcbac04e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fca8affd640 1 -- 172.21.15.114:0/74340686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac043040 con 0x5644edee4500 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644edeec1f0 con 0x5644edee4500 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fca8affd640 1 -- 172.21.15.114:0/74340686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbac050320 con 0x5644edee4500 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fca8affd640 1 -- 172.21.15.114:0/74340686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcbac04ee60 con 0x5644edee4500 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644edeec600 con 0x5644edee4500 2024-05-08T18:09:12.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fca8affd640 1 -- 172.21.15.114:0/74340686 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcbac036060 con 0x5644edee4500 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fca8affd640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca800383a0 0x7fca8003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fca8affd640 1 -- 172.21.15.114:0/74340686 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fcbac04c070 con 0x5644edee4500 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb5829640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca800383a0 0x7fca8003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644edef6f20 0x5644edef93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.703+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edef9b10 con 0x5644edef6f20 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644edef6f20 0x5644edef93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5829640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca800383a0 0x7fca8003a860 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5644edec3b40 tx=0x7fcbb001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644edef6f20 0x5644edef93c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 realm 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edef9f20 con 0x5644edef6f20 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edefa7f0 con 0x5644edef6f20 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edefab90 con 0x5644edef6f20 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edefb3e0 con 0x5644edef6f20 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 20 searching for the correct realm 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5644edefd150 0x5644edeff540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb4827640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5644edefd150 0x5644edeff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb4827640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5644edefd150 0x5644edeff540 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb4827640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcbac01ac20 0x7fcbac051a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbac01ac20 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5829640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcbac01ac20 0x7fcbac051a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5829640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcbac01ac20 0x7fcbac051a30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb001f070 con 0x7fcbac01ac20 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5829640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcbb0031040 0x7fcbb0032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.707+0000 7fcbb5028640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcbb0031040 0x7fcbb0032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcbb0031040 0x7fcbb0032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbac01ac20 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb001f070 con 0x7fcbac01ac20 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.711+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbac01ac20 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcbb001f070 con 0x7fcbac01ac20 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.715+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbac01ac20 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb001f070 con 0x7fcbac01ac20 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbac01ac20 2024-05-08T18:09:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb001f070 con 0x7fcbac01ac20 2024-05-08T18:09:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.719+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edefd150 2024-05-08T18:09:12.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbb0031040 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x5644edef6f20 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffa80 con 0x7fcbac01ac20 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcbb001f070 con 0x7fcbac01ac20 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edefbcf0 con 0x5644edef6f20 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edefc590 con 0x5644edef6f20 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edefc590 con 0x5644edef6f20 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:12.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 zone default found 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 4 Realm: () 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 zonegroup default 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edeffeb0 con 0x7fcbb0031040 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf01890 con 0x5644edefd150 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf01d20 con 0x5644edefd150 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 started sync module instance, tier type = 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.723+0000 7fcbb7514980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf00d30 con 0x7fcbac01ac20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94854049698080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf00990 con 0x7fcbac01ac20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf02c50 con 0x5644edef6f20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94854049698080] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94854049702272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf02c50 con 0x5644edef6f20 2024-05-08T18:09:12.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.727+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf03610 con 0x5644edefd150 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94854049706336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf03e60 con 0x5644edefd150 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf04820 con 0x7fcbac01ac20 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94854049702272] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94854049710960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf04790 con 0x7fcbac01ac20 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf056e0 con 0x5644edef6f20 2024-05-08T18:09:12.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.731+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94854049706336] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94854049710960] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94854049713168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf05230 con 0x5644edef6f20 2024-05-08T18:09:12.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf05a80 con 0x7fcbb0031040 2024-05-08T18:09:12.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94854049713168] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94854049714736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf05e70 con 0x7fcbb0031040 2024-05-08T18:09:12.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.735+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf066c0 con 0x7fcbb0031040 2024-05-08T18:09:12.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.739+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.739+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94854049717872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf067c0 con 0x7fcbb0031040 2024-05-08T18:09:12.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.739+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf072e0 con 0x7fcbb0031040 2024-05-08T18:09:12.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.739+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94854049714736] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.739+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94854049717872] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94854049718928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf05650 con 0x7fcbb0031040 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=0 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=1 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=2 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=3 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=4 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=5 2024-05-08T18:09:12.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=6 2024-05-08T18:09:12.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94854049718928] v30'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 20 add_watcher() i=7 2024-05-08T18:09:12.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:12.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf0a2d0 con 0x5644edef6f20 2024-05-08T18:09:12.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.743+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94854049721776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf07750 con 0x5644edef6f20 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94854049721776] v30'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fca6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 5 note: GC not initialized 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fca6a7e4640 20 reqs_thread_entry: start 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 Filter name: none 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fc9dbfff640 20 reqs_thread_entry: start 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2dc10 con 0x7fcbb0031040 2024-05-08T18:09:12.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:09:12.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2fcf0 con 0x7fcbac01ac20 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf31750 con 0x5644edef6f20 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(64 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T18:09:12.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.747+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf35d60 con 0x7fcbac01ac20 2024-05-08T18:09:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf3bc80 con 0x5644edef6f20 2024-05-08T18:09:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(66 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'4 uv4 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:12.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94854049894400 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf36190 con 0x7fcbac01ac20 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== watch-notify(notify (1) cookie 94854049698080 notify 128849018899 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7fcbb00437a0 con 0x7fcbac01ac20 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fca98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94854049698080 notifier 4499 bl.length()=752 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(67 notify.0 [notify cookie 94854049894400 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fca98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fca98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fca98ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fca98ff9640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fca78003eb0 con 0x7fcbac01ac20 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== watch-notify(notify_complete (2) cookie 94854049894400 notify 128849018899 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcbb0024680 con 0x7fcbac01ac20 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_sources= new_sources= 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential sources added=[] removed=[] 2024-05-08T18:09:12.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_dests= new_dests= 2024-05-08T18:09:12.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential dests added=[] removed=[] 2024-05-08T18:09:12.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.751+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf3a480 con 0x7fcbb0031040 2024-05-08T18:09:12.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.755+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.755+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf3b490 con 0x7fcbac01ac20 2024-05-08T18:09:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb7514980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:09:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb7514980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb7514980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:12.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94854049894400 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5644edf3a930 con 0x7fcbb0031040 2024-05-08T18:09:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== watch-notify(notify (1) cookie 94854049717872 notify 128849018883 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5644edf30c70 con 0x7fcbb0031040 2024-05-08T18:09:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fca98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94854049717872 notifier 4499 bl.length()=314 2024-05-08T18:09:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(71 notify.6 [notify cookie 94854049894400 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fca98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:09:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fca98ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:12.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fca98ff9640 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fca78003eb0 con 0x7fcbb0031040 2024-05-08T18:09:12.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== watch-notify(notify_complete (2) cookie 94854049894400 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5644edec2a00 con 0x7fcbb0031040 2024-05-08T18:09:12.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.759+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fca6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94854049721776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x5644edef6f20 2024-05-08T18:09:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94854049721776] v30'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94854049698080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x7fcbac01ac20 2024-05-08T18:09:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94854049698080] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb7514980 20 remove_watcher() i=0 2024-05-08T18:09:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb7514980 2 removed watcher, disabling cache 2024-05-08T18:09:12.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.763+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94854049702272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x5644edef6f20 2024-05-08T18:09:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94854049702272] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb7514980 20 remove_watcher() i=1 2024-05-08T18:09:12.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94854049706336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x5644edefd150 2024-05-08T18:09:12.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb4827640 1 -- 172.21.15.114:0/74340686 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94854049706336] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbac046040 con 0x5644edefd150 2024-05-08T18:09:12.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb7514980 20 remove_watcher() i=2 2024-05-08T18:09:12.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94854049710960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x7fcbac01ac20 2024-05-08T18:09:12.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb5829640 1 -- 172.21.15.114:0/74340686 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94854049710960] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcbb0040040 con 0x7fcbac01ac20 2024-05-08T18:09:12.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.767+0000 7fcbb7514980 20 remove_watcher() i=3 2024-05-08T18:09:12.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.771+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94854049713168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x5644edef6f20 2024-05-08T18:09:12.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.771+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94854049713168] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x5644edef6f20 2024-05-08T18:09:12.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.771+0000 7fcbb7514980 20 remove_watcher() i=4 2024-05-08T18:09:12.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.771+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94854049714736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x7fcbb0031040 2024-05-08T18:09:12.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.775+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94854049714736] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.775+0000 7fcbb7514980 20 remove_watcher() i=5 2024-05-08T18:09:12.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.775+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94854049717872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x7fcbb0031040 2024-05-08T18:09:12.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.775+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94854049717872] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.775+0000 7fcbb7514980 20 remove_watcher() i=6 2024-05-08T18:09:12.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.775+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94854049718928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5644edf2b940 con 0x7fcbb0031040 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94854049718928] v30'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba80b3cd0 con 0x7fcbb0031040 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 20 remove_watcher() i=7 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcbb0031040 msgr2=0x7fcbb0032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcbb0031040 0x7fcbb0032940 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644edef6f20 msgr2=0x5644edef93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644edef6f20 0x5644edef93c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcbac01ac20 msgr2=0x7fcbac051a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcbac01ac20 0x7fcbac051a30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5644edefd150 msgr2=0x5644edeff540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5644edefd150 0x5644edeff540 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca800383a0 msgr2=0x7fca8003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca800383a0 0x7fca8003a860 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5644edec3b40 tx=0x7fcbb001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 msgr2=0x5644edeeba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edeeba20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00fcf0 tx=0x7fcbac04e9e0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb5028640 1 -- 172.21.15.114:0/74340686 reap_dead start 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 shutdown_connections 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/74340686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edee4500 0x5644edeeba20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 >> 172.21.15.114:0/74340686 conn(0x5644edee0840 msgr2=0x5644ededdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 shutdown_connections 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/74340686 wait complete. 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca8c0383f0 msgr2=0x7fca8c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca8c0383f0 0x7fca8c03a8b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x5644edec7310 tx=0x7fcbb0005850 comp rx=0 tx=0).stop 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 msgr2=0x5644eded7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 0x5644eded7710 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcbac010fd0 tx=0x7fcbac00f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 shutdown_connections 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca8c0383f0 0x7fca8c03a8b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/224515317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644eded72f0 0x5644eded7710 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 >> 172.21.15.114:0/224515317 conn(0x5644edecc100 msgr2=0x5644edeccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 shutdown_connections 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/224515317 wait complete. 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644eddce050 msgr2=0x5644edec64e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644eddce050 0x5644edec64e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca9c038440 msgr2=0x7fca9c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca9c038440 0x7fca9c03a900 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbac001ec0 tx=0x7fcbac001440 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 msgr2=0x5644edebf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644edebf5f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fcba801b380 tx=0x7fcba80180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 shutdown_connections 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5644eddce050 0x5644edec64e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fca9c038440 0x7fca9c03a900 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 --2- 172.21.15.114:0/2260231075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5644edd3f7c0 0x5644edebf5f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 >> 172.21.15.114:0/2260231075 conn(0x5644eddc5630 msgr2=0x5644eddc9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 shutdown_connections 2024-05-08T18:09:12.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.779+0000 7fcbb7514980 1 -- 172.21.15.114:0/2260231075 wait complete. 2024-05-08T18:09:12.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:09:12.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:09:12.792 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:09:12.869 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:12.869 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:12.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2dac49f980 1 Processor -- start 2024-05-08T18:09:12.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2dac49f980 1 -- start start 2024-05-08T18:09:12.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2dac49f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7795d4d70 0x55b7795d5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2dac49f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b779481710 con 0x55b7795d5690 2024-05-08T18:09:12.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2dac49f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b779495f00 con 0x55b7795d4d70 2024-05-08T18:09:12.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2da9fb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7795d4d70 0x55b7795d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2da9fb3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7795d4d70 0x55b7795d5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58598/0 (socket says 172.21.15.114:58598) 2024-05-08T18:09:12.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2da9fb3640 1 -- 172.21.15.114:0/1019879546 learned_addr learned my addr 172.21.15.114:0/1019879546 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2da97b2640 1 --1- 172.21.15.114:0/1019879546 >> v1:172.21.15.53:6789/0 conn(0x55b7795d5690 0x55b7795d60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34714/0 (socket says 172.21.15.114:34714) 2024-05-08T18:09:12.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2da9fb3640 1 -- 172.21.15.114:0/1019879546 >> v1:172.21.15.53:6789/0 conn(0x55b7795d5690 legacy=0x55b7795d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.871+0000 7f2da9fb3640 1 -- 172.21.15.114:0/1019879546 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b77945dae0 con 0x55b7795d4d70 2024-05-08T18:09:12.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/1019879546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7795d5150 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2da400a5c0 tx=0x7f2da401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5964f0cafe66ddf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2da8fb1640 1 -- 172.21.15.114:0/1019879546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2da40a6070 con 0x55b7795d4d70 2024-05-08T18:09:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2da8fb1640 1 -- 172.21.15.114:0/1019879546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da40af070 con 0x55b7795d4d70 2024-05-08T18:09:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2da8fb1640 1 -- 172.21.15.114:0/1019879546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2da40aa5c0 con 0x55b7795d4d70 2024-05-08T18:09:12.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 -- 172.21.15.114:0/1019879546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 msgr2=0x55b7795d5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1019879546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7795d5150 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2da400a5c0 tx=0x7f2da401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 -- 172.21.15.114:0/1019879546 shutdown_connections 2024-05-08T18:09:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1019879546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7795d5150 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 -- 172.21.15.114:0/1019879546 >> 172.21.15.114:0/1019879546 conn(0x55b7795d0640 msgr2=0x55b7795d2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 -- 172.21.15.114:0/1019879546 shutdown_connections 2024-05-08T18:09:12.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.875+0000 7f2dac49f980 1 -- 172.21.15.114:0/1019879546 wait complete. 2024-05-08T18:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2dac49f980 1 Processor -- start 2024-05-08T18:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2dac49f980 1 -- start start 2024-05-08T18:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2dac49f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2dac49f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7794d9f80 con 0x55b7795d4d70 2024-05-08T18:09:12.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2da9fb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2da9fb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58600/0 (socket says 172.21.15.114:58600) 2024-05-08T18:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2da9fb3640 1 -- 172.21.15.114:0/2957041395 learned_addr learned my addr 172.21.15.114:0/2957041395 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2da9fb3640 1 -- 172.21.15.114:0/2957041395 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7794a1da0 con 0x55b7795d4d70 2024-05-08T18:09:12.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/2957041395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c0570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2da400a5c0 tx=0x7f2da4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304b905aa0b6be7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2c97e07640 1 -- 172.21.15.114:0/2957041395 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2da40aa9b0 con 0x55b7795d4d70 2024-05-08T18:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2c97e07640 1 -- 172.21.15.114:0/2957041395 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da40aab50 con 0x55b7795d4d70 2024-05-08T18:09:12.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.891+0000 7f2c97e07640 1 -- 172.21.15.114:0/2957041395 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2da40aae50 con 0x55b7795d4d70 2024-05-08T18:09:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/2957041395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 msgr2=0x55b7796c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 --2- 172.21.15.114:0/2957041395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c0570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2da400a5c0 tx=0x7f2da4003030 comp rx=0 tx=0).stop 2024-05-08T18:09:12.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/2957041395 shutdown_connections 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 --2- 172.21.15.114:0/2957041395 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c0570 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/2957041395 >> 172.21.15.114:0/2957041395 conn(0x55b7795d0640 msgr2=0x55b7796bc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/2957041395 shutdown_connections 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/2957041395 wait complete. 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 Processor -- start 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- start start 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7795dee10 con 0x55b7795d4d70 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2da9fb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2da9fb3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58616/0 (socket says 172.21.15.114:58616) 2024-05-08T18:09:12.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2da9fb3640 1 -- 172.21.15.114:0/1029489891 learned_addr learned my addr 172.21.15.114:0/1029489891 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2da9fb3640 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7796c7e30 con 0x55b7795d4d70 2024-05-08T18:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c78f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2da400a5c0 tx=0x7f2da40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2c96604640 1 -- 172.21.15.114:0/1029489891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2da40c4710 con 0x55b7795d4d70 2024-05-08T18:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7796c80c0 con 0x55b7795d4d70 2024-05-08T18:09:12.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2c96604640 1 -- 172.21.15.114:0/1029489891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2da40c8070 con 0x55b7795d4d70 2024-05-08T18:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2c96604640 1 -- 172.21.15.114:0/1029489891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2da40c49e0 con 0x55b7795d4d70 2024-05-08T18:09:12.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.895+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b779549340 con 0x55b7795d4d70 2024-05-08T18:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2c96604640 1 -- 172.21.15.114:0/1029489891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2da40c4b80 con 0x55b7795d4d70 2024-05-08T18:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2c96604640 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c900383f0 0x7f2c9003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2c96604640 1 -- 172.21.15.114:0/1029489891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2da40ebf40 con 0x55b7795d4d70 2024-05-08T18:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2da97b2640 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c900383f0 0x7f2c9003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7795d5690 0x55b7796cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77954a010 con 0x55b7795d5690 2024-05-08T18:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7795d5690 0x55b7796cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2da97b2640 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c900383f0 0x7f2c9003a8b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d94001e40 tx=0x7f2d940013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7795d5690 0x55b7796cdca0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 -- 172.21.15.114:0/1029489891 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d9c00a4d0 con 0x55b7795d5690 2024-05-08T18:09:12.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7796ce290 con 0x55b7795d5690 2024-05-08T18:09:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 -- 172.21.15.114:0/1029489891 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d9c00a4d0 con 0x55b7795d5690 2024-05-08T18:09:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7796cfb90 con 0x55b7795d5690 2024-05-08T18:09:12.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 -- 172.21.15.114:0/1029489891 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d9c00a4d0 con 0x55b7795d5690 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7796cedc0 con 0x55b7795d5690 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 -- 172.21.15.114:0/1029489891 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d9c00a4d0 con 0x55b7795d5690 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7796cf210 con 0x55b7795d5690 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2daa7b4640 1 -- 172.21.15.114:0/1029489891 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d9c00a4d0 con 0x55b7795d5690 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 Processor -- start 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- start start 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 0x55b7796de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.899+0000 7f2dac49f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7794ddfc0 con 0x55b7796de4b0 2024-05-08T18:09:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2da97b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 0x55b7796de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2da97b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 0x55b7796de8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58630/0 (socket says 172.21.15.114:58630) 2024-05-08T18:09:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2da97b2640 1 -- 172.21.15.114:0/1017748546 learned_addr learned my addr 172.21.15.114:0/1017748546 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2da97b2640 1 -- 172.21.15.114:0/1017748546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7796dee10 con 0x55b7796de4b0 2024-05-08T18:09:12.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2da97b2640 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 0x55b7796de8d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400e670 tx=0x7f2d9400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2c8f7fe640 1 -- 172.21.15.114:0/1017748546 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94022070 con 0x55b7796de4b0 2024-05-08T18:09:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2c8f7fe640 1 -- 172.21.15.114:0/1017748546 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9400d660 con 0x55b7796de4b0 2024-05-08T18:09:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7796df8b0 con 0x55b7796de4b0 2024-05-08T18:09:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2c8f7fe640 1 -- 172.21.15.114:0/1017748546 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94006070 con 0x55b7796de4b0 2024-05-08T18:09:12.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7796dfd80 con 0x55b7796de4b0 2024-05-08T18:09:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2c8f7fe640 1 -- 172.21.15.114:0/1017748546 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2d94025070 con 0x55b7796de4b0 2024-05-08T18:09:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2c8f7fe640 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c84038440 0x7f2c8403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2c8f7fe640 1 -- 172.21.15.114:0/1017748546 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2d9404ffc0 con 0x55b7796de4b0 2024-05-08T18:09:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c84038440 0x7f2c8403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2dac49f980 1 Processor -- start 2024-05-08T18:09:12.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2dac49f980 1 -- start start 2024-05-08T18:09:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c84038440 0x7f2c8403a900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55b7796ce8e0 tx=0x7f2d9c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2dac49f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796efe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.903+0000 7f2dac49f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7796c0c00 con 0x55b7796efa00 2024-05-08T18:09:12.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58646/0 (socket says 172.21.15.114:58646) 2024-05-08T18:09:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 -- 172.21.15.114:0/3130608911 learned_addr learned my addr 172.21.15.114:0/3130608911 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 -- 172.21.15.114:0/3130608911 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7796f0360 con 0x55b7796efa00 2024-05-08T18:09:12.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 --2- 172.21.15.114:0/3130608911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796efe20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400ef50 tx=0x7f2d94026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeccf477688f238 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2c8d7fa640 1 -- 172.21.15.114:0/3130608911 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d940242c0 con 0x55b7796efa00 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2c8d7fa640 1 -- 172.21.15.114:0/3130608911 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d94024460 con 0x55b7796efa00 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2c8d7fa640 1 -- 172.21.15.114:0/3130608911 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94024740 con 0x55b7796efa00 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- 172.21.15.114:0/3130608911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 msgr2=0x55b7796efe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 --2- 172.21.15.114:0/3130608911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796efe20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400ef50 tx=0x7f2d94026780 comp rx=0 tx=0).stop 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- 172.21.15.114:0/3130608911 shutdown_connections 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 --2- 172.21.15.114:0/3130608911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796efe20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- 172.21.15.114:0/3130608911 >> 172.21.15.114:0/3130608911 conn(0x55b7796e78f0 msgr2=0x55b7796e5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- 172.21.15.114:0/3130608911 shutdown_connections 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- 172.21.15.114:0/3130608911 wait complete. 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 Processor -- start 2024-05-08T18:09:12.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- start start 2024-05-08T18:09:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796f6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2dac49f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7796f0ba0 con 0x55b7796efa00 2024-05-08T18:09:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796f6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796f6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58660/0 (socket says 172.21.15.114:58660) 2024-05-08T18:09:12.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 learned_addr learned my addr 172.21.15.114:0/706876825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7796f74f0 con 0x55b7796efa00 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.907+0000 7f2da97b2640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796f6fb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2d9401b6c0 tx=0x7f2d9404e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2c7b7fe640 1 -- 172.21.15.114:0/706876825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d940242c0 con 0x55b7796efa00 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7796f7780 con 0x55b7796efa00 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2c7b7fe640 1 -- 172.21.15.114:0/706876825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d9401a7e0 con 0x55b7796efa00 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2c7b7fe640 1 -- 172.21.15.114:0/706876825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d94024d90 con 0x55b7796efa00 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7796f7780 con 0x55b7796efa00 2024-05-08T18:09:12.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2c7b7fe640 1 -- 172.21.15.114:0/706876825 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2d9403e9f0 con 0x55b7796efa00 2024-05-08T18:09:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2c7b7fe640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c740383f0 0x7f2c7403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2c7b7fe640 1 -- 172.21.15.114:0/706876825 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2d94045030 con 0x55b7796efa00 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c740383f0 0x7f2c7403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b779702260 0x55b779704720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779704e70 con 0x55b779702260 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b779702260 0x55b779704720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c740383f0 0x7f2c7403a8b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55b7795497a0 tx=0x7f2d9c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b779702260 0x55b779704720 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2da40bdf50 con 0x55b779702260 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 realm 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779705280 con 0x55b779702260 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779705b50 con 0x55b779702260 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779705ef0 con 0x55b779702260 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.911+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779706740 con 0x55b779702260 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2dac49f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:12.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2dac49f980 20 searching for the correct realm 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7797081b0 0x55b77970a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x55b7797081b0 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da97b2640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7797081b0 0x55b77970a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da97b2640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7797081b0 0x55b77970a670 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da97b2640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d94027060 0x7f2d9404e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x7f2d94027060 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d94027060 0x7f2d9404e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d94027060 0x7f2d9404e8a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d9c01f070 con 0x7f2d94027060 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2daa7b4640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d9c031040 0x7f2d9c032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:12.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x7f2d9c031040 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d9c031040 0x7f2d9c032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d9c031040 0x7f2d9c032940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x7f2d9c031040 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x55b779702260 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.915+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x55b779702260 2024-05-08T18:09:12.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x7f2d9c031040 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x7f2d9c031040 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x7f2d9c031040 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x7f2d9c031040 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x7f2d94027060 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d9c01f070 con 0x7f2d94027060 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x55b7797081b0 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ad40 con 0x55b779702260 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d9c031040 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x7f2d9c031040 2024-05-08T18:09:12.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b779702260 2024-05-08T18:09:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d94027060 2024-05-08T18:09:12.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d9c01f070 con 0x7f2d94027060 2024-05-08T18:09:12.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.919+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d9c031040 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x7f2d9c031040 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b779702260 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b779702260 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d9c031040 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40d8cc0 con 0x7f2d9c031040 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d94027060 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d9c01f070 con 0x7f2d94027060 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b779702260 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2da40d8cc0 con 0x55b779702260 2024-05-08T18:09:12.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.923+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d9c031040 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d9c031040 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d94027060 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d9c01f070 con 0x7f2d94027060 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b7797081b0 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d9c031040 2024-05-08T18:09:12.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x55b779702260 2024-05-08T18:09:12.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f2da40ef040 con 0x7f2d94027060 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d9c01f070 con 0x7f2d94027060 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.927+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779706f90 con 0x55b779702260 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779707380 con 0x55b779702260 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b779707380 con 0x55b779702260 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 zone default found 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 4 Realm: () 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:12.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 zonegroup default 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77970b1c0 con 0x7f2d9c031040 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77970cbd0 con 0x55b7797081b0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77970d070 con 0x55b7797081b0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 started sync module instance, tier type = 2024-05-08T18:09:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:12.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c040 con 0x7f2d94027060 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94246504809568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970bca0 con 0x7f2d94027060 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.931+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970dfa0 con 0x55b779702260 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.935+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94246504809568] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.935+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.935+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94246504813776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970dfa0 con 0x55b779702260 2024-05-08T18:09:12.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.935+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970e9b0 con 0x55b7797081b0 2024-05-08T18:09:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94246504813776] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94246504815344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970df10 con 0x55b7797081b0 2024-05-08T18:09:12.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970f6f0 con 0x7f2d94027060 2024-05-08T18:09:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94246504821248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970ff90 con 0x7f2d94027060 2024-05-08T18:09:12.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7797109b0 con 0x55b779702260 2024-05-08T18:09:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94246504815344] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94246504821248] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94246504826016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970fae0 con 0x55b779702260 2024-05-08T18:09:12.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.939+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779711250 con 0x7f2d9c031040 2024-05-08T18:09:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.943+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94246504826016] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.943+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.943+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94246504820048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970fae0 con 0x7f2d9c031040 2024-05-08T18:09:12.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.943+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779711680 con 0x7f2d9c031040 2024-05-08T18:09:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.943+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94246504820048] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94246504827824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779711680 con 0x7f2d9c031040 2024-05-08T18:09:12.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779712080 con 0x7f2d9c031040 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94246504831888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7797124a0 con 0x7f2d9c031040 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=0 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=1 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=2 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=3 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=4 2024-05-08T18:09:12.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=5 2024-05-08T18:09:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94246504827824] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.947+0000 7f2dac49f980 20 add_watcher() i=6 2024-05-08T18:09:12.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94246504831888] v30'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 20 add_watcher() i=7 2024-05-08T18:09:12.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:12.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b7797111d0 con 0x55b779702260 2024-05-08T18:09:12.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94246504829392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779712a10 con 0x55b779702260 2024-05-08T18:09:12.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94246504829392] v30'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2c5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:12.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:12.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:12.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.951+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971df20 con 0x55b779702260 2024-05-08T18:09:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.955+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.955+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971e570 con 0x7f2d9c031040 2024-05-08T18:09:12.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.955+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.955+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971e570 con 0x55b7797081b0 2024-05-08T18:09:12.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.955+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.955+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971e910 con 0x55b779702260 2024-05-08T18:09:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.959+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.959+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971e910 con 0x7f2d94027060 2024-05-08T18:09:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.959+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.959+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971ee80 con 0x55b7797081b0 2024-05-08T18:09:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.959+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.959+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971f280 con 0x55b779702260 2024-05-08T18:09:12.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.963+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.963+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971f280 con 0x7f2d9c031040 2024-05-08T18:09:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.963+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.963+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971f280 con 0x7f2d94027060 2024-05-08T18:09:12.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.967+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.967+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971f870 con 0x55b7797081b0 2024-05-08T18:09:12.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.967+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.967+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971fc10 con 0x7f2d94027060 2024-05-08T18:09:12.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.971+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.971+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7797201e0 con 0x7f2d9c031040 2024-05-08T18:09:12.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.971+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.971+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7797201e0 con 0x7f2d94027060 2024-05-08T18:09:12.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.975+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.975+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d9c031040 2024-05-08T18:09:12.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.975+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.975+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b779702260 2024-05-08T18:09:12.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.975+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.975+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.979+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.979+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d94027060 2024-05-08T18:09:12.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.979+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'35 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.979+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.979+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.983+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b779702260 2024-05-08T18:09:12.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.983+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.983+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b779702260 2024-05-08T18:09:12.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.983+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:12.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.983+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.987+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.987+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d94027060 2024-05-08T18:09:12.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.987+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:12.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.987+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.991+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.991+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.991+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.991+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.991+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.991+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.995+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.995+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d9c031040 2024-05-08T18:09:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.995+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:12.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.995+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:12.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.999+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:12.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.999+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d9c031040 2024-05-08T18:09:13.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.999+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:12.999+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x55b7797081b0 2024-05-08T18:09:13.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.003+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:13.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.003+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d9c031040 2024-05-08T18:09:13.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.003+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.003+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b779720690 con 0x7f2d94027060 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2c5a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 20 Filter name: none 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2bcbfff640 20 reqs_thread_entry: start 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77973bc20 con 0x7f2d9c031040 2024-05-08T18:09:13.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:09:13.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:09:13.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:13.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b77973e270 con 0x7f2d9c031040 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.007+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.009 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:09:13.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2c5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94246504829392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77971ab80 con 0x55b779702260 2024-05-08T18:09:13.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94246504829392] v30'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:13.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94246504809568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7797111d0 con 0x7f2d94027060 2024-05-08T18:09:13.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94246504809568] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:13.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2dac49f980 20 remove_watcher() i=0 2024-05-08T18:09:13.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2dac49f980 2 removed watcher, disabling cache 2024-05-08T18:09:13.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.011+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94246504813776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c460 con 0x55b779702260 2024-05-08T18:09:13.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.015+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94246504813776] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:13.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.015+0000 7f2dac49f980 20 remove_watcher() i=1 2024-05-08T18:09:13.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.015+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94246504815344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c460 con 0x55b7797081b0 2024-05-08T18:09:13.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.015+0000 7f2da97b2640 1 -- 172.21.15.114:0/706876825 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94246504815344] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d94024030 con 0x55b7797081b0 2024-05-08T18:09:13.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.015+0000 7f2dac49f980 20 remove_watcher() i=2 2024-05-08T18:09:13.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.015+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94246504821248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c460 con 0x7f2d94027060 2024-05-08T18:09:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.019+0000 7f2daa7b4640 1 -- 172.21.15.114:0/706876825 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94246504821248] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d9c040040 con 0x7f2d94027060 2024-05-08T18:09:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.019+0000 7f2dac49f980 20 remove_watcher() i=3 2024-05-08T18:09:13.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.019+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94246504826016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c460 con 0x55b779702260 2024-05-08T18:09:13.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.019+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94246504826016] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x55b779702260 2024-05-08T18:09:13.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.019+0000 7f2dac49f980 20 remove_watcher() i=4 2024-05-08T18:09:13.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.019+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94246504820048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b7797104a0 con 0x7f2d9c031040 2024-05-08T18:09:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.023+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94246504820048] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.023+0000 7f2dac49f980 20 remove_watcher() i=5 2024-05-08T18:09:13.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.023+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94246504827824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c460 con 0x7f2d9c031040 2024-05-08T18:09:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94246504827824] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 20 remove_watcher() i=6 2024-05-08T18:09:13.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94246504831888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b77970c460 con 0x7f2d9c031040 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94246504831888] v30'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2da40f6040 con 0x7f2d9c031040 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 20 remove_watcher() i=7 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d9c031040 msgr2=0x7f2d9c032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d9c031040 0x7f2d9c032940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b779702260 msgr2=0x55b779704720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b779702260 0x55b779704720 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d94027060 msgr2=0x7f2d9404e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d94027060 0x7f2d9404e8a0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7797081b0 msgr2=0x55b77970a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7797081b0 0x55b77970a670 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c740383f0 msgr2=0x7f2c7403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c740383f0 0x7f2c7403a8b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55b7795497a0 tx=0x7f2d9c01f000 comp rx=0 tx=0).stop 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2da9fb3640 1 -- 172.21.15.114:0/706876825 reap_dead start 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 msgr2=0x55b7796f6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796f6fb0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2d9401b6c0 tx=0x7f2d9404e2a0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 shutdown_connections 2024-05-08T18:09:13.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 --2- 172.21.15.114:0/706876825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796efa00 0x55b7796f6fb0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 >> 172.21.15.114:0/706876825 conn(0x55b7796e78f0 msgr2=0x55b7796e5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 shutdown_connections 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.027+0000 7f2dac49f980 1 -- 172.21.15.114:0/706876825 wait complete. 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c84038440 msgr2=0x7f2c8403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c84038440 0x7f2c8403a900 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55b7796ce8e0 tx=0x7f2d9c005850 comp rx=0 tx=0).stop 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 msgr2=0x55b7796de8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 0x55b7796de8d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400e670 tx=0x7f2d9400ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 shutdown_connections 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c84038440 0x7f2c8403a900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1017748546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7796de4b0 0x55b7796de8d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 >> 172.21.15.114:0/1017748546 conn(0x55b7796d32c0 msgr2=0x55b7796d3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 shutdown_connections 2024-05-08T18:09:13.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1017748546 wait complete. 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7795d5690 msgr2=0x55b7796cdca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7795d5690 0x55b7796cdca0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c900383f0 msgr2=0x7f2c9003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c900383f0 0x7f2c9003a8b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2d94001e40 tx=0x7f2d940013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 msgr2=0x55b7796c78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c78f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2da400a5c0 tx=0x7f2da40180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 shutdown_connections 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7795d5690 0x55b7796cdca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c900383f0 0x7f2c9003a8b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 --2- 172.21.15.114:0/1029489891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7795d4d70 0x55b7796c78f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 >> 172.21.15.114:0/1029489891 conn(0x55b7795d0640 msgr2=0x55b7796bac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 shutdown_connections 2024-05-08T18:09:13.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.031+0000 7f2dac49f980 1 -- 172.21.15.114:0/1029489891 wait complete. 2024-05-08T18:09:13.046 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:09:13.046 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T18:09:13.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T18:09:13.047 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-08T18:09:13.130 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:13.130 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2e3b5980 1 Processor -- start 2024-05-08T18:09:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2e3b5980 1 -- start start 2024-05-08T18:09:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2e3b5980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627b2ab1fa0 0x5627b2b40b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2e3b5980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627b29e9710 con 0x5627b2b41070 2024-05-08T18:09:13.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2e3b5980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5627b29fdf00 con 0x5627b2ab1fa0 2024-05-08T18:09:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2bec9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627b2ab1fa0 0x5627b2b40b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2bec9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627b2ab1fa0 0x5627b2b40b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58676/0 (socket says 172.21.15.114:58676) 2024-05-08T18:09:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2bec9640 1 -- 172.21.15.114:0/1670027981 learned_addr learned my addr 172.21.15.114:0/1670027981 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2bec9640 1 -- 172.21.15.114:0/1670027981 >> v1:172.21.15.53:6789/0 conn(0x5627b2b41070 legacy=0x5627b2b43460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.131+0000 7fdb2bec9640 1 -- 172.21.15.114:0/1670027981 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b29c5ae0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/1670027981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2b40b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a5c0 tx=0x7fdb1c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec49f266247056e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2aec7640 1 -- 172.21.15.114:0/1670027981 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0a6070 con 0x5627b2ab1fa0 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2aec7640 1 -- 172.21.15.114:0/1670027981 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0af070 con 0x5627b2ab1fa0 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2aec7640 1 -- 172.21.15.114:0/1670027981 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0aa5c0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1670027981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 msgr2=0x5627b2b40b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1670027981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2b40b30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a5c0 tx=0x7fdb1c01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1670027981 shutdown_connections 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1670027981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2b40b30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1670027981 >> 172.21.15.114:0/1670027981 conn(0x5627b2b38650 msgr2=0x5627b2b3aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1670027981 shutdown_connections 2024-05-08T18:09:13.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.135+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1670027981 wait complete. 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2e3b5980 1 Processor -- start 2024-05-08T18:09:13.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2e3b5980 1 -- start start 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2e3b5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c28f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2e3b5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627b2a41f80 con 0x5627b2ab1fa0 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2bec9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c28f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2bec9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c28f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58686/0 (socket says 172.21.15.114:58686) 2024-05-08T18:09:13.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2bec9640 1 -- 172.21.15.114:0/3941398374 learned_addr learned my addr 172.21.15.114:0/3941398374 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2bec9640 1 -- 172.21.15.114:0/3941398374 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b2a09da0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/3941398374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c28f60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a5c0 tx=0x7fdb1c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4959b62c202626 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fda19e0b640 1 -- 172.21.15.114:0/3941398374 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0aa9b0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fda19e0b640 1 -- 172.21.15.114:0/3941398374 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0aab50 con 0x5627b2ab1fa0 2024-05-08T18:09:13.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.151+0000 7fda19e0b640 1 -- 172.21.15.114:0/3941398374 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0aae50 con 0x5627b2ab1fa0 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3941398374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 msgr2=0x5627b2c28f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/3941398374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c28f60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a5c0 tx=0x7fdb1c003030 comp rx=0 tx=0).stop 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3941398374 shutdown_connections 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/3941398374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c28f60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3941398374 >> 172.21.15.114:0/3941398374 conn(0x5627b2b38650 msgr2=0x5627b2c24af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3941398374 shutdown_connections 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3941398374 wait complete. 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 Processor -- start 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- start start 2024-05-08T18:09:13.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c30250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627b2b45690 con 0x5627b2ab1fa0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2bec9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c30250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2bec9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c30250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58702/0 (socket says 172.21.15.114:58702) 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2bec9640 1 -- 172.21.15.114:0/1414105154 learned_addr learned my addr 172.21.15.114:0/1414105154 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2bec9640 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b2c30790 con 0x5627b2ab1fa0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c30250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a5c0 tx=0x7fdb1c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fda13fff640 1 -- 172.21.15.114:0/1414105154 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0c6750 con 0x5627b2ab1fa0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fda13fff640 1 -- 172.21.15.114:0/1414105154 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb1c0c68f0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b2c30a20 con 0x5627b2ab1fa0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fda13fff640 1 -- 172.21.15.114:0/1414105154 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb1c0c6bd0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.155+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b2c336b0 con 0x5627b2ab1fa0 2024-05-08T18:09:13.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fda13fff640 1 -- 172.21.15.114:0/1414105154 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fdb1c0ce020 con 0x5627b2ab1fa0 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fda13fff640 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda14038440 0x7fda1403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fda13fff640 1 -- 172.21.15.114:0/1414105154 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fdb1c0cc020 con 0x5627b2ab1fa0 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2b41070 0x5627b2c371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c37840 con 0x5627b2b41070 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda14038440 0x7fda1403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2b41070 0x5627b2c371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda14038440 0x7fda1403a900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb20001ec0 tx=0x7fdb20001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2b41070 0x5627b2c371d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/1414105154 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb2400a4d0 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c348d0 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/1414105154 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb2400a4d0 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c39680 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/1414105154 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdb2400a4d0 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c387f0 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/1414105154 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb2400a4d0 con 0x5627b2b41070 2024-05-08T18:09:13.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c38c40 con 0x5627b2b41070 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/1414105154 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdb2400a4d0 con 0x5627b2b41070 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 Processor -- start 2024-05-08T18:09:13.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.159+0000 7fdb2e3b5980 1 -- start start 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2e3b5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 0x5627b2c483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2e3b5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627b2a45fc0 con 0x5627b2c47fb0 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2b6c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 0x5627b2c483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2b6c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 0x5627b2c483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58712/0 (socket says 172.21.15.114:58712) 2024-05-08T18:09:13.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/416973768 learned_addr learned my addr 172.21.15.114:0/416973768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/416973768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b2c48910 con 0x5627b2c47fb0 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 0x5627b2c483d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdb20010fd0 tx=0x7fdb2000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fda117fa640 1 -- 172.21.15.114:0/416973768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb2000a040 con 0x5627b2c47fb0 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fda117fa640 1 -- 172.21.15.114:0/416973768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb20017050 con 0x5627b2c47fb0 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b2c493b0 con 0x5627b2c47fb0 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fda117fa640 1 -- 172.21.15.114:0/416973768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb2000e6b0 con 0x5627b2c47fb0 2024-05-08T18:09:13.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b2c49880 con 0x5627b2c47fb0 2024-05-08T18:09:13.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fda117fa640 1 -- 172.21.15.114:0/416973768 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fdb2000e8e0 con 0x5627b2c47fb0 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fda117fa640 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda040383f0 0x7fda0403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fda117fa640 1 -- 172.21.15.114:0/416973768 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fdb20050600 con 0x5627b2c47fb0 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.163+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda040383f0 0x7fda0403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 Processor -- start 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- start start 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda040383f0 0x7fda0403a8b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5627b2c38310 tx=0x7fdb24005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2b3e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627b2c295f0 con 0x5627b2b3e0c0 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2b3e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2b3e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58714/0 (socket says 172.21.15.114:58714) 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/3207584340 learned_addr learned my addr 172.21.15.114:0/3207584340 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/3207584340 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b2b3c910 con 0x5627b2b3e0c0 2024-05-08T18:09:13.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/3207584340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2b3e4e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdb2004ea70 tx=0x7fdb20024420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=799afd10764e5d40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fda0affd640 1 -- 172.21.15.114:0/3207584340 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20044070 con 0x5627b2b3e0c0 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fda0affd640 1 -- 172.21.15.114:0/3207584340 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2001a310 con 0x5627b2b3e0c0 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fda0affd640 1 -- 172.21.15.114:0/3207584340 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb200500d0 con 0x5627b2b3e0c0 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3207584340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 msgr2=0x5627b2b3e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/3207584340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2b3e4e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdb2004ea70 tx=0x7fdb20024420 comp rx=0 tx=0).stop 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3207584340 shutdown_connections 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/3207584340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2b3e4e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3207584340 >> 172.21.15.114:0/3207584340 conn(0x5627b2c51520 msgr2=0x5627b2c4f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3207584340 shutdown_connections 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/3207584340 wait complete. 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 Processor -- start 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- start start 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2c5e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2e3b5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627b2b3cdb0 con 0x5627b2b3e0c0 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2c5e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2c5e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58718/0 (socket says 172.21.15.114:58718) 2024-05-08T18:09:13.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.167+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 learned_addr learned my addr 172.21.15.114:0/2425786358 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b2c5ee80 con 0x5627b2b3e0c0 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2c5e940 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb2001cfd0 tx=0x7fdb2004e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fda097fa640 1 -- 172.21.15.114:0/2425786358 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb20044040 con 0x5627b2b3e0c0 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627b2c5f110 con 0x5627b2b3e0c0 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fda097fa640 1 -- 172.21.15.114:0/2425786358 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb2001a990 con 0x5627b2b3e0c0 2024-05-08T18:09:13.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b2c61df0 con 0x5627b2b3e0c0 2024-05-08T18:09:13.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fda097fa640 1 -- 172.21.15.114:0/2425786358 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb2004d2d0 con 0x5627b2b3e0c0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fda097fa640 1 -- 172.21.15.114:0/2425786358 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fdb20035020 con 0x5627b2b3e0c0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fda097fa640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd9f40383f0 0x7fd9f403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fda097fa640 1 -- 172.21.15.114:0/2425786358 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fdb20033020 con 0x5627b2b3e0c0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd9f40383f0 0x7fd9f403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2c69e00 0x5627b2c6c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6c9e0 con 0x5627b2c69e00 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2c69e00 0x5627b2c6c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2c69e00 0x5627b2c6c290 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd9f40383f0 0x7fd9f403a8b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5627b2c34820 tx=0x7fdb2401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 realm 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6cdf0 con 0x5627b2c69e00 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6d6c0 con 0x5627b2c69e00 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.171+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6da60 con 0x5627b2c69e00 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 20 searching for the correct realm 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627b2c70020 0x5627b2c72410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c72950 con 0x5627b2c70020 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627b2c70020 0x5627b2c72410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627b2c70020 0x5627b2c72410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2b6c8640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fdb2003dc20 0x7fdb20037410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c72950 con 0x7fdb2003dc20 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fdb2003dc20 0x7fdb20037410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fdb2003dc20 0x7fdb20037410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2401f070 con 0x7fdb2003dc20 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2c6ca640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fdb24031040 0x7fdb24032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c72950 con 0x7fdb24031040 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fdb24031040 0x7fdb24032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2bec9640 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fdb24031040 0x7fdb24032430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.175+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb2003dc20 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2401f070 con 0x7fdb2003dc20 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb2003dc20 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdb2401f070 con 0x7fdb2003dc20 2024-05-08T18:09:13.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.179+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb2003dc20 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2401f070 con 0x7fdb2003dc20 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.183+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb2003dc20 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2401f070 con 0x7fdb2003dc20 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c70020 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb24031040 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x5627b2c69e00 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6e2b0 con 0x7fdb2003dc20 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdb2401f070 con 0x7fdb2003dc20 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.187+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6eb00 con 0x5627b2c69e00 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6eef0 con 0x5627b2c69e00 2024-05-08T18:09:13.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c6eef0 con 0x5627b2c69e00 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 zone default found 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 4 Realm: () 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 zonegroup default 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c72d80 con 0x7fdb24031040 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c74760 con 0x5627b2c70020 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c74b00 con 0x5627b2c70020 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 started sync module instance, tier type = 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:13.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c73c00 con 0x7fdb2003dc20 2024-05-08T18:09:13.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728503113552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c74ea0 con 0x7fdb2003dc20 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.191+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c75730 con 0x5627b2c69e00 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.195+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728503113552] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.195+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.195+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728503115760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c75350 con 0x5627b2c69e00 2024-05-08T18:09:13.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.195+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c76140 con 0x5627b2c70020 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728503123088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c769e0 con 0x5627b2c70020 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c773a0 con 0x7fdb2003dc20 2024-05-08T18:09:13.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728503115760] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728503127792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c77310 con 0x7fdb2003dc20 2024-05-08T18:09:13.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c78130 con 0x5627b2c69e00 2024-05-08T18:09:13.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728503123088] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728503127792] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728503125296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c77c40 con 0x5627b2c69e00 2024-05-08T18:09:13.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.199+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c789d0 con 0x7fdb24031040 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.203+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728503125296] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.203+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.203+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728503130000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c786e0 con 0x7fdb24031040 2024-05-08T18:09:13.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.203+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c78f30 con 0x7fdb24031040 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728503130000] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728503132992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c78d70 con 0x7fdb24031040 2024-05-08T18:09:13.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c79870 con 0x7fdb24031040 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728503137120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c79830 con 0x7fdb24031040 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=0 2024-05-08T18:09:13.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=1 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=2 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=3 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=4 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=5 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728503132992] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.207+0000 7fdb2e3b5980 20 add_watcher() i=6 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728503137120] v30'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 20 add_watcher() i=7 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:13.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c78800 con 0x5627b2c69e00 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728503134144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c7a200 con 0x5627b2c69e00 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728503134144] v30'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fd9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:13.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 5 note: GC not initialized 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fd9e0fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 20 Filter name: none 2024-05-08T18:09:13.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fd95a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.211+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2ca0760 con 0x7fdb24031040 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2ca2840 con 0x7fdb2003dc20 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2ca41a0 con 0x5627b2c69e00 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(64 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T18:09:13.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.215+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2ca54d0 con 0x7fdb24031040 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2ca58d0 con 0x7fdb2003dc20 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T18:09:13.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.219+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2cab4c0 con 0x7fdb2003dc20 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2e3b5980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2e3b5980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2e3b5980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:13.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94728503324624 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5627b2ca89f0 con 0x7fdb24031040 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== watch-notify(notify (1) cookie 94728503132992 notify 128849018884 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5627b2ca36c0 con 0x7fdb24031040 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fda0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94728503132992 notifier 4513 bl.length()=338 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fda0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fda0affd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fda0affd640 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fd9f0003eb0 con 0x7fdb24031040 2024-05-08T18:09:13.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(68 notify.6 [notify cookie 94728503324624 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== watch-notify(notify_complete (2) cookie 94728503324624 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdb1c0ee040 con 0x7fdb24031040 2024-05-08T18:09:13.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fd9e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.223+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728503134144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c9e490 con 0x5627b2c69e00 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94728503134144] v30'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728503113552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c9e490 con 0x7fdb2003dc20 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94728503113552] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2e3b5980 20 remove_watcher() i=0 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2e3b5980 2 removed watcher, disabling cache 2024-05-08T18:09:13.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728503115760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c9e490 con 0x5627b2c69e00 2024-05-08T18:09:13.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94728503115760] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2e3b5980 20 remove_watcher() i=1 2024-05-08T18:09:13.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.227+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728503123088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c9e490 con 0x5627b2c70020 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.231+0000 7fdb2b6c8640 1 -- 172.21.15.114:0/2425786358 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94728503123088] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb20047040 con 0x5627b2c70020 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.231+0000 7fdb2e3b5980 20 remove_watcher() i=2 2024-05-08T18:09:13.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.231+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728503127792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c73750 con 0x7fdb2003dc20 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.231+0000 7fdb2c6ca640 1 -- 172.21.15.114:0/2425786358 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94728503127792] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb24040040 con 0x7fdb2003dc20 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.231+0000 7fdb2e3b5980 20 remove_watcher() i=3 2024-05-08T18:09:13.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.231+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728503125296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c75c90 con 0x5627b2c69e00 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.235+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94728503125296] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x5627b2c69e00 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.235+0000 7fdb2e3b5980 20 remove_watcher() i=4 2024-05-08T18:09:13.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.235+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728503130000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c76ef0 con 0x7fdb24031040 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.235+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94728503130000] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.235+0000 7fdb2e3b5980 20 remove_watcher() i=5 2024-05-08T18:09:13.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.235+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728503132992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c73750 con 0x7fdb24031040 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.239+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94728503132992] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.239+0000 7fdb2e3b5980 20 remove_watcher() i=6 2024-05-08T18:09:13.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.239+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728503137120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5627b2c75c90 con 0x7fdb24031040 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.239+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94728503137120] v30'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdb1c0d0c60 con 0x7fdb24031040 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.239+0000 7fdb2e3b5980 20 remove_watcher() i=7 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fdb24031040 msgr2=0x7fdb24032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fdb24031040 0x7fdb24032430 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2c69e00 msgr2=0x5627b2c6c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2c69e00 0x5627b2c6c290 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fdb2003dc20 msgr2=0x7fdb20037410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fdb2003dc20 0x7fdb20037410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627b2c70020 msgr2=0x5627b2c72410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627b2c70020 0x5627b2c72410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd9f40383f0 msgr2=0x7fd9f403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd9f40383f0 0x7fd9f403a8b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x5627b2c34820 tx=0x7fdb2401f000 comp rx=0 tx=0).stop 2024-05-08T18:09:13.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 msgr2=0x5627b2c5e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/2425786358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2b3e0c0 0x5627b2c5e940 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdb2001cfd0 tx=0x7fdb2004e9a0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 reap_dead start 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2bec9640 1 -- 172.21.15.114:0/2425786358 reap_dead start 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 shutdown_connections 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 >> 172.21.15.114:0/2425786358 conn(0x5627b2c51520 msgr2=0x5627b2c4eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 shutdown_connections 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/2425786358 wait complete. 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda040383f0 msgr2=0x7fda0403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda040383f0 0x7fda0403a8b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5627b2c38310 tx=0x7fdb24005850 comp rx=0 tx=0).stop 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 msgr2=0x5627b2c483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 0x5627b2c483d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdb20010fd0 tx=0x7fdb2000f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 shutdown_connections 2024-05-08T18:09:13.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda040383f0 0x7fda0403a8b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/416973768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2c47fb0 0x5627b2c483d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 >> 172.21.15.114:0/416973768 conn(0x5627b2c3cdc0 msgr2=0x5627b2c3d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 shutdown_connections 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/416973768 wait complete. 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2b41070 msgr2=0x5627b2c371d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2b41070 0x5627b2c371d0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda14038440 msgr2=0x7fda1403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda14038440 0x7fda1403a900 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fdb20001ec0 tx=0x7fdb20001440 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 msgr2=0x5627b2c30250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c30250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdb1c00a5c0 tx=0x7fdb1c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 shutdown_connections 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627b2b41070 0x5627b2c371d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fda14038440 0x7fda1403a900 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 --2- 172.21.15.114:0/1414105154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627b2ab1fa0 0x5627b2c30250 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 >> 172.21.15.114:0/1414105154 conn(0x5627b2b38650 msgr2=0x5627b2c23600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 shutdown_connections 2024-05-08T18:09:13.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.243+0000 7fdb2e3b5980 1 -- 172.21.15.114:0/1414105154 wait complete. 2024-05-08T18:09:13.255 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1'] 2024-05-08T18:09:13.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1'] 2024-05-08T18:09:13.255 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:13.338 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:13.338 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:13.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f857202c980 1 Processor -- start 2024-05-08T18:09:13.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f857202c980 1 -- start start 2024-05-08T18:09:13.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f857202c980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eca6fcf2d0 0x55eca6fcf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f857202c980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55eca6e7c710 con 0x55eca6fcfbf0 2024-05-08T18:09:13.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f857202c980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55eca6e90f00 con 0x55eca6fcf2d0 2024-05-08T18:09:13.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f856fb40640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eca6fcf2d0 0x55eca6fcf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f856fb40640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55eca6fcf2d0 0x55eca6fcf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58724/0 (socket says 172.21.15.114:58724) 2024-05-08T18:09:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f856f33f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55eca6fcfbf0 0x55eca6fd63e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34732/0 (socket says 172.21.15.114:34732) 2024-05-08T18:09:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f856fb40640 1 -- 172.21.15.114:0/2722423394 learned_addr learned my addr 172.21.15.114:0/2722423394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f856fb40640 1 -- 172.21.15.114:0/2722423394 >> v1:172.21.15.53:6789/0 conn(0x55eca6fcfbf0 legacy=0x55eca6fd63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.339+0000 7f856fb40640 1 -- 172.21.15.114:0/2722423394 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca6e58ae0 con 0x55eca6fcf2d0 2024-05-08T18:09:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f856fb40640 1 --2- 172.21.15.114:0/2722423394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fcf6b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f856000a5c0 tx=0x7f856001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380933b1681d8296 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f856eb3e640 1 -- 172.21.15.114:0/2722423394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85600a6070 con 0x55eca6fcf2d0 2024-05-08T18:09:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f856eb3e640 1 -- 172.21.15.114:0/2722423394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85600af070 con 0x55eca6fcf2d0 2024-05-08T18:09:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f856eb3e640 1 -- 172.21.15.114:0/2722423394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85600aa5c0 con 0x55eca6fcf2d0 2024-05-08T18:09:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 -- 172.21.15.114:0/2722423394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 msgr2=0x55eca6fcf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 --2- 172.21.15.114:0/2722423394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fcf6b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f856000a5c0 tx=0x7f856001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 -- 172.21.15.114:0/2722423394 shutdown_connections 2024-05-08T18:09:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 --2- 172.21.15.114:0/2722423394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fcf6b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 -- 172.21.15.114:0/2722423394 >> 172.21.15.114:0/2722423394 conn(0x55eca6fcad60 msgr2=0x55eca6fcd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 -- 172.21.15.114:0/2722423394 shutdown_connections 2024-05-08T18:09:13.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.343+0000 7f857202c980 1 -- 172.21.15.114:0/2722423394 wait complete. 2024-05-08T18:09:13.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f857202c980 1 Processor -- start 2024-05-08T18:09:13.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f857202c980 1 -- start start 2024-05-08T18:09:13.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f857202c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fd1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f857202c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca6ed4f80 con 0x55eca6fcf2d0 2024-05-08T18:09:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f856fb40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fd1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f856fb40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fd1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58726/0 (socket says 172.21.15.114:58726) 2024-05-08T18:09:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f856fb40640 1 -- 172.21.15.114:0/1361360105 learned_addr learned my addr 172.21.15.114:0/1361360105 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f856fb40640 1 -- 172.21.15.114:0/1361360105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca6e9cda0 con 0x55eca6fcf2d0 2024-05-08T18:09:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f856fb40640 1 --2- 172.21.15.114:0/1361360105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fd1af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f856000a5c0 tx=0x7f8560003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdb26cabc3669f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.359+0000 7f845de0b640 1 -- 172.21.15.114:0/1361360105 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85600aa9b0 con 0x55eca6fcf2d0 2024-05-08T18:09:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f845de0b640 1 -- 172.21.15.114:0/1361360105 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85600aab50 con 0x55eca6fcf2d0 2024-05-08T18:09:13.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f845de0b640 1 -- 172.21.15.114:0/1361360105 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85600aae50 con 0x55eca6fcf2d0 2024-05-08T18:09:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/1361360105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 msgr2=0x55eca6fd1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 --2- 172.21.15.114:0/1361360105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fd1af0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f856000a5c0 tx=0x7f8560003030 comp rx=0 tx=0).stop 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/1361360105 shutdown_connections 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 --2- 172.21.15.114:0/1361360105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca6fd1af0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/1361360105 >> 172.21.15.114:0/1361360105 conn(0x55eca6fcad60 msgr2=0x55eca70b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/1361360105 shutdown_connections 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/1361360105 wait complete. 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 Processor -- start 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- start start 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca70c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca6fd8610 con 0x55eca6fcf2d0 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f856fb40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca70c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f856fb40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca70c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58732/0 (socket says 172.21.15.114:58732) 2024-05-08T18:09:13.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f856fb40640 1 -- 172.21.15.114:0/918928518 learned_addr learned my addr 172.21.15.114:0/918928518 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f856fb40640 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca70c5a70 con 0x55eca6fcf2d0 2024-05-08T18:09:13.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f856fb40640 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca70c5530 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f856000a5c0 tx=0x7f85600180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f8457fff640 1 -- 172.21.15.114:0/918928518 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85600c6750 con 0x55eca6fcf2d0 2024-05-08T18:09:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eca70c5d00 con 0x55eca6fcf2d0 2024-05-08T18:09:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f8457fff640 1 -- 172.21.15.114:0/918928518 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85600c68f0 con 0x55eca6fcf2d0 2024-05-08T18:09:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f8457fff640 1 -- 172.21.15.114:0/918928518 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85600c6bd0 con 0x55eca6fcf2d0 2024-05-08T18:09:13.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.363+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca70c8990 con 0x55eca6fcf2d0 2024-05-08T18:09:13.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8457fff640 1 -- 172.21.15.114:0/918928518 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f85600ce020 con 0x55eca6fcf2d0 2024-05-08T18:09:13.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8457fff640 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84580383f0 0x7f845803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8457fff640 1 -- 172.21.15.114:0/918928518 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f85600cc020 con 0x55eca6fcf2d0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f856f33f640 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84580383f0 0x7f845803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca6fcfbf0 0x55eca70cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70ccad0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca6fcfbf0 0x55eca70cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f856f33f640 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84580383f0 0x7f845803a8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8564001e90 tx=0x7f85640013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca6fcfbf0 0x55eca70cc490 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 -- 172.21.15.114:0/918928518 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f856800a4d0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70cd3b0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 -- 172.21.15.114:0/918928518 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f856800a4d0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70ce760 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 -- 172.21.15.114:0/918928518 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f856800a4d0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70cdc00 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 -- 172.21.15.114:0/918928518 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f856800a4d0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70ce020 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f8570341640 1 -- 172.21.15.114:0/918928518 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f856800a4d0 con 0x55eca6fcfbf0 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 Processor -- start 2024-05-08T18:09:13.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- start start 2024-05-08T18:09:13.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 0x55eca70dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.367+0000 7f857202c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca6ed8fc0 con 0x55eca70dd2b0 2024-05-08T18:09:13.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f856f33f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 0x55eca70dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f856f33f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 0x55eca70dd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58742/0 (socket says 172.21.15.114:58742) 2024-05-08T18:09:13.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f856f33f640 1 -- 172.21.15.114:0/3448720976 learned_addr learned my addr 172.21.15.114:0/3448720976 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f856f33f640 1 -- 172.21.15.114:0/3448720976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca70ddc10 con 0x55eca70dd2b0 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f856f33f640 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 0x55eca70dd6d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f856400e670 tx=0x7f856400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f84557fa640 1 -- 172.21.15.114:0/3448720976 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8564022070 con 0x55eca70dd2b0 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f84557fa640 1 -- 172.21.15.114:0/3448720976 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856400d660 con 0x55eca70dd2b0 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eca70de6b0 con 0x55eca70dd2b0 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f84557fa640 1 -- 172.21.15.114:0/3448720976 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8564006070 con 0x55eca70dd2b0 2024-05-08T18:09:13.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca70deb80 con 0x55eca70dd2b0 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f84557fa640 1 -- 172.21.15.114:0/3448720976 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f8564025070 con 0x55eca70dd2b0 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f84557fa640 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8448038440 0x7f844803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f84557fa640 1 -- 172.21.15.114:0/3448720976 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f8564050130 con 0x55eca70dd2b0 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f8570341640 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8448038440 0x7f844803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f857202c980 1 Processor -- start 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f857202c980 1 -- start start 2024-05-08T18:09:13.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f8570341640 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8448038440 0x7f844803a900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55eca70cdfa0 tx=0x7f8568005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f857202c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70ea880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.371+0000 7f857202c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca6fd2180 con 0x55eca70ea480 2024-05-08T18:09:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70ea880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70ea880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58750/0 (socket says 172.21.15.114:58750) 2024-05-08T18:09:13.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 -- 172.21.15.114:0/2547789367 learned_addr learned my addr 172.21.15.114:0/2547789367 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 -- 172.21.15.114:0/2547789367 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca70eae50 con 0x55eca70ea480 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 --2- 172.21.15.114:0/2547789367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70ea880 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f856400ffd0 tx=0x7f8564024a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fb0ac4591709f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f844effd640 1 -- 172.21.15.114:0/2547789367 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85640268d0 con 0x55eca70ea480 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f844effd640 1 -- 172.21.15.114:0/2547789367 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85640263b0 con 0x55eca70ea480 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f844effd640 1 -- 172.21.15.114:0/2547789367 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8564026a70 con 0x55eca70ea480 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- 172.21.15.114:0/2547789367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 msgr2=0x55eca70ea880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 --2- 172.21.15.114:0/2547789367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70ea880 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f856400ffd0 tx=0x7f8564024a10 comp rx=0 tx=0).stop 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- 172.21.15.114:0/2547789367 shutdown_connections 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 --2- 172.21.15.114:0/2547789367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70ea880 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- 172.21.15.114:0/2547789367 >> 172.21.15.114:0/2547789367 conn(0x55eca70e67c0 msgr2=0x55eca70e4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- 172.21.15.114:0/2547789367 shutdown_connections 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- 172.21.15.114:0/2547789367 wait complete. 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 Processor -- start 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- start start 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f857202c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55eca70eb530 con 0x55eca70ea480 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58752/0 (socket says 172.21.15.114:58752) 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 learned_addr learned my addr 172.21.15.114:0/2203112315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eca70f1e60 con 0x55eca70ea480 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.375+0000 7f856f33f640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70f1920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f856400be60 tx=0x7f856404e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f844d7fa640 1 -- 172.21.15.114:0/2203112315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8564026c30 con 0x55eca70ea480 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55eca70f1e60 con 0x55eca70ea480 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f844d7fa640 1 -- 172.21.15.114:0/2203112315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8564042070 con 0x55eca70ea480 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eca70f1e60 con 0x55eca70ea480 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f844d7fa640 1 -- 172.21.15.114:0/2203112315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f856403ea30 con 0x55eca70ea480 2024-05-08T18:09:13.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f844d7fa640 1 -- 172.21.15.114:0/2203112315 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f856403ebd0 con 0x55eca70ea480 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f844d7fa640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84380383f0 0x7f843803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f844d7fa640 1 -- 172.21.15.114:0/2203112315 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f856403ac30 con 0x55eca70ea480 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f8570341640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84380383f0 0x7f843803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca70fcac0 0x55eca70fef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70ff6b0 con 0x55eca70fcac0 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f856fb40640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca70fcac0 0x55eca70fef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f8570341640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84380383f0 0x7f843803a8b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55eca70cd230 tx=0x7f856801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f856fb40640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca70fcac0 0x55eca70fef60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 realm 2024-05-08T18:09:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca70ffac0 con 0x55eca70fcac0 2024-05-08T18:09:13.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100360 con 0x55eca70fcac0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100700 con 0x55eca70fcac0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.379+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f857202c980 20 searching for the correct realm 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eca7102cc0 0x55eca71050b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca71055f0 con 0x55eca7102cc0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856f33f640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eca7102cc0 0x55eca71050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856f33f640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eca7102cc0 0x55eca71050b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856f33f640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8564027060 0x7f85640277a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca71055f0 con 0x7f8564027060 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f8570341640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8564027060 0x7f85640277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f8570341640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8564027060 0x7f85640277a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856801f070 con 0x7f8564027060 2024-05-08T18:09:13.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f8570341640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8568031040 0x7f8568032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca71055f0 con 0x7f8568031040 2024-05-08T18:09:13.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8568031040 0x7f8568032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8568031040 0x7f8568032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x7f8568031040 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.383+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x7f8568031040 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x7f8568031040 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8564027060 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856801f070 con 0x7f8564027060 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x7f8568031040 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8564027060 2024-05-08T18:09:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f856801f070 con 0x7f8564027060 2024-05-08T18:09:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.387+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x7f8568031040 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600c6d70 con 0x7f8568031040 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8564027060 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856801f070 con 0x7f8564027060 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.391+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85600c6d70 con 0x55eca70fcac0 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8564027060 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856801f070 con 0x7f8564027060 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca7102cc0 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8568031040 2024-05-08T18:09:13.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x55eca70fcac0 2024-05-08T18:09:13.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.395+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55eca7100f50 con 0x7f8564027060 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f856801f070 con 0x7f8564027060 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca71017a0 con 0x55eca70fcac0 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7101b90 con 0x55eca70fcac0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7101b90 con 0x55eca70fcac0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 zone default found 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 4 Realm: () 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:13.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 zonegroup default 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7105a20 con 0x7f8568031040 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7107400 con 0x55eca7102cc0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca71077a0 con 0x55eca7102cc0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 started sync module instance, tier type = 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:13.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71068a0 con 0x7f8564027060 2024-05-08T18:09:13.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.399+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94474903512048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7107b40 con 0x7f8564027060 2024-05-08T18:09:13.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.403+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7108430 con 0x55eca70fcac0 2024-05-08T18:09:13.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.403+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94474903512048] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.403+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.403+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94474903514304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7107ff0 con 0x55eca70fcac0 2024-05-08T18:09:13.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.403+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7108e40 con 0x55eca7102cc0 2024-05-08T18:09:13.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94474903514304] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94474903518016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7107f60 con 0x55eca7102cc0 2024-05-08T18:09:13.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7109b90 con 0x7f8564027060 2024-05-08T18:09:13.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94474903525392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710a430 con 0x7f8564027060 2024-05-08T18:09:13.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710ae30 con 0x55eca70fcac0 2024-05-08T18:09:13.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94474903518016] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.407+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94474903525392] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94474903523888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7109f80 con 0x55eca70fcac0 2024-05-08T18:09:13.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710b700 con 0x7f8568031040 2024-05-08T18:09:13.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94474903523888] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94474903529792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710b3f0 con 0x7f8568031040 2024-05-08T18:09:13.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.411+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710bc40 con 0x7f8568031040 2024-05-08T18:09:13.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94474903529792] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94474903531600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710ba00 con 0x7f8568031040 2024-05-08T18:09:13.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710c520 con 0x7f8568031040 2024-05-08T18:09:13.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94474903531600] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94474903535600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710c4e0 con 0x7f8568031040 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=0 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=1 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=2 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=3 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=4 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=5 2024-05-08T18:09:13.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.415+0000 7f857202c980 20 add_watcher() i=6 2024-05-08T18:09:13.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94474903535600] v30'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 20 add_watcher() i=7 2024-05-08T18:09:13.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:13.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca710f940 con 0x55eca70fcac0 2024-05-08T18:09:13.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94474903532656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca710ce30 con 0x55eca70fcac0 2024-05-08T18:09:13.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94474903532656] v30'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f8425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:13.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:13.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 5 note: GC not initialized 2024-05-08T18:09:13.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f8424fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:13.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:13.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 20 Filter name: none 2024-05-08T18:09:13.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f839e7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:13.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:13.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.419+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca71333b0 con 0x55eca70fcac0 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7135490 con 0x7f8564027060 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7136d60 con 0x55eca70fcac0 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:09:13.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca713b3d0 con 0x7f8568031040 2024-05-08T18:09:13.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.423+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71412e0 con 0x55eca70fcac0 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'5 uv5 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94474903751504 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca713b800 con 0x7f8564027060 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== watch-notify(notify (1) cookie 94474903512048 notify 128849018900 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f8568024a00 con 0x7f8564027060 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f844effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94474903512048 notifier 4520 bl.length()=752 2024-05-08T18:09:13.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f844effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [notify cookie 94474903751504 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f844effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f844effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f844effd640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8434003eb0 con 0x7f8564027060 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== watch-notify(notify_complete (2) cookie 94474903751504 notify 128849018900 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8568014420 con 0x7f8564027060 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_sources= new_sources= 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential sources added=[] removed=[] 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_dests= new_dests= 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential dests added=[] removed=[] 2024-05-08T18:09:13.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.427+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7140b50 con 0x7f8564027060 2024-05-08T18:09:13.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7140b50 con 0x7f8564027060 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f857202c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f857202c980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f857202c980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94474903751504 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55eca7139e60 con 0x7f8568031040 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== watch-notify(notify (1) cookie 94474903531600 notify 128849018885 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f85600ec040 con 0x7f8568031040 2024-05-08T18:09:13.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.6 [notify cookie 94474903751504 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f844effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94474903531600 notifier 4520 bl.length()=314 2024-05-08T18:09:13.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f844effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:09:13.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f844effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:13.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.431+0000 7f844effd640 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f8434003eb0 con 0x7f8568031040 2024-05-08T18:09:13.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.435+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== watch-notify(notify_complete (2) cookie 94474903751504 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55eca70c8990 con 0x7f8568031040 2024-05-08T18:09:13.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.435+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.435+0000 7f8425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.435+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94474903532656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71310e0 con 0x55eca70fcac0 2024-05-08T18:09:13.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.435+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94474903532656] v30'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.435+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94474903512048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71310e0 con 0x7f8564027060 2024-05-08T18:09:13.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94474903512048] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f857202c980 20 remove_watcher() i=0 2024-05-08T18:09:13.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f857202c980 2 removed watcher, disabling cache 2024-05-08T18:09:13.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94474903514304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71310e0 con 0x55eca70fcac0 2024-05-08T18:09:13.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94474903514304] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f857202c980 20 remove_watcher() i=1 2024-05-08T18:09:13.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.439+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94474903518016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71310e0 con 0x55eca7102cc0 2024-05-08T18:09:13.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.443+0000 7f856f33f640 1 -- 172.21.15.114:0/2203112315 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94474903518016] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8564036020 con 0x55eca7102cc0 2024-05-08T18:09:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.443+0000 7f857202c980 20 remove_watcher() i=2 2024-05-08T18:09:13.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.443+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94474903525392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71063f0 con 0x7f8564027060 2024-05-08T18:09:13.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.443+0000 7f8570341640 1 -- 172.21.15.114:0/2203112315 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94474903525392] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8568040040 con 0x7f8564027060 2024-05-08T18:09:13.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.443+0000 7f857202c980 20 remove_watcher() i=3 2024-05-08T18:09:13.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.443+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94474903523888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7106cc0 con 0x55eca70fcac0 2024-05-08T18:09:13.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.447+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94474903523888] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x55eca70fcac0 2024-05-08T18:09:13.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.447+0000 7f857202c980 20 remove_watcher() i=4 2024-05-08T18:09:13.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.447+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94474903529792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7107b40 con 0x7f8568031040 2024-05-08T18:09:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.447+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94474903529792] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.447+0000 7f857202c980 20 remove_watcher() i=5 2024-05-08T18:09:13.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.447+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94474903531600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca71063f0 con 0x7f8568031040 2024-05-08T18:09:13.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94474903531600] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 20 remove_watcher() i=6 2024-05-08T18:09:13.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94474903535600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55eca7109230 con 0x7f8568031040 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94474903535600] v30'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85600f7040 con 0x7f8568031040 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 20 remove_watcher() i=7 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8568031040 msgr2=0x7f8568032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f8568031040 0x7f8568032940 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca70fcac0 msgr2=0x55eca70fef60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca70fcac0 0x55eca70fef60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8564027060 msgr2=0x7f85640277a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f8564027060 0x7f85640277a0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eca7102cc0 msgr2=0x55eca71050b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55eca7102cc0 0x55eca71050b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84380383f0 msgr2=0x7f843803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84380383f0 0x7f843803a8b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55eca70cd230 tx=0x7f856801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:13.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 msgr2=0x55eca70f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/2203112315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70ea480 0x55eca70f1920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f856400be60 tx=0x7f856404e410 comp rx=0 tx=0).stop 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 reap_dead start 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f856fb40640 1 -- 172.21.15.114:0/2203112315 reap_dead start 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 shutdown_connections 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 >> 172.21.15.114:0/2203112315 conn(0x55eca70e67c0 msgr2=0x55eca70e3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 shutdown_connections 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/2203112315 wait complete. 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8448038440 msgr2=0x7f844803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8448038440 0x7f844803a900 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55eca70cdfa0 tx=0x7f8568005850 comp rx=0 tx=0).stop 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 msgr2=0x55eca70dd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 0x55eca70dd6d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f856400e670 tx=0x7f856400ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 shutdown_connections 2024-05-08T18:09:13.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8448038440 0x7f844803a900 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 --2- 172.21.15.114:0/3448720976 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca70dd2b0 0x55eca70dd6d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 >> 172.21.15.114:0/3448720976 conn(0x55eca70d20c0 msgr2=0x55eca70d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 shutdown_connections 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.451+0000 7f857202c980 1 -- 172.21.15.114:0/3448720976 wait complete. 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca6fcfbf0 msgr2=0x55eca70cc490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca6fcfbf0 0x55eca70cc490 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84580383f0 msgr2=0x7f845803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84580383f0 0x7f845803a8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8564001e90 tx=0x7f85640013f0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 msgr2=0x55eca70c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca70c5530 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f856000a5c0 tx=0x7f85600180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 shutdown_connections 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55eca6fcfbf0 0x55eca70cc490 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f84580383f0 0x7f845803a8b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 --2- 172.21.15.114:0/918928518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eca6fcf2d0 0x55eca70c5530 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 >> 172.21.15.114:0/918928518 conn(0x55eca6fcad60 msgr2=0x55eca6fd05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 shutdown_connections 2024-05-08T18:09:13.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.455+0000 7f857202c980 1 -- 172.21.15.114:0/918928518 wait complete. 2024-05-08T18:09:13.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T18:09:13.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T18:09:13.465 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T18:09:13.540 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:13.555 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.539+0000 7f7ac1115980 1 Processor -- start 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.539+0000 7f7ac1115980 1 -- start start 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.539+0000 7f7ac1115980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573ef36bf50 0x5573ef3fcf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.539+0000 7f7ac1115980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573ef2a3710 con 0x5573ef3fd4a0 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.539+0000 7f7ac1115980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5573ef2b7f00 con 0x5573ef36bf50 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abec29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573ef36bf50 0x5573ef3fcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abec29640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5573ef36bf50 0x5573ef3fcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58758/0 (socket says 172.21.15.114:58758) 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abec29640 1 -- 172.21.15.114:0/2771391963 learned_addr learned my addr 172.21.15.114:0/2771391963 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abe428640 1 --1- 172.21.15.114:0/2771391963 >> v1:172.21.15.53:6789/0 conn(0x5573ef3fd4a0 0x5573ef3ff890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34744/0 (socket says 172.21.15.114:34744) 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abec29640 1 -- 172.21.15.114:0/2771391963 >> v1:172.21.15.53:6789/0 conn(0x5573ef3fd4a0 legacy=0x5573ef3ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abec29640 1 -- 172.21.15.114:0/2771391963 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ef27fae0 con 0x5573ef36bf50 2024-05-08T18:09:13.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abec29640 1 --2- 172.21.15.114:0/2771391963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef3fcf60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a5c0 tx=0x7f7ab001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a422d947476944 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abdc27640 1 -- 172.21.15.114:0/2771391963 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00a6070 con 0x5573ef36bf50 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abdc27640 1 -- 172.21.15.114:0/2771391963 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab00af070 con 0x5573ef36bf50 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.543+0000 7f7abdc27640 1 -- 172.21.15.114:0/2771391963 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00aa5c0 con 0x5573ef36bf50 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 -- 172.21.15.114:0/2771391963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 msgr2=0x5573ef3fcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 --2- 172.21.15.114:0/2771391963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef3fcf60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a5c0 tx=0x7f7ab001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 -- 172.21.15.114:0/2771391963 shutdown_connections 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 --2- 172.21.15.114:0/2771391963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef3fcf60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 -- 172.21.15.114:0/2771391963 >> 172.21.15.114:0/2771391963 conn(0x5573ef3f2640 msgr2=0x5573ef3f4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 -- 172.21.15.114:0/2771391963 shutdown_connections 2024-05-08T18:09:13.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.547+0000 7f7ac1115980 1 -- 172.21.15.114:0/2771391963 wait complete. 2024-05-08T18:09:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 Processor -- start 2024-05-08T18:09:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- start start 2024-05-08T18:09:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573ef2fbf80 con 0x5573ef36bf50 2024-05-08T18:09:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58762/0 (socket says 172.21.15.114:58762) 2024-05-08T18:09:13.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 -- 172.21.15.114:0/1760253823 learned_addr learned my addr 172.21.15.114:0/1760253823 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 -- 172.21.15.114:0/1760253823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ef2c3da0 con 0x5573ef36bf50 2024-05-08T18:09:13.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 --2- 172.21.15.114:0/1760253823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4e5120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a5c0 tx=0x7f7ab0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc2d46ded076aa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f79ace09640 1 -- 172.21.15.114:0/1760253823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00aa9b0 con 0x5573ef36bf50 2024-05-08T18:09:13.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f79ace09640 1 -- 172.21.15.114:0/1760253823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab00aab50 con 0x5573ef36bf50 2024-05-08T18:09:13.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f79ace09640 1 -- 172.21.15.114:0/1760253823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00aae50 con 0x5573ef36bf50 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- 172.21.15.114:0/1760253823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 msgr2=0x5573ef4e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1760253823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4e5120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a5c0 tx=0x7f7ab0003030 comp rx=0 tx=0).stop 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- 172.21.15.114:0/1760253823 shutdown_connections 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1760253823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4e5120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- 172.21.15.114:0/1760253823 >> 172.21.15.114:0/1760253823 conn(0x5573ef3f2640 msgr2=0x5573ef4e0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- 172.21.15.114:0/1760253823 shutdown_connections 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- 172.21.15.114:0/1760253823 wait complete. 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 Processor -- start 2024-05-08T18:09:13.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- start start 2024-05-08T18:09:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4ec460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7ac1115980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573ef403a10 con 0x5573ef36bf50 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4ec460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4ec460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58778/0 (socket says 172.21.15.114:58778) 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.563+0000 7f7abec29640 1 -- 172.21.15.114:0/1731168224 learned_addr learned my addr 172.21.15.114:0/1731168224 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abec29640 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ef4ec9a0 con 0x5573ef36bf50 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abec29640 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4ec460 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a5c0 tx=0x7f7ab00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f79ab606640 1 -- 172.21.15.114:0/1731168224 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00c6750 con 0x5573ef36bf50 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f79ab606640 1 -- 172.21.15.114:0/1731168224 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab00c68f0 con 0x5573ef36bf50 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ef4ecc30 con 0x5573ef36bf50 2024-05-08T18:09:13.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f79ab606640 1 -- 172.21.15.114:0/1731168224 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab00c6bd0 con 0x5573ef36bf50 2024-05-08T18:09:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ef4ef910 con 0x5573ef36bf50 2024-05-08T18:09:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f79ab606640 1 -- 172.21.15.114:0/1731168224 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7ab00ce020 con 0x5573ef36bf50 2024-05-08T18:09:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f79ab606640 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79a40383f0 0x7f79a403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f79ab606640 1 -- 172.21.15.114:0/1731168224 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7ab00cc020 con 0x5573ef36bf50 2024-05-08T18:09:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abe428640 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79a40383f0 0x7f79a403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef3fd4a0 0x5573ef4f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef4f3a30 con 0x5573ef3fd4a0 2024-05-08T18:09:13.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abf42a640 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef3fd4a0 0x5573ef4f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abf42a640 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef3fd4a0 0x5573ef4f33f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abe428640 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79a40383f0 0x7f79a403a8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4001e40 tx=0x7f7ab40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7abf42a640 1 -- 172.21.15.114:0/1731168224 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ab800a4d0 con 0x5573ef3fd4a0 2024-05-08T18:09:13.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.567+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef4f0b10 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abf42a640 1 -- 172.21.15.114:0/1731168224 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ab800a4d0 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef4f5850 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abf42a640 1 -- 172.21.15.114:0/1731168224 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7ab800a4d0 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef4f4a80 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abf42a640 1 -- 172.21.15.114:0/1731168224 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ab800a4d0 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef4f4ea0 con 0x5573ef3fd4a0 2024-05-08T18:09:13.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abf42a640 1 -- 172.21.15.114:0/1731168224 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ab800a4d0 con 0x5573ef3fd4a0 2024-05-08T18:09:13.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 Processor -- start 2024-05-08T18:09:13.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 -- start start 2024-05-08T18:09:13.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 0x5573ef5045e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573ef2fffc0 con 0x5573ef5041c0 2024-05-08T18:09:13.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abe428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 0x5573ef5045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abe428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 0x5573ef5045e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58784/0 (socket says 172.21.15.114:58784) 2024-05-08T18:09:13.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abe428640 1 -- 172.21.15.114:0/2487028323 learned_addr learned my addr 172.21.15.114:0/2487028323 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abe428640 1 -- 172.21.15.114:0/2487028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ef504b20 con 0x5573ef5041c0 2024-05-08T18:09:13.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7abe428640 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 0x5573ef5045e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e670 tx=0x7f7ab400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f79a8e01640 1 -- 172.21.15.114:0/2487028323 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab4022070 con 0x5573ef5041c0 2024-05-08T18:09:13.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ef5055c0 con 0x5573ef5041c0 2024-05-08T18:09:13.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.571+0000 7f79a8e01640 1 -- 172.21.15.114:0/2487028323 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab400d660 con 0x5573ef5041c0 2024-05-08T18:09:13.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f79a8e01640 1 -- 172.21.15.114:0/2487028323 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab4006070 con 0x5573ef5041c0 2024-05-08T18:09:13.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ef505a90 con 0x5573ef5041c0 2024-05-08T18:09:13.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f79a8e01640 1 -- 172.21.15.114:0/2487028323 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7ab4025070 con 0x5573ef5041c0 2024-05-08T18:09:13.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f79a8e01640 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7998038380 0x7f799803a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f79a8e01640 1 -- 172.21.15.114:0/2487028323 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7ab404ff00 con 0x5573ef5041c0 2024-05-08T18:09:13.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abf42a640 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7998038380 0x7f799803a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7ac1115980 1 Processor -- start 2024-05-08T18:09:13.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7ac1115980 1 -- start start 2024-05-08T18:09:13.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abf42a640 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7998038380 0x7f799803a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5573ef4f4e20 tx=0x7f7ab8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7ac1115980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5117c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7ac1115980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573ef4e57b0 con 0x5573ef5113a0 2024-05-08T18:09:13.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abe428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5117c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abe428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5117c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58796/0 (socket says 172.21.15.114:58796) 2024-05-08T18:09:13.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abe428640 1 -- 172.21.15.114:0/614538703 learned_addr learned my addr 172.21.15.114:0/614538703 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abe428640 1 -- 172.21.15.114:0/614538703 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ef511d90 con 0x5573ef5113a0 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f7abe428640 1 --2- 172.21.15.114:0/614538703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5117c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4027030 tx=0x7f7ab4025df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d95d15af771de5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f79a27fc640 1 -- 172.21.15.114:0/614538703 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab400dcc0 con 0x5573ef5113a0 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.575+0000 7f79a27fc640 1 -- 172.21.15.114:0/614538703 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab401a320 con 0x5573ef5113a0 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f79a27fc640 1 -- 172.21.15.114:0/614538703 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab400de60 con 0x5573ef5113a0 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/614538703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 msgr2=0x5573ef5117c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 --2- 172.21.15.114:0/614538703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5117c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4027030 tx=0x7f7ab4025df0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/614538703 shutdown_connections 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 --2- 172.21.15.114:0/614538703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5117c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/614538703 >> 172.21.15.114:0/614538703 conn(0x5573ef50d730 msgr2=0x5573ef50b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/614538703 shutdown_connections 2024-05-08T18:09:13.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/614538703 wait complete. 2024-05-08T18:09:13.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 Processor -- start 2024-05-08T18:09:13.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- start start 2024-05-08T18:09:13.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5188b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5573ef5124e0 con 0x5573ef5113a0 2024-05-08T18:09:13.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7abe428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5188b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7abe428640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5188b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58804/0 (socket says 172.21.15.114:58804) 2024-05-08T18:09:13.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 learned_addr learned my addr 172.21.15.114:0/221530823 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573ef518df0 con 0x5573ef5113a0 2024-05-08T18:09:13.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7abe428640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5188b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4024430 tx=0x7f7ab404e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f79a0ff9640 1 -- 172.21.15.114:0/221530823 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab4024680 con 0x5573ef5113a0 2024-05-08T18:09:13.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f79a0ff9640 1 -- 172.21.15.114:0/221530823 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ab403e8c0 con 0x5573ef5113a0 2024-05-08T18:09:13.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573ef519080 con 0x5573ef5113a0 2024-05-08T18:09:13.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f79a0ff9640 1 -- 172.21.15.114:0/221530823 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ab403ebc0 con 0x5573ef5113a0 2024-05-08T18:09:13.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.579+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573ef519080 con 0x5573ef5113a0 2024-05-08T18:09:13.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f79a0ff9640 1 -- 172.21.15.114:0/221530823 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7ab401b8c0 con 0x5573ef5113a0 2024-05-08T18:09:13.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f79a0ff9640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79880383a0 0x7f798803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f79a0ff9640 1 -- 172.21.15.114:0/221530823 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f7ab4046030 con 0x5573ef5113a0 2024-05-08T18:09:13.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abf42a640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79880383a0 0x7f798803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef523bc0 0x5573ef526080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5267d0 con 0x5573ef523bc0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef523bc0 0x5573ef526080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef523bc0 0x5573ef526080 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abf42a640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79880383a0 0x7f798803a860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5573ef4f45a0 tx=0x7f7ab801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 realm 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef526be0 con 0x5573ef523bc0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5274b0 con 0x5573ef523bc0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef527850 con 0x5573ef523bc0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5280a0 con 0x5573ef523bc0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 20 searching for the correct realm 2024-05-08T18:09:13.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5573ef529e10 0x5573ef52c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abe428640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5573ef529e10 0x5573ef52c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abe428640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5573ef529e10 0x5573ef52c200 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abe428640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7ab4027060 0x7f7ab404dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab4027060 2024-05-08T18:09:13.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.583+0000 7f7abf42a640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7ab4027060 0x7f7ab404dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abf42a640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7ab4027060 0x7f7ab404dae0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab801f070 con 0x7f7ab4027060 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abf42a640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7ab8031040 0x7f7ab8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7ab8031040 0x7f7ab8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7ab8031040 0x7f7ab8032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.587+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab4027060 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab801f070 con 0x7f7ab4027060 2024-05-08T18:09:13.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab4027060 2024-05-08T18:09:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7ab801f070 con 0x7f7ab4027060 2024-05-08T18:09:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.591+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab4027060 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab801f070 con 0x7f7ab4027060 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.595+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab4027060 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab801f070 con 0x7f7ab4027060 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef529e10 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab8031040 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x5573ef523bc0 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52c740 con 0x7f7ab4027060 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ab801f070 con 0x7f7ab4027060 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:13.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef528a20 con 0x5573ef523bc0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5292c0 con 0x5573ef523bc0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5292c0 con 0x5573ef523bc0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 zone default found 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 4 Realm: () 2024-05-08T18:09:13.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 zonegroup default 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52cb70 con 0x7f7ab8031040 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.599+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52e550 con 0x5573ef529e10 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52e9c0 con 0x5573ef529e10 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 20 started sync module instance, tier type = 2024-05-08T18:09:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:13.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52d9f0 con 0x7f7ab4027060 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93956424785376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52d650 con 0x7f7ab4027060 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52f8f0 con 0x5573ef523bc0 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93956424785376] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.603+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93956424789536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52f8f0 con 0x5573ef523bc0 2024-05-08T18:09:13.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5302b0 con 0x5573ef529e10 2024-05-08T18:09:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93956424793600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef530b00 con 0x5573ef529e10 2024-05-08T18:09:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93956424789536] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef531010 con 0x7f7ab4027060 2024-05-08T18:09:13.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93956424791104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5318b0 con 0x7f7ab4027060 2024-05-08T18:09:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.607+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5322d0 con 0x5573ef523bc0 2024-05-08T18:09:13.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.611+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93956424793600] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.611+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93956424791104] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.611+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.611+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93956424801728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef531400 con 0x5573ef523bc0 2024-05-08T18:09:13.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.611+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef532b70 con 0x7f7ab8031040 2024-05-08T18:09:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.611+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93956424803504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef532d80 con 0x7f7ab8031040 2024-05-08T18:09:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5335d0 con 0x7f7ab8031040 2024-05-08T18:09:13.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93956424801728] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93956424803504] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93956424804560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5331a0 con 0x7f7ab8031040 2024-05-08T18:09:13.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.615+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef5339f0 con 0x7f7ab8031040 2024-05-08T18:09:13.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93956424807296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef533e10 con 0x7f7ab8031040 2024-05-08T18:09:13.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=0 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=1 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=2 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=3 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=4 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=5 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93956424804560] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=6 2024-05-08T18:09:13.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93956424807296] v30'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 20 add_watcher() i=7 2024-05-08T18:09:13.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:13.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef532cf0 con 0x5573ef523bc0 2024-05-08T18:09:13.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93956424805616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef534390 con 0x5573ef523bc0 2024-05-08T18:09:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93956424805616] v30'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.619+0000 7f79757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.623+0000 7f7ac1115980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.623+0000 7f7ac1115980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:13.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.623+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef53f8d0 con 0x5573ef523bc0 2024-05-08T18:09:13.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.623+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.623+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef53ff20 con 0x7f7ab8031040 2024-05-08T18:09:13.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.627+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.627+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef53ff20 con 0x5573ef529e10 2024-05-08T18:09:13.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.627+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.627+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef540770 con 0x5573ef523bc0 2024-05-08T18:09:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.627+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.627+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef540770 con 0x7f7ab4027060 2024-05-08T18:09:13.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.631+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.631+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef540770 con 0x5573ef529e10 2024-05-08T18:09:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.631+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.631+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef540d20 con 0x5573ef523bc0 2024-05-08T18:09:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.631+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.631+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef540dd0 con 0x7f7ab8031040 2024-05-08T18:09:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.635+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.635+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef540dd0 con 0x7f7ab4027060 2024-05-08T18:09:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.635+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.639+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541480 con 0x5573ef529e10 2024-05-08T18:09:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.639+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.639+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541480 con 0x7f7ab4027060 2024-05-08T18:09:13.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.639+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.639+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541a50 con 0x7f7ab8031040 2024-05-08T18:09:13.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.643+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.643+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541a50 con 0x7f7ab4027060 2024-05-08T18:09:13.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.643+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.643+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541ae0 con 0x7f7ab8031040 2024-05-08T18:09:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.647+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.647+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541ae0 con 0x5573ef523bc0 2024-05-08T18:09:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.647+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.647+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541ae0 con 0x5573ef529e10 2024-05-08T18:09:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.651+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.651+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541ae0 con 0x7f7ab4027060 2024-05-08T18:09:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.651+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.651+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.655+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.655+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef523bc0 2024-05-08T18:09:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.655+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.655+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef523bc0 2024-05-08T18:09:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.659+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.659+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.659+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.659+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x7f7ab4027060 2024-05-08T18:09:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.663+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.663+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.663+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.663+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.667+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.667+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.667+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.667+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.667+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.667+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x7f7ab8031040 2024-05-08T18:09:13.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.671+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.671+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.671+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.671+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x7f7ab8031040 2024-05-08T18:09:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.675+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.675+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x5573ef529e10 2024-05-08T18:09:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.679+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.679+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x7f7ab8031040 2024-05-08T18:09:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.679+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.679+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef541b00 con 0x7f7ab4027060 2024-05-08T18:09:13.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f78effff640 20 reqs_thread_entry: start 2024-05-08T18:09:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 20 Filter name: none 2024-05-08T18:09:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f78edffb640 20 reqs_thread_entry: start 2024-05-08T18:09:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:09:13.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef53db50 con 0x7f7ab8031040 2024-05-08T18:09:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:09:13.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:09:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:09:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.683+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef55fb60 con 0x7f7ab8031040 2024-05-08T18:09:13.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7ac1115980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:09:13.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef55db40 con 0x7f7ab8031040 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7ac1115980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93956424984144 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef560190 con 0x5573ef529e10 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== watch-notify(notify (1) cookie 93956424793600 notify 128849018883 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5573ef540dd0 con 0x5573ef529e10 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f79a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 93956424793600 notifier 4527 bl.length()=170 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f79a27fc640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7984003d70 con 0x5573ef529e10 2024-05-08T18:09:13.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(97 notify.2 [notify cookie 93956424984144 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.687+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== watch-notify(notify_complete (2) cookie 93956424984144 notify 128849018883 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573ef511d90 con 0x5573ef529e10 2024-05-08T18:09:13.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7ac1115980 10 removing email index: 2024-05-08T18:09:13.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7ac1115980 10 removing user buckets index 2024-05-08T18:09:13.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef560110 con 0x7f7ab8031040 2024-05-08T18:09:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(99 fud.buckets [delete] v30'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7ac1115980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T18:09:13.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93956424990992 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef55f660 con 0x7f7ab8031040 2024-05-08T18:09:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== watch-notify(notify (1) cookie 93956424804560 notify 128849018886 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5573ef541480 con 0x7f7ab8031040 2024-05-08T18:09:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f79a1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 93956424804560 notifier 4527 bl.length()=160 2024-05-08T18:09:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f79a1ffb640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f78f40032d0 con 0x7f7ab8031040 2024-05-08T18:09:13.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.691+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(100 notify.6 [notify cookie 93956424990992 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== watch-notify(notify_complete (2) cookie 93956424990992 notify 128849018886 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7ab00e3040 con 0x7f7ab8031040 2024-05-08T18:09:13.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7ac1115980 10 removing user index: fud 2024-05-08T18:09:13.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef55f660 con 0x7f7ab8031040 2024-05-08T18:09:13.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(102 fud [call,call,delete] v30'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7ac1115980 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T18:09:13.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7ac1115980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:09:13.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.695+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 93956424989632 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5573ef55eb00 con 0x7f7ab8031040 2024-05-08T18:09:13.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== watch-notify(notify (1) cookie 93956424803504 notify 128849018887 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f7ab00e3040 con 0x7f7ab8031040 2024-05-08T18:09:13.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f79a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 93956424803504 notifier 4527 bl.length()=152 2024-05-08T18:09:13.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(103 notify.5 [notify cookie 93956424989632 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f79a27fc640 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f7984003d70 con 0x7f7ab8031040 2024-05-08T18:09:13.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== watch-notify(notify_complete (2) cookie 93956424989632 notify 128849018887 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5573ef4ef910 con 0x7f7ab8031040 2024-05-08T18:09:13.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f79757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93956424805616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef55fbc0 con 0x5573ef523bc0 2024-05-08T18:09:13.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93956424805616] v30'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.699+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93956424785376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef532cf0 con 0x7f7ab4027060 2024-05-08T18:09:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93956424785376] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7ac1115980 20 remove_watcher() i=0 2024-05-08T18:09:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7ac1115980 2 removed watcher, disabling cache 2024-05-08T18:09:13.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93956424789536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52dde0 con 0x5573ef523bc0 2024-05-08T18:09:13.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93956424789536] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7ac1115980 20 remove_watcher() i=1 2024-05-08T18:09:13.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.703+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93956424793600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52dde0 con 0x5573ef529e10 2024-05-08T18:09:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.707+0000 7f7abe428640 1 -- 172.21.15.114:0/221530823 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93956424793600] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab4024030 con 0x5573ef529e10 2024-05-08T18:09:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.707+0000 7f7ac1115980 20 remove_watcher() i=2 2024-05-08T18:09:13.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.707+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93956424791104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52dde0 con 0x7f7ab4027060 2024-05-08T18:09:13.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.707+0000 7f7abf42a640 1 -- 172.21.15.114:0/221530823 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93956424791104] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab8040040 con 0x7f7ab4027060 2024-05-08T18:09:13.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.707+0000 7f7ac1115980 20 remove_watcher() i=3 2024-05-08T18:09:13.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.707+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93956424801728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52dde0 con 0x5573ef523bc0 2024-05-08T18:09:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.711+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93956424801728] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x5573ef523bc0 2024-05-08T18:09:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.711+0000 7f7ac1115980 20 remove_watcher() i=4 2024-05-08T18:09:13.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.711+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93956424803504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef531dc0 con 0x7f7ab8031040 2024-05-08T18:09:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.711+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93956424803504] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.711+0000 7f7ac1115980 20 remove_watcher() i=5 2024-05-08T18:09:13.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.711+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93956424804560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef52dde0 con 0x7f7ab8031040 2024-05-08T18:09:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.715+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93956424804560] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.715+0000 7f7ac1115980 20 remove_watcher() i=6 2024-05-08T18:09:13.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.715+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93956424807296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5573ef531dc0 con 0x7f7ab8031040 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.715+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93956424807296] v30'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ab00c6d70 con 0x7f7ab8031040 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.715+0000 7f7ac1115980 20 remove_watcher() i=7 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7ab8031040 msgr2=0x7f7ab8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f7ab8031040 0x7f7ab8032940 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef523bc0 msgr2=0x5573ef526080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef523bc0 0x5573ef526080 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7ab4027060 msgr2=0x7f7ab404dae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f7ab4027060 0x7f7ab404dae0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5573ef529e10 msgr2=0x5573ef52c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5573ef529e10 0x5573ef52c200 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79880383a0 msgr2=0x7f798803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79880383a0 0x7f798803a860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5573ef4f45a0 tx=0x7f7ab801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 msgr2=0x5573ef5188b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5188b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4024430 tx=0x7f7ab404e2a0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7abec29640 1 -- 172.21.15.114:0/221530823 reap_dead start 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 shutdown_connections 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/221530823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5113a0 0x5573ef5188b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 >> 172.21.15.114:0/221530823 conn(0x5573ef50d730 msgr2=0x5573ef512c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 shutdown_connections 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/221530823 wait complete. 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7998038380 msgr2=0x7f799803a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7998038380 0x7f799803a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5573ef4f4e20 tx=0x7f7ab8005850 comp rx=0 tx=0).stop 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 msgr2=0x5573ef5045e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 0x5573ef5045e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400e670 tx=0x7f7ab400ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 shutdown_connections 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7998038380 0x7f799803a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/2487028323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef5041c0 0x5573ef5045e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 >> 172.21.15.114:0/2487028323 conn(0x5573ef4f8fd0 msgr2=0x5573ef4f9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 shutdown_connections 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/2487028323 wait complete. 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef3fd4a0 msgr2=0x5573ef4f33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef3fd4a0 0x5573ef4f33f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79a40383f0 msgr2=0x7f79a403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79a40383f0 0x7f79a403a8b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4001e40 tx=0x7f7ab40013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 msgr2=0x5573ef4ec460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4ec460 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a5c0 tx=0x7f7ab00180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 shutdown_connections 2024-05-08T18:09:13.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5573ef3fd4a0 0x5573ef4f33f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f79a40383f0 0x7f79a403a8b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 --2- 172.21.15.114:0/1731168224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5573ef36bf50 0x5573ef4ec460 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 >> 172.21.15.114:0/1731168224 conn(0x5573ef3f2640 msgr2=0x5573ef4df7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 shutdown_connections 2024-05-08T18:09:13.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.719+0000 7f7ac1115980 1 -- 172.21.15.114:0/1731168224 wait complete. 2024-05-08T18:09:13.732 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:09:13.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T18:09:13.732 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:13.821 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d51710980 1 Processor -- start 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d51710980 1 -- start start 2024-05-08T18:09:13.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d51710980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f979a31670 0x55f979a33a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d51710980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9798d6710 con 0x55f97999f780 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d51710980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f9798eaf00 con 0x55f979a31670 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4ea23640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f979a31670 0x55f979a33a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4ea23640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f979a31670 0x55f979a33a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58808/0 (socket says 172.21.15.114:58808) 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3434178685 learned_addr learned my addr 172.21.15.114:0/3434178685 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4f224640 1 --1- 172.21.15.114:0/3434178685 >> v1:172.21.15.53:6789/0 conn(0x55f97999f780 0x55f979a2ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34754/0 (socket says 172.21.15.114:34754) 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3434178685 >> v1:172.21.15.53:6789/0 conn(0x55f97999f780 legacy=0x55f979a2ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4e222640 1 -- 172.21.15.114:0/3434178685 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594927795 0 0) 0x55f9798d6710 con 0x55f97999f780 2024-05-08T18:09:13.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.823+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3434178685 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9798b2ae0 con 0x55f979a31670 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/3434178685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979a31670 0x55f979a33a60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800a5c0 tx=0x7f2d3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b5668d87ec5cf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d4e222640 1 -- 172.21.15.114:0/3434178685 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380a6070 con 0x55f979a31670 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d4e222640 1 -- 172.21.15.114:0/3434178685 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380af070 con 0x55f979a31670 2024-05-08T18:09:13.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d4e222640 1 -- 172.21.15.114:0/3434178685 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380aa5c0 con 0x55f979a31670 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 -- 172.21.15.114:0/3434178685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979a31670 msgr2=0x55f979a33a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 --2- 172.21.15.114:0/3434178685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979a31670 0x55f979a33a60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800a5c0 tx=0x7f2d3801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 -- 172.21.15.114:0/3434178685 shutdown_connections 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 --2- 172.21.15.114:0/3434178685 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979a31670 0x55f979a33a60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 -- 172.21.15.114:0/3434178685 >> 172.21.15.114:0/3434178685 conn(0x55f979a25630 msgr2=0x55f979a27a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 -- 172.21.15.114:0/3434178685 shutdown_connections 2024-05-08T18:09:13.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.827+0000 7f2d51710980 1 -- 172.21.15.114:0/3434178685 wait complete. 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 Processor -- start 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- start start 2024-05-08T18:09:13.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b17fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f97992ef80 con 0x55f97999f780 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d4f224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b17fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d4f224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b17fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58820/0 (socket says 172.21.15.114:58820) 2024-05-08T18:09:13.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d4f224640 1 -- 172.21.15.114:0/903361965 learned_addr learned my addr 172.21.15.114:0/903361965 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d4f224640 1 -- 172.21.15.114:0/903361965 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9798f6da0 con 0x55f97999f780 2024-05-08T18:09:13.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d4f224640 1 --2- 172.21.15.114:0/903361965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b17fe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2d48006fb0 tx=0x7f2d48001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668bf595c3222f25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2c3d60a640 1 -- 172.21.15.114:0/903361965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d48003460 con 0x55f97999f780 2024-05-08T18:09:13.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2c3d60a640 1 -- 172.21.15.114:0/903361965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d48003600 con 0x55f97999f780 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2c3d60a640 1 -- 172.21.15.114:0/903361965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d48003920 con 0x55f97999f780 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- 172.21.15.114:0/903361965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 msgr2=0x55f979b17fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 --2- 172.21.15.114:0/903361965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b17fe0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2d48006fb0 tx=0x7f2d48001b10 comp rx=0 tx=0).stop 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- 172.21.15.114:0/903361965 shutdown_connections 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 --2- 172.21.15.114:0/903361965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b17fe0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- 172.21.15.114:0/903361965 >> 172.21.15.114:0/903361965 conn(0x55f979a25630 msgr2=0x55f979b13b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- 172.21.15.114:0/903361965 shutdown_connections 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- 172.21.15.114:0/903361965 wait complete. 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 Processor -- start 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- start start 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b1f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.843+0000 7f2d51710980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f979a36a00 con 0x55f97999f780 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4f224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b1f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4f224640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b1f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58832/0 (socket says 172.21.15.114:58832) 2024-05-08T18:09:13.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4f224640 1 -- 172.21.15.114:0/619513596 learned_addr learned my addr 172.21.15.114:0/619513596 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4f224640 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f979b1f9a0 con 0x55f97999f780 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4f224640 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b1f460 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55f979b18e70 tx=0x7f2d48001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2c3be07640 1 -- 172.21.15.114:0/619513596 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d48025070 con 0x55f97999f780 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2c3be07640 1 -- 172.21.15.114:0/619513596 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d48019040 con 0x55f97999f780 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f979b1fc30 con 0x55f97999f780 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2c3be07640 1 -- 172.21.15.114:0/619513596 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d480138f0 con 0x55f97999f780 2024-05-08T18:09:13.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f979b22910 con 0x55f97999f780 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2c3be07640 1 -- 172.21.15.114:0/619513596 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2d48028070 con 0x55f97999f780 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2c3be07640 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c34038440 0x7f2c3403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2c3be07640 1 -- 172.21.15.114:0/619513596 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2d4804e340 con 0x55f97999f780 2024-05-08T18:09:13.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c34038440 0x7f2c3403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979a31670 0x55f979b26430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b26aa0 con 0x55f979a31670 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979a31670 0x55f979b26430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c34038440 0x7f2c3403a900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ae000 tx=0x7f2d380a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.847+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979a31670 0x55f979b26430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4fa25640 1 -- 172.21.15.114:0/619513596 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d400083f0 con 0x55f979a31670 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b23b30 con 0x55f979a31670 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4fa25640 1 -- 172.21.15.114:0/619513596 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d400083f0 con 0x55f979a31670 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b288e0 con 0x55f979a31670 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4fa25640 1 -- 172.21.15.114:0/619513596 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2d400083f0 con 0x55f979a31670 2024-05-08T18:09:13.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b27b10 con 0x55f979a31670 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4fa25640 1 -- 172.21.15.114:0/619513596 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d400083f0 con 0x55f979a31670 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b27f60 con 0x55f979a31670 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4fa25640 1 -- 172.21.15.114:0/619513596 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2d400083f0 con 0x55f979a31670 2024-05-08T18:09:13.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 Processor -- start 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 -- start start 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 0x55f979b375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d51710980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f979932fc0 con 0x55f979b371a0 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4ea23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 0x55f979b375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4ea23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 0x55f979b375c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58848/0 (socket says 172.21.15.114:58848) 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3289423199 learned_addr learned my addr 172.21.15.114:0/3289423199 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3289423199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f979b37b00 con 0x55f979b371a0 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.851+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 0x55f979b375c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2d38018f70 tx=0x7f2d380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2c39602640 1 -- 172.21.15.114:0/3289423199 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380b3c50 con 0x55f979b371a0 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2c39602640 1 -- 172.21.15.114:0/3289423199 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380b3df0 con 0x55f979b371a0 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f979b385a0 con 0x55f979b371a0 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2c39602640 1 -- 172.21.15.114:0/3289423199 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380c8560 con 0x55f979b371a0 2024-05-08T18:09:13.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f979b38a10 con 0x55f979b371a0 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2c39602640 1 -- 172.21.15.114:0/3289423199 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2d380d1440 con 0x55f979b371a0 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2c39602640 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c280383f0 0x7f2c2803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2c39602640 1 -- 172.21.15.114:0/3289423199 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2d380ec210 con 0x55f979b371a0 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c280383f0 0x7f2c2803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d51710980 1 Processor -- start 2024-05-08T18:09:13.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d51710980 1 -- start start 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c280383f0 0x7f2c2803a8b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f979b27630 tx=0x7f2d40003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d51710980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d51710980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f979b18730 con 0x55f979b442a0 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4ea23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4ea23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58860/0 (socket says 172.21.15.114:58860) 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3875248833 learned_addr learned my addr 172.21.15.114:0/3875248833 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4ea23640 1 -- 172.21.15.114:0/3875248833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f979b44c70 con 0x55f979b442a0 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.855+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/3875248833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b446a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ea560 tx=0x7f2d380ea760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65fdfbea737e06a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2c32ffd640 1 -- 172.21.15.114:0/3875248833 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380bcdd0 con 0x55f979b442a0 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2c32ffd640 1 -- 172.21.15.114:0/3875248833 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380e3b90 con 0x55f979b442a0 2024-05-08T18:09:13.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2c32ffd640 1 -- 172.21.15.114:0/3875248833 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380d1730 con 0x55f979b442a0 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/3875248833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 msgr2=0x55f979b446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 --2- 172.21.15.114:0/3875248833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b446a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ea560 tx=0x7f2d380ea760 comp rx=0 tx=0).stop 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/3875248833 shutdown_connections 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 --2- 172.21.15.114:0/3875248833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b446a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/3875248833 >> 172.21.15.114:0/3875248833 conn(0x55f979b405e0 msgr2=0x55f979b3e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/3875248833 shutdown_connections 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/3875248833 wait complete. 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 Processor -- start 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- start start 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b4b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f979b453b0 con 0x55f979b442a0 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d4ea23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b4b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d4ea23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b4b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58866/0 (socket says 172.21.15.114:58866) 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 learned_addr learned my addr 172.21.15.114:0/1574605810 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:13.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f979b4bce0 con 0x55f979b442a0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b4b7a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2d380d1f60 tx=0x7f2d380ea4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2c317fa640 1 -- 172.21.15.114:0/1574605810 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380be420 con 0x55f979b442a0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f979b4bf70 con 0x55f979b442a0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2c317fa640 1 -- 172.21.15.114:0/1574605810 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d380f1070 con 0x55f979b442a0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f979b4ec50 con 0x55f979b442a0 2024-05-08T18:09:13.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.859+0000 7f2c317fa640 1 -- 172.21.15.114:0/1574605810 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2d380be5c0 con 0x55f979b442a0 2024-05-08T18:09:13.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2c317fa640 1 -- 172.21.15.114:0/1574605810 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2d380c7ae0 con 0x55f979b442a0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2c317fa640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c180383f0 0x7f2c1803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2c317fa640 1 -- 172.21.15.114:0/1574605810 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f2d380e2070 con 0x55f979b442a0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c180383f0 0x7f2c1803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979b56c40 0x55f979b590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b59830 con 0x55f979b56c40 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979b56c40 0x55f979b590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c180383f0 0x7f2c1803a8b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000f010 tx=0x7f2d4001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979b56c40 0x55f979b590e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 realm 2024-05-08T18:09:13.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b59c40 con 0x55f979b56c40 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5a4e0 con 0x55f979b56c40 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5a880 con 0x55f979b56c40 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5b0d0 con 0x55f979b56c40 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 20 searching for the correct realm 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f979b5ce40 0x55f979b5f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f979b5ce40 0x55f979b5f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f979b5ce40 0x55f979b5f230 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4ea23640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d380bf040 0x7f2d380bc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d380bf040 2024-05-08T18:09:13.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.863+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d380bf040 0x7f2d380bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d380bf040 0x7f2d380bc580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4fa25640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d40019040 0x7f2d40019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d40019040 0x7f2d40019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d40019040 0x7f2d40019930 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.867+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d380bf040 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d380bf040 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.871+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d380bf040 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.875+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d380bf040 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b5ce40 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d40019040 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x55f979b56c40 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5f770 con 0x7f2d380bf040 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:13.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5ba20 con 0x55f979b56c40 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5c2c0 con 0x55f979b56c40 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5b660 con 0x55f979b56c40 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 zone default found 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 4 Realm: () 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 zonegroup default 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.879+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b5fba0 con 0x7f2d40019040 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b61580 con 0x55f979b5ce40 2024-05-08T18:09:13.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b61a50 con 0x55f979b5ce40 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 started sync module instance, tier type = 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b60a20 con 0x7f2d380bf040 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94529977191952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b62360 con 0x7f2d380bf040 2024-05-08T18:09:13.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b62bb0 con 0x55f979b56c40 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.883+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94529977191952] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94529977196208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b62780 con 0x55f979b56c40 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b632a0 con 0x55f979b5ce40 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94529977199984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b63b40 con 0x55f979b5ce40 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b64500 con 0x7f2d380bf040 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94529977196208] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94529977204816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b64470 con 0x7f2d380bf040 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.887+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b65280 con 0x55f979b56c40 2024-05-08T18:09:13.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.891+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94529977199984] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.891+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94529977204816] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.891+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.891+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94529977202320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b64dd0 con 0x55f979b56c40 2024-05-08T18:09:13.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.891+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b65b20 con 0x7f2d40019040 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.891+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94529977202320] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94529977207072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b64dc0 con 0x7f2d40019040 2024-05-08T18:09:13.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b65f60 con 0x7f2d40019040 2024-05-08T18:09:13.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94529977207072] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94529977211440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b65440 con 0x7f2d40019040 2024-05-08T18:09:13.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.895+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b66ce0 con 0x7f2d40019040 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94529977211440] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94529977214896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b66ca0 con 0x7f2d40019040 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=0 2024-05-08T18:09:13.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=1 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=2 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=3 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=4 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=5 2024-05-08T18:09:13.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=6 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94529977214896] v30'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 20 add_watcher() i=7 2024-05-08T18:09:13.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b6a100 con 0x55f979b56c40 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.899+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94529977213248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b67650 con 0x55f979b56c40 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94529977213248] v30'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2c067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 5 note: GC not initialized 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2c057e2640 20 reqs_thread_entry: start 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 Filter name: none 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2bfe7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:09:13.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8dd60 con 0x7f2d40019040 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 rados->read ofs=0 len=0 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8c2f0 con 0x7f2d40019040 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:09:13.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:09:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:09:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.903+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b90ac0 con 0x7f2d40019040 2024-05-08T18:09:13.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v30'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T18:09:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:09:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T18:09:13.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94529977387712 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b91570 con 0x7f2d380bf040 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== watch-notify(notify (1) cookie 94529977204816 notify 128849018901 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f2d40010040 con 0x7f2d380bf040 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2c32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018901 cookie 94529977204816 notifier 4534 bl.length()=610 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2c32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2c32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(65 notify.3 [notify cookie 94529977387712 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2c32ffd640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2c14003eb0 con 0x7f2d380bf040 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== watch-notify(notify_complete (2) cookie 94529977387712 notify 128849018901 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2d400269d0 con 0x7f2d380bf040 2024-05-08T18:09:13.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b90ac0 con 0x7f2d40019040 2024-05-08T18:09:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:09:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:09:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.907+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94529977387712 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f979b91570 con 0x55f979b5ce40 2024-05-08T18:09:13.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== watch-notify(notify (1) cookie 94529977199984 notify 128849018884 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55f979b4bf70 con 0x55f979b5ce40 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2c32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94529977199984 notifier 4534 bl.length()=192 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2c32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2c32ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2c32ffd640 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f2c14003eb0 con 0x55f979b5ce40 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(68 notify.2 [notify cookie 94529977387712 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== watch-notify(notify_complete (2) cookie 94529977387712 notify 128849018884 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f979b4bce0 con 0x55f979b5ce40 2024-05-08T18:09:13.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.912 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:09:13.907991Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:13.907977Z","tags":[],"group_ids":[]} 2024-05-08T18:09:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2c067e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:13.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94529977213248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x55f979b56c40 2024-05-08T18:09:13.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94529977213248] v30'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.911+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94529977191952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x7f2d380bf040 2024-05-08T18:09:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94529977191952] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d51710980 20 remove_watcher() i=0 2024-05-08T18:09:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d51710980 2 removed watcher, disabling cache 2024-05-08T18:09:13.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94529977196208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x55f979b56c40 2024-05-08T18:09:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94529977196208] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d51710980 20 remove_watcher() i=1 2024-05-08T18:09:13.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.915+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94529977199984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x55f979b5ce40 2024-05-08T18:09:13.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.919+0000 7f2d4ea23640 1 -- 172.21.15.114:0/1574605810 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94529977199984] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d380ce020 con 0x55f979b5ce40 2024-05-08T18:09:13.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.919+0000 7f2d51710980 20 remove_watcher() i=2 2024-05-08T18:09:13.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.919+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94529977204816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x7f2d380bf040 2024-05-08T18:09:13.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.919+0000 7f2d4fa25640 1 -- 172.21.15.114:0/1574605810 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94529977204816] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d4002f040 con 0x7f2d380bf040 2024-05-08T18:09:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.919+0000 7f2d51710980 20 remove_watcher() i=3 2024-05-08T18:09:13.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.919+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94529977202320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x55f979b56c40 2024-05-08T18:09:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.923+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94529977202320] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x55f979b56c40 2024-05-08T18:09:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.923+0000 7f2d51710980 20 remove_watcher() i=4 2024-05-08T18:09:13.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.923+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94529977207072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x7f2d40019040 2024-05-08T18:09:13.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.923+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94529977207072] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.923+0000 7f2d51710980 20 remove_watcher() i=5 2024-05-08T18:09:13.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.923+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94529977211440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x7f2d40019040 2024-05-08T18:09:13.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94529977211440] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 20 remove_watcher() i=6 2024-05-08T18:09:13.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94529977214896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f979b8b860 con 0x7f2d40019040 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94529977214896] v30'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2d48027030 con 0x7f2d40019040 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 20 remove_watcher() i=7 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d40019040 msgr2=0x7f2d40019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2d40019040 0x7f2d40019930 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979b56c40 msgr2=0x55f979b590e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979b56c40 0x55f979b590e0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d380bf040 msgr2=0x7f2d380bc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2d380bf040 0x7f2d380bc580 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f979b5ce40 msgr2=0x55f979b5f230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f979b5ce40 0x55f979b5f230 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c180383f0 msgr2=0x7f2c1803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c180383f0 0x7f2c1803a8b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000f010 tx=0x7f2d4001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:13.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d4f224640 1 -- 172.21.15.114:0/1574605810 reap_dead start 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 msgr2=0x55f979b4b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b4b7a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2d380d1f60 tx=0x7f2d380ea4f0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 shutdown_connections 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/1574605810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b442a0 0x55f979b4b7a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 >> 172.21.15.114:0/1574605810 conn(0x55f979b405e0 msgr2=0x55f979b3dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 shutdown_connections 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/1574605810 wait complete. 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c280383f0 msgr2=0x7f2c2803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c280383f0 0x7f2c2803a8b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f979b27630 tx=0x7f2d40003070 comp rx=0 tx=0).stop 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 msgr2=0x55f979b375c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 0x55f979b375c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2d38018f70 tx=0x7f2d380180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 shutdown_connections 2024-05-08T18:09:13.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c280383f0 0x7f2c2803a8b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 --2- 172.21.15.114:0/3289423199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f979b371a0 0x55f979b375c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 >> 172.21.15.114:0/3289423199 conn(0x55f979b2bfb0 msgr2=0x55f979b2cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 shutdown_connections 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.927+0000 7f2d51710980 1 -- 172.21.15.114:0/3289423199 wait complete. 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979a31670 msgr2=0x55f979b26430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979a31670 0x55f979b26430 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c34038440 msgr2=0x7f2c3403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c34038440 0x7f2c3403a900 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d380ae000 tx=0x7f2d380a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 msgr2=0x55f979b1f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b1f460 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55f979b18e70 tx=0x7f2d48001260 comp rx=0 tx=0).stop 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 shutdown_connections 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f979a31670 0x55f979b26430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2c34038440 0x7f2c3403a900 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 --2- 172.21.15.114:0/619513596 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f97999f780 0x55f979b1f460 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 >> 172.21.15.114:0/619513596 conn(0x55f979a25630 msgr2=0x55f979b12680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 shutdown_connections 2024-05-08T18:09:13.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:13.931+0000 7f2d51710980 1 -- 172.21.15.114:0/619513596 wait complete. 2024-05-08T18:09:13.941 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:09:13.907991Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:13.907977Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:13.941 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:09:13.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:09:13.942 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-08T18:09:14.019 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:14.019 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:14.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400d36f980 1 Processor -- start 2024-05-08T18:09:14.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400d36f980 1 -- start start 2024-05-08T18:09:14.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400d36f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b297a32550 0x55b297a34940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400d36f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2978d7710 con 0x55b297a2e090 2024-05-08T18:09:14.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400d36f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b2978ebf00 con 0x55b297a32550 2024-05-08T18:09:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400a682640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b297a32550 0x55b297a34940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400a682640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b297a32550 0x55b297a34940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58874/0 (socket says 172.21.15.114:58874) 2024-05-08T18:09:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400a682640 1 -- 172.21.15.114:0/3116559660 learned_addr learned my addr 172.21.15.114:0/3116559660 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400ae83640 1 --1- 172.21.15.114:0/3116559660 >> v1:172.21.15.53:6789/0 conn(0x55b297a2e090 0x55b297a2e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34770/0 (socket says 172.21.15.114:34770) 2024-05-08T18:09:14.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400a682640 1 -- 172.21.15.114:0/3116559660 >> v1:172.21.15.53:6789/0 conn(0x55b297a2e090 legacy=0x55b297a2e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.019+0000 7f400a682640 1 -- 172.21.15.114:0/3116559660 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2978b3ae0 con 0x55b297a32550 2024-05-08T18:09:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400a682640 1 --2- 172.21.15.114:0/3116559660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a32550 0x55b297a34940 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f400000a5c0 tx=0x7f400001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b4684ec389595c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f4009e81640 1 -- 172.21.15.114:0/3116559660 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000a6070 con 0x55b297a32550 2024-05-08T18:09:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f4009e81640 1 -- 172.21.15.114:0/3116559660 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40000af070 con 0x55b297a32550 2024-05-08T18:09:14.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f4009e81640 1 -- 172.21.15.114:0/3116559660 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000aa5c0 con 0x55b297a32550 2024-05-08T18:09:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 -- 172.21.15.114:0/3116559660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a32550 msgr2=0x55b297a34940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 --2- 172.21.15.114:0/3116559660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a32550 0x55b297a34940 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f400000a5c0 tx=0x7f400001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 -- 172.21.15.114:0/3116559660 shutdown_connections 2024-05-08T18:09:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 --2- 172.21.15.114:0/3116559660 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a32550 0x55b297a34940 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 -- 172.21.15.114:0/3116559660 >> 172.21.15.114:0/3116559660 conn(0x55b2979a1770 msgr2=0x55b2979a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 -- 172.21.15.114:0/3116559660 shutdown_connections 2024-05-08T18:09:14.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.023+0000 7f400d36f980 1 -- 172.21.15.114:0/3116559660 wait complete. 2024-05-08T18:09:14.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400d36f980 1 Processor -- start 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400d36f980 1 -- start start 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400d36f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b19100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400d36f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b29792ff80 con 0x55b297a2e090 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400ae83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b19100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400ae83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b19100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58884/0 (socket says 172.21.15.114:58884) 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.039+0000 7f400ae83640 1 -- 172.21.15.114:0/2203901238 learned_addr learned my addr 172.21.15.114:0/2203901238 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 -- 172.21.15.114:0/2203901238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2978f7da0 con 0x55b297a2e090 2024-05-08T18:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 --2- 172.21.15.114:0/2203901238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b19100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00b270 tx=0x7f3ffc00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f762e3bf1df76f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f3ef8e09640 1 -- 172.21.15.114:0/2203901238 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc00e5d0 con 0x55b297a2e090 2024-05-08T18:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f3ef8e09640 1 -- 172.21.15.114:0/2203901238 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00e770 con 0x55b297a2e090 2024-05-08T18:09:14.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f3ef8e09640 1 -- 172.21.15.114:0/2203901238 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc00ea70 con 0x55b297a2e090 2024-05-08T18:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- 172.21.15.114:0/2203901238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 msgr2=0x55b297b19100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 --2- 172.21.15.114:0/2203901238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b19100 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00b270 tx=0x7f3ffc00b670 comp rx=0 tx=0).stop 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- 172.21.15.114:0/2203901238 shutdown_connections 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 --2- 172.21.15.114:0/2203901238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b19100 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- 172.21.15.114:0/2203901238 >> 172.21.15.114:0/2203901238 conn(0x55b2979a1770 msgr2=0x55b297b14c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- 172.21.15.114:0/2203901238 shutdown_connections 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- 172.21.15.114:0/2203901238 wait complete. 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 Processor -- start 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- start start 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400d36f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b297a37970 con 0x55b297a2e090 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58890/0 (socket says 172.21.15.114:58890) 2024-05-08T18:09:14.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 -- 172.21.15.114:0/3775720022 learned_addr learned my addr 172.21.15.114:0/3775720022 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b297b20b30 con 0x55b297a2e090 2024-05-08T18:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f400ae83640 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b205f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00b6b0 tx=0x7f3ffc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.043+0000 7f3ef7606640 1 -- 172.21.15.114:0/3775720022 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc00be70 con 0x55b297a2e090 2024-05-08T18:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b297b20dc0 con 0x55b297a2e090 2024-05-08T18:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f3ef7606640 1 -- 172.21.15.114:0/3775720022 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ffc00fa40 con 0x55b297a2e090 2024-05-08T18:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f3ef7606640 1 -- 172.21.15.114:0/3775720022 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ffc00fd80 con 0x55b297a2e090 2024-05-08T18:09:14.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b297b23a50 con 0x55b297a2e090 2024-05-08T18:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f3ef7606640 1 -- 172.21.15.114:0/3775720022 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3ffc017070 con 0x55b297a2e090 2024-05-08T18:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f3ef7606640 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ef00383f0 0x7f3ef003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f3ef7606640 1 -- 172.21.15.114:0/3775720022 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f3ffc015020 con 0x55b297a2e090 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400a682640 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ef00383f0 0x7f3ef003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297a32550 0x55b297b27570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b27bb0 con 0x55b297a32550 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400b684640 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297a32550 0x55b297b27570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400a682640 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ef00383f0 0x7f3ef003a8b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f40000ae000 tx=0x7f40000a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400b684640 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297a32550 0x55b297b27570 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400b684640 1 -- 172.21.15.114:0/3775720022 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f400400a4d0 con 0x55b297a32550 2024-05-08T18:09:14.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b24c70 con 0x55b297a32550 2024-05-08T18:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400b684640 1 -- 172.21.15.114:0/3775720022 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f400400a4d0 con 0x55b297a32550 2024-05-08T18:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b299f0 con 0x55b297a32550 2024-05-08T18:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400b684640 1 -- 172.21.15.114:0/3775720022 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f400400a4d0 con 0x55b297a32550 2024-05-08T18:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b28c20 con 0x55b297a32550 2024-05-08T18:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.047+0000 7f400b684640 1 -- 172.21.15.114:0/3775720022 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f400400a4d0 con 0x55b297a32550 2024-05-08T18:09:14.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b29040 con 0x55b297a32550 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400b684640 1 -- 172.21.15.114:0/3775720022 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f400400a4d0 con 0x55b297a32550 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 Processor -- start 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 -- start start 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 0x55b297b38790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b297933fc0 con 0x55b297b38370 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 0x55b297b38790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 0x55b297b38790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58894/0 (socket says 172.21.15.114:58894) 2024-05-08T18:09:14.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400a682640 1 -- 172.21.15.114:0/4088837790 learned_addr learned my addr 172.21.15.114:0/4088837790 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400a682640 1 -- 172.21.15.114:0/4088837790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b297b38cd0 con 0x55b297b38370 2024-05-08T18:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400a682640 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 0x55b297b38790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40000ac040 tx=0x7f40000180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f3ef4e01640 1 -- 172.21.15.114:0/4088837790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000b3b90 con 0x55b297b38370 2024-05-08T18:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f3ef4e01640 1 -- 172.21.15.114:0/4088837790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40000b3d30 con 0x55b297b38370 2024-05-08T18:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f3ef4e01640 1 -- 172.21.15.114:0/4088837790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000c8560 con 0x55b297b38370 2024-05-08T18:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b297b39770 con 0x55b297b38370 2024-05-08T18:09:14.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.051+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b297b39be0 con 0x55b297b38370 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f3ef4e01640 1 -- 172.21.15.114:0/4088837790 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f40000d1440 con 0x55b297b38370 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f3ef4e01640 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ee4038440 0x7f3ee403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f3ef4e01640 1 -- 172.21.15.114:0/4088837790 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f40000ebfe0 con 0x55b297b38370 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400b684640 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ee4038440 0x7f3ee403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 Processor -- start 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- start start 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400b684640 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ee4038440 0x7f3ee403a900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55b297b28fc0 tx=0x7f4004005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b45800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b297b19850 con 0x55b297b453e0 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b45800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b45800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58902/0 (socket says 172.21.15.114:58902) 2024-05-08T18:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400a682640 1 -- 172.21.15.114:0/2587646867 learned_addr learned my addr 172.21.15.114:0/2587646867 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400a682640 1 -- 172.21.15.114:0/2587646867 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b297b45dd0 con 0x55b297b453e0 2024-05-08T18:09:14.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400a682640 1 --2- 172.21.15.114:0/2587646867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b45800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40000befd0 tx=0x7f40000bccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3a2ba7b928a7a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f3eee7fc640 1 -- 172.21.15.114:0/2587646867 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000d1730 con 0x55b297b453e0 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f3eee7fc640 1 -- 172.21.15.114:0/2587646867 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40000d18d0 con 0x55b297b453e0 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f3eee7fc640 1 -- 172.21.15.114:0/2587646867 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000bd390 con 0x55b297b453e0 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- 172.21.15.114:0/2587646867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 msgr2=0x55b297b45800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 --2- 172.21.15.114:0/2587646867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b45800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f40000befd0 tx=0x7f40000bccd0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- 172.21.15.114:0/2587646867 shutdown_connections 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 --2- 172.21.15.114:0/2587646867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b45800 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- 172.21.15.114:0/2587646867 >> 172.21.15.114:0/2587646867 conn(0x55b297b41770 msgr2=0x55b297b3f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- 172.21.15.114:0/2587646867 shutdown_connections 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- 172.21.15.114:0/2587646867 wait complete. 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 Processor -- start 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.055+0000 7f400d36f980 1 -- start start 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b4c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b297b46520 con 0x55b297b453e0 2024-05-08T18:09:14.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b4c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400a682640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b4c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58904/0 (socket says 172.21.15.114:58904) 2024-05-08T18:09:14.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 learned_addr learned my addr 172.21.15.114:0/2357953795 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b297b4ce90 con 0x55b297b453e0 2024-05-08T18:09:14.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400a682640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b4c950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40000befd0 tx=0x7f40000ea320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f3eecff9640 1 -- 172.21.15.114:0/2357953795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000d1730 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b297b4d120 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f3eecff9640 1 -- 172.21.15.114:0/2357953795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40000c7ae0 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b297b4fe00 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f3eecff9640 1 -- 172.21.15.114:0/2357953795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40000c7dc0 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f3eecff9640 1 -- 172.21.15.114:0/2357953795 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f40000bf970 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f3eecff9640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ed40383f0 0x7f3ed403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f3eecff9640 1 -- 172.21.15.114:0/2357953795 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f40000e1070 con 0x55b297b453e0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400b684640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ed40383f0 0x7f3ed403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297b57df0 0x55b297b5a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5a9e0 con 0x55b297b57df0 2024-05-08T18:09:14.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.059+0000 7f400ae83640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297b57df0 0x55b297b5a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400b684640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ed40383f0 0x7f3ed403a8b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55b297b28740 tx=0x7f400401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297b57df0 0x55b297b5a290 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 realm 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5adf0 con 0x55b297b57df0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5b6c0 con 0x55b297b57df0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5ba60 con 0x55b297b57df0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5c2b0 con 0x55b297b57df0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 20 searching for the correct realm 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b297b5dce0 0x55b297b601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400a682640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b297b5dce0 0x55b297b601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400a682640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b297b5dce0 0x55b297b601a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400a682640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4000009040 0x7f40000bc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4000009040 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400b684640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4000009040 0x7f40000bc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400b684640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4000009040 0x7f40000bc550 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f400401f070 con 0x7f4000009040 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400b684640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4004031040 0x7f4004032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.063+0000 7f400ae83640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4004031040 0x7f4004032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4004031040 0x7f4004032940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4000009040 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f400401f070 con 0x7f4000009040 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.067+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4000009040 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f400401f070 con 0x7f4000009040 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.071+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4000009040 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f400401f070 con 0x7f4000009040 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4000009040 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f400401f070 con 0x7f4000009040 2024-05-08T18:09:14.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b5dce0 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.075+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4004031040 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x55b297b57df0 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60870 con 0x7f4000009040 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f400401f070 con 0x7f4000009040 2024-05-08T18:09:14.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5bf00 con 0x55b297b57df0 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b5d000 con 0x55b297b57df0 2024-05-08T18:09:14.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b60cf0 con 0x55b297b57df0 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 zone default found 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 4 Realm: () 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 zonegroup default 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b61540 con 0x7f4004031040 2024-05-08T18:09:14.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b62f20 con 0x55b297b5dce0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b632e0 con 0x55b297b5dce0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 started sync module instance, tier type = 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:14.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.079+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b623b0 con 0x7f4000009040 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94225537836960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b62010 con 0x7f4000009040 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b64210 con 0x55b297b57df0 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94225537836960] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94225537840960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b64210 con 0x55b297b57df0 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.083+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b64bd0 con 0x55b297b5dce0 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94225537845024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b65420 con 0x55b297b5dce0 2024-05-08T18:09:14.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b65e20 con 0x7f4000009040 2024-05-08T18:09:14.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94225537840960] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94225537842528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b66210 con 0x7f4000009040 2024-05-08T18:09:14.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b66bd0 con 0x55b297b57df0 2024-05-08T18:09:14.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.087+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94225537845024] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94225537842528] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94225537849648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b66720 con 0x55b297b57df0 2024-05-08T18:09:14.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b66f70 con 0x7f4004031040 2024-05-08T18:09:14.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94225537849648] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94225537853216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b67360 con 0x7f4004031040 2024-05-08T18:09:14.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.091+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b67bb0 con 0x7f4004031040 2024-05-08T18:09:14.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94225537856352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b67cb0 con 0x7f4004031040 2024-05-08T18:09:14.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b687d0 con 0x7f4004031040 2024-05-08T18:09:14.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94225537853216] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94225537856352] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94225537860256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b68790 con 0x7f4004031040 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=0 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=1 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=2 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=3 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=4 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=5 2024-05-08T18:09:14.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.095+0000 7f400d36f980 20 add_watcher() i=6 2024-05-08T18:09:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94225537860256] v30'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 20 add_watcher() i=7 2024-05-08T18:09:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:14.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b6b7c0 con 0x55b297b57df0 2024-05-08T18:09:14.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94225537854272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b68c40 con 0x55b297b57df0 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94225537854272] v30'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f3ec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f400d36f980 5 note: GC not initialized 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.099+0000 7f3ec0fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 Filter name: none 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f3eb9ffb640 20 reqs_thread_entry: start 2024-05-08T18:09:14.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:09:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b8f260 con 0x7f4004031040 2024-05-08T18:09:14.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b8ecb0 con 0x7f4000009040 2024-05-08T18:09:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:14.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b92a30 con 0x55b297b57df0 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(64 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-08T18:09:14.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.103+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b96fc0 con 0x7f4000009040 2024-05-08T18:09:14.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 8.f 8:f78b91c5:root::.bucket.meta.testx%3amyfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b9a8d0 con 0x55b297b5dce0 2024-05-08T18:09:14.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [create,call,writefull 0~412,setxattr (203)] v30'3 uv3 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400d36f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x7 2024-05-08T18:09:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400d36f980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400d36f980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:09:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400d36f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.107+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 7.9 7:93e5b521:::notify.7:head [notify cookie 94225538057216 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b9a000 con 0x7f4004031040 2024-05-08T18:09:14.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== watch-notify(notify (1) cookie 94225537860256 notify 128849018888 ret 0) ==== 889+0+0 (crc 0 0 0) 0x55b297b92000 con 0x7f4004031040 2024-05-08T18:09:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f3eee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94225537860256 notifier 4541 bl.length()=847 2024-05-08T18:09:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(67 notify.7 [notify cookie 94225538057216 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f3eee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x7 2024-05-08T18:09:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f3eee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f3eee7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:09:14.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f3eee7fc640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:68 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3ed0003eb0 con 0x7f4004031040 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== watch-notify(notify_complete (2) cookie 94225538057216 notify 128849018888 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3ffc045020 con 0x7f4004031040 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(68 notify.7 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400d36f980 20 handle_bi_update(): bucket=testx:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_sources= new_sources= 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400d36f980 20 handle_bi_update(): bucket=testx:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential sources added=[] removed=[] 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400d36f980 20 handle_bi_update(): bucket=testx:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_dests= new_dests= 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400d36f980 20 handle_bi_update(): bucket=testx:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential dests added=[] removed=[] 2024-05-08T18:09:14.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b9a430 con 0x55b297b57df0 2024-05-08T18:09:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.111+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b99f80 con 0x55b297b57df0 2024-05-08T18:09:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T18:09:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:09:14.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94225538064256 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b9afa0 con 0x55b297b57df0 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify (1) cookie 94225537849648 notify 128849018891 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55b297b99c50 con 0x55b297b57df0 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f3eee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94225537849648 notifier 4541 bl.length()=348 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f3eee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f3eee7fc640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f3eee7fc640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3ed0003eb0 con 0x55b297b57df0 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(71 notify.4 [notify cookie 94225538064256 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94225538064256 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3ffc045020 con 0x55b297b57df0 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b98400 con 0x7f4000009040 2024-05-08T18:09:14.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(73 myfoo [call,delete] v30'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:09:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.115+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94225538064256 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b978a0 con 0x7f4004031040 2024-05-08T18:09:14.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== watch-notify(notify (1) cookie 94225537856352 notify 128849018889 ret 0) ==== 191+0+0 (crc 0 0 0) 0x7f3ffc045020 con 0x7f4004031040 2024-05-08T18:09:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f3eedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94225537856352 notifier 4541 bl.length()=149 2024-05-08T18:09:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(74 notify.6 [notify cookie 94225538064256 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f3eedffb640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3e340032d0 con 0x7f4004031040 2024-05-08T18:09:14.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== watch-notify(notify_complete (2) cookie 94225538064256 notify 128849018889 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b297b23a50 con 0x7f4004031040 2024-05-08T18:09:14.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b973f0 con 0x55b297b57df0 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(76 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call,delete] v30'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400d36f980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 from cache 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400d36f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:77 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94225538064000 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55b297b90e90 con 0x7f4000009040 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== watch-notify(notify (1) cookie 94225537836960 notify 128849018902 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f4004043420 con 0x7f4000009040 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f3eedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018902 cookie 94225537836960 notifier 4541 bl.length()=206 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(77 notify.0 [notify cookie 94225538064000 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.119+0000 7f3eedffb640 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3e340032d0 con 0x7f4000009040 2024-05-08T18:09:14.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(78 notify.0 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== watch-notify(notify_complete (2) cookie 94225538064000 notify 128849018902 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4004024680 con 0x7f4000009040 2024-05-08T18:09:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f3ec1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94225537854272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b8cdf0 con 0x55b297b57df0 2024-05-08T18:09:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94225537854272] v30'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94225537836960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b8cdf0 con 0x7f4000009040 2024-05-08T18:09:14.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94225537836960] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400d36f980 20 remove_watcher() i=0 2024-05-08T18:09:14.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400d36f980 2 removed watcher, disabling cache 2024-05-08T18:09:14.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.123+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94225537840960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b8cdf0 con 0x55b297b57df0 2024-05-08T18:09:14.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.127+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94225537840960] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.127+0000 7f400d36f980 20 remove_watcher() i=1 2024-05-08T18:09:14.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.127+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94225537845024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b8cdf0 con 0x55b297b5dce0 2024-05-08T18:09:14.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.127+0000 7f400a682640 1 -- 172.21.15.114:0/2357953795 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94225537845024] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40000ce020 con 0x55b297b5dce0 2024-05-08T18:09:14.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.127+0000 7f400d36f980 20 remove_watcher() i=2 2024-05-08T18:09:14.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.127+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94225537842528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b627a0 con 0x7f4000009040 2024-05-08T18:09:14.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.131+0000 7f400b684640 1 -- 172.21.15.114:0/2357953795 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94225537842528] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4004040040 con 0x7f4000009040 2024-05-08T18:09:14.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.131+0000 7f400d36f980 20 remove_watcher() i=3 2024-05-08T18:09:14.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.131+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94225537849648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b63740 con 0x55b297b57df0 2024-05-08T18:09:14.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.131+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94225537849648] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x55b297b57df0 2024-05-08T18:09:14.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.131+0000 7f400d36f980 20 remove_watcher() i=4 2024-05-08T18:09:14.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.131+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94225537853216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b64720 con 0x7f4004031040 2024-05-08T18:09:14.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.135+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94225537853216] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.135+0000 7f400d36f980 20 remove_watcher() i=5 2024-05-08T18:09:14.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.135+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94225537856352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b627a0 con 0x7f4004031040 2024-05-08T18:09:14.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.135+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94225537856352] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.135+0000 7f400d36f980 20 remove_watcher() i=6 2024-05-08T18:09:14.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.135+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94225537860256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55b297b64720 con 0x7f4004031040 2024-05-08T18:09:14.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94225537860256] v30'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3ffc02e070 con 0x7f4004031040 2024-05-08T18:09:14.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 20 remove_watcher() i=7 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4004031040 msgr2=0x7f4004032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4004031040 0x7f4004032940 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297b57df0 msgr2=0x55b297b5a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297b57df0 0x55b297b5a290 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4000009040 msgr2=0x7f40000bc550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f4000009040 0x7f40000bc550 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b297b5dce0 msgr2=0x55b297b601a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b297b5dce0 0x55b297b601a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ed40383f0 msgr2=0x7f3ed403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ed40383f0 0x7f3ed403a8b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55b297b28740 tx=0x7f400401f000 comp rx=0 tx=0).stop 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 msgr2=0x55b297b4c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b4c950 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40000befd0 tx=0x7f40000ea320 comp rx=0 tx=0).stop 2024-05-08T18:09:14.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400ae83640 1 -- 172.21.15.114:0/2357953795 reap_dead start 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 shutdown_connections 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/2357953795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b453e0 0x55b297b4c950 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 >> 172.21.15.114:0/2357953795 conn(0x55b297b41770 msgr2=0x55b297b46c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 shutdown_connections 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/2357953795 wait complete. 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ee4038440 msgr2=0x7f3ee403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ee4038440 0x7f3ee403a900 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x55b297b28fc0 tx=0x7f4004005850 comp rx=0 tx=0).stop 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 msgr2=0x55b297b38790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 0x55b297b38790 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f40000ac040 tx=0x7f40000180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 shutdown_connections 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ee4038440 0x7f3ee403a900 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/4088837790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297b38370 0x55b297b38790 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 >> 172.21.15.114:0/4088837790 conn(0x55b297b2d180 msgr2=0x55b297b2dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 shutdown_connections 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/4088837790 wait complete. 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297a32550 msgr2=0x55b297b27570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297a32550 0x55b297b27570 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ef00383f0 msgr2=0x7f3ef003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ef00383f0 0x7f3ef003a8b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f40000ae000 tx=0x7f40000a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 msgr2=0x55b297b205f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b205f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc00b6b0 tx=0x7f3ffc000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 shutdown_connections 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b297a32550 0x55b297b27570 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ef00383f0 0x7f3ef003a8b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 --2- 172.21.15.114:0/3775720022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b297a2e090 0x55b297b205f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 >> 172.21.15.114:0/3775720022 conn(0x55b2979a1770 msgr2=0x55b297b137a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 shutdown_connections 2024-05-08T18:09:14.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.139+0000 7f400d36f980 1 -- 172.21.15.114:0/3775720022 wait complete. 2024-05-08T18:09:14.152 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T18:09:14.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T18:09:14.153 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-08T18:09:14.229 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:14.229 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02e3ee980 1 Processor -- start 2024-05-08T18:09:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02e3ee980 1 -- start start 2024-05-08T18:09:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02e3ee980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555bff1525a0 0x555bff154990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02e3ee980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555bfeff7710 con 0x555bff14e390 2024-05-08T18:09:14.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02e3ee980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555bff00bf00 con 0x555bff1525a0 2024-05-08T18:09:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02b701640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555bff1525a0 0x555bff154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02bf02640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555bff14e390 0x555bff14e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34772/0 (socket says 172.21.15.114:34772) 2024-05-08T18:09:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02b701640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555bff1525a0 0x555bff154990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58916/0 (socket says 172.21.15.114:58916) 2024-05-08T18:09:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02bf02640 1 -- 172.21.15.114:0/3725694344 learned_addr learned my addr 172.21.15.114:0/3725694344 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02b701640 1 -- 172.21.15.114:0/3725694344 >> v1:172.21.15.53:6789/0 conn(0x555bff14e390 legacy=0x555bff14e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.231+0000 7fe02b701640 1 -- 172.21.15.114:0/3725694344 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bfefd3ae0 con 0x555bff1525a0 2024-05-08T18:09:14.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02b701640 1 --2- 172.21.15.114:0/3725694344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff1525a0 0x555bff154990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe02000a480 tx=0x7fe02001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0573f023ebab6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02af00640 1 -- 172.21.15.114:0/3725694344 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200b0070 con 0x555bff1525a0 2024-05-08T18:09:14.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02af00640 1 -- 172.21.15.114:0/3725694344 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200ab540 con 0x555bff1525a0 2024-05-08T18:09:14.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02af00640 1 -- 172.21.15.114:0/3725694344 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200ab840 con 0x555bff1525a0 2024-05-08T18:09:14.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3725694344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff1525a0 msgr2=0x555bff154990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/3725694344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff1525a0 0x555bff154990 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe02000a480 tx=0x7fe02001b280 comp rx=0 tx=0).stop 2024-05-08T18:09:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3725694344 shutdown_connections 2024-05-08T18:09:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/3725694344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff1525a0 0x555bff154990 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3725694344 >> 172.21.15.114:0/3725694344 conn(0x555bff0c17e0 msgr2=0x555bff0c1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3725694344 shutdown_connections 2024-05-08T18:09:14.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.235+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3725694344 wait complete. 2024-05-08T18:09:14.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02e3ee980 1 Processor -- start 2024-05-08T18:09:14.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02e3ee980 1 -- start start 2024-05-08T18:09:14.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02e3ee980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff2391f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02e3ee980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555bff04ff80 con 0x555bff14e390 2024-05-08T18:09:14.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02bf02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff2391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02bf02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff2391f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58932/0 (socket says 172.21.15.114:58932) 2024-05-08T18:09:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02bf02640 1 -- 172.21.15.114:0/1904118821 learned_addr learned my addr 172.21.15.114:0/1904118821 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02bf02640 1 -- 172.21.15.114:0/1904118821 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bff017da0 con 0x555bff14e390 2024-05-08T18:09:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fe02bf02640 1 --2- 172.21.15.114:0/1904118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff2391f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe01c001810 tx=0x7fe01c001cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9211b9374c70a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fdf19e0b640 1 -- 172.21.15.114:0/1904118821 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe01c004530 con 0x555bff14e390 2024-05-08T18:09:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fdf19e0b640 1 -- 172.21.15.114:0/1904118821 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01c0046d0 con 0x555bff14e390 2024-05-08T18:09:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.251+0000 7fdf19e0b640 1 -- 172.21.15.114:0/1904118821 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe01c0049f0 con 0x555bff14e390 2024-05-08T18:09:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1904118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 msgr2=0x555bff2391f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1904118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff2391f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe01c001810 tx=0x7fe01c001cd0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1904118821 shutdown_connections 2024-05-08T18:09:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1904118821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff2391f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1904118821 >> 172.21.15.114:0/1904118821 conn(0x555bff0c17e0 msgr2=0x555bff234d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1904118821 shutdown_connections 2024-05-08T18:09:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1904118821 wait complete. 2024-05-08T18:09:14.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 Processor -- start 2024-05-08T18:09:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- start start 2024-05-08T18:09:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff240720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555bff1579c0 con 0x555bff14e390 2024-05-08T18:09:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02bf02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff240720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02bf02640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff240720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58946/0 (socket says 172.21.15.114:58946) 2024-05-08T18:09:14.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02bf02640 1 -- 172.21.15.114:0/1095099467 learned_addr learned my addr 172.21.15.114:0/1095099467 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02bf02640 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bff240c60 con 0x555bff14e390 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02bf02640 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff240720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe01c000f90 tx=0x7fe01c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fdf13fff640 1 -- 172.21.15.114:0/1095099467 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe01c013820 con 0x555bff14e390 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fdf13fff640 1 -- 172.21.15.114:0/1095099467 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01c0139c0 con 0x555bff14e390 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bff240ef0 con 0x555bff14e390 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fdf13fff640 1 -- 172.21.15.114:0/1095099467 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe01c013ca0 con 0x555bff14e390 2024-05-08T18:09:14.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.255+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bff243b30 con 0x555bff14e390 2024-05-08T18:09:14.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fdf13fff640 1 -- 172.21.15.114:0/1095099467 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe01c010070 con 0x555bff14e390 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fdf13fff640 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf140383f0 0x7fdf1403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fdf13fff640 1 -- 172.21.15.114:0/1095099467 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fe01c018070 con 0x555bff14e390 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02b701640 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf140383f0 0x7fdf1403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff1525a0 0x555bff247610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff247c80 con 0x555bff1525a0 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff1525a0 0x555bff247610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02b701640 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf140383f0 0x7fdf1403a8b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe0200ad000 tx=0x7fe0200a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff1525a0 0x555bff247610 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 -- 172.21.15.114:0/1095099467 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe0240083f0 con 0x555bff1525a0 2024-05-08T18:09:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff244d50 con 0x555bff1525a0 2024-05-08T18:09:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 -- 172.21.15.114:0/1095099467 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe0240083f0 con 0x555bff1525a0 2024-05-08T18:09:14.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff249ac0 con 0x555bff1525a0 2024-05-08T18:09:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 -- 172.21.15.114:0/1095099467 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe0240083f0 con 0x555bff1525a0 2024-05-08T18:09:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff248cf0 con 0x555bff1525a0 2024-05-08T18:09:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 -- 172.21.15.114:0/1095099467 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe0240083f0 con 0x555bff1525a0 2024-05-08T18:09:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff249140 con 0x555bff1525a0 2024-05-08T18:09:14.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02c703640 1 -- 172.21.15.114:0/1095099467 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe0240083f0 con 0x555bff1525a0 2024-05-08T18:09:14.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 Processor -- start 2024-05-08T18:09:14.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.259+0000 7fe02e3ee980 1 -- start start 2024-05-08T18:09:14.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02e3ee980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 0x555bff258820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02e3ee980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555bff053fc0 con 0x555bff258400 2024-05-08T18:09:14.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02b701640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 0x555bff258820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02b701640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 0x555bff258820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58954/0 (socket says 172.21.15.114:58954) 2024-05-08T18:09:14.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02b701640 1 -- 172.21.15.114:0/1997640483 learned_addr learned my addr 172.21.15.114:0/1997640483 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02b701640 1 -- 172.21.15.114:0/1997640483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bff258d60 con 0x555bff258400 2024-05-08T18:09:14.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02b701640 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 0x555bff258820 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe02001b2c0 tx=0x7fe020018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fdf117fa640 1 -- 172.21.15.114:0/1997640483 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200c6070 con 0x555bff258400 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fdf117fa640 1 -- 172.21.15.114:0/1997640483 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200b7760 con 0x555bff258400 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fdf117fa640 1 -- 172.21.15.114:0/1997640483 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200b0040 con 0x555bff258400 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bff259800 con 0x555bff258400 2024-05-08T18:09:14.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bff259c70 con 0x555bff258400 2024-05-08T18:09:14.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fdf117fa640 1 -- 172.21.15.114:0/1997640483 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe0200c9070 con 0x555bff258400 2024-05-08T18:09:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fdf117fa640 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf040383f0 0x7fdf0403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fdf117fa640 1 -- 172.21.15.114:0/1997640483 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fe0200be030 con 0x555bff258400 2024-05-08T18:09:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.263+0000 7fe02c703640 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf040383f0 0x7fdf0403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 Processor -- start 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- start start 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02c703640 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf040383f0 0x7fdf0403a8b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x555bff248810 tx=0x7fe024003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff2658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555bff239940 con 0x555bff2654d0 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02b701640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff2658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02b701640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff2658f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58958/0 (socket says 172.21.15.114:58958) 2024-05-08T18:09:14.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02b701640 1 -- 172.21.15.114:0/3216542982 learned_addr learned my addr 172.21.15.114:0/3216542982 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02b701640 1 -- 172.21.15.114:0/3216542982 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bff265ec0 con 0x555bff2654d0 2024-05-08T18:09:14.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02b701640 1 --2- 172.21.15.114:0/3216542982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff2658f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe0200e91d0 tx=0x7fe020006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5666cc9f946e23d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fdf0affd640 1 -- 172.21.15.114:0/3216542982 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200caa00 con 0x555bff2654d0 2024-05-08T18:09:14.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fdf0affd640 1 -- 172.21.15.114:0/3216542982 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200ca3b0 con 0x555bff2654d0 2024-05-08T18:09:14.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fdf0affd640 1 -- 172.21.15.114:0/3216542982 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020006390 con 0x555bff2654d0 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3216542982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 msgr2=0x555bff2658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/3216542982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff2658f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe0200e91d0 tx=0x7fe020006ae0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3216542982 shutdown_connections 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/3216542982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff2658f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3216542982 >> 172.21.15.114:0/3216542982 conn(0x555bff261860 msgr2=0x555bff25f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3216542982 shutdown_connections 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- 172.21.15.114:0/3216542982 wait complete. 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 Processor -- start 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- start start 2024-05-08T18:09:14.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff26ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02e3ee980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555bff266610 con 0x555bff2654d0 2024-05-08T18:09:14.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.267+0000 7fe02b701640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff26ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02b701640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff26ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58964/0 (socket says 172.21.15.114:58964) 2024-05-08T18:09:14.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 learned_addr learned my addr 172.21.15.114:0/2579168871 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bff26cf80 con 0x555bff2654d0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02b701640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff26ca40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe0200b46d0 tx=0x7fe0200e9130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fdf097fa640 1 -- 172.21.15.114:0/2579168871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200c9580 con 0x555bff2654d0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bff26d210 con 0x555bff2654d0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bff26fef0 con 0x555bff2654d0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fdf097fa640 1 -- 172.21.15.114:0/2579168871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200c9720 con 0x555bff2654d0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fdf097fa640 1 -- 172.21.15.114:0/2579168871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0200c9910 con 0x555bff2654d0 2024-05-08T18:09:14.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fdf097fa640 1 -- 172.21.15.114:0/2579168871 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe0200c9ab0 con 0x555bff2654d0 2024-05-08T18:09:14.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fdf097fa640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef4038440 0x7fdef403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fdf097fa640 1 -- 172.21.15.114:0/2579168871 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fe0200a8070 con 0x555bff2654d0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02c703640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef4038440 0x7fdef403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff277ed0 0x555bff27a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27aac0 con 0x555bff277ed0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02bf02640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff277ed0 0x555bff27a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02c703640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef4038440 0x7fdef403a900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe02400f010 tx=0x7fe02401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.271+0000 7fe02bf02640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff277ed0 0x555bff27a370 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 realm 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27aed0 con 0x555bff277ed0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27b7a0 con 0x555bff277ed0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bb40 con 0x555bff277ed0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:14.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 20 searching for the correct realm 2024-05-08T18:09:14.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555bff27df10 0x555bff280300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff280980 con 0x555bff27df10 2024-05-08T18:09:14.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02b701640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555bff27df10 0x555bff280300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02b701640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555bff27df10 0x555bff280300 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02b701640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe0200cb060 0x7fe0200cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff280980 con 0x7fe0200cb060 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02c703640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe0200cb060 0x7fe0200cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02c703640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe0200cb060 0x7fe0200cb920 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02c703640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe024019040 0x7fe024019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff280980 con 0x7fe024019040 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.275+0000 7fe02bf02640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe024019040 0x7fe024019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe024019040 0x7fe024019930 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x7fe024019040 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x7fe024019040 2024-05-08T18:09:14.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x7fe024019040 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe0200cb060 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.279+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x7fe024019040 2024-05-08T18:09:14.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe0200cb060 2024-05-08T18:09:14.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x7fe024019040 2024-05-08T18:09:14.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.283+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c01b030 con 0x7fe024019040 2024-05-08T18:09:14.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe0200cb060 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe01c01b030 con 0x555bff277ed0 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe0200cb060 2024-05-08T18:09:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.287+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff27df10 2024-05-08T18:09:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe024019040 2024-05-08T18:09:14.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x555bff277ed0 2024-05-08T18:09:14.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555bff27bfa0 con 0x7fe0200cb060 2024-05-08T18:09:14.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27c880 con 0x555bff277ed0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27cc70 con 0x555bff277ed0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27cc70 con 0x555bff277ed0 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 zone default found 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 4 Realm: () 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 zonegroup default 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27d090 con 0x7fe024019040 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff27d4b0 con 0x555bff27df10 2024-05-08T18:09:14.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.291+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff2827c0 con 0x555bff27df10 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 20 started sync module instance, tier type = 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:14.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff281c60 con 0x7fe0200cb060 2024-05-08T18:09:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93853611204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff283010 con 0x7fe0200cb060 2024-05-08T18:09:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff283860 con 0x555bff277ed0 2024-05-08T18:09:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.295+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93853611204736] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93853611207520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff2834f0 con 0x555bff277ed0 2024-05-08T18:09:14.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff284010 con 0x555bff27df10 2024-05-08T18:09:14.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93853611211488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff2848b0 con 0x555bff27df10 2024-05-08T18:09:14.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff2852b0 con 0x7fe0200cb060 2024-05-08T18:09:14.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93853611207520] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93853611208576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff2856a0 con 0x7fe0200cb060 2024-05-08T18:09:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.299+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286060 con 0x555bff277ed0 2024-05-08T18:09:14.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.303+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93853611211488] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.303+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93853611208576] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.303+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.303+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93853611216320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff285bb0 con 0x555bff277ed0 2024-05-08T18:09:14.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.303+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286900 con 0x7fe024019040 2024-05-08T18:09:14.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.303+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93853611216320] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93853611213824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff285bb0 con 0x7fe024019040 2024-05-08T18:09:14.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286da0 con 0x7fe024019040 2024-05-08T18:09:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93853611213824] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93853611223152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286d60 con 0x7fe024019040 2024-05-08T18:09:14.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.307+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff2877a0 con 0x7fe024019040 2024-05-08T18:09:14.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93853611223152] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93853611225712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff287760 con 0x7fe024019040 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=0 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=1 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=2 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=3 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=4 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=5 2024-05-08T18:09:14.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=6 2024-05-08T18:09:14.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93853611225712] v30'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 20 add_watcher() i=7 2024-05-08T18:09:14.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:14.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff28abf0 con 0x555bff277ed0 2024-05-08T18:09:14.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.311+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93853611221360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff288110 con 0x555bff277ed0 2024-05-08T18:09:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93853611221360] v30'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fdee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:14.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 5 note: GC not initialized 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fdee0fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 20 Filter name: none 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fde5a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555bff2ae030 con 0x555bff277ed0 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T18:09:14.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fdee1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.315+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93853611221360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff28d2c0 con 0x555bff277ed0 2024-05-08T18:09:14.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.319+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93853611221360] v30'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.319+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93853611204736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286170 con 0x7fe0200cb060 2024-05-08T18:09:14.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.319+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93853611204736] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.319+0000 7fe02e3ee980 20 remove_watcher() i=0 2024-05-08T18:09:14.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.319+0000 7fe02e3ee980 2 removed watcher, disabling cache 2024-05-08T18:09:14.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.319+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93853611207520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286170 con 0x555bff277ed0 2024-05-08T18:09:14.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93853611207520] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02e3ee980 20 remove_watcher() i=1 2024-05-08T18:09:14.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93853611211488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff282b60 con 0x555bff27df10 2024-05-08T18:09:14.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02b701640 1 -- 172.21.15.114:0/2579168871 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93853611211488] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe0200c8030 con 0x555bff27df10 2024-05-08T18:09:14.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02e3ee980 20 remove_watcher() i=2 2024-05-08T18:09:14.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93853611208576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286170 con 0x7fe0200cb060 2024-05-08T18:09:14.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02c703640 1 -- 172.21.15.114:0/2579168871 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93853611208576] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe02402f040 con 0x7fe0200cb060 2024-05-08T18:09:14.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02e3ee980 20 remove_watcher() i=3 2024-05-08T18:09:14.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.323+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93853611216320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff283ae0 con 0x555bff277ed0 2024-05-08T18:09:14.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.327+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93853611216320] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x555bff277ed0 2024-05-08T18:09:14.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.327+0000 7fe02e3ee980 20 remove_watcher() i=4 2024-05-08T18:09:14.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.327+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93853611213824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff286170 con 0x7fe024019040 2024-05-08T18:09:14.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.331+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93853611213824] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.331+0000 7fe02e3ee980 20 remove_watcher() i=5 2024-05-08T18:09:14.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.331+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93853611223152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff284dc0 con 0x7fe024019040 2024-05-08T18:09:14.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.331+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93853611223152] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.331+0000 7fe02e3ee980 20 remove_watcher() i=6 2024-05-08T18:09:14.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.331+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93853611225712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555bff283ae0 con 0x7fe024019040 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93853611225712] v30'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01c05f040 con 0x7fe024019040 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 20 remove_watcher() i=7 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe024019040 msgr2=0x7fe024019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe024019040 0x7fe024019930 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff277ed0 msgr2=0x555bff27a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff277ed0 0x555bff27a370 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe0200cb060 msgr2=0x7fe0200cb920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe0200cb060 0x7fe0200cb920 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555bff27df10 msgr2=0x555bff280300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555bff27df10 0x555bff280300 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef4038440 msgr2=0x7fdef403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef4038440 0x7fdef403a900 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe02400f010 tx=0x7fe02401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 msgr2=0x555bff26ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02bf02640 1 -- 172.21.15.114:0/2579168871 reap_dead start 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff26ca40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fe0200b46d0 tx=0x7fe0200e9130 comp rx=0 tx=0).stop 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 shutdown_connections 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/2579168871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff2654d0 0x555bff26ca40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 >> 172.21.15.114:0/2579168871 conn(0x555bff261860 msgr2=0x555bff266d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 shutdown_connections 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/2579168871 wait complete. 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf040383f0 msgr2=0x7fdf0403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf040383f0 0x7fdf0403a8b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x555bff248810 tx=0x7fe024003070 comp rx=0 tx=0).stop 2024-05-08T18:09:14.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 msgr2=0x555bff258820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 0x555bff258820 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe02001b2c0 tx=0x7fe020018020 comp rx=0 tx=0).stop 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 shutdown_connections 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf040383f0 0x7fdf0403a8b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1997640483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff258400 0x555bff258820 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 >> 172.21.15.114:0/1997640483 conn(0x555bff24d210 msgr2=0x555bff24dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 shutdown_connections 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1997640483 wait complete. 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff1525a0 msgr2=0x555bff247610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff1525a0 0x555bff247610 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf140383f0 msgr2=0x7fdf1403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf140383f0 0x7fdf1403a8b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe0200ad000 tx=0x7fe0200a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 msgr2=0x555bff240720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff240720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe01c000f90 tx=0x7fe01c001260 comp rx=0 tx=0).stop 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 shutdown_connections 2024-05-08T18:09:14.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555bff1525a0 0x555bff247610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdf140383f0 0x7fdf1403a8b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 --2- 172.21.15.114:0/1095099467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555bff14e390 0x555bff240720 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 >> 172.21.15.114:0/1095099467 conn(0x555bff0c17e0 msgr2=0x555bff233890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 shutdown_connections 2024-05-08T18:09:14.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.335+0000 7fe02e3ee980 1 -- 172.21.15.114:0/1095099467 wait complete. 2024-05-08T18:09:14.347 INFO:teuthology.orchestra.run.smithi114.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"I54Bf8GRLZcIliTk3IheMP07","ver":2},"mtime":"2024-05-08T18:09:14.116813Z","data":{"bucket":{"name":"myfoo","marker":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","bucket_id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-08T18:09:10.628914Z","linked":true,"has_bucket_info":false}} 2024-05-08T18:09:14.347 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'I54Bf8GRLZcIliTk3IheMP07', 'ver': 2}, 'mtime': '2024-05-08T18:09:14.116813Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'bucket_id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-08T18:09:10.628914Z', 'linked': True, 'has_bucket_info': False}} 2024-05-08T18:09:14.347 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T18:09:14.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T18:09:14.347 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-08T18:09:14.425 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:14.425 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:14.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f414689d980 1 Processor -- start 2024-05-08T18:09:14.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f414689d980 1 -- start start 2024-05-08T18:09:14.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f414689d980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f4ea54e830 0x55f4ea5dcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f414689d980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f4ea485710 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f414689d980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f4ea499f00 con 0x55f4ea54e830 2024-05-08T18:09:14.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f41443b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f4ea54e830 0x55f4ea5dcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f41443b1640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f4ea54e830 0x55f4ea5dcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58976/0 (socket says 172.21.15.114:58976) 2024-05-08T18:09:14.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f41443b1640 1 -- 172.21.15.114:0/2601583172 learned_addr learned my addr 172.21.15.114:0/2601583172 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f41443b1640 1 -- 172.21.15.114:0/2601583172 >> v1:172.21.15.53:6789/0 conn(0x55f4ea5dd0c0 legacy=0x55f4ea5df4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.427+0000 7f41443b1640 1 -- 172.21.15.114:0/2601583172 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea461ae0 con 0x55f4ea54e830 2024-05-08T18:09:14.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f41443b1640 1 --2- 172.21.15.114:0/2601583172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5dcb80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a4e0 tx=0x7f413c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c359addf5cb3d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f41433af640 1 -- 172.21.15.114:0/2601583172 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413c0aa540 con 0x55f4ea54e830 2024-05-08T18:09:14.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f41433af640 1 -- 172.21.15.114:0/2601583172 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c0aa6e0 con 0x55f4ea54e830 2024-05-08T18:09:14.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f41433af640 1 -- 172.21.15.114:0/2601583172 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413c0aaa40 con 0x55f4ea54e830 2024-05-08T18:09:14.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 -- 172.21.15.114:0/2601583172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 msgr2=0x55f4ea5dcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 --2- 172.21.15.114:0/2601583172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5dcb80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a4e0 tx=0x7f413c01b090 comp rx=0 tx=0).stop 2024-05-08T18:09:14.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 -- 172.21.15.114:0/2601583172 shutdown_connections 2024-05-08T18:09:14.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 --2- 172.21.15.114:0/2601583172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5dcb80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 -- 172.21.15.114:0/2601583172 >> 172.21.15.114:0/2601583172 conn(0x55f4ea5d46a0 msgr2=0x55f4ea5d6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 -- 172.21.15.114:0/2601583172 shutdown_connections 2024-05-08T18:09:14.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.431+0000 7f414689d980 1 -- 172.21.15.114:0/2601583172 wait complete. 2024-05-08T18:09:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f414689d980 1 Processor -- start 2024-05-08T18:09:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f414689d980 1 -- start start 2024-05-08T18:09:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f414689d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5da2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f414689d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea4ddf80 con 0x55f4ea54e830 2024-05-08T18:09:14.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f41443b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5da2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f41443b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5da2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58986/0 (socket says 172.21.15.114:58986) 2024-05-08T18:09:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f41443b1640 1 -- 172.21.15.114:0/3499154055 learned_addr learned my addr 172.21.15.114:0/3499154055 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f41443b1640 1 -- 172.21.15.114:0/3499154055 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea4a5da0 con 0x55f4ea54e830 2024-05-08T18:09:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f41443b1640 1 --2- 172.21.15.114:0/3499154055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5da2e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f413c018cc0 tx=0x7f413c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0df4cbac4f9089 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f403260c640 1 -- 172.21.15.114:0/3499154055 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413c0b9070 con 0x55f4ea54e830 2024-05-08T18:09:14.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f403260c640 1 -- 172.21.15.114:0/3499154055 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c0aab50 con 0x55f4ea54e830 2024-05-08T18:09:14.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.447+0000 7f403260c640 1 -- 172.21.15.114:0/3499154055 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413c0aae50 con 0x55f4ea54e830 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/3499154055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 msgr2=0x55f4ea5da2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 --2- 172.21.15.114:0/3499154055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5da2e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f413c018cc0 tx=0x7f413c0033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/3499154055 shutdown_connections 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 --2- 172.21.15.114:0/3499154055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea5da2e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/3499154055 >> 172.21.15.114:0/3499154055 conn(0x55f4ea5d46a0 msgr2=0x55f4ea6c0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/3499154055 shutdown_connections 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/3499154055 wait complete. 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 Processor -- start 2024-05-08T18:09:14.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- start start 2024-05-08T18:09:14.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea6ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea5e16e0 con 0x55f4ea54e830 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f41443b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea6ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f41443b1640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea6ce4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:58994/0 (socket says 172.21.15.114:58994) 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f41443b1640 1 -- 172.21.15.114:0/928934808 learned_addr learned my addr 172.21.15.114:0/928934808 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f41443b1640 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea6cea00 con 0x55f4ea54e830 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f41443b1640 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea6ce4c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f413c018cc0 tx=0x7f413c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f4030e09640 1 -- 172.21.15.114:0/928934808 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413c0b9070 con 0x55f4ea54e830 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f4030e09640 1 -- 172.21.15.114:0/928934808 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413c0c7410 con 0x55f4ea54e830 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4ea6cec90 con 0x55f4ea54e830 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f4030e09640 1 -- 172.21.15.114:0/928934808 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413c0c7710 con 0x55f4ea54e830 2024-05-08T18:09:14.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.451+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ea6d1970 con 0x55f4ea54e830 2024-05-08T18:09:14.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4030e09640 1 -- 172.21.15.114:0/928934808 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f413c0b3040 con 0x55f4ea54e830 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4030e09640 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f402c038440 0x7f402c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4030e09640 1 -- 172.21.15.114:0/928934808 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f413c0c4070 con 0x55f4ea54e830 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4143bb0640 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f402c038440 0x7f402c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea5dd0c0 0x55f4ea6d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea6d5b40 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea5dd0c0 0x55f4ea6d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4143bb0640 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f402c038440 0x7f402c03a900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4138001e60 tx=0x7f41380013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea5dd0c0 0x55f4ea6d55c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 -- 172.21.15.114:0/928934808 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41340083f0 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea6d2b90 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 -- 172.21.15.114:0/928934808 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41340083f0 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea6d79b0 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 -- 172.21.15.114:0/928934808 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41340083f0 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea6d6b20 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 -- 172.21.15.114:0/928934808 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41340083f0 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea6d6f70 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f4144bb2640 1 -- 172.21.15.114:0/928934808 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41340083f0 con 0x55f4ea5dd0c0 2024-05-08T18:09:14.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 Processor -- start 2024-05-08T18:09:14.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- start start 2024-05-08T18:09:14.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 0x55f4ea6e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.455+0000 7f414689d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea4e1fc0 con 0x55f4ea6e62e0 2024-05-08T18:09:14.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4143bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 0x55f4ea6e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4143bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 0x55f4ea6e6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59006/0 (socket says 172.21.15.114:59006) 2024-05-08T18:09:14.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4143bb0640 1 -- 172.21.15.114:0/3152913480 learned_addr learned my addr 172.21.15.114:0/3152913480 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4143bb0640 1 -- 172.21.15.114:0/3152913480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea6e6c40 con 0x55f4ea6e62e0 2024-05-08T18:09:14.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4143bb0640 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 0x55f4ea6e6700 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4138010f90 tx=0x7f413800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4029ffb640 1 -- 172.21.15.114:0/3152913480 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413800a040 con 0x55f4ea6e62e0 2024-05-08T18:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4029ffb640 1 -- 172.21.15.114:0/3152913480 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4138017050 con 0x55f4ea6e62e0 2024-05-08T18:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4029ffb640 1 -- 172.21.15.114:0/3152913480 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413800e7e0 con 0x55f4ea6e62e0 2024-05-08T18:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4ea6e76e0 con 0x55f4ea6e62e0 2024-05-08T18:09:14.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ea6e7bb0 con 0x55f4ea6e62e0 2024-05-08T18:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4029ffb640 1 -- 172.21.15.114:0/3152913480 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f413800e980 con 0x55f4ea6e62e0 2024-05-08T18:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.459+0000 7f4029ffb640 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f401c038440 0x7f401c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4029ffb640 1 -- 172.21.15.114:0/3152913480 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f4138050660 con 0x55f4ea6e62e0 2024-05-08T18:09:14.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f401c038440 0x7f401c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 Processor -- start 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- start start 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f401c038440 0x7f401c03a900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f413400e3f0 tx=0x7f4134003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea5da970 con 0x55f4ea6f3490 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6f38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59010/0 (socket says 172.21.15.114:59010) 2024-05-08T18:09:14.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 -- 172.21.15.114:0/1281628792 learned_addr learned my addr 172.21.15.114:0/1281628792 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 -- 172.21.15.114:0/1281628792 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea6f3e80 con 0x55f4ea6f3490 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 --2- 172.21.15.114:0/1281628792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6f38b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f413801cfd0 tx=0x7f4138023660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d353de23010312e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f401b7fe640 1 -- 172.21.15.114:0/1281628792 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413801a310 con 0x55f4ea6f3490 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f401b7fe640 1 -- 172.21.15.114:0/1281628792 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413800ec70 con 0x55f4ea6f3490 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f401b7fe640 1 -- 172.21.15.114:0/1281628792 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f413801a4b0 con 0x55f4ea6f3490 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- 172.21.15.114:0/1281628792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 msgr2=0x55f4ea6f38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 --2- 172.21.15.114:0/1281628792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6f38b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f413801cfd0 tx=0x7f4138023660 comp rx=0 tx=0).stop 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- 172.21.15.114:0/1281628792 shutdown_connections 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 --2- 172.21.15.114:0/1281628792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6f38b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- 172.21.15.114:0/1281628792 >> 172.21.15.114:0/1281628792 conn(0x55f4ea6ef820 msgr2=0x55f4ea6ed880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- 172.21.15.114:0/1281628792 shutdown_connections 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- 172.21.15.114:0/1281628792 wait complete. 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 Processor -- start 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- start start 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6fa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f414689d980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f4ea6f4570 con 0x55f4ea6f3490 2024-05-08T18:09:14.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6fa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6fa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59016/0 (socket says 172.21.15.114:59016) 2024-05-08T18:09:14.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.463+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 learned_addr learned my addr 172.21.15.114:0/3098806721 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ea6faf20 con 0x55f4ea6f3490 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4143bb0640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6fa9e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4138027030 tx=0x7f413804e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4019ffb640 1 -- 172.21.15.114:0/3098806721 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4138023530 con 0x55f4ea6f3490 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f4ea6fb1b0 con 0x55f4ea6f3490 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4019ffb640 1 -- 172.21.15.114:0/3098806721 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413800ee20 con 0x55f4ea6f3490 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ea6fde90 con 0x55f4ea6f3490 2024-05-08T18:09:14.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4019ffb640 1 -- 172.21.15.114:0/3098806721 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4138023760 con 0x55f4ea6f3490 2024-05-08T18:09:14.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4019ffb640 1 -- 172.21.15.114:0/3098806721 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f4138047040 con 0x55f4ea6f3490 2024-05-08T18:09:14.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4019ffb640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f400c0383f0 0x7f400c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4019ffb640 1 -- 172.21.15.114:0/3098806721 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f4138044040 con 0x55f4ea6f3490 2024-05-08T18:09:14.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f400c0383f0 0x7f400c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea705ec0 0x55f4ea708360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea708ab0 con 0x55f4ea705ec0 2024-05-08T18:09:14.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f41443b1640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea705ec0 0x55f4ea708360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f400c0383f0 0x7f400c03a8b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55f4ea6d6640 tx=0x7f413401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.467+0000 7f41443b1640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea705ec0 0x55f4ea708360 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 realm 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea708ec0 con 0x55f4ea705ec0 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea709760 con 0x55f4ea705ec0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea709b00 con 0x55f4ea705ec0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70a350 con 0x55f4ea705ec0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:14.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 20 searching for the correct realm 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f4ea70c0c0 0x55f4ea70e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4143bb0640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f4ea70c0c0 0x55f4ea70e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4143bb0640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f4ea70c0c0 0x55f4ea70e4b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4143bb0640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f413801c030 0x7f4138037880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f413801c030 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f413801c030 0x7f4138037880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f413801c030 0x7f4138037880 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4144bb2640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4134019040 0x7f4134019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.471+0000 7f41443b1640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4134019040 0x7f4134019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4134019040 0x7f4134019930 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x7f4134019040 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x7f4134019040 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x7f4134019040 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f413801c030 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.475+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x7f4134019040 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f413801c030 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x7f4134019040 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.479+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0e0d70 con 0x7f4134019040 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f413801c030 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f413c0e0d70 con 0x55f4ea705ec0 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f413801c030 2024-05-08T18:09:14.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.483+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f4134019040 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70e9f0 con 0x7f413801c030 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:14.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70aca0 con 0x55f4ea705ec0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70b540 con 0x55f4ea705ec0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70a8e0 con 0x55f4ea705ec0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:14.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 zone default found 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 4 Realm: () 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 zonegroup default 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70ee20 con 0x7f4134019040 2024-05-08T18:09:14.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea710800 con 0x55f4ea70c0c0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea710c90 con 0x55f4ea70c0c0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 started sync module instance, tier type = 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.487+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea70fca0 con 0x7f413801c030 2024-05-08T18:09:14.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94510393655440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea7115a0 con 0x7f413801c030 2024-05-08T18:09:14.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea711df0 con 0x55f4ea705ec0 2024-05-08T18:09:14.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94510393655440] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94510393659632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea7119c0 con 0x55f4ea705ec0 2024-05-08T18:09:14.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.491+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea712490 con 0x55f4ea70c0c0 2024-05-08T18:09:14.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94510393659632] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94510393660688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea711930 con 0x55f4ea70c0c0 2024-05-08T18:09:14.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea713220 con 0x7f413801c030 2024-05-08T18:09:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94510393666864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea713ac0 con 0x7f413801c030 2024-05-08T18:09:14.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.495+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea714500 con 0x55f4ea705ec0 2024-05-08T18:09:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94510393660688] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94510393666864] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94510393671632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea713610 con 0x55f4ea705ec0 2024-05-08T18:09:14.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea714da0 con 0x7f4134019040 2024-05-08T18:09:14.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94510393673232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea714ee0 con 0x7f4134019040 2024-05-08T18:09:14.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea715790 con 0x7f4134019040 2024-05-08T18:09:14.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.499+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94510393671632] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.503+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94510393673232] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.503+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.503+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94510393665664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea714ee0 con 0x7f4134019040 2024-05-08T18:09:14.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.503+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea715e20 con 0x7f4134019040 2024-05-08T18:09:14.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.503+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94510393665664] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.503+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94510393674288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea715e20 con 0x7f4134019040 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=0 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=1 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=2 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=3 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=4 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=5 2024-05-08T18:09:14.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=6 2024-05-08T18:09:14.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94510393674288] v30'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 20 add_watcher() i=7 2024-05-08T18:09:14.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:14.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea718fc0 con 0x55f4ea705ec0 2024-05-08T18:09:14.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94510393690576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea715e20 con 0x55f4ea705ec0 2024-05-08T18:09:14.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94510393690576] v30'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.507+0000 7f3ffa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:14.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 5 note: GC not initialized 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f3ff97e2640 20 reqs_thread_entry: start 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 Filter name: none 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f3f6affd640 20 reqs_thread_entry: start 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73cac0 con 0x55f4ea705ec0 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:14.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-08T18:09:14.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73c5e0 con 0x55f4ea705ec0 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 8.f 8:f78b91c5:root::.bucket.meta.testx%3amyfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea7403a0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv3 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 20 rados_obj.operate() r=0 bl.length=412 2024-05-08T18:09:14.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.511+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea744a30 con 0x55f4ea705ec0 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'4 uv4 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea748340 con 0x55f4ea705ec0 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(66 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [create,call,writefull 0~379,setxattr (123)] v30'7 uv7 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x7 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94510393876704 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea747d20 con 0x7f413801c030 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== watch-notify(notify (1) cookie 94510393655440 notify 128849018903 ret 0) ==== 770+0+0 (crc 0 0 0) 0x7f4134010040 con 0x7f413801c030 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f401b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018903 cookie 94510393655440 notifier 4555 bl.length()=728 2024-05-08T18:09:14.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f401b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x7 2024-05-08T18:09:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f401b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f401b7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(67 notify.0 [notify cookie 94510393876704 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f401b7fe640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4008003eb0 con 0x7f413801c030 2024-05-08T18:09:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== watch-notify(notify_complete (2) cookie 94510393876704 notify 128849018903 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4134026ce0 con 0x7f413801c030 2024-05-08T18:09:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_sources= new_sources= 2024-05-08T18:09:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential sources added=[] removed=[] 2024-05-08T18:09:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_dests= new_dests= 2024-05-08T18:09:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential dests added=[] removed=[] 2024-05-08T18:09:14.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.515+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea742ad0 con 0x7f413801c030 2024-05-08T18:09:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea7470f0 con 0x7f413801c030 2024-05-08T18:09:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f414689d980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:09:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f414689d980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f414689d980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:14.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94510393863360 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea7470f0 con 0x7f4134019040 2024-05-08T18:09:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.519+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== watch-notify(notify (1) cookie 94510393665664 notify 128849018890 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f413c0bde30 con 0x7f4134019040 2024-05-08T18:09:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f401b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94510393665664 notifier 4555 bl.length()=314 2024-05-08T18:09:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f401b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T18:09:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f401b7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(71 notify.6 [notify cookie 94510393863360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f401b7fe640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4008003eb0 con 0x7f4134019040 2024-05-08T18:09:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== watch-notify(notify_complete (2) cookie 94510393863360 notify 128849018890 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f413c0e6040 con 0x7f4134019040 2024-05-08T18:09:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea742cc0 con 0x55f4ea705ec0 2024-05-08T18:09:14.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(73 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f414689d980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f414689d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94510393863360 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea745580 con 0x55f4ea705ec0 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify (1) cookie 94510393671632 notify 128849018892 ret 0) ==== 197+0+0 (crc 0 0 0) 0x7f413c0e6040 con 0x55f4ea705ec0 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f401affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94510393671632 notifier 4555 bl.length()=155 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(74 notify.4 [notify cookie 94510393863360 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f401affd640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3f780032d0 con 0x55f4ea705ec0 2024-05-08T18:09:14.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== watch-notify(notify_complete (2) cookie 94510393863360 notify 128849018892 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f4ea6d1970 con 0x55f4ea705ec0 2024-05-08T18:09:14.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.523+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:76 8.f 8:f78b91c5:root::.bucket.meta.testx%3amyfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea7450d0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call,delete] v30'4 uv4 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f414689d980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 from cache 2024-05-08T18:09:14.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f414689d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:14.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94510393854528 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73d6e0 con 0x7f4134019040 2024-05-08T18:09:14.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== watch-notify(notify (1) cookie 94510393674288 notify 128849018891 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55f4ea6d1970 con 0x7f4134019040 2024-05-08T18:09:14.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f401b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94510393674288 notifier 4555 bl.length()=212 2024-05-08T18:09:14.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(77 notify.7 [notify cookie 94510393854528 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f401b7fe640 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f4008003eb0 con 0x7f4134019040 2024-05-08T18:09:14.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== watch-notify(notify_complete (2) cookie 94510393854528 notify 128849018891 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f4ea6cec90 con 0x7f4134019040 2024-05-08T18:09:14.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.527+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f3ffa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94510393690576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94510393690576] v30'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94510393655440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x7f413801c030 2024-05-08T18:09:14.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94510393655440] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f414689d980 20 remove_watcher() i=0 2024-05-08T18:09:14.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f414689d980 2 removed watcher, disabling cache 2024-05-08T18:09:14.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.531+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94510393659632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.535+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94510393659632] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.535+0000 7f414689d980 20 remove_watcher() i=1 2024-05-08T18:09:14.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.535+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94510393660688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x55f4ea70c0c0 2024-05-08T18:09:14.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.535+0000 7f4143bb0640 1 -- 172.21.15.114:0/3098806721 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94510393660688] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4138034020 con 0x55f4ea70c0c0 2024-05-08T18:09:14.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.535+0000 7f414689d980 20 remove_watcher() i=2 2024-05-08T18:09:14.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.535+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94510393666864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x7f413801c030 2024-05-08T18:09:14.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.539+0000 7f4144bb2640 1 -- 172.21.15.114:0/3098806721 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94510393666864] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413402f040 con 0x7f413801c030 2024-05-08T18:09:14.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.539+0000 7f414689d980 20 remove_watcher() i=3 2024-05-08T18:09:14.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.539+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94510393671632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x55f4ea705ec0 2024-05-08T18:09:14.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.539+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94510393671632] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x55f4ea705ec0 2024-05-08T18:09:14.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.539+0000 7f414689d980 20 remove_watcher() i=4 2024-05-08T18:09:14.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.539+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94510393673232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x7f4134019040 2024-05-08T18:09:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.543+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94510393673232] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.543+0000 7f414689d980 20 remove_watcher() i=5 2024-05-08T18:09:14.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.543+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94510393665664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x7f4134019040 2024-05-08T18:09:14.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.543+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94510393665664] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.543+0000 7f414689d980 20 remove_watcher() i=6 2024-05-08T18:09:14.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.543+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94510393674288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55f4ea73a7f0 con 0x7f4134019040 2024-05-08T18:09:14.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94510393674288] v30'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f413c0f9040 con 0x7f4134019040 2024-05-08T18:09:14.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 20 remove_watcher() i=7 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4134019040 msgr2=0x7f4134019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4134019040 0x7f4134019930 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea705ec0 msgr2=0x55f4ea708360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea705ec0 0x55f4ea708360 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f413801c030 msgr2=0x7f4138037880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f413801c030 0x7f4138037880 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f4ea70c0c0 msgr2=0x55f4ea70e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f4ea70c0c0 0x55f4ea70e4b0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f400c0383f0 msgr2=0x7f400c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f400c0383f0 0x7f400c03a8b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x55f4ea6d6640 tx=0x7f413401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 msgr2=0x55f4ea6fa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6fa9e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4138027030 tx=0x7f413804e940 comp rx=0 tx=0).stop 2024-05-08T18:09:14.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f41443b1640 1 -- 172.21.15.114:0/3098806721 reap_dead start 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 shutdown_connections 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3098806721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6f3490 0x55f4ea6fa9e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 >> 172.21.15.114:0/3098806721 conn(0x55f4ea6ef820 msgr2=0x55f4ea6ece80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 shutdown_connections 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3098806721 wait complete. 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f401c038440 msgr2=0x7f401c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f401c038440 0x7f401c03a900 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f413400e3f0 tx=0x7f4134003070 comp rx=0 tx=0).stop 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 msgr2=0x55f4ea6e6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 0x55f4ea6e6700 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4138010f90 tx=0x7f413800f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 shutdown_connections 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f401c038440 0x7f401c03a900 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/3152913480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea6e62e0 0x55f4ea6e6700 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 >> 172.21.15.114:0/3152913480 conn(0x55f4ea6db0f0 msgr2=0x55f4ea6dbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 shutdown_connections 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/3152913480 wait complete. 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea5dd0c0 msgr2=0x55f4ea6d55c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea5dd0c0 0x55f4ea6d55c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f402c038440 msgr2=0x7f402c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f402c038440 0x7f402c03a900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4138001e60 tx=0x7f41380013e0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 msgr2=0x55f4ea6ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea6ce4c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f413c018cc0 tx=0x7f413c017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 shutdown_connections 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f4ea5dd0c0 0x55f4ea6d55c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f402c038440 0x7f402c03a900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 --2- 172.21.15.114:0/928934808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f4ea54e830 0x55f4ea6ce4c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 >> 172.21.15.114:0/928934808 conn(0x55f4ea5d46a0 msgr2=0x55f4ea5d8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 shutdown_connections 2024-05-08T18:09:14.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.547+0000 7f414689d980 1 -- 172.21.15.114:0/928934808 wait complete. 2024-05-08T18:09:14.562 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:09:14.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T18:09:14.563 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-08T18:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:14.645 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:14.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7b1a14980 1 Processor -- start 2024-05-08T18:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7b1a14980 1 -- start start 2024-05-08T18:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7b1a14980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5555ee62dfe0 0x5555ee62c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7b1a14980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5555ee563710 con 0x5555ee62cb20 2024-05-08T18:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7b1a14980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5555ee577f00 con 0x5555ee62dfe0 2024-05-08T18:09:14.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7af528640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5555ee62dfe0 0x5555ee62c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7af528640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5555ee62dfe0 0x5555ee62c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59026/0 (socket says 172.21.15.114:59026) 2024-05-08T18:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7aed27640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5555ee62cb20 0x5555ee6bfee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34792/0 (socket says 172.21.15.114:34792) 2024-05-08T18:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7af528640 1 -- 172.21.15.114:0/1658082672 learned_addr learned my addr 172.21.15.114:0/1658082672 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7af528640 1 -- 172.21.15.114:0/1658082672 >> v1:172.21.15.53:6789/0 conn(0x5555ee62cb20 legacy=0x5555ee6bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.647+0000 7fb7af528640 1 -- 172.21.15.114:0/1658082672 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee53fae0 con 0x5555ee62dfe0 2024-05-08T18:09:14.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7af528640 1 --2- 172.21.15.114:0/1658082672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62dfe0 0x5555ee62c5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000a5c0 tx=0x7fb7a001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4460fe36e620abfd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7ae526640 1 -- 172.21.15.114:0/1658082672 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a00a6070 con 0x5555ee62dfe0 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7ae526640 1 -- 172.21.15.114:0/1658082672 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a00af070 con 0x5555ee62dfe0 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7ae526640 1 -- 172.21.15.114:0/1658082672 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a00aa5c0 con 0x5555ee62dfe0 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1658082672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62dfe0 msgr2=0x5555ee62c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/1658082672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62dfe0 0x5555ee62c5e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000a5c0 tx=0x7fb7a001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1658082672 shutdown_connections 2024-05-08T18:09:14.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/1658082672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62dfe0 0x5555ee62c5e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1658082672 >> 172.21.15.114:0/1658082672 conn(0x5555ee6b37b0 msgr2=0x5555ee6b5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1658082672 shutdown_connections 2024-05-08T18:09:14.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.651+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1658082672 wait complete. 2024-05-08T18:09:14.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 Processor -- start 2024-05-08T18:09:14.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- start start 2024-05-08T18:09:14.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7a5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555ee5bbf80 con 0x5555ee62cb20 2024-05-08T18:09:14.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7af528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7af528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7a5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59030/0 (socket says 172.21.15.114:59030) 2024-05-08T18:09:14.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7af528640 1 -- 172.21.15.114:0/2247359627 learned_addr learned my addr 172.21.15.114:0/2247359627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7af528640 1 -- 172.21.15.114:0/2247359627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee583da0 con 0x5555ee62cb20 2024-05-08T18:09:14.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7af528640 1 --2- 172.21.15.114:0/2247359627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7a5820 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00199f0 tx=0x7fb7a0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68e9a26be1d4cb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb69d60a640 1 -- 172.21.15.114:0/2247359627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a00aaa00 con 0x5555ee62cb20 2024-05-08T18:09:14.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb69d60a640 1 -- 172.21.15.114:0/2247359627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a00aaba0 con 0x5555ee62cb20 2024-05-08T18:09:14.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb69d60a640 1 -- 172.21.15.114:0/2247359627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a00bd3f0 con 0x5555ee62cb20 2024-05-08T18:09:14.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2247359627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 msgr2=0x5555ee7a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2247359627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7a5820 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00199f0 tx=0x7fb7a0003030 comp rx=0 tx=0).stop 2024-05-08T18:09:14.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2247359627 shutdown_connections 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2247359627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7a5820 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2247359627 >> 172.21.15.114:0/2247359627 conn(0x5555ee6b37b0 msgr2=0x5555ee7a13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2247359627 shutdown_connections 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2247359627 wait complete. 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 Processor -- start 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.667+0000 7fb7b1a14980 1 -- start start 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7b1a14980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7b1a14980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555ee6c40c0 con 0x5555ee62cb20 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7af528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7af528640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59042/0 (socket says 172.21.15.114:59042) 2024-05-08T18:09:14.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7af528640 1 -- 172.21.15.114:0/3299037517 learned_addr learned my addr 172.21.15.114:0/3299037517 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7af528640 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee7ad080 con 0x5555ee62cb20 2024-05-08T18:09:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7af528640 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7acb40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb7a001b170 tx=0x7fb7a00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb69be07640 1 -- 172.21.15.114:0/3299037517 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a00bd7c0 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb69be07640 1 -- 172.21.15.114:0/3299037517 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a00bd960 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ee7ad310 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb69be07640 1 -- 172.21.15.114:0/3299037517 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a00bdc40 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ee7affa0 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb69be07640 1 -- 172.21.15.114:0/3299037517 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb7a00ce020 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb69be07640 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb694038440 0x7fb69403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb69be07640 1 -- 172.21.15.114:0/3299037517 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb7a00cc020 con 0x5555ee62cb20 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7aed27640 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb694038440 0x7fb69403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee62dfe0 0x5555ee7b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7b40f0 con 0x5555ee62dfe0 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7afd29640 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee62dfe0 0x5555ee7b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.671+0000 7fb7aed27640 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb694038440 0x7fb69403a900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4001e40 tx=0x7fb7a40013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7afd29640 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee62dfe0 0x5555ee7b3a80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7afd29640 1 -- 172.21.15.114:0/3299037517 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7a800a4d0 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7b49d0 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7afd29640 1 -- 172.21.15.114:0/3299037517 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7a800a4d0 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7b5d80 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7afd29640 1 -- 172.21.15.114:0/3299037517 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7a800a4d0 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7b5220 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7afd29640 1 -- 172.21.15.114:0/3299037517 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7a800a4d0 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7b5640 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7afd29640 1 -- 172.21.15.114:0/3299037517 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7a800a4d0 con 0x5555ee62dfe0 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 Processor -- start 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 -- start start 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 0x5555ee7c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7b1a14980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555ee5bffc0 con 0x5555ee7c48d0 2024-05-08T18:09:14.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7aed27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 0x5555ee7c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7aed27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 0x5555ee7c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59048/0 (socket says 172.21.15.114:59048) 2024-05-08T18:09:14.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7aed27640 1 -- 172.21.15.114:0/1882489016 learned_addr learned my addr 172.21.15.114:0/1882489016 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7aed27640 1 -- 172.21.15.114:0/1882489016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee7c5230 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.675+0000 7fb7aed27640 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 0x5555ee7c4cf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e670 tx=0x7fb7a400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb699602640 1 -- 172.21.15.114:0/1882489016 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a4022070 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ee7c5cd0 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb699602640 1 -- 172.21.15.114:0/1882489016 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a400d660 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb699602640 1 -- 172.21.15.114:0/1882489016 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a4006070 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ee7c61a0 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb699602640 1 -- 172.21.15.114:0/1882489016 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb7a4025070 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb699602640 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6880383f0 0x7fb68803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb699602640 1 -- 172.21.15.114:0/1882489016 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb7a404ff80 con 0x5555ee7c48d0 2024-05-08T18:09:14.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7afd29640 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6880383f0 0x7fb68803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7b1a14980 1 Processor -- start 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7b1a14980 1 -- start start 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7afd29640 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6880383f0 0x7fb68803a8b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5555ee7b55c0 tx=0x7fb7a8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7b1a14980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7b1a14980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555ee7a5eb0 con 0x5555ee7d1ab0 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7aed27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7aed27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59056/0 (socket says 172.21.15.114:59056) 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7aed27640 1 -- 172.21.15.114:0/2264159666 learned_addr learned my addr 172.21.15.114:0/2264159666 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7aed27640 1 -- 172.21.15.114:0/2264159666 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee7d24a0 con 0x5555ee7d1ab0 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb7aed27640 1 --2- 172.21.15.114:0/2264159666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d1ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb7a404e3c0 tx=0x7fb7a4026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510e6b65cf21973a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb692ffd640 1 -- 172.21.15.114:0/2264159666 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a403d0d0 con 0x5555ee7d1ab0 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb692ffd640 1 -- 172.21.15.114:0/2264159666 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a403d270 con 0x5555ee7d1ab0 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.679+0000 7fb692ffd640 1 -- 172.21.15.114:0/2264159666 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a40242c0 con 0x5555ee7d1ab0 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2264159666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 msgr2=0x5555ee7d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2264159666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d1ed0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb7a404e3c0 tx=0x7fb7a4026780 comp rx=0 tx=0).stop 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2264159666 shutdown_connections 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2264159666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d1ed0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2264159666 >> 172.21.15.114:0/2264159666 conn(0x5555ee7cde40 msgr2=0x5555ee7cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2264159666 shutdown_connections 2024-05-08T18:09:14.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2264159666 wait complete. 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 Processor -- start 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- start start 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5555ee7d2bf0 con 0x5555ee7d1ab0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7aed27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7aed27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59062/0 (socket says 172.21.15.114:59062) 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 learned_addr learned my addr 172.21.15.114:0/2900078553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555ee7d9500 con 0x5555ee7d1ab0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7aed27640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d8fc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400ef00 tx=0x7fb7a404e320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb6917fa640 1 -- 172.21.15.114:0/2900078553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a403d0d0 con 0x5555ee7d1ab0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5555ee7d9790 con 0x5555ee7d1ab0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb6917fa640 1 -- 172.21.15.114:0/2900078553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a4024780 con 0x5555ee7d1ab0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb6917fa640 1 -- 172.21.15.114:0/2900078553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7a4024970 con 0x5555ee7d1ab0 2024-05-08T18:09:14.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555ee7d9790 con 0x5555ee7d1ab0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.683+0000 7fb6917fa640 1 -- 172.21.15.114:0/2900078553 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb7a403e940 con 0x5555ee7d1ab0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb6917fa640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6780383f0 0x7fb67803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb6917fa640 1 -- 172.21.15.114:0/2900078553 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fb7a4046070 con 0x5555ee7d1ab0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7afd29640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6780383f0 0x7fb67803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee7e42f0 0x5555ee7e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e6f00 con 0x5555ee7e42f0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee7e42f0 0x5555ee7e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7afd29640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6780383f0 0x7fb67803a8b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5555ee7b4850 tx=0x7fb7a801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee7e42f0 0x5555ee7e67b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 realm 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e7310 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e7be0 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e7f80 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 20 searching for the correct realm 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5555ee7ea540 0x5555ee7ec930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ece70 con 0x5555ee7ea540 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7aed27640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5555ee7ea540 0x5555ee7ec930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7aed27640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5555ee7ea540 0x5555ee7ec930 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7aed27640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb7a4027060 0x7fb7a40429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ece70 con 0x7fb7a4027060 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7afd29640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb7a4027060 0x7fb7a40429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.687+0000 7fb7afd29640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb7a4027060 0x7fb7a40429d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a801f070 con 0x7fb7a4027060 2024-05-08T18:09:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7afd29640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb7a8031040 0x7fb7a8032940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ece70 con 0x7fb7a8031040 2024-05-08T18:09:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb7a8031040 0x7fb7a8032940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb7a8031040 0x7fb7a8032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x7fb7a8031040 2024-05-08T18:09:14.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x7fb7a8031040 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x7fb7a8031040 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a4027060 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a801f070 con 0x7fb7a4027060 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.691+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x7fb7a8031040 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a4027060 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7a801f070 con 0x7fb7a4027060 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x7fb7a8031040 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.695+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00bc580 con 0x7fb7a8031040 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a4027060 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a801f070 con 0x7fb7a4027060 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7a00bc580 con 0x5555ee7e42f0 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.699+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a4027060 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a801f070 con 0x7fb7a4027060 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7ea540 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a8031040 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x5555ee7e42f0 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e87d0 con 0x7fb7a4027060 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7a801f070 con 0x7fb7a4027060 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:14.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e9020 con 0x5555ee7e42f0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e9410 con 0x5555ee7e42f0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7e9410 con 0x5555ee7e42f0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 zone default found 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 4 Realm: () 2024-05-08T18:09:14.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 zonegroup default 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ed2a0 con 0x7fb7a8031040 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7eec80 con 0x5555ee7ea540 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.703+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ef020 con 0x5555ee7ea540 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 20 started sync module instance, tier type = 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ee120 con 0x7fb7a4027060 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93827561872496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ef3c0 con 0x7fb7a4027060 2024-05-08T18:09:14.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7efc70 con 0x5555ee7e42f0 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93827561872496] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.707+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.711+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93827561874704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ef870 con 0x5555ee7e42f0 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.711+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f0680 con 0x5555ee7ea540 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.711+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93827561874704] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.711+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.711+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93827561878464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ef7e0 con 0x5555ee7ea540 2024-05-08T18:09:14.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.711+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f13d0 con 0x7fb7a4027060 2024-05-08T18:09:14.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93827561885744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f1c70 con 0x7fb7a4027060 2024-05-08T18:09:14.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f2670 con 0x5555ee7e42f0 2024-05-08T18:09:14.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93827561878464] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93827561885744] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93827561884272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f17c0 con 0x5555ee7e42f0 2024-05-08T18:09:14.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.715+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f2f10 con 0x7fb7a8031040 2024-05-08T18:09:14.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93827561884272] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93827561890176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f17c0 con 0x7fb7a8031040 2024-05-08T18:09:14.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f3400 con 0x7fb7a8031040 2024-05-08T18:09:14.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93827561890176] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93827561893616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f33c0 con 0x7fb7a8031040 2024-05-08T18:09:14.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.719+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f3dc0 con 0x7fb7a8031040 2024-05-08T18:09:14.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93827561893616] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93827561891872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f3d80 con 0x7fb7a8031040 2024-05-08T18:09:14.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=0 2024-05-08T18:09:14.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=1 2024-05-08T18:09:14.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=2 2024-05-08T18:09:14.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=3 2024-05-08T18:09:14.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=4 2024-05-08T18:09:14.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=5 2024-05-08T18:09:14.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=6 2024-05-08T18:09:14.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93827561891872] v30'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 20 add_watcher() i=7 2024-05-08T18:09:14.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:14.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f7210 con 0x5555ee7e42f0 2024-05-08T18:09:14.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.723+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93827561896608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f4730 con 0x5555ee7e42f0 2024-05-08T18:09:14.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93827561896608] v30'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb7b1a14980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:14.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb7b1a14980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:14.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ffcc0 con 0x5555ee7e42f0 2024-05-08T18:09:14.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.727+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee800310 con 0x7fb7a8031040 2024-05-08T18:09:14.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.731+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.731+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee800310 con 0x5555ee7ea540 2024-05-08T18:09:14.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.731+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.731+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee800730 con 0x5555ee7e42f0 2024-05-08T18:09:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.731+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.731+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee800820 con 0x7fb7a4027060 2024-05-08T18:09:14.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.735+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.735+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee800e90 con 0x5555ee7ea540 2024-05-08T18:09:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.735+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.735+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee801230 con 0x5555ee7e42f0 2024-05-08T18:09:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.739+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.739+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8016e0 con 0x7fb7a8031040 2024-05-08T18:09:14.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.739+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.739+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8016e0 con 0x7fb7a4027060 2024-05-08T18:09:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.743+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.743+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb900 con 0x5555ee7ea540 2024-05-08T18:09:14.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.743+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.743+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee802240 con 0x7fb7a4027060 2024-05-08T18:09:14.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.743+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.743+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee802240 con 0x7fb7a8031040 2024-05-08T18:09:14.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.747+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.747+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee802240 con 0x7fb7a4027060 2024-05-08T18:09:14.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.747+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.747+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x7fb7a8031040 2024-05-08T18:09:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.751+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.751+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7e42f0 2024-05-08T18:09:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.751+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.751+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7ea540 2024-05-08T18:09:14.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.755+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.755+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x7fb7a4027060 2024-05-08T18:09:14.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.755+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.755+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7ea540 2024-05-08T18:09:14.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.755+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.755+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7e42f0 2024-05-08T18:09:14.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.759+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.759+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7e42f0 2024-05-08T18:09:14.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.759+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.759+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7ea540 2024-05-08T18:09:14.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.763+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.763+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x7fb7a4027060 2024-05-08T18:09:14.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.763+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.763+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee8026f0 con 0x5555ee7ea540 2024-05-08T18:09:14.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.763+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.763+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x5555ee7ea540 2024-05-08T18:09:14.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.767+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.767+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x5555ee7ea540 2024-05-08T18:09:14.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.767+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.767+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x5555ee7ea540 2024-05-08T18:09:14.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.767+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.767+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x7fb7a8031040 2024-05-08T18:09:14.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.771+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.771+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x5555ee7ea540 2024-05-08T18:09:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.771+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.771+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x7fb7a8031040 2024-05-08T18:09:14.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.775+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.775+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x5555ee7ea540 2024-05-08T18:09:14.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.775+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.775+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x7fb7a8031040 2024-05-08T18:09:14.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.779+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.779+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7fb280 con 0x7fb7a4027060 2024-05-08T18:09:14.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb664fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 20 Filter name: none 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb5de7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee81dd70 con 0x7fb7a8031040 2024-05-08T18:09:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T18:09:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T18:09:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T18:09:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:14.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee820240 con 0x5555ee7e42f0 2024-05-08T18:09:14.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:09:14.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.783+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee81e220 con 0x7fb7a8031040 2024-05-08T18:09:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7b1a14980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:09:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93827562073472 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee820800 con 0x5555ee7ea540 2024-05-08T18:09:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== watch-notify(notify (1) cookie 93827561878464 notify 128849018885 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5555ee802410 con 0x5555ee7ea540 2024-05-08T18:09:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 93827561878464 notifier 4562 bl.length()=170 2024-05-08T18:09:14.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(97 notify.2 [notify cookie 93827562073472 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb692ffd640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb674003d70 con 0x5555ee7ea540 2024-05-08T18:09:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== watch-notify(notify_complete (2) cookie 93827562073472 notify 128849018885 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555ee7d24a0 con 0x5555ee7ea540 2024-05-08T18:09:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7b1a14980 10 removing email index: 2024-05-08T18:09:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7b1a14980 10 removing user buckets index 2024-05-08T18:09:14.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.787+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee820780 con 0x5555ee7e42f0 2024-05-08T18:09:14.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v30'5 uv5 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-08T18:09:14.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93827562078768 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee820780 con 0x5555ee7e42f0 2024-05-08T18:09:14.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== watch-notify(notify (1) cookie 93827561884272 notify 128849018893 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5555ee7fbf80 con 0x5555ee7e42f0 2024-05-08T18:09:14.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb692ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 93827561884272 notifier 4562 bl.length()=175 2024-05-08T18:09:14.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb692ffd640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb674003d70 con 0x5555ee7e42f0 2024-05-08T18:09:14.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(100 notify.4 [notify cookie 93827562078768 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== watch-notify(notify_complete (2) cookie 93827562078768 notify 128849018893 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555ee7fe410 con 0x5555ee7e42f0 2024-05-08T18:09:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 10 removing user index: testx$tenanteduser 2024-05-08T18:09:14.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee81fd90 con 0x7fb7a8031040 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.791+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93827562078768 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x5555ee81f230 con 0x7fb7a4027060 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== watch-notify(notify (1) cookie 93827561885744 notify 128849018904 ret 0) ==== 209+0+0 (crc 0 0 0) 0x5555ee802240 con 0x7fb7a4027060 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb6927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018904 cookie 93827561885744 notifier 4562 bl.length()=167 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb6927fc640 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fb5e40032d0 con 0x7fb7a4027060 2024-05-08T18:09:14.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(103 notify.3 [notify cookie 93827562078768 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== watch-notify(notify_complete (2) cookie 93827562078768 notify 128849018904 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5555ee7fbca0 con 0x7fb7a4027060 2024-05-08T18:09:14.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93827561896608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f9440 con 0x5555ee7e42f0 2024-05-08T18:09:14.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93827561896608] v30'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.795+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93827561872496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f9440 con 0x7fb7a4027060 2024-05-08T18:09:14.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93827561872496] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7b1a14980 20 remove_watcher() i=0 2024-05-08T18:09:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7b1a14980 2 removed watcher, disabling cache 2024-05-08T18:09:14.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93827561874704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f9440 con 0x5555ee7e42f0 2024-05-08T18:09:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93827561874704] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7b1a14980 20 remove_watcher() i=1 2024-05-08T18:09:14.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.799+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93827561878464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ee510 con 0x5555ee7ea540 2024-05-08T18:09:14.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.803+0000 7fb7aed27640 1 -- 172.21.15.114:0/2900078553 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93827561878464] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a4024030 con 0x5555ee7ea540 2024-05-08T18:09:14.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.803+0000 7fb7b1a14980 20 remove_watcher() i=2 2024-05-08T18:09:14.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.803+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93827561885744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f9440 con 0x7fb7a4027060 2024-05-08T18:09:14.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.803+0000 7fb7afd29640 1 -- 172.21.15.114:0/2900078553 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93827561885744] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a8040040 con 0x7fb7a4027060 2024-05-08T18:09:14.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.803+0000 7fb7b1a14980 20 remove_watcher() i=3 2024-05-08T18:09:14.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.803+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93827561884272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ef3c0 con 0x5555ee7e42f0 2024-05-08T18:09:14.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.807+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93827561884272] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x5555ee7e42f0 2024-05-08T18:09:14.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.807+0000 7fb7b1a14980 20 remove_watcher() i=4 2024-05-08T18:09:14.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.807+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93827561890176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ee510 con 0x7fb7a8031040 2024-05-08T18:09:14.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.807+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93827561890176] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.807+0000 7fb7b1a14980 20 remove_watcher() i=5 2024-05-08T18:09:14.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.807+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93827561893616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7f9440 con 0x7fb7a8031040 2024-05-08T18:09:14.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93827561893616] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 20 remove_watcher() i=6 2024-05-08T18:09:14.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93827561891872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x5555ee7ef3c0 con 0x7fb7a8031040 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93827561891872] v30'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7a00fa040 con 0x7fb7a8031040 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 20 remove_watcher() i=7 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb7a8031040 msgr2=0x7fb7a8032940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb7a8031040 0x7fb7a8032940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee7e42f0 msgr2=0x5555ee7e67b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee7e42f0 0x5555ee7e67b0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb7a4027060 msgr2=0x7fb7a40429d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb7a4027060 0x7fb7a40429d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5555ee7ea540 msgr2=0x5555ee7ec930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5555ee7ea540 0x5555ee7ec930 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6780383f0 msgr2=0x7fb67803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6780383f0 0x7fb67803a8b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x5555ee7b4850 tx=0x7fb7a801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 msgr2=0x5555ee7d8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7af528640 1 -- 172.21.15.114:0/2900078553 reap_dead start 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d8fc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400ef00 tx=0x7fb7a404e320 comp rx=0 tx=0).stop 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 shutdown_connections 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/2900078553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7d1ab0 0x5555ee7d8fc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 >> 172.21.15.114:0/2900078553 conn(0x5555ee7cde40 msgr2=0x5555ee7d3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 shutdown_connections 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.811+0000 7fb7b1a14980 1 -- 172.21.15.114:0/2900078553 wait complete. 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6880383f0 msgr2=0x7fb68803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6880383f0 0x7fb68803a8b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x5555ee7b55c0 tx=0x7fb7a8005850 comp rx=0 tx=0).stop 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 msgr2=0x5555ee7c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 0x5555ee7c4cf0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb7a400e670 tx=0x7fb7a400ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:14.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 shutdown_connections 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb6880383f0 0x7fb68803a8b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/1882489016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee7c48d0 0x5555ee7c4cf0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 >> 172.21.15.114:0/1882489016 conn(0x5555ee7b96e0 msgr2=0x5555ee7ba1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 shutdown_connections 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/1882489016 wait complete. 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee62dfe0 msgr2=0x5555ee7b3a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee62dfe0 0x5555ee7b3a80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb694038440 msgr2=0x7fb69403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb694038440 0x7fb69403a900 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4001e40 tx=0x7fb7a40013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 msgr2=0x5555ee7acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7acb40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb7a001b170 tx=0x7fb7a00180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 shutdown_connections 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5555ee62dfe0 0x5555ee7b3a80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb694038440 0x7fb69403a900 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 --2- 172.21.15.114:0/3299037517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555ee62cb20 0x5555ee7acb40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 >> 172.21.15.114:0/3299037517 conn(0x5555ee6b37b0 msgr2=0x5555ee79fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 shutdown_connections 2024-05-08T18:09:14.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.815+0000 7fb7b1a14980 1 -- 172.21.15.114:0/3299037517 wait complete. 2024-05-08T18:09:14.835 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T18:09:14.838 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-08T18:09:14.841 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:14.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T18:09:14.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T18:09:14.842 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-08T18:09:14.908 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:14.908 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:14.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.907+0000 7f5f4d5d6980 1 Processor -- start 2024-05-08T18:09:14.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.907+0000 7f5f4d5d6980 1 -- start start 2024-05-08T18:09:14.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.907+0000 7f5f4d5d6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bb85bd7ee0 0x55bb85bd82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.907+0000 7f5f4d5d6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb85a83710 con 0x55bb85bd8800 2024-05-08T18:09:14.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.907+0000 7f5f4d5d6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bb85a97f00 con 0x55bb85bd7ee0 2024-05-08T18:09:14.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4b0ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bb85bd7ee0 0x55bb85bd82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4b0ea640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bb85bd7ee0 0x55bb85bd82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59068/0 (socket says 172.21.15.114:59068) 2024-05-08T18:09:14.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2271402651 learned_addr learned my addr 172.21.15.114:0/2271402651 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2271402651 >> v1:172.21.15.53:6789/0 conn(0x55bb85bd8800 legacy=0x55bb85bd9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2271402651 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb85a5fae0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/2271402651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85bd82c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a5c0 tx=0x7f5f3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccaae5449cc6395 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4a0e8640 1 -- 172.21.15.114:0/2271402651 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c0a6070 con 0x55bb85bd7ee0 2024-05-08T18:09:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4a0e8640 1 -- 172.21.15.114:0/2271402651 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0af070 con 0x55bb85bd7ee0 2024-05-08T18:09:14.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.911+0000 7f5f4a0e8640 1 -- 172.21.15.114:0/2271402651 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c0aa5c0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2271402651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 msgr2=0x55bb85bd82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2271402651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85bd82c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a5c0 tx=0x7f5f3c01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:14.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2271402651 shutdown_connections 2024-05-08T18:09:14.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2271402651 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85bd82c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2271402651 >> 172.21.15.114:0/2271402651 conn(0x55bb85bd37b0 msgr2=0x55bb85bd5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2271402651 shutdown_connections 2024-05-08T18:09:14.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.915+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2271402651 wait complete. 2024-05-08T18:09:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.927+0000 7f5f4d5d6980 1 Processor -- start 2024-05-08T18:09:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- start start 2024-05-08T18:09:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85cc36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb85adbf80 con 0x55bb85bd7ee0 2024-05-08T18:09:14.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85cc36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85cc36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59080/0 (socket says 172.21.15.114:59080) 2024-05-08T18:09:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2979535623 learned_addr learned my addr 172.21.15.114:0/2979535623 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2979535623 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb85aa3da0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/2979535623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85cc36b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a5c0 tx=0x7f5f3c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fa6ecd6119433a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5e3960a640 1 -- 172.21.15.114:0/2979535623 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c0aa9f0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5e3960a640 1 -- 172.21.15.114:0/2979535623 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0aab90 con 0x55bb85bd7ee0 2024-05-08T18:09:14.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5e3960a640 1 -- 172.21.15.114:0/2979535623 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c0bd3f0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2979535623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 msgr2=0x55bb85cc36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2979535623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85cc36b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00a5c0 tx=0x7f5f3c003030 comp rx=0 tx=0).stop 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2979535623 shutdown_connections 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2979535623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85cc36b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2979535623 >> 172.21.15.114:0/2979535623 conn(0x55bb85bd37b0 msgr2=0x55bb85cbf240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2979535623 shutdown_connections 2024-05-08T18:09:14.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2979535623 wait complete. 2024-05-08T18:09:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 Processor -- start 2024-05-08T18:09:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- start start 2024-05-08T18:09:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85ccaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4d5d6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb85be1ee0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.931+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85ccaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4b0ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85ccaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59090/0 (socket says 172.21.15.114:59090) 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2355436336 learned_addr learned my addr 172.21.15.114:0/2355436336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb85ccaff0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85ccaab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0199f0 tx=0x7f5f3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5e37e07640 1 -- 172.21.15.114:0/2355436336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c0c6750 con 0x55bb85bd7ee0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5e37e07640 1 -- 172.21.15.114:0/2355436336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3c0c68f0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5e37e07640 1 -- 172.21.15.114:0/2355436336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f3c0c6bd0 con 0x55bb85bd7ee0 2024-05-08T18:09:14.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb85ccb280 con 0x55bb85bd7ee0 2024-05-08T18:09:14.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb85ccdf10 con 0x55bb85bd7ee0 2024-05-08T18:09:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5e37e07640 1 -- 172.21.15.114:0/2355436336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5f3c0ce020 con 0x55bb85bd7ee0 2024-05-08T18:09:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5e37e07640 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038490 0x7f5e3003a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5e37e07640 1 -- 172.21.15.114:0/2355436336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f5f3c0cc020 con 0x55bb85bd7ee0 2024-05-08T18:09:14.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038490 0x7f5e3003a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85bd8800 0x55bb85cd1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85cd20a0 con 0x55bb85bd8800 2024-05-08T18:09:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85bd8800 0x55bb85cd1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038490 0x7f5e3003a950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f400015d0 tx=0x7f5f400066b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.935+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85bd8800 0x55bb85cd1a30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/2355436336 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f440083f0 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85cd2960 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/2355436336 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f440083f0 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85cd3d10 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/2355436336 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f440083f0 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85cd31b0 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/2355436336 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f440083f0 con 0x55bb85bd8800 2024-05-08T18:09:14.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85cd35d0 con 0x55bb85bd8800 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/2355436336 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f440083f0 con 0x55bb85bd8800 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 Processor -- start 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 -- start start 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 0x55bb85ce2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4d5d6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb85adffc0 con 0x55bb85ce2840 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4a8e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 0x55bb85ce2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4a8e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 0x55bb85ce2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59104/0 (socket says 172.21.15.114:59104) 2024-05-08T18:09:14.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/3520699446 learned_addr learned my addr 172.21.15.114:0/3520699446 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/3520699446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb85ce31a0 con 0x55bb85ce2840 2024-05-08T18:09:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.939+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 0x55bb85ce2c60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5f40012630 tx=0x7f5f40015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5e35602640 1 -- 172.21.15.114:0/3520699446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400152c0 con 0x55bb85ce2840 2024-05-08T18:09:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5e35602640 1 -- 172.21.15.114:0/3520699446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f40020430 con 0x55bb85ce2840 2024-05-08T18:09:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5e35602640 1 -- 172.21.15.114:0/3520699446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40020710 con 0x55bb85ce2840 2024-05-08T18:09:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb85ce3c40 con 0x55bb85ce2840 2024-05-08T18:09:14.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb85ce4110 con 0x55bb85ce2840 2024-05-08T18:09:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5e35602640 1 -- 172.21.15.114:0/3520699446 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5f40010070 con 0x55bb85ce2840 2024-05-08T18:09:14.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5e35602640 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e24038440 0x7f5e2403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5e35602640 1 -- 172.21.15.114:0/3520699446 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f5f4001b070 con 0x55bb85ce2840 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e24038440 0x7f5e2403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4d5d6980 1 Processor -- start 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4d5d6980 1 -- start start 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e24038440 0x7f5e2403a900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55bb85cd3550 tx=0x7f5f44003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4d5d6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85b4e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4d5d6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb85cc3d40 con 0x55bb85b4dc10 2024-05-08T18:09:14.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4a8e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85b4e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4a8e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85b4e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59110/0 (socket says 172.21.15.114:59110) 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/2484681171 learned_addr learned my addr 172.21.15.114:0/2484681171 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/2484681171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb85b4c460 con 0x55bb85b4dc10 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.943+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/2484681171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85b4e030 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5f4001d9c0 tx=0x7f5f4001dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334229c8ac826555 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5e2effd640 1 -- 172.21.15.114:0/2484681171 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40043070 con 0x55bb85b4dc10 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5e2effd640 1 -- 172.21.15.114:0/2484681171 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4004d460 con 0x55bb85b4dc10 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5e2effd640 1 -- 172.21.15.114:0/2484681171 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4001d4a0 con 0x55bb85b4dc10 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2484681171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 msgr2=0x55bb85b4e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2484681171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85b4e030 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5f4001d9c0 tx=0x7f5f4001dce0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2484681171 shutdown_connections 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2484681171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85b4e030 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2484681171 >> 172.21.15.114:0/2484681171 conn(0x55bb85cebe30 msgr2=0x55bb85ce9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2484681171 shutdown_connections 2024-05-08T18:09:14.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2484681171 wait complete. 2024-05-08T18:09:14.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 Processor -- start 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- start start 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85cf9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bb85b4c900 con 0x55bb85b4dc10 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4a8e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85cf9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4a8e9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85cf9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59122/0 (socket says 172.21.15.114:59122) 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 learned_addr learned my addr 172.21.15.114:0/1070674117 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb85cf9740 con 0x55bb85b4dc10 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85cf9200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5f4001d9c0 tx=0x7f5f4004e850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5e2d7fa640 1 -- 172.21.15.114:0/1070674117 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f40043070 con 0x55bb85b4dc10 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb85cf99d0 con 0x55bb85b4dc10 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5e2d7fa640 1 -- 172.21.15.114:0/1070674117 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f40010750 con 0x55bb85b4dc10 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5e2d7fa640 1 -- 172.21.15.114:0/1070674117 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4001d670 con 0x55bb85b4dc10 2024-05-08T18:09:14.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.947+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb85cfc6b0 con 0x55bb85b4dc10 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5e2d7fa640 1 -- 172.21.15.114:0/1070674117 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5f40030070 con 0x55bb85b4dc10 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5e2d7fa640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e140383f0 0x7f5e1403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5e2d7fa640 1 -- 172.21.15.114:0/1070674117 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f5f4004d050 con 0x55bb85b4dc10 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e140383f0 0x7f5e1403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85d046b0 0x55bb85d06b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d072c0 con 0x55bb85d046b0 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85d046b0 0x55bb85d06b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e140383f0 0x7f5e1403a8b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f44008fd0 tx=0x7f5f4401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85d046b0 0x55bb85d06b70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 realm 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d076d0 con 0x55bb85d046b0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d07fa0 con 0x55bb85d046b0 2024-05-08T18:09:14.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d08340 con 0x55bb85d046b0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d08b90 con 0x55bb85d046b0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:14.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 20 searching for the correct realm 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bb85d0a620 0x55bb85d0cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bb85d0a620 0x55bb85d0cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.951+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bb85d0a620 0x55bb85d0cae0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4a8e9640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f40013040 0x7f5f4004ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f40013040 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f40013040 0x7f5f4004ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f40013040 0x7f5f4004ea00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b8eb640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f44019040 0x7f5f44019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f44019040 0x7f5f44019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:14.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f44019040 0x7f5f44019930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:14.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.955+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f40013040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f40013040 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.959+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f40013040 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.963+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f40013040 2024-05-08T18:09:14.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d0a620 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f44019040 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x55bb85d046b0 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d1b0 con 0x7f5f40013040 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:14.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d093e0 con 0x55bb85d046b0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d097d0 con 0x55bb85d046b0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d097d0 con 0x55bb85d046b0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 zone default found 2024-05-08T18:09:14.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 4 Realm: () 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 zonegroup default 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.967+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0d630 con 0x7f5f44019040 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0f040 con 0x55bb85d0a620 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:14.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0f510 con 0x55bb85d0a620 2024-05-08T18:09:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 started sync module instance, tier type = 2024-05-08T18:09:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:14.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0e4b0 con 0x7f5f40013040 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94263892306080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0e110 con 0x7f5f40013040 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d10440 con 0x55bb85d046b0 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.971+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94263892306080] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94263892310384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d10440 con 0x55bb85d046b0 2024-05-08T18:09:14.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d10e00 con 0x55bb85d0a620 2024-05-08T18:09:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94263892314448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d11650 con 0x55bb85d0a620 2024-05-08T18:09:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d12010 con 0x7f5f40013040 2024-05-08T18:09:14.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.975+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94263892310384] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94263892319072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d11f80 con 0x7f5f40013040 2024-05-08T18:09:14.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d12ed0 con 0x55bb85d046b0 2024-05-08T18:09:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94263892314448] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94263892319072] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94263892321280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d12a20 con 0x55bb85d046b0 2024-05-08T18:09:14.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.979+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d13270 con 0x7f5f44019040 2024-05-08T18:09:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94263892321280] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94263892322848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d132f0 con 0x7f5f44019040 2024-05-08T18:09:14.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d13b40 con 0x7f5f44019040 2024-05-08T18:09:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94263892325584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d13f40 con 0x7f5f44019040 2024-05-08T18:09:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d14a60 con 0x7f5f44019040 2024-05-08T18:09:14.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.983+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94263892322848] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94263892329776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d14a20 con 0x7f5f44019040 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=0 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=1 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=2 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=3 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=4 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=5 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94263892325584] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=6 2024-05-08T18:09:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94263892329776] v30'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 20 add_watcher() i=7 2024-05-08T18:09:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d139d0 con 0x55bb85d046b0 2024-05-08T18:09:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.987+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94263892326800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d14e50 con 0x55bb85d046b0 2024-05-08T18:09:14.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94263892326800] v30'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5e027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5f4d5d6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5f4d5d6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:14.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d203e0 con 0x55bb85d046b0 2024-05-08T18:09:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.991+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d20ab0 con 0x7f5f44019040 2024-05-08T18:09:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.995+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:14.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.995+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d20ab0 con 0x55bb85d0a620 2024-05-08T18:09:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.995+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:14.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.995+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d20e50 con 0x55bb85d046b0 2024-05-08T18:09:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.995+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:14.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.995+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d20e50 con 0x7f5f40013040 2024-05-08T18:09:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.999+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:14.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.999+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d214c0 con 0x55bb85d0a620 2024-05-08T18:09:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.999+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:14.999+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d21550 con 0x55bb85d046b0 2024-05-08T18:09:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.003+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.003+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d21550 con 0x7f5f44019040 2024-05-08T18:09:15.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.003+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.003+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d21550 con 0x7f5f40013040 2024-05-08T18:09:15.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.007+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.007+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d21b20 con 0x55bb85d0a620 2024-05-08T18:09:15.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.007+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.007+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d21bb0 con 0x7f5f40013040 2024-05-08T18:09:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.007+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.007+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22120 con 0x7f5f44019040 2024-05-08T18:09:15.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.011+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.011+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22120 con 0x7f5f40013040 2024-05-08T18:09:15.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.011+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.011+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d222e0 con 0x7f5f44019040 2024-05-08T18:09:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.015+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.015+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d222e0 con 0x55bb85d046b0 2024-05-08T18:09:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.015+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.015+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d222e0 con 0x55bb85d0a620 2024-05-08T18:09:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.019+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.019+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22370 con 0x7f5f40013040 2024-05-08T18:09:15.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.019+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.019+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22400 con 0x55bb85d0a620 2024-05-08T18:09:15.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.019+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.019+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22400 con 0x55bb85d046b0 2024-05-08T18:09:15.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.023+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.023+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22400 con 0x55bb85d046b0 2024-05-08T18:09:15.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.023+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.023+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22400 con 0x55bb85d0a620 2024-05-08T18:09:15.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.027+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.027+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d22400 con 0x7f5f40013040 2024-05-08T18:09:15.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.027+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.027+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x55bb85d0a620 2024-05-08T18:09:15.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.031+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.031+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x55bb85d0a620 2024-05-08T18:09:15.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.031+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.031+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x55bb85d0a620 2024-05-08T18:09:15.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.031+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.031+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x55bb85d0a620 2024-05-08T18:09:15.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.035+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.035+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x7f5f44019040 2024-05-08T18:09:15.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.035+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.035+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x55bb85d0a620 2024-05-08T18:09:15.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.039+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.039+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x7f5f44019040 2024-05-08T18:09:15.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.039+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.039+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x55bb85d0a620 2024-05-08T18:09:15.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.043+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.043+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x7f5f44019040 2024-05-08T18:09:15.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d224b0 con 0x7f5f40013040 2024-05-08T18:09:15.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5e017e2640 20 reqs_thread_entry: start 2024-05-08T18:09:15.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4d5d6980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:15.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4d5d6980 20 Filter name: none 2024-05-08T18:09:15.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5dfa7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:15.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4d5d6980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:15.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.047+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d3ddd0 con 0x7f5f40013040 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d3f730 con 0x55bb85d046b0 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(95 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 get_obj_state: octx=0x7f5f44005e50 obj=myfoo:four state=0x55bb85d404e8 s->prefetch_data=0 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 3.3s0 3:c1163364:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d416e0 con 0x7f5f40013040 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(96 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+867 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 10 manifest: total_size = 4 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.14833905978618446040 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 get_obj_state: octx=0x7f5f44005e50 obj=myfoo:four state=0x55bb85d404e8 s->prefetch_data=0 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 prepare_atomic_modification: state is not atomic. state=0x55bb85d404e8 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 2024-05-08T18:09:15.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d46160 con 0x55bb85d0a620 2024-05-08T18:09:15.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(97 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.051+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 3.3s0 3:c1163364:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d46160 con 0x7f5f40013040 2024-05-08T18:09:15.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.055+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(98 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1_four [call] v30'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.055+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d46bf0 con 0x55bb85d0a620 2024-05-08T18:09:15.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.055+0000 7f5e027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.055+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94263892326800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d46bf0 con 0x55bb85d046b0 2024-05-08T18:09:15.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.055+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(99 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [stat,call,call] v30'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.055+0000 7f5e2effd640 20 handle_completion(): completion ok for obj=four 2024-05-08T18:09:15.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.059+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94263892326800] v30'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.059+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94263892306080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d46bf0 con 0x7f5f40013040 2024-05-08T18:09:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.059+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94263892306080] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.059+0000 7f5f4d5d6980 20 remove_watcher() i=0 2024-05-08T18:09:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.059+0000 7f5f4d5d6980 2 removed watcher, disabling cache 2024-05-08T18:09:15.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.059+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94263892310384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0e8a0 con 0x55bb85d046b0 2024-05-08T18:09:15.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.063+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94263892310384] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.063+0000 7f5f4d5d6980 20 remove_watcher() i=1 2024-05-08T18:09:15.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.063+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94263892314448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0f970 con 0x55bb85d0a620 2024-05-08T18:09:15.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.063+0000 7f5f4a8e9640 1 -- 172.21.15.114:0/1070674117 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94263892314448] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f40059040 con 0x55bb85d0a620 2024-05-08T18:09:15.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.063+0000 7f5f4d5d6980 20 remove_watcher() i=2 2024-05-08T18:09:15.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.063+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94263892319072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0e8a0 con 0x7f5f40013040 2024-05-08T18:09:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.067+0000 7f5f4b8eb640 1 -- 172.21.15.114:0/1070674117 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94263892319072] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4402f040 con 0x7f5f40013040 2024-05-08T18:09:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.067+0000 7f5f4d5d6980 20 remove_watcher() i=3 2024-05-08T18:09:15.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.067+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94263892321280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d10950 con 0x55bb85d046b0 2024-05-08T18:09:15.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.067+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94263892321280] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x55bb85d046b0 2024-05-08T18:09:15.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.067+0000 7f5f4d5d6980 20 remove_watcher() i=4 2024-05-08T18:09:15.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.067+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94263892322848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d11b60 con 0x7f5f44019040 2024-05-08T18:09:15.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.071+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94263892322848] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.071+0000 7f5f4d5d6980 20 remove_watcher() i=5 2024-05-08T18:09:15.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.071+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94263892325584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d0e8a0 con 0x7f5f44019040 2024-05-08T18:09:15.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.071+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94263892325584] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.071+0000 7f5f4d5d6980 20 remove_watcher() i=6 2024-05-08T18:09:15.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.071+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94263892329776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55bb85d10950 con 0x7f5f44019040 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94263892329776] v30'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f3c0c6d70 con 0x7f5f44019040 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 20 remove_watcher() i=7 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f44019040 msgr2=0x7f5f44019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f44019040 0x7f5f44019930 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85d046b0 msgr2=0x55bb85d06b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85d046b0 0x55bb85d06b70 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f40013040 msgr2=0x7f5f4004ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f40013040 0x7f5f4004ea00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bb85d0a620 msgr2=0x55bb85d0cae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bb85d0a620 0x55bb85d0cae0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e140383f0 msgr2=0x7f5e1403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e140383f0 0x7f5e1403a8b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5f44008fd0 tx=0x7f5f4401b070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 msgr2=0x55bb85cf9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4b0ea640 1 -- 172.21.15.114:0/1070674117 reap_dead start 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85cf9200 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5f4001d9c0 tx=0x7f5f4004e850 comp rx=0 tx=0).stop 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 shutdown_connections 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/1070674117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85b4dc10 0x55bb85cf9200 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 >> 172.21.15.114:0/1070674117 conn(0x55bb85cebe30 msgr2=0x55bb85ce9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 shutdown_connections 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/1070674117 wait complete. 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e24038440 msgr2=0x7f5e2403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e24038440 0x7f5e2403a900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55bb85cd3550 tx=0x7f5f44003070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 msgr2=0x55bb85ce2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 0x55bb85ce2c60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5f40012630 tx=0x7f5f40015f90 comp rx=0 tx=0).stop 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 shutdown_connections 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e24038440 0x7f5e2403a900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/3520699446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85ce2840 0x55bb85ce2c60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 >> 172.21.15.114:0/3520699446 conn(0x55bb85cd7650 msgr2=0x55bb85cd8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 shutdown_connections 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/3520699446 wait complete. 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85bd8800 msgr2=0x55bb85cd1a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85bd8800 0x55bb85cd1a30 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038490 msgr2=0x7f5e3003a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038490 0x7f5e3003a950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f400015d0 tx=0x7f5f400066b0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 msgr2=0x55bb85ccaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85ccaab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0199f0 tx=0x7f5f3c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 shutdown_connections 2024-05-08T18:09:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bb85bd8800 0x55bb85cd1a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038490 0x7f5e3003a950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 --2- 172.21.15.114:0/2355436336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bb85bd7ee0 0x55bb85ccaab0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 >> 172.21.15.114:0/2355436336 conn(0x55bb85bd37b0 msgr2=0x55bb85cbdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 shutdown_connections 2024-05-08T18:09:15.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.075+0000 7f5f4d5d6980 1 -- 172.21.15.114:0/2355436336 wait complete. 2024-05-08T18:09:15.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:09:15.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T18:09:15.091 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T18:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:15.171 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3815761980 1 Processor -- start 2024-05-08T18:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3815761980 1 -- start start 2024-05-08T18:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3815761980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558ac2973680 0x558ac2975a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3815761980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ac2818710 con 0x558ac28e0f50 2024-05-08T18:09:15.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3815761980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558ac282cf00 con 0x558ac2973680 2024-05-08T18:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3812a74640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558ac2973680 0x558ac2975a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3812a74640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558ac2973680 0x558ac2975a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59138/0 (socket says 172.21.15.114:59138) 2024-05-08T18:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3813275640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558ac28e0f50 0x558ac2971f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34812/0 (socket says 172.21.15.114:34812) 2024-05-08T18:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3812a74640 1 -- 172.21.15.114:0/3561047485 learned_addr learned my addr 172.21.15.114:0/3561047485 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3812a74640 1 -- 172.21.15.114:0/3561047485 >> v1:172.21.15.53:6789/0 conn(0x558ac28e0f50 legacy=0x558ac2971f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.171+0000 7f3812a74640 1 -- 172.21.15.114:0/3561047485 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac27f4ae0 con 0x558ac2973680 2024-05-08T18:09:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3812a74640 1 --2- 172.21.15.114:0/3561047485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2973680 0x558ac2975a70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f380800a5c0 tx=0x7f380801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11d0842eda223d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3812273640 1 -- 172.21.15.114:0/3561047485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080a6070 con 0x558ac2973680 2024-05-08T18:09:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3812273640 1 -- 172.21.15.114:0/3561047485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38080af070 con 0x558ac2973680 2024-05-08T18:09:15.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3812273640 1 -- 172.21.15.114:0/3561047485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080aa5c0 con 0x558ac2973680 2024-05-08T18:09:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 -- 172.21.15.114:0/3561047485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2973680 msgr2=0x558ac2975a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 --2- 172.21.15.114:0/3561047485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2973680 0x558ac2975a70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f380800a5c0 tx=0x7f380801b340 comp rx=0 tx=0).stop 2024-05-08T18:09:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 -- 172.21.15.114:0/3561047485 shutdown_connections 2024-05-08T18:09:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 --2- 172.21.15.114:0/3561047485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2973680 0x558ac2975a70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 -- 172.21.15.114:0/3561047485 >> 172.21.15.114:0/3561047485 conn(0x558ac2967640 msgr2=0x558ac2969a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 -- 172.21.15.114:0/3561047485 shutdown_connections 2024-05-08T18:09:15.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.175+0000 7f3815761980 1 -- 172.21.15.114:0/3561047485 wait complete. 2024-05-08T18:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3815761980 1 Processor -- start 2024-05-08T18:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3815761980 1 -- start start 2024-05-08T18:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3815761980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a5a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3815761980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ac2870f80 con 0x558ac28e0f50 2024-05-08T18:09:15.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3813275640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a5a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3813275640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a5a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59144/0 (socket says 172.21.15.114:59144) 2024-05-08T18:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.191+0000 7f3813275640 1 -- 172.21.15.114:0/3745269707 learned_addr learned my addr 172.21.15.114:0/3745269707 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 -- 172.21.15.114:0/3745269707 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac2838da0 con 0x558ac28e0f50 2024-05-08T18:09:15.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 --2- 172.21.15.114:0/3745269707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a5a170 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3804001680 tx=0x7f3804001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee777b1e12c2496 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f370160a640 1 -- 172.21.15.114:0/3745269707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3804013420 con 0x558ac28e0f50 2024-05-08T18:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f370160a640 1 -- 172.21.15.114:0/3745269707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38040135c0 con 0x558ac28e0f50 2024-05-08T18:09:15.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f370160a640 1 -- 172.21.15.114:0/3745269707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38040138e0 con 0x558ac28e0f50 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/3745269707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 msgr2=0x558ac2a5a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 --2- 172.21.15.114:0/3745269707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a5a170 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3804001680 tx=0x7f3804001b40 comp rx=0 tx=0).stop 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/3745269707 shutdown_connections 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 --2- 172.21.15.114:0/3745269707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a5a170 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/3745269707 >> 172.21.15.114:0/3745269707 conn(0x558ac2967640 msgr2=0x558ac2a55d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/3745269707 shutdown_connections 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/3745269707 wait complete. 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 Processor -- start 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- start start 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a61650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ac2978a10 con 0x558ac28e0f50 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a61650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a61650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59158/0 (socket says 172.21.15.114:59158) 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 -- 172.21.15.114:0/2906348862 learned_addr learned my addr 172.21.15.114:0/2906348862 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac2a61b90 con 0x558ac28e0f50 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3813275640 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a61650 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3804002260 tx=0x7f3804000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f36ffe07640 1 -- 172.21.15.114:0/2906348862 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38040037a0 con 0x558ac28e0f50 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f36ffe07640 1 -- 172.21.15.114:0/2906348862 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3804023070 con 0x558ac28e0f50 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ac2a61e20 con 0x558ac28e0f50 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f36ffe07640 1 -- 172.21.15.114:0/2906348862 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3804003a70 con 0x558ac28e0f50 2024-05-08T18:09:15.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.195+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac2a64b00 con 0x558ac28e0f50 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f36ffe07640 1 -- 172.21.15.114:0/2906348862 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3804010070 con 0x558ac28e0f50 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f36ffe07640 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36f80383f0 0x7f36f803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f36ffe07640 1 -- 172.21.15.114:0/2906348862 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f380404e7c0 con 0x558ac28e0f50 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3812a74640 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36f80383f0 0x7f36f803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2973680 0x558ac2a68620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a68c60 con 0x558ac2973680 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3813a76640 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2973680 0x558ac2a68620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3812a74640 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36f80383f0 0x7f36f803a8b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f38080ae000 tx=0x7f38080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3813a76640 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2973680 0x558ac2a68620 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3813a76640 1 -- 172.21.15.114:0/2906348862 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380c0083f0 con 0x558ac2973680 2024-05-08T18:09:15.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a65d20 con 0x558ac2973680 2024-05-08T18:09:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3813a76640 1 -- 172.21.15.114:0/2906348862 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f380c0083f0 con 0x558ac2973680 2024-05-08T18:09:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a6aaa0 con 0x558ac2973680 2024-05-08T18:09:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3813a76640 1 -- 172.21.15.114:0/2906348862 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f380c0083f0 con 0x558ac2973680 2024-05-08T18:09:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a69cd0 con 0x558ac2973680 2024-05-08T18:09:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3813a76640 1 -- 172.21.15.114:0/2906348862 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f380c0083f0 con 0x558ac2973680 2024-05-08T18:09:15.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.199+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a6a0f0 con 0x558ac2973680 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3813a76640 1 -- 172.21.15.114:0/2906348862 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f380c0083f0 con 0x558ac2973680 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3815761980 1 Processor -- start 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3815761980 1 -- start start 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3815761980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 0x558ac2a797d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3815761980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ac2874fc0 con 0x558ac2a793b0 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3812a74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 0x558ac2a797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3812a74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 0x558ac2a797d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59166/0 (socket says 172.21.15.114:59166) 2024-05-08T18:09:15.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3812a74640 1 -- 172.21.15.114:0/2610082327 learned_addr learned my addr 172.21.15.114:0/2610082327 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3812a74640 1 -- 172.21.15.114:0/2610082327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac2a79d10 con 0x558ac2a793b0 2024-05-08T18:09:15.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3812a74640 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 0x558ac2a797d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f38080ac040 tx=0x7f38080180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f36fd602640 1 -- 172.21.15.114:0/2610082327 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080b3b80 con 0x558ac2a793b0 2024-05-08T18:09:15.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f36fd602640 1 -- 172.21.15.114:0/2610082327 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38080b3d20 con 0x558ac2a793b0 2024-05-08T18:09:15.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f36fd602640 1 -- 172.21.15.114:0/2610082327 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080c8560 con 0x558ac2a793b0 2024-05-08T18:09:15.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ac2a7a7b0 con 0x558ac2a793b0 2024-05-08T18:09:15.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.203+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac2a7ac20 con 0x558ac2a793b0 2024-05-08T18:09:15.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f36fd602640 1 -- 172.21.15.114:0/2610082327 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f38080d1440 con 0x558ac2a793b0 2024-05-08T18:09:15.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f36fd602640 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36ec038440 0x7f36ec03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f36fd602640 1 -- 172.21.15.114:0/2610082327 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f38080ec130 con 0x558ac2a793b0 2024-05-08T18:09:15.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3813a76640 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36ec038440 0x7f36ec03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 Processor -- start 2024-05-08T18:09:15.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- start start 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3813a76640 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36ec038440 0x7f36ec03a900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x558ac2a6a070 tx=0x7f380c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a86890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ac2a5a8c0 con 0x558ac2a86490 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3812a74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a86890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3812a74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a86890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59176/0 (socket says 172.21.15.114:59176) 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3812a74640 1 -- 172.21.15.114:0/819439200 learned_addr learned my addr 172.21.15.114:0/819439200 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3812a74640 1 -- 172.21.15.114:0/819439200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac2a86e60 con 0x558ac2a86490 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3812a74640 1 --2- 172.21.15.114:0/819439200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a86890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f38080b3fd0 tx=0x7f38080d1b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4619433f345ce9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f36f6ffd640 1 -- 172.21.15.114:0/819439200 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080e7070 con 0x558ac2a86490 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f36f6ffd640 1 -- 172.21.15.114:0/819439200 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38080bd390 con 0x558ac2a86490 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f36f6ffd640 1 -- 172.21.15.114:0/819439200 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080bd580 con 0x558ac2a86490 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- 172.21.15.114:0/819439200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 msgr2=0x558ac2a86890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 --2- 172.21.15.114:0/819439200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a86890 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f38080b3fd0 tx=0x7f38080d1b10 comp rx=0 tx=0).stop 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- 172.21.15.114:0/819439200 shutdown_connections 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 --2- 172.21.15.114:0/819439200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a86890 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- 172.21.15.114:0/819439200 >> 172.21.15.114:0/819439200 conn(0x558ac2a827d0 msgr2=0x558ac2a80830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- 172.21.15.114:0/819439200 shutdown_connections 2024-05-08T18:09:15.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.207+0000 7f3815761980 1 -- 172.21.15.114:0/819439200 wait complete. 2024-05-08T18:09:15.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 Processor -- start 2024-05-08T18:09:15.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 -- start start 2024-05-08T18:09:15.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a8d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ac2a875a0 con 0x558ac2a86490 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3812a74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a8d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3812a74640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a8d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59186/0 (socket says 172.21.15.114:59186) 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 learned_addr learned my addr 172.21.15.114:0/1959301991 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac2a8de70 con 0x558ac2a86490 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3812a74640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a8d930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f38080b3fd0 tx=0x7f38080ea410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f36f57fa640 1 -- 172.21.15.114:0/1959301991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080c7ae0 con 0x558ac2a86490 2024-05-08T18:09:15.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f36f57fa640 1 -- 172.21.15.114:0/1959301991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38080e0070 con 0x558ac2a86490 2024-05-08T18:09:15.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ac2a8e100 con 0x558ac2a86490 2024-05-08T18:09:15.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f36f57fa640 1 -- 172.21.15.114:0/1959301991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38080c7db0 con 0x558ac2a86490 2024-05-08T18:09:15.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac2a8e510 con 0x558ac2a86490 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f36f57fa640 1 -- 172.21.15.114:0/1959301991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f38080f3060 con 0x558ac2a86490 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f36f57fa640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36dc0383f0 0x7f36dc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f36f57fa640 1 -- 172.21.15.114:0/1959301991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f38080edc40 con 0x558ac2a86490 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3813a76640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36dc0383f0 0x7f36dc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2a98e30 0x558ac2a9b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9ba20 con 0x558ac2a98e30 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.211+0000 7f3813275640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2a98e30 0x558ac2a9b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813a76640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36dc0383f0 0x7f36dc03a8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f380c00f010 tx=0x7f380c01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813275640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2a98e30 0x558ac2a9b2d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 realm 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9be30 con 0x558ac2a98e30 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9c700 con 0x558ac2a98e30 2024-05-08T18:09:15.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9caa0 con 0x558ac2a98e30 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9cf40 con 0x558ac2a98e30 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 20 searching for the correct realm 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ac2a9eeb0 0x558ac2aa12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a9eeb0 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3812a74640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ac2a9eeb0 0x558ac2aa12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3812a74640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ac2a9eeb0 0x558ac2aa12a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3812a74640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f38080f5070 0x7f38080eea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f38080f5070 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813a76640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f38080f5070 0x7f38080eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813a76640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f38080f5070 0x7f38080eea10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813a76640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f380c019040 0x7f380c019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.215+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f380c019040 2024-05-08T18:09:15.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f380c019040 0x7f380c019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f380c019040 0x7f380c019930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a98e30 2024-05-08T18:09:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a98e30 2024-05-08T18:09:15.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f380c019040 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f380c019040 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f38080f5070 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a9eeb0 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.219+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a98e30 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f380c019040 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a98e30 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f38080f5070 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a9eeb0 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a9eeb0 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x7f380c019040 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a9eeb0 2024-05-08T18:09:15.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a9eeb0 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa1920 con 0x558ac2a98e30 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x558ac2a98e30 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.223+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f380c019040 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x558ac2a9eeb0 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f38080f5070 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x558ac2a98e30 2024-05-08T18:09:15.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f380c019040 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x558ac2a9eeb0 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f380c019040 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f38080f5070 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x558ac2a9eeb0 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.227+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f380c019040 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x558ac2a98e30 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x7f3804040040 con 0x7f38080f5070 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:15.234 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9d820 con 0x558ac2a98e30 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9dc10 con 0x558ac2a98e30 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9dc10 con 0x558ac2a98e30 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 zone default found 2024-05-08T18:09:15.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 4 Realm: () 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 zonegroup default 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9e030 con 0x7f380c019040 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2a9e030 con 0x558ac2a9eeb0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa3760 con 0x558ac2a9eeb0 2024-05-08T18:09:15.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 started sync module instance, tier type = 2024-05-08T18:09:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:15.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.231+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa2c00 con 0x7f38080f5070 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054459781152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa2860 con 0x7f38080f5070 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa44c0 con 0x558ac2a98e30 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054459781152] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054459783936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa4480 con 0x558ac2a98e30 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.235+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa4ed0 con 0x558ac2a9eeb0 2024-05-08T18:09:15.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054459783936] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054459787808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa52c0 con 0x558ac2a9eeb0 2024-05-08T18:09:15.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa5c80 con 0x7f38080f5070 2024-05-08T18:09:15.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054459791584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa63b0 con 0x7f38080f5070 2024-05-08T18:09:15.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa6ed0 con 0x558ac2a98e30 2024-05-08T18:09:15.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.239+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054459787808] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.242 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054459791584] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054459795872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa6e90 con 0x558ac2a98e30 2024-05-08T18:09:15.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa7770 con 0x7f380c019040 2024-05-08T18:09:15.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054459795872] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054459784992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa7340 con 0x7f380c019040 2024-05-08T18:09:15.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.243+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa7c30 con 0x7f380c019040 2024-05-08T18:09:15.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.247+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054459784992] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.247+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.247+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054459797136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa7d40 con 0x7f380c019040 2024-05-08T18:09:15.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.247+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa8590 con 0x7f380c019040 2024-05-08T18:09:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054459797136] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054459800896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa8610 con 0x7f380c019040 2024-05-08T18:09:15.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=0 2024-05-08T18:09:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=1 2024-05-08T18:09:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=2 2024-05-08T18:09:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=3 2024-05-08T18:09:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=4 2024-05-08T18:09:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=5 2024-05-08T18:09:15.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=6 2024-05-08T18:09:15.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054459800896] v30'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 20 add_watcher() i=7 2024-05-08T18:09:15.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:15.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aab8d0 con 0x558ac2a98e30 2024-05-08T18:09:15.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.251+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054459802320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa8ba0 con 0x558ac2a98e30 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054459802320] v30'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f36c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 5 note: GC not initialized 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f36c8fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 Filter name: none 2024-05-08T18:09:15.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f36427fc640 20 reqs_thread_entry: start 2024-05-08T18:09:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2acf2f0 con 0x7f38080f5070 2024-05-08T18:09:15.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:15.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2acfc60 con 0x558ac2a98e30 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ad1330 con 0x7f38080f5070 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ad1330 con 0x558ac2a98e30 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:15.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 4.2 4:43f4944a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ad2c20 con 0x558ac2a98e30 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 4.33 4:cc48b6a6:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ad55b0 con 0x7f380c019040 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 4.10 4:09fd83a7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ad81d0 con 0x558ac2a9eeb0 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 4.3c 4:3f857315:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2adad50 con 0x558ac2a98e30 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 4.6 4:62dffd56:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2add930 con 0x558ac2a9eeb0 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 4.31 4:8ce771c4:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ae0540 con 0x558ac2a98e30 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:72 4.10 4:0b66cbfc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ae2fc0 con 0x558ac2a9eeb0 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 4.2e 4:776f9cc7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ae5e80 con 0x558ac2a9eeb0 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 4.18 4:1b5001e2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ae86f0 con 0x7f38080f5070 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 4.c 4:30553688:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2ae5e80 con 0x558ac2a98e30 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 4.33 4:ce643036:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aed860 con 0x7f380c019040 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(69 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(66 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(71 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.255+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(75 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(67 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(74 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(70 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(72 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.6 [call out=124b] v0'0 uv8 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(73 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(76 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1.10 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f36c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054459802320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2acfe90 con 0x558ac2a98e30 2024-05-08T18:09:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94054459802320] v30'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.259+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054459781152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa82d0 con 0x7f38080f5070 2024-05-08T18:09:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94054459781152] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3815761980 20 remove_watcher() i=0 2024-05-08T18:09:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3815761980 2 removed watcher, disabling cache 2024-05-08T18:09:15.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054459783936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa82d0 con 0x558ac2a98e30 2024-05-08T18:09:15.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94054459783936] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3815761980 20 remove_watcher() i=1 2024-05-08T18:09:15.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.263+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054459787808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa3b00 con 0x558ac2a9eeb0 2024-05-08T18:09:15.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3812a74640 1 -- 172.21.15.114:0/1959301991 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94054459787808] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38080ce020 con 0x558ac2a9eeb0 2024-05-08T18:09:15.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3815761980 20 remove_watcher() i=2 2024-05-08T18:09:15.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054459791584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa82d0 con 0x7f38080f5070 2024-05-08T18:09:15.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3813a76640 1 -- 172.21.15.114:0/1959301991 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94054459791584] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380c02f040 con 0x7f38080f5070 2024-05-08T18:09:15.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3815761980 20 remove_watcher() i=3 2024-05-08T18:09:15.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054459795872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa3b00 con 0x558ac2a98e30 2024-05-08T18:09:15.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.267+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94054459795872] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x558ac2a98e30 2024-05-08T18:09:15.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3815761980 20 remove_watcher() i=4 2024-05-08T18:09:15.270 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054459784992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa82d0 con 0x7f380c019040 2024-05-08T18:09:15.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94054459784992] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3815761980 20 remove_watcher() i=5 2024-05-08T18:09:15.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054459797136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa82d0 con 0x7f380c019040 2024-05-08T18:09:15.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94054459797136] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3815761980 20 remove_watcher() i=6 2024-05-08T18:09:15.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.271+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054459800896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x558ac2aa6e90 con 0x7f380c019040 2024-05-08T18:09:15.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94054459800896] v30'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f380400f030 con 0x7f380c019040 2024-05-08T18:09:15.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 20 remove_watcher() i=7 2024-05-08T18:09:15.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f380c019040 msgr2=0x7f380c019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f380c019040 0x7f380c019930 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2a98e30 msgr2=0x558ac2a9b2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2a98e30 0x558ac2a9b2d0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f38080f5070 msgr2=0x7f38080eea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f38080f5070 0x7f38080eea10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ac2a9eeb0 msgr2=0x558ac2aa12a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ac2a9eeb0 0x558ac2aa12a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36dc0383f0 msgr2=0x7f36dc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36dc0383f0 0x7f36dc03a8b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f380c00f010 tx=0x7f380c01b070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3813275640 1 -- 172.21.15.114:0/1959301991 reap_dead start 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 msgr2=0x558ac2a8d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a8d930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f38080b3fd0 tx=0x7f38080ea410 comp rx=0 tx=0).stop 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 shutdown_connections 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/1959301991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a86490 0x558ac2a8d930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 >> 172.21.15.114:0/1959301991 conn(0x558ac2a827d0 msgr2=0x558ac2a7fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 shutdown_connections 2024-05-08T18:09:15.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/1959301991 wait complete. 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36ec038440 msgr2=0x7f36ec03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36ec038440 0x7f36ec03a900 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x558ac2a6a070 tx=0x7f380c003070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 msgr2=0x558ac2a797d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 0x558ac2a797d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f38080ac040 tx=0x7f38080180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 shutdown_connections 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36ec038440 0x7f36ec03a900 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2610082327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac2a793b0 0x558ac2a797d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 >> 172.21.15.114:0/2610082327 conn(0x558ac2a6e1c0 msgr2=0x558ac2a6ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 shutdown_connections 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2610082327 wait complete. 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2973680 msgr2=0x558ac2a68620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2973680 0x558ac2a68620 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36f80383f0 msgr2=0x7f36f803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36f80383f0 0x7f36f803a8b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f38080ae000 tx=0x7f38080a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 msgr2=0x558ac2a61650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a61650 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3804002260 tx=0x7f3804000f50 comp rx=0 tx=0).stop 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 shutdown_connections 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ac2973680 0x558ac2a68620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36f80383f0 0x7f36f803a8b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 --2- 172.21.15.114:0/2906348862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ac28e0f50 0x558ac2a61650 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 >> 172.21.15.114:0/2906348862 conn(0x558ac2967640 msgr2=0x558ac2a54810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 shutdown_connections 2024-05-08T18:09:15.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.275+0000 7f3815761980 1 -- 172.21.15.114:0/2906348862 wait complete. 2024-05-08T18:09:15.288 INFO:teuthology.orchestra.run.smithi114.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"50b0c397-f53b-4292-89b3-02a592fb10e2","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","marker":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T18:09:14.517558Z","creation_time":"2024-05-08T18:09:10.628914Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T18:09:15.289 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:09:14.517558Z', 'creation_time': '2024-05-08T18:09:10.628914Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:09:15.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-08T18:09:15.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-08T18:09:15.289 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-08T18:09:15.364 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:15.364 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:15.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.363+0000 7fda00946980 1 Processor -- start 2024-05-08T18:09:15.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.363+0000 7fda00946980 1 -- start start 2024-05-08T18:09:15.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.363+0000 7fda00946980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e33de697d0 0x55e33def7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.363+0000 7fda00946980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e33dda0710 con 0x55e33def80e0 2024-05-08T18:09:15.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.363+0000 7fda00946980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e33ddb4f00 con 0x55e33de697d0 2024-05-08T18:09:15.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.363+0000 7fd9fe45a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e33de697d0 0x55e33def7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.367+0000 7fd9fdc59640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e33def80e0 0x55e33defa4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34814/0 (socket says 172.21.15.114:34814) 2024-05-08T18:09:15.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.367+0000 7fd9fdc59640 1 -- 172.21.15.114:0/2981917979 learned_addr learned my addr 172.21.15.114:0/2981917979 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:15.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.367+0000 7fd9fe45a640 1 -- 172.21.15.114:0/2981917979 >> v1:172.21.15.53:6789/0 conn(0x55e33def80e0 legacy=0x55e33defa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.367+0000 7fd9fe45a640 1 -- 172.21.15.114:0/2981917979 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dd7cae0 con 0x55e33de697d0 2024-05-08T18:09:15.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.367+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/2981917979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33de697d0 0x55e33def7ba0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800a480 tx=0x7fd9e801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f78838ce44f1e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.367+0000 7fd9fd458640 1 -- 172.21.15.114:0/2981917979 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80b0070 con 0x55e33de697d0 2024-05-08T18:09:15.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fd9fd458640 1 -- 172.21.15.114:0/2981917979 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e80ab540 con 0x55e33de697d0 2024-05-08T18:09:15.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fd9fd458640 1 -- 172.21.15.114:0/2981917979 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80ab840 con 0x55e33de697d0 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 -- 172.21.15.114:0/2981917979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33de697d0 msgr2=0x55e33def7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 --2- 172.21.15.114:0/2981917979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33de697d0 0x55e33def7ba0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800a480 tx=0x7fd9e801b280 comp rx=0 tx=0).stop 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 -- 172.21.15.114:0/2981917979 shutdown_connections 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 --2- 172.21.15.114:0/2981917979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33de697d0 0x55e33def7ba0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 -- 172.21.15.114:0/2981917979 >> 172.21.15.114:0/2981917979 conn(0x55e33deef680 msgr2=0x55e33def1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 -- 172.21.15.114:0/2981917979 shutdown_connections 2024-05-08T18:09:15.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.371+0000 7fda00946980 1 -- 172.21.15.114:0/2981917979 wait complete. 2024-05-08T18:09:15.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fda00946980 1 Processor -- start 2024-05-08T18:09:15.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fda00946980 1 -- start start 2024-05-08T18:09:15.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fda00946980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 0x55e33dfe0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fda00946980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e33ddf8f80 con 0x55e33def80e0 2024-05-08T18:09:15.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd9fe45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 0x55e33dfe0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd9fe45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 0x55e33dfe0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59212/0 (socket says 172.21.15.114:59212) 2024-05-08T18:09:15.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd9fe45a640 1 -- 172.21.15.114:0/2082627024 learned_addr learned my addr 172.21.15.114:0/2082627024 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd9fe45a640 1 -- 172.21.15.114:0/2082627024 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33ddc0da0 con 0x55e33def80e0 2024-05-08T18:09:15.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/2082627024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 0x55e33dfe0080 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800a480 tx=0x7fd9e8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdf2fb1e3ed9659 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd8ec608640 1 -- 172.21.15.114:0/2082627024 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80b0040 con 0x55e33def80e0 2024-05-08T18:09:15.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd8ec608640 1 -- 172.21.15.114:0/2082627024 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e80ab8a0 con 0x55e33def80e0 2024-05-08T18:09:15.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.387+0000 7fd8ec608640 1 -- 172.21.15.114:0/2082627024 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80abb80 con 0x55e33def80e0 2024-05-08T18:09:15.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/2082627024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 msgr2=0x55e33dfe0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 --2- 172.21.15.114:0/2082627024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 0x55e33dfe0080 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800a480 tx=0x7fd9e8003030 comp rx=0 tx=0).stop 2024-05-08T18:09:15.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/2082627024 shutdown_connections 2024-05-08T18:09:15.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 --2- 172.21.15.114:0/2082627024 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def80e0 0x55e33dfe0080 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/2082627024 >> 172.21.15.114:0/2082627024 conn(0x55e33deef680 msgr2=0x55e33dfdbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/2082627024 shutdown_connections 2024-05-08T18:09:15.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/2082627024 wait complete. 2024-05-08T18:09:15.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 Processor -- start 2024-05-08T18:09:15.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- start start 2024-05-08T18:09:15.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 0x55e33dfe7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e33defc700 con 0x55e33dfe7660 2024-05-08T18:09:15.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd9fe45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 0x55e33dfe7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd9fe45a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 0x55e33dfe7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59218/0 (socket says 172.21.15.114:59218) 2024-05-08T18:09:15.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd9fe45a640 1 -- 172.21.15.114:0/4231385797 learned_addr learned my addr 172.21.15.114:0/4231385797 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd9fe45a640 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dfe7fc0 con 0x55e33dfe7660 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 0x55e33dfe7a80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80ab510 tx=0x7fd9e8018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd8eae05640 1 -- 172.21.15.114:0/4231385797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80b0070 con 0x55e33dfe7660 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e33dfe8250 con 0x55e33dfe7660 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd8eae05640 1 -- 172.21.15.114:0/4231385797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9e8000e50 con 0x55e33dfe7660 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd8eae05640 1 -- 172.21.15.114:0/4231385797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9e80b67d0 con 0x55e33dfe7660 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33dfead30 con 0x55e33dfe7660 2024-05-08T18:09:15.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.391+0000 7fd8eae05640 1 -- 172.21.15.114:0/4231385797 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd9e80b6970 con 0x55e33dfe7660 2024-05-08T18:09:15.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd8eae05640 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8e40383f0 0x7fd8e403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd8eae05640 1 -- 172.21.15.114:0/4231385797 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fd9e80bc070 con 0x55e33dfe7660 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8e40383f0 0x7fd8e403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33dfeca80 0x55e33dfeee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33dfef4b0 con 0x55e33dfeca80 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33dfeca80 0x55e33dfeee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8e40383f0 0x7fd8e403a8b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0001650 tx=0x7fd9f0006720 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33dfeca80 0x55e33dfeee90 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 -- 172.21.15.114:0/4231385797 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9f80083f0 con 0x55e33dfeca80 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33dfefd50 con 0x55e33dfeca80 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 -- 172.21.15.114:0/4231385797 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9f80083f0 con 0x55e33dfeca80 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33dff1100 con 0x55e33dfeca80 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 -- 172.21.15.114:0/4231385797 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9f80083f0 con 0x55e33dfeca80 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33dff05a0 con 0x55e33dfeca80 2024-05-08T18:09:15.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 -- 172.21.15.114:0/4231385797 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9f80083f0 con 0x55e33dfeca80 2024-05-08T18:09:15.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33dff09c0 con 0x55e33dfeca80 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fec5b640 1 -- 172.21.15.114:0/4231385797 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9f80083f0 con 0x55e33dfeca80 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 Processor -- start 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- start start 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 0x55e33def3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fda00946980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e33ddfcfc0 con 0x55e33def5700 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.395+0000 7fd9fdc59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 0x55e33def3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd9fdc59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 0x55e33def3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59234/0 (socket says 172.21.15.114:59234) 2024-05-08T18:09:15.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd9fdc59640 1 -- 172.21.15.114:0/2495405896 learned_addr learned my addr 172.21.15.114:0/2495405896 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd9fdc59640 1 -- 172.21.15.114:0/2495405896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33def40e0 con 0x55e33def5700 2024-05-08T18:09:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 0x55e33def3ba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0006960 tx=0x7fd9f0015820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd8e3fff640 1 -- 172.21.15.114:0/2495405896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0015240 con 0x55e33def5700 2024-05-08T18:09:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd8e3fff640 1 -- 172.21.15.114:0/2495405896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f0011440 con 0x55e33def5700 2024-05-08T18:09:15.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd8e3fff640 1 -- 172.21.15.114:0/2495405896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0011720 con 0x55e33def5700 2024-05-08T18:09:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e33def4370 con 0x55e33def5700 2024-05-08T18:09:15.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33def4840 con 0x55e33def5700 2024-05-08T18:09:15.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd8e3fff640 1 -- 172.21.15.114:0/2495405896 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd9f00118c0 con 0x55e33def5700 2024-05-08T18:09:15.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd8e3fff640 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8d80383f0 0x7fd8d803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd8e3fff640 1 -- 172.21.15.114:0/2495405896 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fd9f001b030 con 0x55e33def5700 2024-05-08T18:09:15.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8d80383f0 0x7fd8d803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.399+0000 7fda00946980 1 Processor -- start 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- start start 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8d80383f0 0x7fd8d803a8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55e33dff0940 tx=0x7fd9f8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e00f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e33dfe0710 con 0x55e33e00f000 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e00f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e00f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59238/0 (socket says 172.21.15.114:59238) 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3379106859 learned_addr learned my addr 172.21.15.114:0/3379106859 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3379106859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33e00f9d0 con 0x55e33e00f000 2024-05-08T18:09:15.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/3379106859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e00f400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0006f70 tx=0x7fd9f001e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e82e637add099b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd8e1ffb640 1 -- 172.21.15.114:0/3379106859 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0013430 con 0x55e33e00f000 2024-05-08T18:09:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd8e1ffb640 1 -- 172.21.15.114:0/3379106859 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f003eb80 con 0x55e33e00f000 2024-05-08T18:09:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd8e1ffb640 1 -- 172.21.15.114:0/3379106859 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f00135d0 con 0x55e33e00f000 2024-05-08T18:09:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- 172.21.15.114:0/3379106859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 msgr2=0x55e33e00f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 --2- 172.21.15.114:0/3379106859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e00f400 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0006f70 tx=0x7fd9f001e330 comp rx=0 tx=0).stop 2024-05-08T18:09:15.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- 172.21.15.114:0/3379106859 shutdown_connections 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 --2- 172.21.15.114:0/3379106859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e00f400 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- 172.21.15.114:0/3379106859 >> 172.21.15.114:0/3379106859 conn(0x55e33e00b340 msgr2=0x55e33e0093a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- 172.21.15.114:0/3379106859 shutdown_connections 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- 172.21.15.114:0/3379106859 wait complete. 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 Processor -- start 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- start start 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e016430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fda00946980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e33e0100b0 con 0x55e33e00f000 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e016430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e016430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59248/0 (socket says 172.21.15.114:59248) 2024-05-08T18:09:15.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 learned_addr learned my addr 172.21.15.114:0/3418926869 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.403+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33e016970 con 0x55e33e00f000 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e016430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0015d40 tx=0x7fd9f004e560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd8cffff640 1 -- 172.21.15.114:0/3418926869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f0037070 con 0x55e33e00f000 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd8cffff640 1 -- 172.21.15.114:0/3418926869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f001f7f0 con 0x55e33e00f000 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e33e016c00 con 0x55e33e00f000 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd8cffff640 1 -- 172.21.15.114:0/3418926869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9f001fb10 con 0x55e33e00f000 2024-05-08T18:09:15.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33e0198e0 con 0x55e33e00f000 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd8cffff640 1 -- 172.21.15.114:0/3418926869 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd9f003a070 con 0x55e33e00f000 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd8cffff640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8c8038440 0x7fd8c803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd8cffff640 1 -- 172.21.15.114:0/3418926869 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fd9f004d050 con 0x55e33e00f000 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8c8038440 0x7fd8c803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33e021900 0x55e33e023da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e0244f0 con 0x55e33e021900 2024-05-08T18:09:15.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33e021900 0x55e33e023da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8c8038440 0x7fd8c803a900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8008fd0 tx=0x7fd9f801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33e021900 0x55e33e023da0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 realm 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e024950 con 0x55e33e021900 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e0251f0 con 0x55e33e021900 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e025590 con 0x55e33e021900 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.407+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e025de0 con 0x55e33e021900 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 20 searching for the correct realm 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e33e027b50 0x55e33e029f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e33e027b50 0x55e33e029f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e33e027b50 0x55e33e029f40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fdc59640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd9f003c060 0x7fd9f003ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f003c060 2024-05-08T18:09:15.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd9f003c060 0x7fd9f003ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd9f003c060 0x7fd9f003ca90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fec5b640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9f8019040 0x7fd9f8019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9f8019040 0x7fd9f8019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9f8019040 0x7fd9f8019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.411+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f003c060 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f003c060 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.415+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f003c060 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.419+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f003c060 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e027b50 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f8019040 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9e80c6070 con 0x7fd9f8019040 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x55e33e021900 2024-05-08T18:09:15.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02a480 con 0x7fd9f003c060 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x55e33e021900 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9e80c6070 con 0x55e33e021900 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.423+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026340 con 0x55e33e021900 2024-05-08T18:09:15.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e027020 con 0x55e33e021900 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 zone default found 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 4 Realm: () 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 zonegroup default 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e027020 con 0x7fd9f8019040 2024-05-08T18:09:15.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02c290 con 0x55e33e027b50 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02c630 con 0x55e33e027b50 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 started sync module instance, tier type = 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434486303568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b390 con 0x7fd9f003c060 2024-05-08T18:09:15.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.427+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02d370 con 0x55e33e021900 2024-05-08T18:09:15.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434486303568] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434486307280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02d2a0 con 0x55e33e021900 2024-05-08T18:09:15.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02dd80 con 0x55e33e027b50 2024-05-08T18:09:15.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434486311120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02e620 con 0x55e33e027b50 2024-05-08T18:09:15.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02f020 con 0x7fd9f003c060 2024-05-08T18:09:15.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.431+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434486307280] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434486308336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02f410 con 0x7fd9f003c060 2024-05-08T18:09:15.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02fdd0 con 0x55e33e021900 2024-05-08T18:09:15.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434486311120] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434486308336] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434486315824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02f920 con 0x55e33e021900 2024-05-08T18:09:15.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.435+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e030170 con 0x7fd9f8019040 2024-05-08T18:09:15.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434486319664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e030560 con 0x7fd9f8019040 2024-05-08T18:09:15.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e031050 con 0x7fd9f8019040 2024-05-08T18:09:15.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434486315824] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434486319664] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434486324000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e031010 con 0x7fd9f8019040 2024-05-08T18:09:15.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.439+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e031440 con 0x7fd9f8019040 2024-05-08T18:09:15.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434486320848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e0318f0 con 0x7fd9f8019040 2024-05-08T18:09:15.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=0 2024-05-08T18:09:15.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=1 2024-05-08T18:09:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=2 2024-05-08T18:09:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=3 2024-05-08T18:09:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=4 2024-05-08T18:09:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=5 2024-05-08T18:09:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434486324000] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=6 2024-05-08T18:09:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434486320848] v30'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 20 add_watcher() i=7 2024-05-08T18:09:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:15.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55e33e0318f0 con 0x55e33e021900 2024-05-08T18:09:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.443+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434486326336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e031860 con 0x55e33e021900 2024-05-08T18:09:15.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434486326336] v30'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd8b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fda00946980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fda00946980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fda00946980 5 note: GC not initialized 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd82f7fe640 20 reqs_thread_entry: start 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fda00946980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fda00946980 20 Filter name: none 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd82d7fa640 20 reqs_thread_entry: start 2024-05-08T18:09:15.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e057800 con 0x7fd9f8019040 2024-05-08T18:09:15.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x7fd9f8019040 2024-05-08T18:09:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.447+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'5 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x55e33e027b50 2024-05-08T18:09:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x7fd9f8019040 2024-05-08T18:09:15.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x55e33e021900 2024-05-08T18:09:15.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x7fd9f003c060 2024-05-08T18:09:15.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.451+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e021900 2024-05-08T18:09:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e021900 2024-05-08T18:09:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e021900 2024-05-08T18:09:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.455+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e021900 2024-05-08T18:09:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f8019040 2024-05-08T18:09:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'44 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f8019040 2024-05-08T18:09:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.459+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e027b50 2024-05-08T18:09:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x55e33e021900 2024-05-08T18:09:15.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f003c060 2024-05-08T18:09:15.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02b730 con 0x7fd9f8019040 2024-05-08T18:09:15.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.463+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.465 INFO:teuthology.orchestra.run.smithi114.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-08T18:09:15.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fd8b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434486326336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x55e33e021900 2024-05-08T18:09:15.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94434486326336] v30'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434486303568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x7fd9f003c060 2024-05-08T18:09:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94434486303568] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fda00946980 20 remove_watcher() i=0 2024-05-08T18:09:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fda00946980 2 removed watcher, disabling cache 2024-05-08T18:09:15.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.467+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434486307280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x55e33e021900 2024-05-08T18:09:15.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.471+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94434486307280] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.471+0000 7fda00946980 20 remove_watcher() i=1 2024-05-08T18:09:15.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.471+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434486311120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e026730 con 0x55e33e027b50 2024-05-08T18:09:15.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.471+0000 7fd9fdc59640 1 -- 172.21.15.114:0/3418926869 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94434486311120] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f0039030 con 0x55e33e027b50 2024-05-08T18:09:15.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.471+0000 7fda00946980 20 remove_watcher() i=2 2024-05-08T18:09:15.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.471+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434486308336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02c9d0 con 0x7fd9f003c060 2024-05-08T18:09:15.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.475+0000 7fd9fec5b640 1 -- 172.21.15.114:0/3418926869 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94434486308336] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9f802f040 con 0x7fd9f003c060 2024-05-08T18:09:15.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.475+0000 7fda00946980 20 remove_watcher() i=3 2024-05-08T18:09:15.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.475+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434486315824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02bb50 con 0x55e33e021900 2024-05-08T18:09:15.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.475+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94434486315824] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x55e33e021900 2024-05-08T18:09:15.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.475+0000 7fda00946980 20 remove_watcher() i=4 2024-05-08T18:09:15.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.475+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434486319664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02bb50 con 0x7fd9f8019040 2024-05-08T18:09:15.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.479+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94434486319664] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.479+0000 7fda00946980 20 remove_watcher() i=5 2024-05-08T18:09:15.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.479+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434486324000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02bb50 con 0x7fd9f8019040 2024-05-08T18:09:15.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94434486324000] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 20 remove_watcher() i=6 2024-05-08T18:09:15.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434486320848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55e33e02bb50 con 0x7fd9f8019040 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94434486320848] v30'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9e80fb040 con 0x7fd9f8019040 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 20 remove_watcher() i=7 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9f8019040 msgr2=0x7fd9f8019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9f8019040 0x7fd9f8019930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33e021900 msgr2=0x55e33e023da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33e021900 0x55e33e023da0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd9f003c060 msgr2=0x7fd9f003ca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd9f003c060 0x7fd9f003ca90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e33e027b50 msgr2=0x55e33e029f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e33e027b50 0x55e33e029f40 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8c8038440 msgr2=0x7fd8c803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8c8038440 0x7fd8c803a900 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8008fd0 tx=0x7fd9f801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 msgr2=0x55e33e016430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/3418926869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33e00f000 0x55e33e016430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0015d40 tx=0x7fd9f004e560 comp rx=0 tx=0).stop 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fd9fe45a640 1 -- 172.21.15.114:0/3418926869 reap_dead start 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 shutdown_connections 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 >> 172.21.15.114:0/3418926869 conn(0x55e33e00b340 msgr2=0x55e33e0089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 shutdown_connections 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/3418926869 wait complete. 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8d80383f0 msgr2=0x7fd8d803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8d80383f0 0x7fd8d803a8b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55e33dff0940 tx=0x7fd9f8003070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 msgr2=0x55e33def3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.483+0000 7fda00946980 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 0x55e33def3ba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0006960 tx=0x7fd9f0015820 comp rx=0 tx=0).stop 2024-05-08T18:09:15.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 shutdown_connections 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8d80383f0 0x7fd8d803a8b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/2495405896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33def5700 0x55e33def3ba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 >> 172.21.15.114:0/2495405896 conn(0x55e33dff49e0 msgr2=0x55e33dff54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 shutdown_connections 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/2495405896 wait complete. 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33dfeca80 msgr2=0x55e33dfeee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33dfeca80 0x55e33dfeee90 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8e40383f0 msgr2=0x7fd8e403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8e40383f0 0x7fd8e403a8b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0001650 tx=0x7fd9f0006720 comp rx=0 tx=0).stop 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 msgr2=0x55e33dfe7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 0x55e33dfe7a80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fd9e80ab510 tx=0x7fd9e8018020 comp rx=0 tx=0).stop 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 shutdown_connections 2024-05-08T18:09:15.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e33dfeca80 0x55e33dfeee90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8e40383f0 0x7fd8e403a8b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 --2- 172.21.15.114:0/4231385797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e33dfe7660 0x55e33dfe7a80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 >> 172.21.15.114:0/4231385797 conn(0x55e33deef680 msgr2=0x55e33dfda680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 shutdown_connections 2024-05-08T18:09:15.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.487+0000 7fda00946980 1 -- 172.21.15.114:0/4231385797 wait complete. 2024-05-08T18:09:15.499 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-08T18:09:15.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T18:09:15.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T18:09:15.499 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T18:09:15.573 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:15.573 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:15.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a060fb980 1 Processor -- start 2024-05-08T18:09:15.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a060fb980 1 -- start start 2024-05-08T18:09:15.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a060fb980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555b1529d820 0x555b1532bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a060fb980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b151d4710 con 0x555b1532c0b0 2024-05-08T18:09:15.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a060fb980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555b151e8f00 con 0x555b1529d820 2024-05-08T18:09:15.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a03c0f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555b1529d820 0x555b1532bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a03c0f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555b1529d820 0x555b1532bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59252/0 (socket says 172.21.15.114:59252) 2024-05-08T18:09:15.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1218109621 learned_addr learned my addr 172.21.15.114:0/1218109621 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1218109621 >> v1:172.21.15.53:6789/0 conn(0x555b1532c0b0 legacy=0x555b1532e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.575+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1218109621 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b151b0ae0 con 0x555b1529d820 2024-05-08T18:09:15.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/1218109621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1532bb70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f39f400a5c0 tx=0x7f39f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcba9f6a0d886311 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a0340e640 1 -- 172.21.15.114:0/1218109621 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40a6070 con 0x555b1529d820 2024-05-08T18:09:15.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a0340e640 1 -- 172.21.15.114:0/1218109621 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f40af070 con 0x555b1529d820 2024-05-08T18:09:15.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a0340e640 1 -- 172.21.15.114:0/1218109621 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40aa5c0 con 0x555b1529d820 2024-05-08T18:09:15.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 -- 172.21.15.114:0/1218109621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 msgr2=0x555b1532bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1218109621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1532bb70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f39f400a5c0 tx=0x7f39f401b340 comp rx=0 tx=0).stop 2024-05-08T18:09:15.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 -- 172.21.15.114:0/1218109621 shutdown_connections 2024-05-08T18:09:15.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1218109621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1532bb70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 -- 172.21.15.114:0/1218109621 >> 172.21.15.114:0/1218109621 conn(0x555b15323690 msgr2=0x555b15325ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 -- 172.21.15.114:0/1218109621 shutdown_connections 2024-05-08T18:09:15.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.579+0000 7f3a060fb980 1 -- 172.21.15.114:0/1218109621 wait complete. 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 Processor -- start 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- start start 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b153292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b1522cf80 con 0x555b1529d820 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a03c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b153292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a03c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b153292d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59258/0 (socket says 172.21.15.114:59258) 2024-05-08T18:09:15.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1860898097 learned_addr learned my addr 172.21.15.114:0/1860898097 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1860898097 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b151f4da0 con 0x555b1529d820 2024-05-08T18:09:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/1860898097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b153292d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f39f40199f0 tx=0x7f39f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5103e5826bffcd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f38f1e0b640 1 -- 172.21.15.114:0/1860898097 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40aaa00 con 0x555b1529d820 2024-05-08T18:09:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f38f1e0b640 1 -- 172.21.15.114:0/1860898097 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f40aaba0 con 0x555b1529d820 2024-05-08T18:09:15.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f38f1e0b640 1 -- 172.21.15.114:0/1860898097 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40bd3f0 con 0x555b1529d820 2024-05-08T18:09:15.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- 172.21.15.114:0/1860898097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 msgr2=0x555b153292d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1860898097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b153292d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f39f40199f0 tx=0x7f39f4003030 comp rx=0 tx=0).stop 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- 172.21.15.114:0/1860898097 shutdown_connections 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1860898097 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b153292d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- 172.21.15.114:0/1860898097 >> 172.21.15.114:0/1860898097 conn(0x555b15323690 msgr2=0x555b1540fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- 172.21.15.114:0/1860898097 shutdown_connections 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- 172.21.15.114:0/1860898097 wait complete. 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 Processor -- start 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- start start 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1541d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.595+0000 7f3a060fb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b153306d0 con 0x555b1529d820 2024-05-08T18:09:15.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a03c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1541d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a03c0f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1541d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59270/0 (socket says 172.21.15.114:59270) 2024-05-08T18:09:15.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a03c0f640 1 -- 172.21.15.114:0/811281923 learned_addr learned my addr 172.21.15.114:0/811281923 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a03c0f640 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b1541d9f0 con 0x555b1529d820 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1541d4b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39f401b380 tx=0x7f39f40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f38ebfff640 1 -- 172.21.15.114:0/811281923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40bd7c0 con 0x555b1529d820 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f38ebfff640 1 -- 172.21.15.114:0/811281923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f40bd960 con 0x555b1529d820 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b1541dc80 con 0x555b1529d820 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f38ebfff640 1 -- 172.21.15.114:0/811281923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39f40bdc40 con 0x555b1529d820 2024-05-08T18:09:15.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b154208c0 con 0x555b1529d820 2024-05-08T18:09:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f38ebfff640 1 -- 172.21.15.114:0/811281923 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f39f40ce020 con 0x555b1529d820 2024-05-08T18:09:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f38ebfff640 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38ec0383f0 0x7f38ec03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f38ebfff640 1 -- 172.21.15.114:0/811281923 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f39f40cc020 con 0x555b1529d820 2024-05-08T18:09:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f39fb40e640 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38ec0383f0 0x7f38ec03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b1532c0b0 0x555b154243a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b154249f0 con 0x555b1532c0b0 2024-05-08T18:09:15.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f3a04410640 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b1532c0b0 0x555b154243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.599+0000 7f39fb40e640 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38ec0383f0 0x7f38ec03a8b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39ec001ec0 tx=0x7f39ec001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a04410640 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b1532c0b0 0x555b154243a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a04410640 1 -- 172.21.15.114:0/811281923 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39fc00a4d0 con 0x555b1532c0b0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15425320 con 0x555b1532c0b0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a04410640 1 -- 172.21.15.114:0/811281923 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39fc00a4d0 con 0x555b1532c0b0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b154266d0 con 0x555b1532c0b0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a04410640 1 -- 172.21.15.114:0/811281923 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39fc00a4d0 con 0x555b1532c0b0 2024-05-08T18:09:15.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15425b70 con 0x555b1532c0b0 2024-05-08T18:09:15.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a04410640 1 -- 172.21.15.114:0/811281923 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39fc00a4d0 con 0x555b1532c0b0 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15425fc0 con 0x555b1532c0b0 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a04410640 1 -- 172.21.15.114:0/811281923 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39fc00a4d0 con 0x555b1532c0b0 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 Processor -- start 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 -- start start 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 0x555b15435600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f3a060fb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b15230fc0 con 0x555b154351e0 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f39fb40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 0x555b15435600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f39fb40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 0x555b15435600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59286/0 (socket says 172.21.15.114:59286) 2024-05-08T18:09:15.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f39fb40e640 1 -- 172.21.15.114:0/137043434 learned_addr learned my addr 172.21.15.114:0/137043434 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f39fb40e640 1 -- 172.21.15.114:0/137043434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b15435b40 con 0x555b154351e0 2024-05-08T18:09:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.603+0000 7f39fb40e640 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 0x555b15435600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f39ec010fd0 tx=0x7f39ec00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e97fa640 1 -- 172.21.15.114:0/137043434 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec00a040 con 0x555b154351e0 2024-05-08T18:09:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e97fa640 1 -- 172.21.15.114:0/137043434 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec017050 con 0x555b154351e0 2024-05-08T18:09:15.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b154365e0 con 0x555b154351e0 2024-05-08T18:09:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e97fa640 1 -- 172.21.15.114:0/137043434 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec00e6b0 con 0x555b154351e0 2024-05-08T18:09:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b15436ab0 con 0x555b154351e0 2024-05-08T18:09:15.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e97fa640 1 -- 172.21.15.114:0/137043434 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f39ec00e8e0 con 0x555b154351e0 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e97fa640 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38dc0383f0 0x7f38dc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e97fa640 1 -- 172.21.15.114:0/137043434 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f39ec0506c0 con 0x555b154351e0 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a04410640 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38dc0383f0 0x7f38dc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a060fb980 1 Processor -- start 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a060fb980 1 -- start start 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a060fb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b154427f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a04410640 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38dc0383f0 0x7f38dc03a8b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x555b15425200 tx=0x7f39fc005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f3a060fb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b15329960 con 0x555b15442410 2024-05-08T18:09:15.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f39fb40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b154427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f39fb40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b154427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59288/0 (socket says 172.21.15.114:59288) 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f39fb40e640 1 -- 172.21.15.114:0/3272355476 learned_addr learned my addr 172.21.15.114:0/3272355476 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f39fb40e640 1 -- 172.21.15.114:0/3272355476 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b15442dc0 con 0x555b15442410 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f39fb40e640 1 --2- 172.21.15.114:0/3272355476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b154427f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f39ec04ea40 tx=0x7f39ec01aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09c8e9cea3ef6db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e2ffd640 1 -- 172.21.15.114:0/3272355476 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec043070 con 0x555b15442410 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e2ffd640 1 -- 172.21.15.114:0/3272355476 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec01c410 con 0x555b15442410 2024-05-08T18:09:15.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.607+0000 7f38e2ffd640 1 -- 172.21.15.114:0/3272355476 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec01a310 con 0x555b15442410 2024-05-08T18:09:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/3272355476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 msgr2=0x555b154427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 --2- 172.21.15.114:0/3272355476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b154427f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f39ec04ea40 tx=0x7f39ec01aee0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/3272355476 shutdown_connections 2024-05-08T18:09:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 --2- 172.21.15.114:0/3272355476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b154427f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/3272355476 >> 172.21.15.114:0/3272355476 conn(0x555b1543e750 msgr2=0x555b1543c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/3272355476 shutdown_connections 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/3272355476 wait complete. 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 Processor -- start 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- start start 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b15449910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555b15443580 con 0x555b15442410 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f39fb40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b15449910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f39fb40e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b15449910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59304/0 (socket says 172.21.15.114:59304) 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 learned_addr learned my addr 172.21.15.114:0/1578011237 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b15449e50 con 0x555b15442410 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f39fb40e640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b15449910 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00fcf0 tx=0x7f39ec04e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f38e17fa640 1 -- 172.21.15.114:0/1578011237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec034070 con 0x555b15442410 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f38e17fa640 1 -- 172.21.15.114:0/1578011237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ec04d290 con 0x555b15442410 2024-05-08T18:09:15.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b1544a0e0 con 0x555b15442410 2024-05-08T18:09:15.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f38e17fa640 1 -- 172.21.15.114:0/1578011237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39ec043040 con 0x555b15442410 2024-05-08T18:09:15.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b1544cdc0 con 0x555b15442410 2024-05-08T18:09:15.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f38e17fa640 1 -- 172.21.15.114:0/1578011237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f39ec037070 con 0x555b15442410 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f38e17fa640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38cc0383f0 0x7f38cc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.611+0000 7f38e17fa640 1 -- 172.21.15.114:0/1578011237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7f39ec030cc0 con 0x555b15442410 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a04410640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38cc0383f0 0x7f38cc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b15454e30 0x555b154572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15457a40 con 0x555b15454e30 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b15454e30 0x555b154572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a04410640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38cc0383f0 0x7f38cc03a8b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x555b15421a00 tx=0x7f39fc01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b15454e30 0x555b154572f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 realm 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15457e50 con 0x555b15454e30 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15458720 con 0x555b15454e30 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15458ac0 con 0x555b15454e30 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15459310 con 0x555b15454e30 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 20 searching for the correct realm 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555b1545b080 0x555b1545d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f39fb40e640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555b1545b080 0x555b1545d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f39fb40e640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555b1545b080 0x555b1545d470 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f39fb40e640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39ec039060 0x7f39ec02e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39ec039060 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a04410640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39ec039060 0x7f39ec02e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.615+0000 7f3a04410640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39ec039060 0x7f39ec02e600 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc01f070 con 0x7f39ec039060 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a04410640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f39fc031040 0x7f39fc032430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f39fc031040 0x7f39fc032430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f39fc031040 0x7f39fc032430 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x7f39fc031040 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x7f39fc031040 2024-05-08T18:09:15.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x7f39fc031040 2024-05-08T18:09:15.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.619+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39ec039060 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc01f070 con 0x7f39ec039060 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x7f39fc031040 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39ec039060 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f39fc01f070 con 0x7f39ec039060 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x7f39fc031040 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.623+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40c5d00 con 0x7f39fc031040 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39ec039060 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc01f070 con 0x7f39ec039060 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39f40c5d00 con 0x555b15454e30 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.627+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39ec039060 2024-05-08T18:09:15.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc01f070 con 0x7f39ec039060 2024-05-08T18:09:15.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b1545b080 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39fc031040 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x555b15454e30 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x555b1545d9b0 con 0x7f39ec039060 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39fc01f070 con 0x7f39ec039060 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:15.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15459c20 con 0x555b15454e30 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1545a4c0 con 0x555b15454e30 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1545a4c0 con 0x555b15454e30 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 zone default found 2024-05-08T18:09:15.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 4 Realm: () 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 zonegroup default 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1545dde0 con 0x7f39fc031040 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.631+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1545f820 con 0x555b1545b080 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1545fc90 con 0x555b1545b080 2024-05-08T18:09:15.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 20 started sync module instance, tier type = 2024-05-08T18:09:15.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:15.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b1545ec60 con 0x7f39ec039060 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93849687289936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b1545f470 con 0x7f39ec039060 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15460bc0 con 0x555b15454e30 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.635+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93849687289936] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93849687295760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15460fe0 con 0x555b15454e30 2024-05-08T18:09:15.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15461890 con 0x555b1545b080 2024-05-08T18:09:15.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93849687295760] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93849687297088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15461cb0 con 0x555b1545b080 2024-05-08T18:09:15.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.639+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15462670 con 0x7f39ec039060 2024-05-08T18:09:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93849687302864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15462d80 con 0x7f39ec039060 2024-05-08T18:09:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b154638a0 con 0x555b15454e30 2024-05-08T18:09:15.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93849687297088] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93849687302864] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93849687307120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15463860 con 0x555b15454e30 2024-05-08T18:09:15.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.643+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15464140 con 0x7f39fc031040 2024-05-08T18:09:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93849687307120] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93849687298208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15463d10 con 0x7f39fc031040 2024-05-08T18:09:15.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b154645e0 con 0x7f39fc031040 2024-05-08T18:09:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93849687309584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15464130 con 0x7f39fc031040 2024-05-08T18:09:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15465530 con 0x7f39fc031040 2024-05-08T18:09:15.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.647+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93849687298208] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93849687314464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b154654f0 con 0x7f39fc031040 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=0 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=1 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=2 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=3 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=4 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=5 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93849687309584] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=6 2024-05-08T18:09:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93849687314464] v30'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 20 add_watcher() i=7 2024-05-08T18:09:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15464a00 con 0x555b15454e30 2024-05-08T18:09:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.651+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93849687312896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15465960 con 0x555b15454e30 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93849687312896] v30'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f38b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 5 note: GC not initialized 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f38b8fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:15.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 Filter name: none 2024-05-08T18:09:15.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f38327fc640 20 reqs_thread_entry: start 2024-05-08T18:09:15.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:15.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1548be00 con 0x555b15454e30 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1548e890 con 0x7f39ec039060 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 disabling bucket name=myfoo 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1548c870 con 0x7f39ec039060 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b1548f1e0 con 0x555b15454e30 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv7 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:15.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:15.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.655+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15496bc0 con 0x555b15454e30 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'8 uv8 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93849687485024 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b15492270 con 0x7f39ec039060 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== watch-notify(notify (1) cookie 93849687289936 notify 128849018905 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7f39fc032cf0 con 0x7f39ec039060 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018905 cookie 93849687289936 notifier 4590 bl.length()=752 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e2ffd640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f38c8003eb0 con 0x7f39ec039060 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(67 notify.0 [notify cookie 93849687485024 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== watch-notify(notify_complete (2) cookie 93849687485024 notify 128849018905 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f39fc024780 con 0x7f39ec039060 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_sources= new_sources= 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential sources added=[] removed=[] 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_dests= new_dests= 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential dests added=[] removed=[] 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b1548ea30 con 0x555b15454e30 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:15.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93849687484976 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x555b154946e0 con 0x555b15454e30 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== watch-notify(notify (1) cookie 93849687307120 notify 128849018894 ret 0) ==== 609+0+0 (crc 0 0 0) 0x555b1548e6f0 con 0x555b15454e30 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 93849687307120 notifier 4590 bl.length()=567 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f38e27fc640 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7f3838003440 con 0x555b15454e30 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(70 notify.4 [notify cookie 93849687484976 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.659+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== watch-notify(notify_complete (2) cookie 93849687484976 notify 128849018894 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f39f40ec040 con 0x555b15454e30 2024-05-08T18:09:15.664 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:15.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f38b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93849687312896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15489b30 con 0x555b15454e30 2024-05-08T18:09:15.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93849687312896] v30'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93849687289936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15489b30 con 0x7f39ec039060 2024-05-08T18:09:15.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93849687289936] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a060fb980 20 remove_watcher() i=0 2024-05-08T18:09:15.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a060fb980 2 removed watcher, disabling cache 2024-05-08T18:09:15.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.663+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93849687295760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15489b30 con 0x555b15454e30 2024-05-08T18:09:15.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.667+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93849687295760] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.667+0000 7f3a060fb980 20 remove_watcher() i=1 2024-05-08T18:09:15.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.667+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93849687297088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15489b30 con 0x555b1545b080 2024-05-08T18:09:15.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.667+0000 7f39fb40e640 1 -- 172.21.15.114:0/1578011237 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93849687297088] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39ec036030 con 0x555b1545b080 2024-05-08T18:09:15.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.667+0000 7f3a060fb980 20 remove_watcher() i=2 2024-05-08T18:09:15.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.667+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93849687302864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15460710 con 0x7f39ec039060 2024-05-08T18:09:15.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.671+0000 7f3a04410640 1 -- 172.21.15.114:0/1578011237 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93849687302864] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39fc040040 con 0x7f39ec039060 2024-05-08T18:09:15.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.671+0000 7f3a060fb980 20 remove_watcher() i=3 2024-05-08T18:09:15.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.671+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93849687307120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15460710 con 0x555b15454e30 2024-05-08T18:09:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.671+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93849687307120] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x555b15454e30 2024-05-08T18:09:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.671+0000 7f3a060fb980 20 remove_watcher() i=4 2024-05-08T18:09:15.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.671+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93849687298208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15463370 con 0x7f39fc031040 2024-05-08T18:09:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.675+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93849687298208] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.675+0000 7f3a060fb980 20 remove_watcher() i=5 2024-05-08T18:09:15.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.675+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93849687309584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15460710 con 0x7f39fc031040 2024-05-08T18:09:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.675+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93849687309584] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.675+0000 7f3a060fb980 20 remove_watcher() i=6 2024-05-08T18:09:15.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.675+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93849687314464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x555b15463d10 con 0x7f39fc031040 2024-05-08T18:09:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93849687314464] v30'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39f40f7040 con 0x7f39fc031040 2024-05-08T18:09:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 20 remove_watcher() i=7 2024-05-08T18:09:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f39fc031040 msgr2=0x7f39fc032430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f39fc031040 0x7f39fc032430 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b15454e30 msgr2=0x555b154572f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b15454e30 0x555b154572f0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39ec039060 msgr2=0x7f39ec02e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f39ec039060 0x7f39ec02e600 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555b1545b080 msgr2=0x555b1545d470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555b1545b080 0x555b1545d470 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38cc0383f0 msgr2=0x7f38cc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38cc0383f0 0x7f38cc03a8b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x555b15421a00 tx=0x7f39fc01f000 comp rx=0 tx=0).stop 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 msgr2=0x555b15449910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a03c0f640 1 -- 172.21.15.114:0/1578011237 reap_dead start 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b15449910 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f39ec00fcf0 tx=0x7f39ec04e9a0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 shutdown_connections 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/1578011237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b15442410 0x555b15449910 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 >> 172.21.15.114:0/1578011237 conn(0x555b1543e750 msgr2=0x555b1543bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 shutdown_connections 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/1578011237 wait complete. 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38dc0383f0 msgr2=0x7f38dc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38dc0383f0 0x7f38dc03a8b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x555b15425200 tx=0x7f39fc005850 comp rx=0 tx=0).stop 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 msgr2=0x555b15435600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 0x555b15435600 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f39ec010fd0 tx=0x7f39ec00f7a0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 shutdown_connections 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38dc0383f0 0x7f38dc03a8b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/137043434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b154351e0 0x555b15435600 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 >> 172.21.15.114:0/137043434 conn(0x555b15429ff0 msgr2=0x555b1542ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 shutdown_connections 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/137043434 wait complete. 2024-05-08T18:09:15.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b1532c0b0 msgr2=0x555b154243a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b1532c0b0 0x555b154243a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38ec0383f0 msgr2=0x7f38ec03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38ec0383f0 0x7f38ec03a8b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f39ec001ec0 tx=0x7f39ec001440 comp rx=0 tx=0).stop 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 msgr2=0x555b1541d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1541d4b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f39f401b380 tx=0x7f39f40180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 shutdown_connections 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555b1532c0b0 0x555b154243a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f38ec0383f0 0x7f38ec03a8b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 --2- 172.21.15.114:0/811281923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555b1529d820 0x555b1541d4b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 >> 172.21.15.114:0/811281923 conn(0x555b15323690 msgr2=0x555b15327d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 shutdown_connections 2024-05-08T18:09:15.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.679+0000 7f3a060fb980 1 -- 172.21.15.114:0/811281923 wait complete. 2024-05-08T18:09:15.692 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:15.694 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T18:09:15.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T18:09:15.694 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T18:09:15.764 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:15.765 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:15.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.763+0000 7fbb98a9b980 1 Processor -- start 2024-05-08T18:09:15.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.763+0000 7fbb98a9b980 1 -- start start 2024-05-08T18:09:15.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb98a9b980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d778f9d5b0 0x55d778f9f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb98a9b980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d778e42710 con 0x55d778f990f0 2024-05-08T18:09:15.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb98a9b980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d778e56f00 con 0x55d778f9d5b0 2024-05-08T18:09:15.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb95dae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d778f9d5b0 0x55d778f9f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb95dae640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d778f9d5b0 0x55d778f9f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59318/0 (socket says 172.21.15.114:59318) 2024-05-08T18:09:15.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb95dae640 1 -- 172.21.15.114:0/851886668 learned_addr learned my addr 172.21.15.114:0/851886668 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb965af640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d778f990f0 0x55d778f994d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:34840/0 (socket says 172.21.15.114:34840) 2024-05-08T18:09:15.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb955ad640 1 -- 172.21.15.114:0/851886668 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262515060 0 0) 0x55d778e42710 con 0x55d778f990f0 2024-05-08T18:09:15.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb955ad640 1 -- 172.21.15.114:0/851886668 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb80001e20 con 0x55d778f990f0 2024-05-08T18:09:15.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb95dae640 1 -- 172.21.15.114:0/851886668 >> v1:172.21.15.53:6789/0 conn(0x55d778f990f0 legacy=0x55d778f994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb95dae640 1 -- 172.21.15.114:0/851886668 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d778e1eae0 con 0x55d778f9d5b0 2024-05-08T18:09:15.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb95dae640 1 --2- 172.21.15.114:0/851886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f9d5b0 0x55d778f9f9a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00a5c0 tx=0x7fbb8c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f0c914d68258ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb955ad640 1 -- 172.21.15.114:0/851886668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0a6070 con 0x55d778f9d5b0 2024-05-08T18:09:15.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb955ad640 1 -- 172.21.15.114:0/851886668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0af070 con 0x55d778f9d5b0 2024-05-08T18:09:15.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.767+0000 7fbb955ad640 1 -- 172.21.15.114:0/851886668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0aa5a0 con 0x55d778f9d5b0 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 -- 172.21.15.114:0/851886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f9d5b0 msgr2=0x55d778f9f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/851886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f9d5b0 0x55d778f9f9a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00a5c0 tx=0x7fbb8c01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 -- 172.21.15.114:0/851886668 shutdown_connections 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/851886668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f9d5b0 0x55d778f9f9a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 -- 172.21.15.114:0/851886668 >> 172.21.15.114:0/851886668 conn(0x55d778f0c7d0 msgr2=0x55d778f0cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 -- 172.21.15.114:0/851886668 shutdown_connections 2024-05-08T18:09:15.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.771+0000 7fbb98a9b980 1 -- 172.21.15.114:0/851886668 wait complete. 2024-05-08T18:09:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.783+0000 7fbb98a9b980 1 Processor -- start 2024-05-08T18:09:15.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.783+0000 7fbb98a9b980 1 -- start start 2024-05-08T18:09:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.783+0000 7fbb98a9b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d779083f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.783+0000 7fbb98a9b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d778e9af80 con 0x55d778f990f0 2024-05-08T18:09:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d779083f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d779083f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59328/0 (socket says 172.21.15.114:59328) 2024-05-08T18:09:15.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 -- 172.21.15.114:0/3681133524 learned_addr learned my addr 172.21.15.114:0/3681133524 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 -- 172.21.15.114:0/3681133524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d778e62da0 con 0x55d778f990f0 2024-05-08T18:09:15.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 --2- 172.21.15.114:0/3681133524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d779083f70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbb900016a0 tx=0x7fbb90001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539c97bccceaefff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fba84608640 1 -- 172.21.15.114:0/3681133524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb90013420 con 0x55d778f990f0 2024-05-08T18:09:15.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fba84608640 1 -- 172.21.15.114:0/3681133524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb900135c0 con 0x55d778f990f0 2024-05-08T18:09:15.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fba84608640 1 -- 172.21.15.114:0/3681133524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb90013900 con 0x55d778f990f0 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3681133524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 msgr2=0x55d779083f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3681133524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d779083f70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbb900016a0 tx=0x7fbb90001b60 comp rx=0 tx=0).stop 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3681133524 shutdown_connections 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3681133524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d779083f70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3681133524 >> 172.21.15.114:0/3681133524 conn(0x55d778f0c7d0 msgr2=0x55d77907fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3681133524 shutdown_connections 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3681133524 wait complete. 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 Processor -- start 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- start start 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d77908b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb98a9b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d778fa29d0 con 0x55d778f990f0 2024-05-08T18:09:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d77908b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d77908b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59336/0 (socket says 172.21.15.114:59336) 2024-05-08T18:09:15.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 -- 172.21.15.114:0/762942804 learned_addr learned my addr 172.21.15.114:0/762942804 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.787+0000 7fbb965af640 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d77908b9a0 con 0x55d778f990f0 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb965af640 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d77908b460 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbb90000f90 tx=0x7fbb90001370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fba82e05640 1 -- 172.21.15.114:0/762942804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb900037a0 con 0x55d778f990f0 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fba82e05640 1 -- 172.21.15.114:0/762942804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb90003940 con 0x55d778f990f0 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d77908bc30 con 0x55d778f990f0 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fba82e05640 1 -- 172.21.15.114:0/762942804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb90003c60 con 0x55d778f990f0 2024-05-08T18:09:15.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d77908e870 con 0x55d778f990f0 2024-05-08T18:09:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fba82e05640 1 -- 172.21.15.114:0/762942804 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbb90010070 con 0x55d778f990f0 2024-05-08T18:09:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fba82e05640 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba7c038490 0x7fba7c03a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fba82e05640 1 -- 172.21.15.114:0/762942804 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fbb90018070 con 0x55d778f990f0 2024-05-08T18:09:15.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb95dae640 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba7c038490 0x7fba7c03a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d778f9d5b0 0x55d779092350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790929a0 con 0x55d778f9d5b0 2024-05-08T18:09:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb96db0640 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d778f9d5b0 0x55d779092350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb95dae640 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba7c038490 0x7fba7c03a950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ae000 tx=0x7fbb8c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb96db0640 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d778f9d5b0 0x55d779092350 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb96db0640 1 -- 172.21.15.114:0/762942804 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb880083f0 con 0x55d778f9d5b0 2024-05-08T18:09:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d77908fa90 con 0x55d778f9d5b0 2024-05-08T18:09:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb96db0640 1 -- 172.21.15.114:0/762942804 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb880083f0 con 0x55d778f9d5b0 2024-05-08T18:09:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d779094830 con 0x55d778f9d5b0 2024-05-08T18:09:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb96db0640 1 -- 172.21.15.114:0/762942804 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbb880083f0 con 0x55d778f9d5b0 2024-05-08T18:09:15.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.791+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790939a0 con 0x55d778f9d5b0 2024-05-08T18:09:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb96db0640 1 -- 172.21.15.114:0/762942804 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb880083f0 con 0x55d778f9d5b0 2024-05-08T18:09:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d779093df0 con 0x55d778f9d5b0 2024-05-08T18:09:15.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb96db0640 1 -- 172.21.15.114:0/762942804 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbb880083f0 con 0x55d778f9d5b0 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 Processor -- start 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 -- start start 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 0x55d7790a3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d778e9efc0 con 0x55d7790a3160 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb95dae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 0x55d7790a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb95dae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 0x55d7790a3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59338/0 (socket says 172.21.15.114:59338) 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb95dae640 1 -- 172.21.15.114:0/1453307120 learned_addr learned my addr 172.21.15.114:0/1453307120 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb95dae640 1 -- 172.21.15.114:0/1453307120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7790a3ac0 con 0x55d7790a3160 2024-05-08T18:09:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb95dae640 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 0x55d7790a3580 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c005410 tx=0x7fbb8c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fba7bfff640 1 -- 172.21.15.114:0/1453307120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0b3b90 con 0x55d7790a3160 2024-05-08T18:09:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fba7bfff640 1 -- 172.21.15.114:0/1453307120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0b3d30 con 0x55d7790a3160 2024-05-08T18:09:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7790a4560 con 0x55d7790a3160 2024-05-08T18:09:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fba7bfff640 1 -- 172.21.15.114:0/1453307120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0c8580 con 0x55d7790a3160 2024-05-08T18:09:15.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.795+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7790a49d0 con 0x55d7790a3160 2024-05-08T18:09:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fba7bfff640 1 -- 172.21.15.114:0/1453307120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbb8c0d1440 con 0x55d7790a3160 2024-05-08T18:09:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fba7bfff640 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba700383f0 0x7fba7003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fba7bfff640 1 -- 172.21.15.114:0/1453307120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fbb8c0ebfe0 con 0x55d7790a3160 2024-05-08T18:09:15.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb96db0640 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba700383f0 0x7fba7003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 Processor -- start 2024-05-08T18:09:15.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- start start 2024-05-08T18:09:15.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb96db0640 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba700383f0 0x7fba7003a8b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800e3f0 tx=0x7fbb88003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7790846c0 con 0x55d7790b0210 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb95dae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb95dae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59342/0 (socket says 172.21.15.114:59342) 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb95dae640 1 -- 172.21.15.114:0/3941779665 learned_addr learned my addr 172.21.15.114:0/3941779665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb95dae640 1 -- 172.21.15.114:0/3941779665 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7790b0c00 con 0x55d7790b0210 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb95dae640 1 --2- 172.21.15.114:0/3941779665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b0630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ea3f0 tx=0x7fbb8c0d1e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa245de6eabdf93 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fba79ffb640 1 -- 172.21.15.114:0/3941779665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0b2c30 con 0x55d7790b0210 2024-05-08T18:09:15.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fba79ffb640 1 -- 172.21.15.114:0/3941779665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0b2dd0 con 0x55d7790b0210 2024-05-08T18:09:15.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fba79ffb640 1 -- 172.21.15.114:0/3941779665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0be550 con 0x55d7790b0210 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3941779665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 msgr2=0x55d7790b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3941779665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b0630 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ea3f0 tx=0x7fbb8c0d1e20 comp rx=0 tx=0).stop 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3941779665 shutdown_connections 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3941779665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b0630 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3941779665 >> 172.21.15.114:0/3941779665 conn(0x55d7790ac5a0 msgr2=0x55d7790aa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3941779665 shutdown_connections 2024-05-08T18:09:15.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3941779665 wait complete. 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 Processor -- start 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- start start 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb98a9b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7790b1350 con 0x55d7790b0210 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.799+0000 7fbb95dae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb95dae640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:59348/0 (socket says 172.21.15.114:59348) 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 learned_addr learned my addr 172.21.15.114:0/3231786548 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:15.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7790b7ca0 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb95dae640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b7760 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0e9140 tx=0x7fbb8c0ea380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fba67fff640 1 -- 172.21.15.114:0/3231786548 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0f3070 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fba67fff640 1 -- 172.21.15.114:0/3231786548 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0be740 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7790b7f30 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fba67fff640 1 -- 172.21.15.114:0/3231786548 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb8c0b2c30 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7790bac10 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fba67fff640 1 -- 172.21.15.114:0/3231786548 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbb8c0f6070 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fba67fff640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba600383f0 0x7fba6003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fba67fff640 1 -- 172.21.15.114:0/3231786548 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6110+0+0 (secure 0 0 0) 0x7fbb8c0e2070 con 0x55d7790b0210 2024-05-08T18:09:15.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb96db0640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba600383f0 0x7fba6003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7790c2c70 0x55d7790c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c5880 con 0x55d7790c2c70 2024-05-08T18:09:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb965af640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7790c2c70 0x55d7790c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb96db0640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba600383f0 0x7fba6003a8b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55d7790934c0 tx=0x7fbb8801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb965af640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7790c2c70 0x55d7790c5130 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 20 realm 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.803+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c5c90 con 0x55d7790c2c70 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c6560 con 0x55d7790c2c70 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c6900 con 0x55d7790c2c70 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 20 searching for the correct realm 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7790c8bc0 0x55d7790cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cb750 con 0x55d7790c8bc0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb95dae640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7790c8bc0 0x55d7790cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb95dae640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7790c8bc0 0x55d7790cb080 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb95dae640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbb8c0f8060 0x7fbb8c0c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cb750 con 0x7fbb8c0f8060 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb96db0640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbb8c0f8060 0x7fbb8c0c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb96db0640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbb8c0f8060 0x7fbb8c0c1ab0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb96db0640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbb88019040 0x7fbb88019930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cb750 con 0x7fbb88019040 2024-05-08T18:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb965af640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbb88019040 0x7fbb88019930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:15.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.807+0000 7fbb965af640 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbb88019040 0x7fbb88019930 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb8c0f8060 2024-05-08T18:09:15.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.811+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb8c0f8060 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 30 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb8c0f8060 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(28 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.815+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb8c0f8060 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c8bc0 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb88019040 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x55d7790c2c70 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c7150 con 0x7fbb8c0f8060 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:15.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.819+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c74f0 con 0x55d7790c2c70 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c78e0 con 0x55d7790c2c70 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c78e0 con 0x55d7790c2c70 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 zone default found 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 4 Realm: () 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 zonegroup default 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c6d60 con 0x7fbb88019040 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790c6d80 con 0x55d7790c8bc0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cd670 con 0x55d7790c8bc0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 started sync module instance, tier type = 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:15.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cca50 con 0x7fbb8c0f8060 2024-05-08T18:09:15.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94383937211968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cc6b0 con 0x7fbb8c0f8060 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.823+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790ce5a0 con 0x55d7790c2c70 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94383937211968] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94383937215184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790ce5a0 con 0x55d7790c2c70 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cefb0 con 0x55d7790c8bc0 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94383937219328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cf800 con 0x55d7790c8bc0 2024-05-08T18:09:15.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.827+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d01c0 con 0x7fbb8c0f8060 2024-05-08T18:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94383937215184] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94383937223952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d0130 con 0x7fbb8c0f8060 2024-05-08T18:09:15.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d0f90 con 0x55d7790c2c70 2024-05-08T18:09:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94383937219328] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94383937223952] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94383937221456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d0f50 con 0x55d7790c2c70 2024-05-08T18:09:15.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.831+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d1380 con 0x7fbb88019040 2024-05-08T18:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94383937221456] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94383937226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d1330 con 0x7fbb88019040 2024-05-08T18:09:15.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d1c20 con 0x7fbb88019040 2024-05-08T18:09:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94383937230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d2080 con 0x7fbb88019040 2024-05-08T18:09:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d2b80 con 0x7fbb88019040 2024-05-08T18:09:15.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.835+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94383937226160] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94383937230704] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94383937234544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d1b90 con 0x7fbb88019040 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=0 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=1 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=2 2024-05-08T18:09:15.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=3 2024-05-08T18:09:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=4 2024-05-08T18:09:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=5 2024-05-08T18:09:15.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb98a9b980 20 add_watcher() i=6 2024-05-08T18:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.839+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94383937234544] v30'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 add_watcher() i=7 2024-05-08T18:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d5b70 con 0x55d7790c2c70 2024-05-08T18:09:15.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94383937227216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790d2ff0 con 0x55d7790c2c70 2024-05-08T18:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94383937227216] v30'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fba4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:15.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 5 note: GC not initialized 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fb9c77fe640 20 reqs_thread_entry: start 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 Filter name: none 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fb9c57fa640 20 reqs_thread_entry: start 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790f9470 con 0x55d7790c2c70 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790fbf00 con 0x7fbb8c0f8060 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 enabling bucket name=myfoo 2024-05-08T18:09:15.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790f9ee0 con 0x7fbb8c0f8060 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 : miss 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 20 rados->read ofs=0 len=0 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.843+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790fc870 con 0x55d7790c2c70 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv8 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:15.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 2024-05-08T18:09:15.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.17 8:eeefec1e:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d779104240 con 0x55d7790c2c70 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v30'9 uv9 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1, ofs0, ns] 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94383937405136 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d7790ff8f0 con 0x7fbb8c0f8060 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== watch-notify(notify (1) cookie 94383937211968 notify 128849018906 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7fbb88010040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fba79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018906 cookie 94383937211968 notifier 4597 bl.length()=752 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(67 notify.0 [notify cookie 94383937405136 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fba79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 info.flags=0x17 2024-05-08T18:09:15.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fba79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1 to cache LRU end 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fba79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fba79ffb640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fba5c003eb0 con 0x7fbb8c0f8060 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== watch-notify(notify_complete (2) cookie 94383937405136 notify 128849018906 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbb88026970 con 0x7fbb8c0f8060 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_sources= new_sources= 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential sources added=[] removed=[] 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): orig_dests= new_dests= 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 20 handle_bi_update(): bucket=:myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1]): potential dests added=[] removed=[] 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.847+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790fc0a0 con 0x55d7790c2c70 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v30'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb98a9b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb98a9b980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb98a9b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:15.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94383937405088 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x55d779101d90 con 0x55d7790c2c70 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== watch-notify(notify (1) cookie 94383937221456 notify 128849018895 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55d7790fbd60 con 0x55d7790c2c70 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fba79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94383937221456 notifier 4597 bl.length()=567 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fba79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fba79ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fba79ffb640 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) -- 0x7fba5c003eb0 con 0x55d7790c2c70 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(70 notify.4 [notify cookie 94383937405088 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== watch-notify(notify_complete (2) cookie 94383937405088 notify 128849018895 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbb9003e040 con 0x55d7790c2c70 2024-05-08T18:09:15.853 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fba4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94383937227216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790f71a0 con 0x55d7790c2c70 2024-05-08T18:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94383937227216] v30'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.851+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94383937211968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790f71a0 con 0x7fbb8c0f8060 2024-05-08T18:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94383937211968] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb98a9b980 20 remove_watcher() i=0 2024-05-08T18:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb98a9b980 2 removed watcher, disabling cache 2024-05-08T18:09:15.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94383937215184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790f71a0 con 0x55d7790c2c70 2024-05-08T18:09:15.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94383937215184] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb98a9b980 20 remove_watcher() i=1 2024-05-08T18:09:15.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.855+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94383937219328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790f71a0 con 0x55d7790c8bc0 2024-05-08T18:09:15.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.859+0000 7fbb95dae640 1 -- 172.21.15.114:0/3231786548 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94383937219328] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8c0f5030 con 0x55d7790c8bc0 2024-05-08T18:09:15.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.859+0000 7fbb98a9b980 20 remove_watcher() i=2 2024-05-08T18:09:15.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.859+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94383937223952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790ceb00 con 0x7fbb8c0f8060 2024-05-08T18:09:15.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.859+0000 7fbb96db0640 1 -- 172.21.15.114:0/3231786548 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94383937223952] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb8802f040 con 0x7fbb8c0f8060 2024-05-08T18:09:15.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.859+0000 7fbb98a9b980 20 remove_watcher() i=3 2024-05-08T18:09:15.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.859+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94383937221456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cfd10 con 0x55d7790c2c70 2024-05-08T18:09:15.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94383937221456] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x55d7790c2c70 2024-05-08T18:09:15.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb98a9b980 20 remove_watcher() i=4 2024-05-08T18:09:15.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94383937226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790ceb00 con 0x7fbb88019040 2024-05-08T18:09:15.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94383937226160] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb98a9b980 20 remove_watcher() i=5 2024-05-08T18:09:15.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94383937230704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790cfd10 con 0x7fbb88019040 2024-05-08T18:09:15.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94383937230704] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb98a9b980 20 remove_watcher() i=6 2024-05-08T18:09:15.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.863+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94383937234544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) -- 0x55d7790ceb00 con 0x7fbb88019040 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94383937234544] v30'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbb9001b030 con 0x7fbb88019040 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 20 remove_watcher() i=7 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbb88019040 msgr2=0x7fbb88019930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbb88019040 0x7fbb88019930 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7790c2c70 msgr2=0x55d7790c5130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7790c2c70 0x55d7790c5130 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbb8c0f8060 msgr2=0x7fbb8c0c1ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbb8c0f8060 0x7fbb8c0c1ab0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7790c8bc0 msgr2=0x55d7790cb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7790c8bc0 0x55d7790cb080 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba600383f0 msgr2=0x7fba6003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba600383f0 0x7fba6003a8b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x55d7790934c0 tx=0x7fbb8801b070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 msgr2=0x55d7790b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb965af640 1 -- 172.21.15.114:0/3231786548 reap_dead start 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b7760 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0e9140 tx=0x7fbb8c0ea380 comp rx=0 tx=0).stop 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 shutdown_connections 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/3231786548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790b0210 0x55d7790b7760 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 >> 172.21.15.114:0/3231786548 conn(0x55d7790ac5a0 msgr2=0x55d7790b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 shutdown_connections 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/3231786548 wait complete. 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba700383f0 msgr2=0x7fba7003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba700383f0 0x7fba7003a8b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbb8800e3f0 tx=0x7fbb88003070 comp rx=0 tx=0).stop 2024-05-08T18:09:15.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 msgr2=0x55d7790a3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 0x55d7790a3580 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c005410 tx=0x7fbb8c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 shutdown_connections 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba700383f0 0x7fba7003a8b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/1453307120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7790a3160 0x55d7790a3580 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 >> 172.21.15.114:0/1453307120 conn(0x55d779097f70 msgr2=0x55d779098a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 shutdown_connections 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/1453307120 wait complete. 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d778f9d5b0 msgr2=0x55d779092350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d778f9d5b0 0x55d779092350 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba7c038490 msgr2=0x7fba7c03a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba7c038490 0x7fba7c03a950 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0ae000 tx=0x7fbb8c0a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 msgr2=0x55d77908b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d77908b460 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbb90000f90 tx=0x7fbb90001370 comp rx=0 tx=0).stop 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 shutdown_connections 2024-05-08T18:09:15.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d778f9d5b0 0x55d779092350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba7c038490 0x7fba7c03a950 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 --2- 172.21.15.114:0/762942804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d778f990f0 0x55d77908b460 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:15.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 >> 172.21.15.114:0/762942804 conn(0x55d778f0c7d0 msgr2=0x55d77907e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:15.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 shutdown_connections 2024-05-08T18:09:15.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:15.867+0000 7fbb98a9b980 1 -- 172.21.15.114:0/762942804 wait complete. 2024-05-08T18:09:15.880 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:15.890 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:09:16.235 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-08T18:09:16.251 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:31.251 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T18:09:31.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T18:09:31.252 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T18:09:31.290 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:31.290 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:31.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b823a980 1 Processor -- start 2024-05-08T18:09:31.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b823a980 1 -- start start 2024-05-08T18:09:31.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b823a980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d9182eed0 0x555d9182f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b823a980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d916da710 con 0x555d9182f7f0 2024-05-08T18:09:31.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b823a980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555d916eef00 con 0x555d9182eed0 2024-05-08T18:09:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b5d4e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d9182eed0 0x555d9182f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b5d4e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555d9182eed0 0x555d9182f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44560/0 (socket says 172.21.15.114:44560) 2024-05-08T18:09:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b5d4e640 1 -- 172.21.15.114:0/5002564 learned_addr learned my addr 172.21.15.114:0/5002564 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b554d640 1 --1- 172.21.15.114:0/5002564 >> v1:172.21.15.53:6789/0 conn(0x555d9182f7f0 0x555d91830160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55250/0 (socket says 172.21.15.114:55250) 2024-05-08T18:09:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b5d4e640 1 -- 172.21.15.114:0/5002564 >> v1:172.21.15.53:6789/0 conn(0x555d9182f7f0 legacy=0x555d91830160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.290+0000 7f19b5d4e640 1 -- 172.21.15.114:0/5002564 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d916b6ae0 con 0x555d9182eed0 2024-05-08T18:09:31.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/5002564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9182f2b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19a800a4e0 tx=0x7f19a801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8521db72cf175ab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b4d4c640 1 -- 172.21.15.114:0/5002564 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19a80aa540 con 0x555d9182eed0 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b4d4c640 1 -- 172.21.15.114:0/5002564 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a80aa6e0 con 0x555d9182eed0 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b4d4c640 1 -- 172.21.15.114:0/5002564 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19a80aaa40 con 0x555d9182eed0 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 -- 172.21.15.114:0/5002564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 msgr2=0x555d9182f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 --2- 172.21.15.114:0/5002564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9182f2b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f19a800a4e0 tx=0x7f19a801b090 comp rx=0 tx=0).stop 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 -- 172.21.15.114:0/5002564 shutdown_connections 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 --2- 172.21.15.114:0/5002564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9182f2b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 -- 172.21.15.114:0/5002564 >> 172.21.15.114:0/5002564 conn(0x555d9182a7a0 msgr2=0x555d9182cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 -- 172.21.15.114:0/5002564 shutdown_connections 2024-05-08T18:09:31.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.294+0000 7f19b823a980 1 -- 172.21.15.114:0/5002564 wait complete. 2024-05-08T18:09:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b823a980 1 Processor -- start 2024-05-08T18:09:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b823a980 1 -- start start 2024-05-08T18:09:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b823a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9191a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b823a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d91732f80 con 0x555d9182eed0 2024-05-08T18:09:31.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b5d4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9191a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b5d4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9191a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44566/0 (socket says 172.21.15.114:44566) 2024-05-08T18:09:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b5d4e640 1 -- 172.21.15.114:0/3976614036 learned_addr learned my addr 172.21.15.114:0/3976614036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b5d4e640 1 -- 172.21.15.114:0/3976614036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d916fada0 con 0x555d9182eed0 2024-05-08T18:09:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.310+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/3976614036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9191a630 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f19a8017ca0 tx=0x7f19a80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c140794fdaba1632 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f18a3e07640 1 -- 172.21.15.114:0/3976614036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19a80b9070 con 0x555d9182eed0 2024-05-08T18:09:31.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f18a3e07640 1 -- 172.21.15.114:0/3976614036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a80aaa80 con 0x555d9182eed0 2024-05-08T18:09:31.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f18a3e07640 1 -- 172.21.15.114:0/3976614036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19a80aad60 con 0x555d9182eed0 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/3976614036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 msgr2=0x555d9191a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 --2- 172.21.15.114:0/3976614036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9191a630 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f19a8017ca0 tx=0x7f19a80033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/3976614036 shutdown_connections 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 --2- 172.21.15.114:0/3976614036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d9191a630 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/3976614036 >> 172.21.15.114:0/3976614036 conn(0x555d9182a7a0 msgr2=0x555d919161c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/3976614036 shutdown_connections 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/3976614036 wait complete. 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 Processor -- start 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- start start 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d91921a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d91838ed0 con 0x555d9182eed0 2024-05-08T18:09:31.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b5d4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d91921a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b5d4e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d91921a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44574/0 (socket says 172.21.15.114:44574) 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1824947926 learned_addr learned my addr 172.21.15.114:0/1824947926 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d91921f60 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d91921a20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f19a8017ca0 tx=0x7f19a8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f18a2604640 1 -- 172.21.15.114:0/1824947926 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19a80b9070 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f18a2604640 1 -- 172.21.15.114:0/1824947926 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19a80b5e10 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d919221f0 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f18a2604640 1 -- 172.21.15.114:0/1824947926 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19a80bd780 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.314+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d91924e80 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f18a2604640 1 -- 172.21.15.114:0/1824947926 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f19a80b3040 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f18a2604640 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f189c038440 0x7f189c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f18a2604640 1 -- 172.21.15.114:0/1824947926 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f19a80c4070 con 0x555d9182eed0 2024-05-08T18:09:31.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b554d640 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f189c038440 0x7f189c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d9182f7f0 0x555d91928ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91929050 con 0x555d9182f7f0 2024-05-08T18:09:31.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d9182f7f0 0x555d91928ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b554d640 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f189c038440 0x7f189c03a900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19ac001e40 tx=0x7f19ac0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d9182f7f0 0x555d91928ad0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 -- 172.21.15.114:0/1824947926 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19b00083f0 con 0x555d9182f7f0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91926080 con 0x555d9182f7f0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 -- 172.21.15.114:0/1824947926 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19b00083f0 con 0x555d9182f7f0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9192aea0 con 0x555d9182f7f0 2024-05-08T18:09:31.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 -- 172.21.15.114:0/1824947926 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19b00083f0 con 0x555d9182f7f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9192a010 con 0x555d9182f7f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 -- 172.21.15.114:0/1824947926 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19b00083f0 con 0x555d9182f7f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9192a430 con 0x555d9182f7f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.318+0000 7f19b654f640 1 -- 172.21.15.114:0/1824947926 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19b00083f0 con 0x555d9182f7f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b823a980 1 Processor -- start 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b823a980 1 -- start start 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b823a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 0x555d91939c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b823a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d91736fc0 con 0x555d919397f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b554d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 0x555d91939c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b554d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 0x555d91939c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44586/0 (socket says 172.21.15.114:44586) 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b554d640 1 -- 172.21.15.114:0/77122904 learned_addr learned my addr 172.21.15.114:0/77122904 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b554d640 1 -- 172.21.15.114:0/77122904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d9193a150 con 0x555d919397f0 2024-05-08T18:09:31.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b554d640 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 0x555d91939c10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e670 tx=0x7f19ac00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f189b7fe640 1 -- 172.21.15.114:0/77122904 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac022070 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d9193abf0 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f189b7fe640 1 -- 172.21.15.114:0/77122904 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac00d660 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f189b7fe640 1 -- 172.21.15.114:0/77122904 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac006070 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9193b0c0 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.322+0000 7f189b7fe640 1 -- 172.21.15.114:0/77122904 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f19ac025070 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f189b7fe640 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18900383f0 0x7f189003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f189b7fe640 1 -- 172.21.15.114:0/77122904 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f19ac050050 con 0x555d919397f0 2024-05-08T18:09:31.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b654f640 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18900383f0 0x7f189003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 Processor -- start 2024-05-08T18:09:31.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- start start 2024-05-08T18:09:31.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b654f640 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18900383f0 0x7f189003a8b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x555d9192a3b0 tx=0x7f19b0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d91946e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d9191acc0 con 0x555d91946a20 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b554d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d91946e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b554d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d91946e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44602/0 (socket says 172.21.15.114:44602) 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b554d640 1 -- 172.21.15.114:0/4085947191 learned_addr learned my addr 172.21.15.114:0/4085947191 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b554d640 1 -- 172.21.15.114:0/4085947191 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d919473f0 con 0x555d91946a20 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b554d640 1 --2- 172.21.15.114:0/4085947191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d91946e20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f19ac04e3c0 tx=0x7f19ac026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709e3d99874516a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f18997fa640 1 -- 172.21.15.114:0/4085947191 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac03d0d0 con 0x555d91946a20 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f18997fa640 1 -- 172.21.15.114:0/4085947191 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac03d270 con 0x555d91946a20 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f18997fa640 1 -- 172.21.15.114:0/4085947191 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac0242c0 con 0x555d91946a20 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- 172.21.15.114:0/4085947191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 msgr2=0x555d91946e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 --2- 172.21.15.114:0/4085947191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d91946e20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f19ac04e3c0 tx=0x7f19ac026780 comp rx=0 tx=0).stop 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- 172.21.15.114:0/4085947191 shutdown_connections 2024-05-08T18:09:31.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 --2- 172.21.15.114:0/4085947191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d91946e20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- 172.21.15.114:0/4085947191 >> 172.21.15.114:0/4085947191 conn(0x555d91942d60 msgr2=0x555d91940dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- 172.21.15.114:0/4085947191 shutdown_connections 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- 172.21.15.114:0/4085947191 wait complete. 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 Processor -- start 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- start start 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d9194dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b823a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555d91947b30 con 0x555d91946a20 2024-05-08T18:09:31.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.326+0000 7f19b554d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d9194dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b554d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d9194dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44612/0 (socket says 172.21.15.114:44612) 2024-05-08T18:09:31.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 learned_addr learned my addr 172.21.15.114:0/1208563486 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d9194e400 con 0x555d91946a20 2024-05-08T18:09:31.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b554d640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d9194dec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f19ac04d260 tx=0x7f19ac04e320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f18877fe640 1 -- 172.21.15.114:0/1208563486 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac03d0d0 con 0x555d91946a20 2024-05-08T18:09:31.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d9194e690 con 0x555d91946a20 2024-05-08T18:09:31.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f18877fe640 1 -- 172.21.15.114:0/1208563486 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ac024780 con 0x555d91946a20 2024-05-08T18:09:31.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f18877fe640 1 -- 172.21.15.114:0/1208563486 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19ac024970 con 0x555d91946a20 2024-05-08T18:09:31.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d9194e690 con 0x555d91946a20 2024-05-08T18:09:31.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f18877fe640 1 -- 172.21.15.114:0/1208563486 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f19ac03e940 con 0x555d91946a20 2024-05-08T18:09:31.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f18877fe640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18800383a0 0x7f188003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f18877fe640 1 -- 172.21.15.114:0/1208563486 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f19ac046070 con 0x555d91946a20 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b654f640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18800383a0 0x7f188003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d919591e0 0x555d9195b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195bdd0 con 0x555d919591e0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d919591e0 0x555d9195b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b654f640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18800383a0 0x7f188003a860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x555d91929b30 tx=0x7f19b001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d919591e0 0x555d9195b680 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 20 realm 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.330+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195c1e0 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195cab0 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195ce50 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195d2f0 con 0x555d919591e0 2024-05-08T18:09:31.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 20 searching for the correct realm 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555d9195f260 0x555d91961650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d9195f260 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b554d640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555d9195f260 0x555d91961650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b554d640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555d9195f260 0x555d91961650 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b554d640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f19ac027060 0x7f19ac0343f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19ac027060 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b654f640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f19ac027060 0x7f19ac0343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b654f640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f19ac027060 0x7f19ac0343f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19ac027060 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d919591e0 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d919591e0 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80cd060 con 0x555d919591e0 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f19a80b4c20 0x7f19a80bd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.334+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19a80b4c20 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f19a80b4c20 0x7f19a80bd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f19a80b4c20 0x7f19a80bd920 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19a80b4c20 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19ac027060 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d9195f260 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d919591e0 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19ac027060 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d919591e0 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x7f19ac027060 2024-05-08T18:09:31.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.338+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d9195f260 2024-05-08T18:09:31.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555d91961cd0 con 0x555d9195f260 2024-05-08T18:09:31.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19a80b4c20 2024-05-08T18:09:31.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d9195f260 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d9195f260 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d919591e0 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d919591e0 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19a80b4c20 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d9195f260 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19ac027060 2024-05-08T18:09:31.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d919591e0 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.342+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19a80b4c20 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d9195f260 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19a80b4c20 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19ac027060 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d9195f260 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19a80b4c20 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x555d919591e0 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f19ac05c040 con 0x7f19ac027060 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:31.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.346+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195dcd0 con 0x555d919591e0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195d910 con 0x555d919591e0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195e5a0 con 0x555d919591e0 2024-05-08T18:09:31.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 zone default found 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 4 Realm: () 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 zonegroup default 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9195e5a0 con 0x7f19a80b4c20 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91963b10 con 0x555d9195f260 2024-05-08T18:09:31.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91963eb0 con 0x555d9195f260 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 started sync module instance, tier type = 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:31.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91962fb0 con 0x7f19ac027060 2024-05-08T18:09:31.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93860362859424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91962c10 con 0x7f19ac027060 2024-05-08T18:09:31.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.350+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91964d20 con 0x555d919591e0 2024-05-08T18:09:31.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.354+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93860362859424] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.354+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.354+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93860362863184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91964d20 con 0x555d919591e0 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.354+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d919656e0 con 0x555d9195f260 2024-05-08T18:09:31.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93860362863184] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93860362864752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91964c90 con 0x555d9195f260 2024-05-08T18:09:31.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91966490 con 0x7f19ac027060 2024-05-08T18:09:31.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93860362870656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91966d30 con 0x7f19ac027060 2024-05-08T18:09:31.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91967770 con 0x555d919591e0 2024-05-08T18:09:31.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93860362864752] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.358+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93860362870656] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93860362875456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91966880 con 0x555d919591e0 2024-05-08T18:09:31.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91968010 con 0x7f19a80b4c20 2024-05-08T18:09:31.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93860362875456] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93860362869456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91966880 con 0x7f19a80b4c20 2024-05-08T18:09:31.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.362+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91968580 con 0x7f19a80b4c20 2024-05-08T18:09:31.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.366+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93860362869456] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.366+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.366+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93860362879056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91968540 con 0x7f19a80b4c20 2024-05-08T18:09:31.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.366+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91968f40 con 0x7f19a80b4c20 2024-05-08T18:09:31.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.366+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93860362879056] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93860362877312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91968f00 con 0x7f19a80b4c20 2024-05-08T18:09:31.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=0 2024-05-08T18:09:31.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=1 2024-05-08T18:09:31.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=2 2024-05-08T18:09:31.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=3 2024-05-08T18:09:31.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=4 2024-05-08T18:09:31.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=5 2024-05-08T18:09:31.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=6 2024-05-08T18:09:31.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93860362877312] v32'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 add_watcher() i=7 2024-05-08T18:09:31.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:31.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d9196c360 con 0x555d919591e0 2024-05-08T18:09:31.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93860362882080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91969800 con 0x555d919591e0 2024-05-08T18:09:31.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93860362882080] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f18677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:31.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:31.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.370+0000 7f19b823a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:31.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.374+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91974a40 con 0x555d919591e0 2024-05-08T18:09:31.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.374+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.374+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91974c10 con 0x7f19a80b4c20 2024-05-08T18:09:31.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.378+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.378+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91974c10 con 0x555d9195f260 2024-05-08T18:09:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.378+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.378+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91975240 con 0x555d919591e0 2024-05-08T18:09:31.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.378+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.378+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d919756b0 con 0x7f19ac027060 2024-05-08T18:09:31.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.382+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'46 uv45 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.382+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91973a30 con 0x555d9195f260 2024-05-08T18:09:31.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.382+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.382+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976040 con 0x555d919591e0 2024-05-08T18:09:31.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.386+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.386+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976040 con 0x7f19a80b4c20 2024-05-08T18:09:31.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.386+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.386+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976040 con 0x7f19ac027060 2024-05-08T18:09:31.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.390+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.390+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d919764f0 con 0x555d9195f260 2024-05-08T18:09:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.390+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.390+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d919764f0 con 0x7f19ac027060 2024-05-08T18:09:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.390+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'47 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.390+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d919766c0 con 0x7f19a80b4c20 2024-05-08T18:09:31.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.394+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.394+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d919766c0 con 0x7f19ac027060 2024-05-08T18:09:31.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.394+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.394+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976750 con 0x7f19a80b4c20 2024-05-08T18:09:31.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.398+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.398+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976750 con 0x555d919591e0 2024-05-08T18:09:31.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.398+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.398+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976c00 con 0x555d9195f260 2024-05-08T18:09:31.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.402+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.402+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976c00 con 0x7f19ac027060 2024-05-08T18:09:31.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.402+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'48 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.402+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976c00 con 0x555d9195f260 2024-05-08T18:09:31.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.406+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.406+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976c00 con 0x555d919591e0 2024-05-08T18:09:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.406+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.406+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b70 con 0x555d919591e0 2024-05-08T18:09:31.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.410+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.410+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.410+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.410+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x7f19ac027060 2024-05-08T18:09:31.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.414+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.414+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.414+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.414+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.418+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.418+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.418+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.418+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.418+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.418+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x7f19a80b4c20 2024-05-08T18:09:31.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.422+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.422+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.426+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.426+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x7f19a80b4c20 2024-05-08T18:09:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.430+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.430+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x555d9195f260 2024-05-08T18:09:31.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.430+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.430+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x7f19a80b4c20 2024-05-08T18:09:31.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.434+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.434+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91976b40 con 0x7f19ac027060 2024-05-08T18:09:31.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f18667fc640 20 reqs_thread_entry: start 2024-05-08T18:09:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b823a980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:31.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b823a980 20 Filter name: none 2024-05-08T18:09:31.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f17d7fff640 20 reqs_thread_entry: start 2024-05-08T18:09:31.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x555d919591e0 2024-05-08T18:09:31.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919916c0 con 0x555d919591e0 2024-05-08T18:09:31.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x555d919591e0 2024-05-08T18:09:31.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.438+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x7f19a80b4c20 2024-05-08T18:09:31.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919916c0 con 0x7f19a80b4c20 2024-05-08T18:09:31.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x7f19a80b4c20 2024-05-08T18:09:31.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x555d9195f260 2024-05-08T18:09:31.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919916c0 con 0x555d9195f260 2024-05-08T18:09:31.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x555d9195f260 2024-05-08T18:09:31.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x555d919591e0 2024-05-08T18:09:31.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.442+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919916c0 con 0x555d919591e0 2024-05-08T18:09:31.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x555d919591e0 2024-05-08T18:09:31.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x7f19ac027060 2024-05-08T18:09:31.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv45 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919916c0 con 0x7f19ac027060 2024-05-08T18:09:31.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv45 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d919926d0 con 0x7f19ac027060 2024-05-08T18:09:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(108 gc.4 [call out=1701b] v0'0 uv45 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv8 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv8 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.446+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.450+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.454+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.458+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.462+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.466+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d919591e0 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.470+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.474+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.478+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.482+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x555d9195f260 2024-05-08T18:09:31.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19a80b4c20 2024-05-08T18:09:31.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.486+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555d91972af0 con 0x7f19ac027060 2024-05-08T18:09:31.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f18677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:31.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.490+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93860362882080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91991ed0 con 0x555d919591e0 2024-05-08T18:09:31.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.494+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 93860362882080] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.494+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93860362859424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x7f19ac027060 2024-05-08T18:09:31.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.494+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 93860362859424] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.494+0000 7f19b823a980 20 remove_watcher() i=0 2024-05-08T18:09:31.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.494+0000 7f19b823a980 2 removed watcher, disabling cache 2024-05-08T18:09:31.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.494+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93860362863184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x555d919591e0 2024-05-08T18:09:31.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.498+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 93860362863184] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.498+0000 7f19b823a980 20 remove_watcher() i=1 2024-05-08T18:09:31.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.498+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93860362864752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x555d9195f260 2024-05-08T18:09:31.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.498+0000 7f19b554d640 1 -- 172.21.15.114:0/1208563486 <== osd.3 v2:172.21.15.114:6808/3988457904 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 93860362864752] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19ac024030 con 0x555d9195f260 2024-05-08T18:09:31.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.498+0000 7f19b823a980 20 remove_watcher() i=2 2024-05-08T18:09:31.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.498+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93860362870656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x7f19ac027060 2024-05-08T18:09:31.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.502+0000 7f19b654f640 1 -- 172.21.15.114:0/1208563486 <== osd.2 v2:172.21.15.114:6810/2279342404 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 93860362870656] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19b002f040 con 0x7f19ac027060 2024-05-08T18:09:31.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.502+0000 7f19b823a980 20 remove_watcher() i=3 2024-05-08T18:09:31.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.502+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93860362875456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x555d919591e0 2024-05-08T18:09:31.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.502+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.1 v2:172.21.15.114:6800/1559856467 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 93860362875456] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x555d919591e0 2024-05-08T18:09:31.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.502+0000 7f19b823a980 20 remove_watcher() i=4 2024-05-08T18:09:31.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.502+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93860362869456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x7f19a80b4c20 2024-05-08T18:09:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.506+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 93860362869456] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.506+0000 7f19b823a980 20 remove_watcher() i=5 2024-05-08T18:09:31.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.506+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93860362879056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x7f19a80b4c20 2024-05-08T18:09:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.506+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 93860362879056] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.506+0000 7f19b823a980 20 remove_watcher() i=6 2024-05-08T18:09:31.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.506+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93860362877312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555d91972250 con 0x7f19a80b4c20 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 93860362877312] v32'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19a80df040 con 0x7f19a80b4c20 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 20 remove_watcher() i=7 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f19a80b4c20 msgr2=0x7f19a80bd920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f19a80b4c20 0x7f19a80bd920 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d919591e0 msgr2=0x555d9195b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d919591e0 0x555d9195b680 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f19ac027060 msgr2=0x7f19ac0343f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f19ac027060 0x7f19ac0343f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555d9195f260 msgr2=0x555d91961650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555d9195f260 0x555d91961650 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18800383a0 msgr2=0x7f188003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18800383a0 0x7f188003a860 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x555d91929b30 tx=0x7f19b001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 msgr2=0x555d9194dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d9194dec0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f19ac04d260 tx=0x7f19ac04e320 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 shutdown_connections 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f19a80b4c20 0x7f19a80bd920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f19ac027060 0x7f19ac0343f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555d9195f260 0x555d91961650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d919591e0 0x555d9195b680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 reap_dead start 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18800383a0 0x7f188003a860 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1208563486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d91946a20 0x555d9194dec0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 >> 172.21.15.114:0/1208563486 conn(0x555d91942d60 msgr2=0x555d919403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b5d4e640 1 -- 172.21.15.114:0/1208563486 reap_dead start 2024-05-08T18:09:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 shutdown_connections 2024-05-08T18:09:31.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1208563486 wait complete. 2024-05-08T18:09:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18900383f0 msgr2=0x7f189003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18900383f0 0x7f189003a8b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x555d9192a3b0 tx=0x7f19b0003070 comp rx=0 tx=0).stop 2024-05-08T18:09:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 msgr2=0x555d91939c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 0x555d91939c10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00e670 tx=0x7f19ac00ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 shutdown_connections 2024-05-08T18:09:31.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f18900383f0 0x7f189003a8b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/77122904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d919397f0 0x555d91939c10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 >> 172.21.15.114:0/77122904 conn(0x555d9192e600 msgr2=0x555d9192f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 shutdown_connections 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/77122904 wait complete. 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d9182f7f0 msgr2=0x555d91928ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d9182f7f0 0x555d91928ad0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f189c038440 msgr2=0x7f189c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f189c038440 0x7f189c03a900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19ac001e40 tx=0x7f19ac0013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 msgr2=0x555d91921a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d91921a20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f19a8017ca0 tx=0x7f19a8017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 shutdown_connections 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555d9182f7f0 0x555d91928ad0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f189c038440 0x7f189c03a900 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 --2- 172.21.15.114:0/1824947926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d9182eed0 0x555d91921a20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.510+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 >> 172.21.15.114:0/1824947926 conn(0x555d9182a7a0 msgr2=0x555d91914cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.514+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 shutdown_connections 2024-05-08T18:09:31.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.514+0000 7f19b823a980 1 -- 172.21.15.114:0/1824947926 wait complete. 2024-05-08T18:09:31.527 INFO:teuthology.orchestra.run.smithi114.stdout:[{"tag":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7664126669705142838\u0000","time":"2024-05-08T18:09:31.250635+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_7","key":"","instance":""}]}] 2024-05-08T18:09:31.527 DEBUG:tasks.util.rgw: json result: [{'tag': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7664126669705142838\x00', 'time': '2024-05-08T18:09:31.250635+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_7', 'key': '', 'instance': ''}]}] 2024-05-08T18:09:31.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-08T18:09:31.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-08T18:09:31.528 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:31.604 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e9c49980 1 Processor -- start 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e9c49980 1 -- start start 2024-05-08T18:09:31.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e9c49980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f5f2061270 0x55f5f2063660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e9c49980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f5f1f08710 con 0x55f5f1fd0f40 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e9c49980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f5f1f1cf00 con 0x55f5f2061270 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e6f5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f5f2061270 0x55f5f2063660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e6f5c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f5f2061270 0x55f5f2063660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44628/0 (socket says 172.21.15.114:44628) 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e775d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f5f1fd0f40 0x55f5f205fb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55264/0 (socket says 172.21.15.114:55264) 2024-05-08T18:09:31.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.602+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2257735513 learned_addr learned my addr 172.21.15.114:0/2257735513 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.606+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2257735513 >> v1:172.21.15.53:6789/0 conn(0x55f5f1fd0f40 legacy=0x55f5f205fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.606+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2257735513 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f1ee4ae0 con 0x55f5f2061270 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.606+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/2257735513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2061270 0x55f5f2063660 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00a5c0 tx=0x7f24dc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da12f14abb0d21f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.606+0000 7f24e675b640 1 -- 172.21.15.114:0/2257735513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0a6070 con 0x55f5f2061270 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e675b640 1 -- 172.21.15.114:0/2257735513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc0af070 con 0x55f5f2061270 2024-05-08T18:09:31.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e675b640 1 -- 172.21.15.114:0/2257735513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0aa5c0 con 0x55f5f2061270 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 -- 172.21.15.114:0/2257735513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2061270 msgr2=0x55f5f2063660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2257735513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2061270 0x55f5f2063660 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f24dc00a5c0 tx=0x7f24dc01b340 comp rx=0 tx=0).stop 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 -- 172.21.15.114:0/2257735513 shutdown_connections 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2257735513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2061270 0x55f5f2063660 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 -- 172.21.15.114:0/2257735513 >> 172.21.15.114:0/2257735513 conn(0x55f5f2057630 msgr2=0x55f5f2059a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 -- 172.21.15.114:0/2257735513 shutdown_connections 2024-05-08T18:09:31.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.610+0000 7f24e9c49980 1 -- 172.21.15.114:0/2257735513 wait complete. 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 Processor -- start 2024-05-08T18:09:31.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- start start 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f2147f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f5f1f60f80 con 0x55f5f1fd0f40 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e775d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f2147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e775d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f2147f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44638/0 (socket says 172.21.15.114:44638) 2024-05-08T18:09:31.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e775d640 1 -- 172.21.15.114:0/2572474306 learned_addr learned my addr 172.21.15.114:0/2572474306 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e775d640 1 -- 172.21.15.114:0/2572474306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f1f28da0 con 0x55f5f1fd0f40 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e775d640 1 --2- 172.21.15.114:0/2572474306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f2147f10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b270 tx=0x7f24d800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5742b662dc9ec1b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f23d560a640 1 -- 172.21.15.114:0/2572474306 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d800e5d0 con 0x55f5f1fd0f40 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f23d560a640 1 -- 172.21.15.114:0/2572474306 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d800e770 con 0x55f5f1fd0f40 2024-05-08T18:09:31.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f23d560a640 1 -- 172.21.15.114:0/2572474306 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d800ea70 con 0x55f5f1fd0f40 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- 172.21.15.114:0/2572474306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 msgr2=0x55f5f2147f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2572474306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f2147f10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b270 tx=0x7f24d800b670 comp rx=0 tx=0).stop 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- 172.21.15.114:0/2572474306 shutdown_connections 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2572474306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f2147f10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- 172.21.15.114:0/2572474306 >> 172.21.15.114:0/2572474306 conn(0x55f5f2057630 msgr2=0x55f5f2143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- 172.21.15.114:0/2572474306 shutdown_connections 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- 172.21.15.114:0/2572474306 wait complete. 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 Processor -- start 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- start start 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f214f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.626+0000 7f24e9c49980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f5f2064740 con 0x55f5f1fd0f40 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e775d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f214f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e775d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f214f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44644/0 (socket says 172.21.15.114:44644) 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e775d640 1 -- 172.21.15.114:0/657694139 learned_addr learned my addr 172.21.15.114:0/657694139 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e775d640 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f214f910 con 0x55f5f1fd0f40 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e775d640 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f214f3d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b6b0 tx=0x7f24d8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f23d3e07640 1 -- 172.21.15.114:0/657694139 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d800be70 con 0x55f5f1fd0f40 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f23d3e07640 1 -- 172.21.15.114:0/657694139 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d800fa40 con 0x55f5f1fd0f40 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f214fba0 con 0x55f5f1fd0f40 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f23d3e07640 1 -- 172.21.15.114:0/657694139 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24d800fd80 con 0x55f5f1fd0f40 2024-05-08T18:09:31.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f2152830 con 0x55f5f1fd0f40 2024-05-08T18:09:31.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f23d3e07640 1 -- 172.21.15.114:0/657694139 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f24d8017070 con 0x55f5f1fd0f40 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f23d3e07640 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23cc0383f0 0x7f23cc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f23d3e07640 1 -- 172.21.15.114:0/657694139 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f24d8015020 con 0x55f5f1fd0f40 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23cc0383f0 0x7f23cc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2061270 0x55f5f2156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2156990 con 0x55f5f2061270 2024-05-08T18:09:31.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2061270 0x55f5f2156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23cc0383f0 0x7f23cc03a8b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0ae000 tx=0x7f24dc0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.630+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2061270 0x55f5f2156350 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e7f5e640 1 -- 172.21.15.114:0/657694139 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24e000a4d0 con 0x55f5f2061270 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2153a50 con 0x55f5f2061270 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e7f5e640 1 -- 172.21.15.114:0/657694139 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24e000a4d0 con 0x55f5f2061270 2024-05-08T18:09:31.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21587d0 con 0x55f5f2061270 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e7f5e640 1 -- 172.21.15.114:0/657694139 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24e000a4d0 con 0x55f5f2061270 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2157a00 con 0x55f5f2061270 2024-05-08T18:09:31.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e7f5e640 1 -- 172.21.15.114:0/657694139 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24e000a4d0 con 0x55f5f2061270 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2157e20 con 0x55f5f2061270 2024-05-08T18:09:31.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e7f5e640 1 -- 172.21.15.114:0/657694139 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24e000a4d0 con 0x55f5f2061270 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 Processor -- start 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 -- start start 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 0x55f5f2167570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e9c49980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f5f1f64fc0 con 0x55f5f2167150 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e6f5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 0x55f5f2167570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e6f5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 0x55f5f2167570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44646/0 (socket says 172.21.15.114:44646) 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2157001456 learned_addr learned my addr 172.21.15.114:0/2157001456 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.634+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2157001456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f2167ab0 con 0x55f5f2167150 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 0x55f5f2167570 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0ac040 tx=0x7f24dc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f23d1602640 1 -- 172.21.15.114:0/2157001456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0b3b90 con 0x55f5f2167150 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f23d1602640 1 -- 172.21.15.114:0/2157001456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc0b3d30 con 0x55f5f2167150 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f2168550 con 0x55f5f2167150 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f23d1602640 1 -- 172.21.15.114:0/2157001456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0c8560 con 0x55f5f2167150 2024-05-08T18:09:31.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f21689c0 con 0x55f5f2167150 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f23d1602640 1 -- 172.21.15.114:0/2157001456 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f24dc0d1440 con 0x55f5f2167150 2024-05-08T18:09:31.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f23d1602640 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23c0038440 0x7f23c003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f23d1602640 1 -- 172.21.15.114:0/2157001456 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f24dc0ec160 con 0x55f5f2167150 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23c0038440 0x7f23c003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e9c49980 1 Processor -- start 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23c0038440 0x7f23c003a900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55f5f2157da0 tx=0x7f24e0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e9c49980 1 -- start start 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e9c49980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f205d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e9c49980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f5f2148660 con 0x55f5f205d0e0 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e6f5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f205d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e6f5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f205d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44648/0 (socket says 172.21.15.114:44648) 2024-05-08T18:09:31.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e6f5c640 1 -- 172.21.15.114:0/748194817 learned_addr learned my addr 172.21.15.114:0/748194817 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.638+0000 7f24e6f5c640 1 -- 172.21.15.114:0/748194817 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f205b930 con 0x55f5f205d0e0 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/748194817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f205d500 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0ea3e0 tx=0x7f24dc0bced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28aeac13a48c652a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f23caffd640 1 -- 172.21.15.114:0/748194817 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0d1940 con 0x55f5f205d0e0 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f23caffd640 1 -- 172.21.15.114:0/748194817 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc0bd390 con 0x55f5f205d0e0 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f23caffd640 1 -- 172.21.15.114:0/748194817 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0bd670 con 0x55f5f205d0e0 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/748194817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 msgr2=0x55f5f205d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 --2- 172.21.15.114:0/748194817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f205d500 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0ea3e0 tx=0x7f24dc0bced0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/748194817 shutdown_connections 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 --2- 172.21.15.114:0/748194817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f205d500 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/748194817 >> 172.21.15.114:0/748194817 conn(0x55f5f2170550 msgr2=0x55f5f216e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:31.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/748194817 shutdown_connections 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/748194817 wait complete. 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 Processor -- start 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- start start 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f217d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f5f205bdd0 con 0x55f5f205d0e0 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e6f5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f217d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e6f5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f217d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44664/0 (socket says 172.21.15.114:44664) 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 learned_addr learned my addr 172.21.15.114:0/2593914806 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5f217de60 con 0x55f5f205d0e0 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f217d920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0b37e0 tx=0x7f24dc0ea370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f23c97fa640 1 -- 172.21.15.114:0/2593914806 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0be750 con 0x55f5f205d0e0 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f5f217e0f0 con 0x55f5f205d0e0 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f23c97fa640 1 -- 172.21.15.114:0/2593914806 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24dc0c7ae0 con 0x55f5f205d0e0 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f23c97fa640 1 -- 172.21.15.114:0/2593914806 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24dc0c7dc0 con 0x55f5f205d0e0 2024-05-08T18:09:31.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.642+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5f2180dd0 con 0x55f5f205d0e0 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f23c97fa640 1 -- 172.21.15.114:0/2593914806 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f24dc0f3060 con 0x55f5f205d0e0 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f23c97fa640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23b00383f0 0x7f23b003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f23c97fa640 1 -- 172.21.15.114:0/2593914806 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f24dc0edd40 con 0x55f5f205d0e0 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23b00383f0 0x7f23b003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2188c20 0x55f5f218b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218b830 con 0x55f5f2188c20 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2188c20 0x55f5f218b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23b00383f0 0x7f23b003a8b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55f5f2157520 tx=0x7f24e001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2188c20 0x55f5f218b0e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 realm 2024-05-08T18:09:31.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218bc40 con 0x55f5f2188c20 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218c510 con 0x55f5f2188c20 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218c8b0 con 0x55f5f2188c20 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218d100 con 0x55f5f2188c20 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 20 searching for the correct realm 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f5f218ee70 0x55f5f2191260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.646+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f5f218ee70 0x55f5f2191260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f5f218ee70 0x55f5f2191260 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e6f5c640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f24dc0f5070 0x7f24dc0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f24dc0f5070 0x7f24dc0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e7f5e640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f24dc0f5070 0x7f24dc0caa70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f24d803cb80 0x7f24d804c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f24d803cb80 0x7f24d804c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.650+0000 7f24e775d640 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f24d803cb80 0x7f24d804c130 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.654+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.658+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f218ee70 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24d803cb80 2024-05-08T18:09:31.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x55f5f2188c20 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21917a0 con 0x7f24dc0f5070 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218da80 con 0x55f5f2188c20 2024-05-08T18:09:31.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218e2d0 con 0x55f5f2188c20 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2191b40 con 0x55f5f2188c20 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.662+0000 7f24e9c49980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 zone default found 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 4 Realm: () 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:31.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:31.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 zonegroup default 2024-05-08T18:09:31.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f218def0 con 0x7f24d803cb80 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2193a50 con 0x55f5f218ee70 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 rados->read ofs=0 len=0 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2193e20 con 0x55f5f218ee70 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 started sync module instance, tier type = 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:31.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2192ef0 con 0x7f24dc0f5070 2024-05-08T18:09:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94514817086176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2192b50 con 0x7f24dc0f5070 2024-05-08T18:09:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.666+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2194d50 con 0x55f5f2188c20 2024-05-08T18:09:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94514817086176] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94514817090176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2194d50 con 0x55f5f2188c20 2024-05-08T18:09:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2195710 con 0x55f5f218ee70 2024-05-08T18:09:31.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94514817090176] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94514817091744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2194cc0 con 0x55f5f218ee70 2024-05-08T18:09:31.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.670+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2196450 con 0x7f24dc0f5070 2024-05-08T18:09:31.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94514817097568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2196cf0 con 0x7f24dc0f5070 2024-05-08T18:09:31.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197710 con 0x55f5f2188c20 2024-05-08T18:09:31.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94514817091744] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94514817097568] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94514817102336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2196840 con 0x55f5f2188c20 2024-05-08T18:09:31.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.674+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197fb0 con 0x7f24d803cb80 2024-05-08T18:09:31.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.678+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94514817102336] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.678+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.678+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94514817096368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197cd0 con 0x7f24d803cb80 2024-05-08T18:09:31.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.678+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2198520 con 0x7f24d803cb80 2024-05-08T18:09:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94514817105376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2198870 con 0x7f24d803cb80 2024-05-08T18:09:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2199390 con 0x7f24d803cb80 2024-05-08T18:09:31.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94514817096368] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94514817105376] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94514817109600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21982c0 con 0x7f24d803cb80 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=0 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=1 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=2 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=3 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=4 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=5 2024-05-08T18:09:31.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.682+0000 7f24e9c49980 20 add_watcher() i=6 2024-05-08T18:09:31.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94514817109600] v32'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 20 add_watcher() i=7 2024-05-08T18:09:31.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:31.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f219c380 con 0x55f5f2188c20 2024-05-08T18:09:31.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94514817103904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2199800 con 0x55f5f2188c20 2024-05-08T18:09:31.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94514817103904] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f239dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:31.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:31.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:31.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.686+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a4ce0 con 0x55f5f2188c20 2024-05-08T18:09:31.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.690+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.690+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a5330 con 0x7f24d803cb80 2024-05-08T18:09:31.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.690+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.690+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a5330 con 0x55f5f218ee70 2024-05-08T18:09:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.694+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.694+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a5b80 con 0x55f5f2188c20 2024-05-08T18:09:31.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.694+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.694+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a44d0 con 0x7f24dc0f5070 2024-05-08T18:09:31.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.694+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'49 uv45 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.697 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.694+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a44d0 con 0x55f5f218ee70 2024-05-08T18:09:31.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.698+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.698+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6200 con 0x55f5f2188c20 2024-05-08T18:09:31.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.698+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.698+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6200 con 0x7f24d803cb80 2024-05-08T18:09:31.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.702+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.702+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6200 con 0x7f24dc0f5070 2024-05-08T18:09:31.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.702+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.702+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6770 con 0x55f5f218ee70 2024-05-08T18:09:31.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.706+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.706+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6770 con 0x7f24dc0f5070 2024-05-08T18:09:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.706+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'50 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.706+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6ce0 con 0x7f24d803cb80 2024-05-08T18:09:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.710+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.710+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6ce0 con 0x7f24dc0f5070 2024-05-08T18:09:31.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.710+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.710+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6f60 con 0x7f24d803cb80 2024-05-08T18:09:31.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.714+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.714+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6f60 con 0x55f5f2188c20 2024-05-08T18:09:31.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.714+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.714+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6f60 con 0x55f5f218ee70 2024-05-08T18:09:31.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.718+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.718+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6f60 con 0x7f24dc0f5070 2024-05-08T18:09:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.718+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'51 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.718+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a6f60 con 0x55f5f218ee70 2024-05-08T18:09:31.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.722+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.722+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f2188c20 2024-05-08T18:09:31.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.722+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.722+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f2188c20 2024-05-08T18:09:31.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.726+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.726+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.726+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.726+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x7f24dc0f5070 2024-05-08T18:09:31.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.730+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.730+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.730+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.730+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.734+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.734+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.734+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.734+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.734+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.734+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x7f24d803cb80 2024-05-08T18:09:31.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.738+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.738+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.738+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.738+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x7f24d803cb80 2024-05-08T18:09:31.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.742+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.742+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x55f5f218ee70 2024-05-08T18:09:31.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.742+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.742+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x7f24d803cb80 2024-05-08T18:09:31.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.746+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.746+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a7010 con 0x7f24dc0f5070 2024-05-08T18:09:31.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f239cfe1640 20 reqs_thread_entry: start 2024-05-08T18:09:31.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f24e9c49980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f24e9c49980 20 Filter name: none 2024-05-08T18:09:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f23167fc640 20 reqs_thread_entry: start 2024-05-08T18:09:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-08T18:09:31.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.750+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:94 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(94 gc.16 [call] v32'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(95 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(96 gc.16 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:97 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(97 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(98 gc.16 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.754+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:99 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(99 gc.16 [call] v32'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-08T18:09:31.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(100 gc.17 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(101 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(102 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.758+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:103 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(103 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:104 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(104 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:105 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(105 gc.17 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-08T18:09:31.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.762+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:106 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(106 gc.18 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:107 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(107 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:108 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(108 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:109 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(109 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:110 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(110 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:111 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(111 gc.18 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-08T18:09:31.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.766+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:112 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(112 gc.19 [call] v32'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:113 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(113 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:114 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(114 gc.19 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:115 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== osd_op_reply(115 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:116 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(116 gc.19 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.770+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:117 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 40 ==== osd_op_reply(117 gc.19 [call] v32'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-08T18:09:31.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:118 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(118 gc.20 [call] v32'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:119 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(119 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:120 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(120 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:121 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(121 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.774+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:122 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.778+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(122 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.778+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.778+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:123 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.778+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(123 gc.20 [call] v32'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.778+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-08T18:09:31.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.778+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:124 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(124 gc.21 [call] v32'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:125 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(125 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:126 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x7f24dc0f5070 2024-05-08T18:09:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== osd_op_reply(126 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:127 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(127 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:128 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(128 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:129 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(129 gc.21 [call] v32'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.782+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-08T18:09:31.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:130 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(130 gc.22 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:131 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(131 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:132 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== osd_op_reply(132 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:133 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(133 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:134 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(134 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.786+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:135 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== osd_op_reply(135 gc.22 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-08T18:09:31.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:136 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(136 gc.23 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:137 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(137 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:138 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(138 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:139 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(139 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.790+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:140 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.794+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== osd_op_reply(140 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.794+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.794+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:141 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.794+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 49 ==== osd_op_reply(141 gc.23 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.794+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-08T18:09:31.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.794+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:142 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 50 ==== osd_op_reply(142 gc.24 [call] v32'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:143 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 51 ==== osd_op_reply(143 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:144 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 52 ==== osd_op_reply(144 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:145 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 53 ==== osd_op_reply(145 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:146 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 54 ==== osd_op_reply(146 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.798+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:147 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 55 ==== osd_op_reply(147 gc.24 [call] v32'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-08T18:09:31.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:148 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 56 ==== osd_op_reply(148 gc.25 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:149 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 57 ==== osd_op_reply(149 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:150 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 58 ==== osd_op_reply(150 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:151 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 59 ==== osd_op_reply(151 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.802+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:152 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.806+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 60 ==== osd_op_reply(152 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.806+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.806+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:153 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.806+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 61 ==== osd_op_reply(153 gc.25 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.806+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-08T18:09:31.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.806+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:154 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(154 gc.26 [call] v32'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:155 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(155 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:156 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(156 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:157 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(157 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:158 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(158 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.810+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:159 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(159 gc.26 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-08T18:09:31.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:160 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 62 ==== osd_op_reply(160 gc.27 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:161 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 63 ==== osd_op_reply(161 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.814+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:162 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 64 ==== osd_op_reply(162 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:163 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 65 ==== osd_op_reply(163 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:164 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 66 ==== osd_op_reply(164 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:165 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 67 ==== osd_op_reply(165 gc.27 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-08T18:09:31.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.818+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:166 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(166 gc.28 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:167 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(167 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:168 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x7f24d803cb80 2024-05-08T18:09:31.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(168 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:169 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(169 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.822+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:170 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.826+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(170 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.826+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.826+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:171 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.826+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(171 gc.28 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.826+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-08T18:09:31.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.826+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:172 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 68 ==== osd_op_reply(172 gc.29 [call] v32'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:173 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 69 ==== osd_op_reply(173 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:174 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 70 ==== osd_op_reply(174 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:175 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 71 ==== osd_op_reply(175 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:176 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 72 ==== osd_op_reply(176 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.830+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:177 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.834+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 73 ==== osd_op_reply(177 gc.29 [call] v32'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.834+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-08T18:09:31.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.834+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:178 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(178 gc.30 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:179 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(179 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:180 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x7f24d803cb80 2024-05-08T18:09:31.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(180 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.838+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:181 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.842+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(181 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.842+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.842+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:182 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.842+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(182 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.842+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.842+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:183 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(183 gc.30 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-08T18:09:31.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:184 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(184 gc.31 [call] v32'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:185 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(185 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.846+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:186 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(186 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 36 ==== osd_op_reply(188 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 37 ==== osd_op_reply(189 gc.31 [call] v32'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-08T18:09:31.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.850+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:190 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 41 ==== osd_op_reply(190 gc.0 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:191 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 42 ==== osd_op_reply(191 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:192 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 43 ==== osd_op_reply(192 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:193 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 44 ==== osd_op_reply(193 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:194 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 45 ==== osd_op_reply(194 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.854+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:195 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.858+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 46 ==== osd_op_reply(195 gc.0 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.858+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-08T18:09:31.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.858+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:196 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(196 gc.1 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:197 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(197 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:198 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x7f24d803cb80 2024-05-08T18:09:31.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== osd_op_reply(198 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.862+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:199 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.866+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(199 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.866+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.866+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:200 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.866+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(200 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.866+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.866+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:201 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24d803cb80 2024-05-08T18:09:31.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== osd_op_reply(201 gc.1 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-08T18:09:31.871 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:202 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 74 ==== osd_op_reply(202 gc.2 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:203 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 75 ==== osd_op_reply(203 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:204 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f218ee70 2024-05-08T18:09:31.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 76 ==== osd_op_reply(204 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:205 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 77 ==== osd_op_reply(205 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:206 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 78 ==== osd_op_reply(206 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.870+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:207 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f218ee70 2024-05-08T18:09:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 79 ==== osd_op_reply(207 gc.2 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-08T18:09:31.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:208 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 47 ==== osd_op_reply(208 gc.3 [call] v32'163 uv163 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:209 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 48 ==== osd_op_reply(209 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.874+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:210 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x55f5f2188c20 2024-05-08T18:09:31.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 49 ==== osd_op_reply(210 gc.3 [call out=24b] v0'0 uv163 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:211 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 50 ==== osd_op_reply(211 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:212 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 51 ==== osd_op_reply(212 gc.3 [call out=15b] v0'0 uv163 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:213 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x55f5f2188c20 2024-05-08T18:09:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 52 ==== osd_op_reply(213 gc.3 [call] v32'164 uv164 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-08T18:09:31.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.878+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:214 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 38 ==== osd_op_reply(214 gc.4 [call] v32'54 uv54 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:215 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 39 ==== osd_op_reply(215 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:216 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c2730 con 0x7f24dc0f5070 2024-05-08T18:09:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 40 ==== osd_op_reply(216 gc.4 [call out=24b] v0'0 uv54 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:217 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 41 ==== osd_op_reply(217 gc.4 [call out=15b] v0'0 uv54 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:218 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c3740 con 0x7f24dc0f5070 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 42 ==== osd_op_reply(218 gc.4 [call out=1701b] v0'0 uv54 ondisk = 0) ==== 148+0+1701 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 20 garbage collection: RGWGC::process iterating over entry tag='e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7664126669705142838', time=2024-05-08T18:09:31.250635+0000, chain.objs.size()=7 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_1 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:219 3.7s0 3:e18cfe14:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21a0310 con 0x55f5f218ee70 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_2 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:220 3.5s0 3:a2e84556:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c6c20 con 0x7f24dc0f5070 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_3 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:221 3.10s0 3:0916188c:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21c6c20 con 0x55f5f2188c20 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_4 2024-05-08T18:09:31.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:222 3.34s0 3:2d00d12d:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cb9c0 con 0x55f5f2188c20 2024-05-08T18:09:31.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_5 2024-05-08T18:09:31.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:223 3.18s0 3:1ba03546:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21ce2a0 con 0x55f5f218ee70 2024-05-08T18:09:31.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_6 2024-05-08T18:09:31.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:224 3.1es0 3:7bcdeb05:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0d80 con 0x7f24d803cb80 2024-05-08T18:09:31.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_7 2024-05-08T18:09:31.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.882+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:225 3.34s0 3:2c66dc9e:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cb9c0 con 0x55f5f2188c20 2024-05-08T18:09:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.886+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 43 ==== osd_op_reply(220 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_2 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.886+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 80 ==== osd_op_reply(219 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_1 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.886+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 81 ==== osd_op_reply(223 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_5 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.894+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 53 ==== osd_op_reply(221 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_3 [call] v32'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.894+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 54 ==== osd_op_reply(222 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_4 [call] v32'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.894+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 55 ==== osd_op_reply(225 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_7 [call] v32'4 uv4 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.894+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 46 ==== osd_op_reply(224 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.1__shadow_.Ket3TIR4sYD-8u2vwHIKnOpamdrni0R_6 [call] v32'3 uv3 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.894+0000 7f24e9c49980 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T18:09:31.896 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.894+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:226 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x7f24dc0f5070 2024-05-08T18:09:31.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.898+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 44 ==== osd_op_reply(226 gc.4 [call] v32'55 uv55 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.899 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.898+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:227 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x7f24dc0f5070 2024-05-08T18:09:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.898+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 45 ==== osd_op_reply(227 gc.4 [call] v32'56 uv56 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.898+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-08T18:09:31.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.898+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:228 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f218ee70 2024-05-08T18:09:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 82 ==== osd_op_reply(228 gc.5 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:229 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f218ee70 2024-05-08T18:09:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 83 ==== osd_op_reply(229 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:230 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f218ee70 2024-05-08T18:09:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 84 ==== osd_op_reply(230 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:231 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f218ee70 2024-05-08T18:09:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 85 ==== osd_op_reply(231 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:232 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f218ee70 2024-05-08T18:09:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 86 ==== osd_op_reply(232 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.902+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:233 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f218ee70 2024-05-08T18:09:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 87 ==== osd_op_reply(233 gc.5 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-08T18:09:31.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:234 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06f0 con 0x55f5f2188c20 2024-05-08T18:09:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 56 ==== osd_op_reply(234 gc.6 [call] v32'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:235 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06d0 con 0x55f5f2188c20 2024-05-08T18:09:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 57 ==== osd_op_reply(235 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:236 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d06d0 con 0x55f5f2188c20 2024-05-08T18:09:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 58 ==== osd_op_reply(236 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.906+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:237 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x55f5f2188c20 2024-05-08T18:09:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 59 ==== osd_op_reply(237 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x55f5f2188c20 2024-05-08T18:09:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 60 ==== osd_op_reply(238 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x55f5f2188c20 2024-05-08T18:09:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 61 ==== osd_op_reply(239 gc.6 [call] v32'24 uv24 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-08T18:09:31.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.910+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:240 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x7f24d803cb80 2024-05-08T18:09:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 47 ==== osd_op_reply(240 gc.7 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:241 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x7f24d803cb80 2024-05-08T18:09:31.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 48 ==== osd_op_reply(241 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:242 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21ccde0 con 0x7f24d803cb80 2024-05-08T18:09:31.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 49 ==== osd_op_reply(242 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.914+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:243 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x7f24d803cb80 2024-05-08T18:09:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.918+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 50 ==== osd_op_reply(243 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.918+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.918+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x7f24d803cb80 2024-05-08T18:09:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.918+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 51 ==== osd_op_reply(244 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.918+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.918+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x7f24d803cb80 2024-05-08T18:09:31.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 52 ==== osd_op_reply(245 gc.7 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-08T18:09:31.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:246 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cddf0 con 0x7f24dc0f5070 2024-05-08T18:09:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 46 ==== osd_op_reply(246 gc.8 [call] v32'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:247 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 47 ==== osd_op_reply(247 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:248 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0860 con 0x7f24dc0f5070 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 48 ==== osd_op_reply(248 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:249 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 49 ==== osd_op_reply(249 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.922+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 50 ==== osd_op_reply(250 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 51 ==== osd_op_reply(251 gc.8 [call] v32'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-08T18:09:31.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:252 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.926+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 88 ==== osd_op_reply(252 gc.9 [call] v32'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:253 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 89 ==== osd_op_reply(253 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:254 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0820 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 90 ==== osd_op_reply(254 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:255 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0820 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 91 ==== osd_op_reply(255 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 92 ==== osd_op_reply(256 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 93 ==== osd_op_reply(257 gc.9 [call] v32'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-08T18:09:31.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.930+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:258 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 52 ==== osd_op_reply(258 gc.10 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:259 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 53 ==== osd_op_reply(259 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:260 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0850 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 54 ==== osd_op_reply(260 gc.10 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:261 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 55 ==== osd_op_reply(261 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 56 ==== osd_op_reply(262 gc.10 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.934+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.938+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 57 ==== osd_op_reply(263 gc.10 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.938+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-08T18:09:31.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.938+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:264 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 53 ==== osd_op_reply(264 gc.11 [call] v32'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:265 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 54 ==== osd_op_reply(265 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:266 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0850 con 0x7f24d803cb80 2024-05-08T18:09:31.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 55 ==== osd_op_reply(266 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:267 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 56 ==== osd_op_reply(267 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.942+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.946+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 57 ==== osd_op_reply(268 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.946+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.946+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.946+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 58 ==== osd_op_reply(269 gc.11 [call] v32'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-08T18:09:31.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:270 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 58 ==== osd_op_reply(270 gc.12 [call] v32'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:271 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 59 ==== osd_op_reply(271 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:272 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0850 con 0x7f24dc0f5070 2024-05-08T18:09:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 60 ==== osd_op_reply(272 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.950+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:273 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 61 ==== osd_op_reply(273 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 62 ==== osd_op_reply(274 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24dc0f5070 2024-05-08T18:09:31.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 63 ==== osd_op_reply(275 gc.12 [call] v32'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-08T18:09:31.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.954+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:276 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 59 ==== osd_op_reply(276 gc.13 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:277 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 60 ==== osd_op_reply(277 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:278 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0850 con 0x7f24d803cb80 2024-05-08T18:09:31.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 61 ==== osd_op_reply(278 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.958+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:279 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.962+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 62 ==== osd_op_reply(279 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.962+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.962+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.962+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 63 ==== osd_op_reply(280 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.962+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.962+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x7f24d803cb80 2024-05-08T18:09:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 64 ==== osd_op_reply(281 gc.13 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-08T18:09:31.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:282 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f2188c20 2024-05-08T18:09:31.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 62 ==== osd_op_reply(282 gc.14 [call] v32'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:283 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f2188c20 2024-05-08T18:09:31.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 63 ==== osd_op_reply(283 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:284 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0850 con 0x55f5f2188c20 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 64 ==== osd_op_reply(284 gc.14 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:285 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f2188c20 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 65 ==== osd_op_reply(285 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.966+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:286 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f2188c20 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 66 ==== osd_op_reply(286 gc.14 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:287 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f2188c20 2024-05-08T18:09:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 67 ==== osd_op_reply(287 gc.14 [call] v32'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e9c49980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-08T18:09:31.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:288 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.970+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 94 ==== osd_op_reply(288 gc.15 [call] v32'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:289 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 95 ==== osd_op_reply(289 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:290 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cf450 con 0x55f5f218ee70 2024-05-08T18:09:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 96 ==== osd_op_reply(290 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:291 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cf450 con 0x55f5f218ee70 2024-05-08T18:09:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 97 ==== osd_op_reply(291 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:09:31.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:292 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21cf450 con 0x55f5f218ee70 2024-05-08T18:09:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 98 ==== osd_op_reply(292 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:09:31.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:293 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0460 con 0x55f5f218ee70 2024-05-08T18:09:31.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.974+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 99 ==== osd_op_reply(293 gc.15 [call] v32'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.978+0000 7f239dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:31.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.978+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94514817103904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21d0850 con 0x55f5f2188c20 2024-05-08T18:09:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.978+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 68 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94514817103904] v32'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.978+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94514817086176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197820 con 0x7f24dc0f5070 2024-05-08T18:09:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94514817086176] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e9c49980 20 remove_watcher() i=0 2024-05-08T18:09:31.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e9c49980 2 removed watcher, disabling cache 2024-05-08T18:09:31.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94514817090176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197820 con 0x55f5f2188c20 2024-05-08T18:09:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 69 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94514817090176] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e9c49980 20 remove_watcher() i=1 2024-05-08T18:09:31.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.982+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94514817091744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2194280 con 0x55f5f218ee70 2024-05-08T18:09:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.986+0000 7f24e6f5c640 1 -- 172.21.15.114:0/2593914806 <== osd.3 v2:172.21.15.114:6808/3988457904 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94514817091744] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24dc0ce020 con 0x55f5f218ee70 2024-05-08T18:09:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.986+0000 7f24e9c49980 20 remove_watcher() i=2 2024-05-08T18:09:31.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.986+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94514817097568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197820 con 0x7f24dc0f5070 2024-05-08T18:09:31.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.990+0000 7f24e7f5e640 1 -- 172.21.15.114:0/2593914806 <== osd.2 v2:172.21.15.114:6810/2279342404 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94514817097568] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e001f070 con 0x7f24dc0f5070 2024-05-08T18:09:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.990+0000 7f24e9c49980 20 remove_watcher() i=3 2024-05-08T18:09:31.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.990+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94514817102336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f21948a0 con 0x55f5f2188c20 2024-05-08T18:09:31.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.990+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.1 v2:172.21.15.114:6800/1559856467 70 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94514817102336] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x55f5f2188c20 2024-05-08T18:09:31.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.990+0000 7f24e9c49980 20 remove_watcher() i=4 2024-05-08T18:09:31.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.990+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94514817096368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2194280 con 0x7f24d803cb80 2024-05-08T18:09:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.994+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 65 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94514817096368] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.994+0000 7f24e9c49980 20 remove_watcher() i=5 2024-05-08T18:09:31.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.994+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94514817105376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197820 con 0x7f24d803cb80 2024-05-08T18:09:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 66 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94514817105376] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 20 remove_watcher() i=6 2024-05-08T18:09:31.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94514817109600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f5f2197200 con 0x7f24d803cb80 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 <== osd.0 v2:172.21.15.53:6800/803213352 67 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94514817109600] v32'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24d802e070 con 0x7f24d803cb80 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 20 remove_watcher() i=7 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f24d803cb80 msgr2=0x7f24d804c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f24d803cb80 0x7f24d804c130 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2188c20 msgr2=0x55f5f218b0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2188c20 0x55f5f218b0e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f24dc0f5070 msgr2=0x7f24dc0caa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f24dc0f5070 0x7f24dc0caa70 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f5f218ee70 msgr2=0x55f5f2191260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f5f218ee70 0x55f5f2191260 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23b00383f0 msgr2=0x7f23b003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23b00383f0 0x7f23b003a8b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55f5f2157520 tx=0x7f24e001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e775d640 1 -- 172.21.15.114:0/2593914806 reap_dead start 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 msgr2=0x55f5f217d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:31.998+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f217d920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0b37e0 tx=0x7f24dc0ea370 comp rx=0 tx=0).stop 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 shutdown_connections 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2593914806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f205d0e0 0x55f5f217d920 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 >> 172.21.15.114:0/2593914806 conn(0x55f5f2170550 msgr2=0x55f5f216dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 shutdown_connections 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2593914806 wait complete. 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23c0038440 msgr2=0x7f23c003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23c0038440 0x7f23c003a900 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55f5f2157da0 tx=0x7f24e0005850 comp rx=0 tx=0).stop 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 msgr2=0x55f5f2167570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 0x55f5f2167570 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0ac040 tx=0x7f24dc0180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 shutdown_connections 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23c0038440 0x7f23c003a900 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/2157001456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f2167150 0x55f5f2167570 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 >> 172.21.15.114:0/2157001456 conn(0x55f5f215bf60 msgr2=0x55f5f215ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 shutdown_connections 2024-05-08T18:09:32.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/2157001456 wait complete. 2024-05-08T18:09:32.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2061270 msgr2=0x55f5f2156350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2061270 0x55f5f2156350 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23cc0383f0 msgr2=0x7f23cc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23cc0383f0 0x7f23cc03a8b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0ae000 tx=0x7f24dc0a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 msgr2=0x55f5f214f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f214f3d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f24d800b6b0 tx=0x7f24d8000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 shutdown_connections 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f5f2061270 0x55f5f2156350 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f23cc0383f0 0x7f23cc03a8b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 --2- 172.21.15.114:0/657694139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5f1fd0f40 0x55f5f214f3d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 >> 172.21.15.114:0/657694139 conn(0x55f5f2057630 msgr2=0x55f5f21425b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 shutdown_connections 2024-05-08T18:09:32.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.002+0000 7f24e9c49980 1 -- 172.21.15.114:0/657694139 wait complete. 2024-05-08T18:09:32.021 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T18:09:32.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T18:09:32.022 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T18:09:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:32.098 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec80a1980 1 Processor -- start 2024-05-08T18:09:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec80a1980 1 -- start start 2024-05-08T18:09:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec80a1980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5612d743b820 0x5612d74c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec80a1980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612d7372710 con 0x5612d74ca0b0 2024-05-08T18:09:32.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec80a1980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5612d7386f00 con 0x5612d743b820 2024-05-08T18:09:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec5bb5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5612d743b820 0x5612d74c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec53b4640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5612d74ca0b0 0x5612d74cc4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55268/0 (socket says 172.21.15.114:55268) 2024-05-08T18:09:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec5bb5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5612d743b820 0x5612d74c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44674/0 (socket says 172.21.15.114:44674) 2024-05-08T18:09:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec53b4640 1 -- 172.21.15.114:0/247562707 learned_addr learned my addr 172.21.15.114:0/247562707 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec5bb5640 1 -- 172.21.15.114:0/247562707 >> v1:172.21.15.53:6789/0 conn(0x5612d74ca0b0 legacy=0x5612d74cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.098+0000 7efec5bb5640 1 -- 172.21.15.114:0/247562707 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d734eae0 con 0x5612d743b820 2024-05-08T18:09:32.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec5bb5640 1 --2- 172.21.15.114:0/247562707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d74c9b70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efeb800a480 tx=0x7efeb801b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a677e48ff8a07992 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec4bb3640 1 -- 172.21.15.114:0/247562707 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb80af070 con 0x5612d743b820 2024-05-08T18:09:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec4bb3640 1 -- 172.21.15.114:0/247562707 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb80a3e50 con 0x5612d743b820 2024-05-08T18:09:32.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec4bb3640 1 -- 172.21.15.114:0/247562707 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb80aa680 con 0x5612d743b820 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 -- 172.21.15.114:0/247562707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 msgr2=0x5612d74c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 --2- 172.21.15.114:0/247562707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d74c9b70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efeb800a480 tx=0x7efeb801b110 comp rx=0 tx=0).stop 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 -- 172.21.15.114:0/247562707 shutdown_connections 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 --2- 172.21.15.114:0/247562707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d74c9b70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 -- 172.21.15.114:0/247562707 >> 172.21.15.114:0/247562707 conn(0x5612d74c1690 msgr2=0x5612d74c3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 -- 172.21.15.114:0/247562707 shutdown_connections 2024-05-08T18:09:32.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.102+0000 7efec80a1980 1 -- 172.21.15.114:0/247562707 wait complete. 2024-05-08T18:09:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.118+0000 7efec80a1980 1 Processor -- start 2024-05-08T18:09:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.118+0000 7efec80a1980 1 -- start start 2024-05-08T18:09:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.118+0000 7efec80a1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.118+0000 7efec80a1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612d73caf80 con 0x5612d743b820 2024-05-08T18:09:32.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.118+0000 7efec5bb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44684/0 (socket says 172.21.15.114:44684) 2024-05-08T18:09:32.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 -- 172.21.15.114:0/1502729924 learned_addr learned my addr 172.21.15.114:0/1502729924 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 -- 172.21.15.114:0/1502729924 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d7392da0 con 0x5612d743b820 2024-05-08T18:09:32.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 --2- 172.21.15.114:0/1502729924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b2010 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efeb80ad040 tx=0x7efeb8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963bbfc300689d03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efdb3e07640 1 -- 172.21.15.114:0/1502729924 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb80af040 con 0x5612d743b820 2024-05-08T18:09:32.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efdb3e07640 1 -- 172.21.15.114:0/1502729924 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb80aa870 con 0x5612d743b820 2024-05-08T18:09:32.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efdb3e07640 1 -- 172.21.15.114:0/1502729924 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb80aab90 con 0x5612d743b820 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- 172.21.15.114:0/1502729924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 msgr2=0x5612d75b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 --2- 172.21.15.114:0/1502729924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b2010 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efeb80ad040 tx=0x7efeb8003030 comp rx=0 tx=0).stop 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- 172.21.15.114:0/1502729924 shutdown_connections 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 --2- 172.21.15.114:0/1502729924 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b2010 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- 172.21.15.114:0/1502729924 >> 172.21.15.114:0/1502729924 conn(0x5612d74c1690 msgr2=0x5612d75adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- 172.21.15.114:0/1502729924 shutdown_connections 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- 172.21.15.114:0/1502729924 wait complete. 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 Processor -- start 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- start start 2024-05-08T18:09:32.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec80a1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612d74ce6d0 con 0x5612d743b820 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44692/0 (socket says 172.21.15.114:44692) 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 -- 172.21.15.114:0/1900366586 learned_addr learned my addr 172.21.15.114:0/1900366586 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.122+0000 7efec5bb5640 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d75b97e0 con 0x5612d743b820 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec5bb5640 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b92a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efeb8018d40 tx=0x7efeb8017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efdb2604640 1 -- 172.21.15.114:0/1900366586 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb80c2070 con 0x5612d743b820 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efdb2604640 1 -- 172.21.15.114:0/1900366586 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb80b5ae0 con 0x5612d743b820 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612d75b9a70 con 0x5612d743b820 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efdb2604640 1 -- 172.21.15.114:0/1900366586 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efeb80af070 con 0x5612d743b820 2024-05-08T18:09:32.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d75bc700 con 0x5612d743b820 2024-05-08T18:09:32.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efdb2604640 1 -- 172.21.15.114:0/1900366586 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efeb80c5070 con 0x5612d743b820 2024-05-08T18:09:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efdb2604640 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efdac038440 0x7efdac03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efdb2604640 1 -- 172.21.15.114:0/1900366586 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7efeb80ba070 con 0x5612d743b820 2024-05-08T18:09:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec53b4640 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efdac038440 0x7efdac03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d74ca0b0 0x5612d75c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75c0830 con 0x5612d74ca0b0 2024-05-08T18:09:32.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec63b6640 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d74ca0b0 0x5612d75c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec53b4640 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efdac038440 0x7efdac03a900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efebc00b3c0 tx=0x7efebc001570 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec63b6640 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d74ca0b0 0x5612d75c01e0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec63b6640 1 -- 172.21.15.114:0/1900366586 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efec000a4d0 con 0x5612d74ca0b0 2024-05-08T18:09:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75bd900 con 0x5612d74ca0b0 2024-05-08T18:09:32.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec63b6640 1 -- 172.21.15.114:0/1900366586 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efec000a4d0 con 0x5612d74ca0b0 2024-05-08T18:09:32.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.126+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75c2660 con 0x5612d74ca0b0 2024-05-08T18:09:32.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec63b6640 1 -- 172.21.15.114:0/1900366586 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efec000a4d0 con 0x5612d74ca0b0 2024-05-08T18:09:32.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75c17d0 con 0x5612d74ca0b0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec63b6640 1 -- 172.21.15.114:0/1900366586 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efec000a4d0 con 0x5612d74ca0b0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75c1bf0 con 0x5612d74ca0b0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec63b6640 1 -- 172.21.15.114:0/1900366586 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efec000a4d0 con 0x5612d74ca0b0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 Processor -- start 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 -- start start 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 0x5612d75d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612d73cefc0 con 0x5612d75d0fb0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec53b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 0x5612d75d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec53b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 0x5612d75d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44702/0 (socket says 172.21.15.114:44702) 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec53b4640 1 -- 172.21.15.114:0/2130292355 learned_addr learned my addr 172.21.15.114:0/2130292355 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec53b4640 1 -- 172.21.15.114:0/2130292355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d75d1910 con 0x5612d75d0fb0 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec53b4640 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 0x5612d75d13d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efebc00ffd0 tx=0x7efebc00e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efdab7fe640 1 -- 172.21.15.114:0/2130292355 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc022070 con 0x5612d75d0fb0 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612d75d23b0 con 0x5612d75d0fb0 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efdab7fe640 1 -- 172.21.15.114:0/2130292355 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc01b4b0 con 0x5612d75d0fb0 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efdab7fe640 1 -- 172.21.15.114:0/2130292355 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc01b790 con 0x5612d75d0fb0 2024-05-08T18:09:32.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.130+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d75d2880 con 0x5612d75d0fb0 2024-05-08T18:09:32.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efdab7fe640 1 -- 172.21.15.114:0/2130292355 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efebc025070 con 0x5612d75d0fb0 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efdab7fe640 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efda00383f0 0x7efda003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efdab7fe640 1 -- 172.21.15.114:0/2130292355 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7efebc04ff80 con 0x5612d75d0fb0 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec63b6640 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efda00383f0 0x7efda003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec80a1980 1 Processor -- start 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec80a1980 1 -- start start 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec63b6640 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efda00383f0 0x7efda003a8b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5612d75c1b70 tx=0x7efec0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec80a1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d74c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec80a1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612d75b26a0 con 0x5612d74c70d0 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec53b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d74c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec53b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d74c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44712/0 (socket says 172.21.15.114:44712) 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec53b4640 1 -- 172.21.15.114:0/4204198658 learned_addr learned my addr 172.21.15.114:0/4204198658 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec53b4640 1 -- 172.21.15.114:0/4204198658 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d74c5950 con 0x5612d74c70d0 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efec53b4640 1 --2- 172.21.15.114:0/4204198658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d74c74f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efebc001da0 tx=0x7efebc04e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de9442763504707 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.134+0000 7efda97fa640 1 -- 172.21.15.114:0/4204198658 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc0263b0 con 0x5612d74c70d0 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efda97fa640 1 -- 172.21.15.114:0/4204198658 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc026550 con 0x5612d74c70d0 2024-05-08T18:09:32.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efda97fa640 1 -- 172.21.15.114:0/4204198658 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc03e050 con 0x5612d74c70d0 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/4204198658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 msgr2=0x5612d74c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 --2- 172.21.15.114:0/4204198658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d74c74f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efebc001da0 tx=0x7efebc04e4d0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/4204198658 shutdown_connections 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 --2- 172.21.15.114:0/4204198658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d74c74f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/4204198658 >> 172.21.15.114:0/4204198658 conn(0x5612d75da540 msgr2=0x5612d75d85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/4204198658 shutdown_connections 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/4204198658 wait complete. 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 Processor -- start 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- start start 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d75e7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5612d74c5dc0 con 0x5612d74c70d0 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec53b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d75e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec53b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d75e7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44728/0 (socket says 172.21.15.114:44728) 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 learned_addr learned my addr 172.21.15.114:0/608168116 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612d75e7e90 con 0x5612d74c70d0 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec53b4640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d75e7950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efebc00eab0 tx=0x7efebc026f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efd977fe640 1 -- 172.21.15.114:0/608168116 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc0263b0 con 0x5612d74c70d0 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612d75e7e90 con 0x5612d74c70d0 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612d75e7e90 con 0x5612d74c70d0 2024-05-08T18:09:32.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efd977fe640 1 -- 172.21.15.114:0/608168116 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efebc025d40 con 0x5612d74c70d0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efd977fe640 1 -- 172.21.15.114:0/608168116 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efebc024a80 con 0x5612d74c70d0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.138+0000 7efd977fe640 1 -- 172.21.15.114:0/608168116 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7efebc03e7b0 con 0x5612d74c70d0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efd977fe640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd900383f0 0x7efd9003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efd977fe640 1 -- 172.21.15.114:0/608168116 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7efebc03bbc0 con 0x5612d74c70d0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec63b6640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd900383f0 0x7efd9003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d75f2a30 0x5612d75f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f5640 con 0x5612d75f2a30 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d75f2a30 0x5612d75f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec63b6640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd900383f0 0x7efd9003a8b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5612d75c12f0 tx=0x7efec001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d75f2a30 0x5612d75f4ef0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 realm 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f5a50 con 0x5612d75f2a30 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f62f0 con 0x5612d75f2a30 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f6690 con 0x5612d75f2a30 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f6ee0 con 0x5612d75f2a30 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 20 searching for the correct realm 2024-05-08T18:09:32.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5612d75f8c50 0x5612d75fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec53b4640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5612d75f8c50 0x5612d75fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec53b4640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5612d75f8c50 0x5612d75fb040 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec53b4640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efebc01ac00 0x7efebc01c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.142+0000 7efec63b6640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efebc01ac00 0x7efebc01c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efebc01ac00 0x7efebc01c420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efeb80c7070 0x7efeb80e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efeb80c7070 0x7efeb80e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efeb80c7070 0x7efeb80e61d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x7efeb80c7070 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x7efeb80c7070 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.146+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x7efeb80c7070 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.150+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80c4030 con 0x7efeb80c7070 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efeb80c4030 con 0x5612d75f2a30 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f8c50 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.154+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efeb80c7070 2024-05-08T18:09:32.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x5612d75f2a30 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb580 con 0x7efebc01ac00 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:32.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f7860 con 0x5612d75f2a30 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f74a0 con 0x5612d75f2a30 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75f74b0 con 0x5612d75f2a30 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:32.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 zone default found 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 4 Realm: () 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 zonegroup default 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fb9e0 con 0x7efeb80c7070 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fd870 con 0x5612d75f8c50 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fdc10 con 0x5612d75f8c50 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 started sync module instance, tier type = 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.158+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fccb0 con 0x7efebc01ac00 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638922778624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fdfb0 con 0x7efebc01ac00 2024-05-08T18:09:32.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe970 con 0x5612d75f2a30 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638922778624] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638922780880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe970 con 0x5612d75f2a30 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.162+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75ff330 con 0x5612d75f8c50 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638922780880] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638922785984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe8e0 con 0x5612d75f8c50 2024-05-08T18:09:32.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7600070 con 0x7efebc01ac00 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638922791808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7600910 con 0x7efebc01ac00 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.166+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7601350 con 0x5612d75f2a30 2024-05-08T18:09:32.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638922785984] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638922791808] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638922796576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7600460 con 0x5612d75f2a30 2024-05-08T18:09:32.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7601bf0 con 0x7efeb80c7070 2024-05-08T18:09:32.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638922796576] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638922790608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7600460 con 0x7efeb80c7070 2024-05-08T18:09:32.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.170+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d76020d0 con 0x7efeb80c7070 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638922800096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d76024b0 con 0x7efeb80c7070 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7602f80 con 0x7efeb80c7070 2024-05-08T18:09:32.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638922790608] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638922803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7602f40 con 0x7efeb80c7070 2024-05-08T18:09:32.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 20 add_watcher() i=0 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 20 add_watcher() i=1 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 20 add_watcher() i=2 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 20 add_watcher() i=3 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 20 add_watcher() i=4 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.174+0000 7efec80a1980 20 add_watcher() i=5 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638922800096] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 20 add_watcher() i=6 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638922803824] v32'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 20 add_watcher() i=7 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d7602000 con 0x5612d75f2a30 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638922801152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d76033a0 con 0x5612d75f2a30 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638922801152] v32'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efd777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:32.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.178+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760e7a0 con 0x5612d75f2a30 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.182+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.182+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760ed80 con 0x7efeb80c7070 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.182+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.182+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760ed80 con 0x5612d75f8c50 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.186+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.186+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760f5d0 con 0x5612d75f2a30 2024-05-08T18:09:32.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.186+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.186+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760f5d0 con 0x7efebc01ac00 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.186+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'59 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.186+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760a600 con 0x5612d75f8c50 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.190+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.190+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610130 con 0x5612d75f2a30 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.190+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.190+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610130 con 0x7efeb80c7070 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.194+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.194+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610130 con 0x7efebc01ac00 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.194+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.198+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d76105e0 con 0x5612d75f8c50 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.198+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.198+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610980 con 0x7efebc01ac00 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.198+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'60 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.198+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efeb80c7070 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.202+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.202+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efebc01ac00 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.202+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.202+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efeb80c7070 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.206+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.206+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f2a30 2024-05-08T18:09:32.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.206+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.206+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.210+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.210+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efebc01ac00 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.210+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.213 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.210+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.214+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.214+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f2a30 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.214+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.214+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f2a30 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.218+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.218+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.218+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.218+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efebc01ac00 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.222+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.222+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.222+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.222+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.222+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.226+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.226+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.226+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.226+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.226+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efeb80c7070 2024-05-08T18:09:32.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.230+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.230+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.230+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.230+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efeb80c7070 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.234+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.236 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.234+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x5612d75f8c50 2024-05-08T18:09:32.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.238+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.238+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efeb80c7070 2024-05-08T18:09:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.238+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.241 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.238+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d7610e30 con 0x7efebc01ac00 2024-05-08T18:09:32.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efd767fc640 20 reqs_thread_entry: start 2024-05-08T18:09:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec80a1980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec80a1980 20 Filter name: none 2024-05-08T18:09:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efce7fff640 20 reqs_thread_entry: start 2024-05-08T18:09:32.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.242+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x7efeb80c7070 2024-05-08T18:09:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.246+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.246+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x7efeb80c7070 2024-05-08T18:09:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.246+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.246+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x7efeb80c7070 2024-05-08T18:09:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.246+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.246+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x5612d75f8c50 2024-05-08T18:09:32.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x5612d75f8c50 2024-05-08T18:09:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x5612d75f8c50 2024-05-08T18:09:32.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x5612d75f2a30 2024-05-08T18:09:32.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv164 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x5612d75f2a30 2024-05-08T18:09:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv164 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv56 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv56 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d400 con 0x5612d75f8c50 2024-05-08T18:09:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.250+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv24 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv24 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.254+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.258+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.262+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.268 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.266+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 40 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.270+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 41 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 42 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 43 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 44 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 45 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 46 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.274+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.278+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.282+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.286+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.290+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efeb80c7070 2024-05-08T18:09:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.294+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efd777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:32.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638922801152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94638922801152] v32'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.298+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638922778624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x7efebc01ac00 2024-05-08T18:09:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94638922778624] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec80a1980 20 remove_watcher() i=0 2024-05-08T18:09:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec80a1980 2 removed watcher, disabling cache 2024-05-08T18:09:32.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638922780880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f2a30 2024-05-08T18:09:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94638922780880] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec80a1980 20 remove_watcher() i=1 2024-05-08T18:09:32.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.302+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638922785984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d760d8b0 con 0x5612d75f8c50 2024-05-08T18:09:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.306+0000 7efec53b4640 1 -- 172.21.15.114:0/608168116 <== osd.3 v2:172.21.15.114:6808/3988457904 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94638922785984] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efebc024030 con 0x5612d75f8c50 2024-05-08T18:09:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.306+0000 7efec80a1980 20 remove_watcher() i=2 2024-05-08T18:09:32.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.306+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638922791808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe4c0 con 0x7efebc01ac00 2024-05-08T18:09:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.306+0000 7efec63b6640 1 -- 172.21.15.114:0/608168116 <== osd.2 v2:172.21.15.114:6810/2279342404 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94638922791808] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efec001f070 con 0x7efebc01ac00 2024-05-08T18:09:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.306+0000 7efec80a1980 20 remove_watcher() i=3 2024-05-08T18:09:32.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.306+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638922796576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe4c0 con 0x5612d75f2a30 2024-05-08T18:09:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.310+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.1 v2:172.21.15.114:6800/1559856467 49 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94638922796576] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x5612d75f2a30 2024-05-08T18:09:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.310+0000 7efec80a1980 20 remove_watcher() i=4 2024-05-08T18:09:32.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.310+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638922790608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe4c0 con 0x7efeb80c7070 2024-05-08T18:09:32.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.314+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94638922790608] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.314+0000 7efec80a1980 20 remove_watcher() i=5 2024-05-08T18:09:32.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.314+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638922800096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75ff6d0 con 0x7efeb80c7070 2024-05-08T18:09:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.314+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94638922800096] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.314+0000 7efec80a1980 20 remove_watcher() i=6 2024-05-08T18:09:32.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.314+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638922803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5612d75fe4c0 con 0x7efeb80c7070 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94638922803824] v32'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efeb80f9040 con 0x7efeb80c7070 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 20 remove_watcher() i=7 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efeb80c7070 msgr2=0x7efeb80e61d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7efeb80c7070 0x7efeb80e61d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d75f2a30 msgr2=0x5612d75f4ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d75f2a30 0x5612d75f4ef0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efebc01ac00 msgr2=0x7efebc01c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7efebc01ac00 0x7efebc01c420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5612d75f8c50 msgr2=0x5612d75fb040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5612d75f8c50 0x5612d75fb040 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd900383f0 msgr2=0x7efd9003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efd900383f0 0x7efd9003a8b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5612d75c12f0 tx=0x7efec001f000 comp rx=0 tx=0).stop 2024-05-08T18:09:32.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 msgr2=0x5612d75e7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/608168116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d74c70d0 0x5612d75e7950 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efebc00eab0 tx=0x7efebc026f10 comp rx=0 tx=0).stop 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 reap_dead start 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec5bb5640 1 -- 172.21.15.114:0/608168116 reap_dead start 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 shutdown_connections 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 >> 172.21.15.114:0/608168116 conn(0x5612d75da540 msgr2=0x5612d75d7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 shutdown_connections 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/608168116 wait complete. 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efda00383f0 msgr2=0x7efda003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efda00383f0 0x7efda003a8b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x5612d75c1b70 tx=0x7efec0005850 comp rx=0 tx=0).stop 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 msgr2=0x5612d75d13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 0x5612d75d13d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7efebc00ffd0 tx=0x7efebc00e620 comp rx=0 tx=0).stop 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 shutdown_connections 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efda00383f0 0x7efda003a8b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/2130292355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d75d0fb0 0x5612d75d13d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 >> 172.21.15.114:0/2130292355 conn(0x5612d75c5dc0 msgr2=0x5612d75c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 shutdown_connections 2024-05-08T18:09:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/2130292355 wait complete. 2024-05-08T18:09:32.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d74ca0b0 msgr2=0x5612d75c01e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d74ca0b0 0x5612d75c01e0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efdac038440 msgr2=0x7efdac03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efdac038440 0x7efdac03a900 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efebc00b3c0 tx=0x7efebc001570 comp rx=0 tx=0).stop 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.318+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 msgr2=0x5612d75b92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b92a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efeb8018d40 tx=0x7efeb8017eb0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 shutdown_connections 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5612d74ca0b0 0x5612d75c01e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7efdac038440 0x7efdac03a900 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 --2- 172.21.15.114:0/1900366586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612d743b820 0x5612d75b92a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 >> 172.21.15.114:0/1900366586 conn(0x5612d74c1690 msgr2=0x5612d75ac6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 shutdown_connections 2024-05-08T18:09:32.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.322+0000 7efec80a1980 1 -- 172.21.15.114:0/1900366586 wait complete. 2024-05-08T18:09:32.337 INFO:teuthology.orchestra.run.smithi114.stdout:[] 2024-05-08T18:09:32.337 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T18:09:32.338 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:09:32.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:09:32.338 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:09:32.416 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:32.416 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3d5e6980 1 Processor -- start 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3d5e6980 1 -- start start 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3d5e6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e0aa75c5b0 0x55e0aa75e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3d5e6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0aa601710 con 0x55e0aa7580f0 2024-05-08T18:09:32.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3d5e6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55e0aa615f00 con 0x55e0aa75c5b0 2024-05-08T18:09:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3a8f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e0aa75c5b0 0x55e0aa75e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3b0fa640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55e0aa7580f0 0x55e0aa7584d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55270/0 (socket says 172.21.15.114:55270) 2024-05-08T18:09:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3a8f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55e0aa75c5b0 0x55e0aa75e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44744/0 (socket says 172.21.15.114:44744) 2024-05-08T18:09:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3b0fa640 1 -- 172.21.15.114:0/2588122006 learned_addr learned my addr 172.21.15.114:0/2588122006 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3a8f9640 1 -- 172.21.15.114:0/2588122006 >> v1:172.21.15.53:6789/0 conn(0x55e0aa7580f0 legacy=0x55e0aa7584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.414+0000 7fad3a8f9640 1 -- 172.21.15.114:0/2588122006 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aa5ddae0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/2588122006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa75c5b0 0x55e0aa75e9a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fad3000a480 tx=0x7fad3001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8138894d489c6759 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3a0f8640 1 -- 172.21.15.114:0/2588122006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b0070 con 0x55e0aa75c5b0 2024-05-08T18:09:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3a0f8640 1 -- 172.21.15.114:0/2588122006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300ab540 con 0x55e0aa75c5b0 2024-05-08T18:09:32.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3a0f8640 1 -- 172.21.15.114:0/2588122006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300ab840 con 0x55e0aa75c5b0 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2588122006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa75c5b0 msgr2=0x55e0aa75e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2588122006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa75c5b0 0x55e0aa75e9a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fad3000a480 tx=0x7fad3001b280 comp rx=0 tx=0).stop 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2588122006 shutdown_connections 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2588122006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa75c5b0 0x55e0aa75e9a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2588122006 >> 172.21.15.114:0/2588122006 conn(0x55e0aa6cb7d0 msgr2=0x55e0aa6cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2588122006 shutdown_connections 2024-05-08T18:09:32.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.418+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2588122006 wait complete. 2024-05-08T18:09:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3d5e6980 1 Processor -- start 2024-05-08T18:09:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3d5e6980 1 -- start start 2024-05-08T18:09:32.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3d5e6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa843160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3d5e6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0aa659f80 con 0x55e0aa7580f0 2024-05-08T18:09:32.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3b0fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa843160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3b0fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa843160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44746/0 (socket says 172.21.15.114:44746) 2024-05-08T18:09:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.434+0000 7fad3b0fa640 1 -- 172.21.15.114:0/758054693 learned_addr learned my addr 172.21.15.114:0/758054693 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 -- 172.21.15.114:0/758054693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aa621da0 con 0x55e0aa7580f0 2024-05-08T18:09:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/758054693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa843160 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fad2c001e00 tx=0x7fad2c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1382114db2744036 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fac2960a640 1 -- 172.21.15.114:0/758054693 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c012020 con 0x55e0aa7580f0 2024-05-08T18:09:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fac2960a640 1 -- 172.21.15.114:0/758054693 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c00e690 con 0x55e0aa7580f0 2024-05-08T18:09:32.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fac2960a640 1 -- 172.21.15.114:0/758054693 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c00ea10 con 0x55e0aa7580f0 2024-05-08T18:09:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- 172.21.15.114:0/758054693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 msgr2=0x55e0aa843160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/758054693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa843160 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fad2c001e00 tx=0x7fad2c00b6d0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- 172.21.15.114:0/758054693 shutdown_connections 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/758054693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa843160 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- 172.21.15.114:0/758054693 >> 172.21.15.114:0/758054693 conn(0x55e0aa6cb7d0 msgr2=0x55e0aa83ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- 172.21.15.114:0/758054693 shutdown_connections 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- 172.21.15.114:0/758054693 wait complete. 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 Processor -- start 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- start start 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa84a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0aa7619d0 con 0x55e0aa7580f0 2024-05-08T18:09:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa84a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa84a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44754/0 (socket says 172.21.15.114:44754) 2024-05-08T18:09:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 -- 172.21.15.114:0/2221596232 learned_addr learned my addr 172.21.15.114:0/2221596232 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aa84ab70 con 0x55e0aa7580f0 2024-05-08T18:09:32.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa84a630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55e0aa843ff0 tx=0x7fad2c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fac27e07640 1 -- 172.21.15.114:0/2221596232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c012030 con 0x55e0aa7580f0 2024-05-08T18:09:32.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.438+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0aa84ae00 con 0x55e0aa7580f0 2024-05-08T18:09:32.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fac27e07640 1 -- 172.21.15.114:0/2221596232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2c01a750 con 0x55e0aa7580f0 2024-05-08T18:09:32.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aa84da40 con 0x55e0aa7580f0 2024-05-08T18:09:32.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fac27e07640 1 -- 172.21.15.114:0/2221596232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad2c01aa30 con 0x55e0aa7580f0 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fac27e07640 1 -- 172.21.15.114:0/2221596232 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fad2c015020 con 0x55e0aa7580f0 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fac27e07640 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac20038440 0x7fac2003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fac27e07640 1 -- 172.21.15.114:0/2221596232 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fad2c020030 con 0x55e0aa7580f0 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac20038440 0x7fac2003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa75c5b0 0x55e0aa851520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa851b70 con 0x55e0aa75c5b0 2024-05-08T18:09:32.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa75c5b0 0x55e0aa851520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac20038440 0x7fac2003a900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fad300ad000 tx=0x7fad300a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa75c5b0 0x55e0aa851520 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3b8fb640 1 -- 172.21.15.114:0/2221596232 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad3400a4d0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa84ec60 con 0x55e0aa75c5b0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3b8fb640 1 -- 172.21.15.114:0/2221596232 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad3400a4d0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8539c0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3b8fb640 1 -- 172.21.15.114:0/2221596232 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fad3400a4d0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa852bf0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3b8fb640 1 -- 172.21.15.114:0/2221596232 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad3400a4d0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.442+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa853010 con 0x55e0aa75c5b0 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3b8fb640 1 -- 172.21.15.114:0/2221596232 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fad3400a4d0 con 0x55e0aa75c5b0 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3d5e6980 1 Processor -- start 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3d5e6980 1 -- start start 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3d5e6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 0x55e0aa862760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3d5e6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0aa65dfc0 con 0x55e0aa862340 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3a8f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 0x55e0aa862760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3a8f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 0x55e0aa862760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44766/0 (socket says 172.21.15.114:44766) 2024-05-08T18:09:32.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3a8f9640 1 -- 172.21.15.114:0/716297380 learned_addr learned my addr 172.21.15.114:0/716297380 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3a8f9640 1 -- 172.21.15.114:0/716297380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aa862ca0 con 0x55e0aa862340 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 0x55e0aa862760 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fad300ae040 tx=0x7fad30018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fac25602640 1 -- 172.21.15.114:0/716297380 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300c6070 con 0x55e0aa862340 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0aa863740 con 0x55e0aa862340 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fac25602640 1 -- 172.21.15.114:0/716297380 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300b7740 con 0x55e0aa862340 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fac25602640 1 -- 172.21.15.114:0/716297380 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b0040 con 0x55e0aa862340 2024-05-08T18:09:32.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aa863bb0 con 0x55e0aa862340 2024-05-08T18:09:32.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.446+0000 7fac25602640 1 -- 172.21.15.114:0/716297380 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fad300c9070 con 0x55e0aa862340 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fac25602640 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac140383f0 0x7fac1403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fac25602640 1 -- 172.21.15.114:0/716297380 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fad300be030 con 0x55e0aa862340 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac140383f0 0x7fac1403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 Processor -- start 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- start start 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac140383f0 0x7fac1403a8b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55e0aa852f90 tx=0x7fad34005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa86f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0aa8438b0 con 0x55e0aa86f410 2024-05-08T18:09:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3a8f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa86f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3a8f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa86f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44770/0 (socket says 172.21.15.114:44770) 2024-05-08T18:09:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3a8f9640 1 -- 172.21.15.114:0/51289738 learned_addr learned my addr 172.21.15.114:0/51289738 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3a8f9640 1 -- 172.21.15.114:0/51289738 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aa86fe00 con 0x55e0aa86f410 2024-05-08T18:09:32.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/51289738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa86f830 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fad300b6fd0 tx=0x7fad30006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73208842ed55ef8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fac1effd640 1 -- 172.21.15.114:0/51289738 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300dd070 con 0x55e0aa86f410 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fac1effd640 1 -- 172.21.15.114:0/51289738 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300aac80 con 0x55e0aa86f410 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fac1effd640 1 -- 172.21.15.114:0/51289738 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300c9c60 con 0x55e0aa86f410 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- 172.21.15.114:0/51289738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 msgr2=0x55e0aa86f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/51289738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa86f830 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fad300b6fd0 tx=0x7fad30006ae0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- 172.21.15.114:0/51289738 shutdown_connections 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/51289738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa86f830 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- 172.21.15.114:0/51289738 >> 172.21.15.114:0/51289738 conn(0x55e0aa86b7a0 msgr2=0x55e0aa869800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- 172.21.15.114:0/51289738 shutdown_connections 2024-05-08T18:09:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- 172.21.15.114:0/51289738 wait complete. 2024-05-08T18:09:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 Processor -- start 2024-05-08T18:09:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- start start 2024-05-08T18:09:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa876980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.450+0000 7fad3d5e6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55e0aa870550 con 0x55e0aa86f410 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3a8f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa876980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3a8f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa876980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44786/0 (socket says 172.21.15.114:44786) 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 learned_addr learned my addr 172.21.15.114:0/919798017 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0aa876ec0 con 0x55e0aa86f410 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa876980 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fad300b6fd0 tx=0x7fad300e9140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fac1d7fa640 1 -- 172.21.15.114:0/919798017 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300dd040 con 0x55e0aa86f410 2024-05-08T18:09:32.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fac1d7fa640 1 -- 172.21.15.114:0/919798017 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad300b7b50 con 0x55e0aa86f410 2024-05-08T18:09:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fac1d7fa640 1 -- 172.21.15.114:0/919798017 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad300b7e30 con 0x55e0aa86f410 2024-05-08T18:09:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0aa877150 con 0x55e0aa86f410 2024-05-08T18:09:32.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0aa879e30 con 0x55e0aa86f410 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fac1d7fa640 1 -- 172.21.15.114:0/919798017 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fad30007d00 con 0x55e0aa86f410 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fac1d7fa640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac040383a0 0x7fac0403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fac1d7fa640 1 -- 172.21.15.114:0/919798017 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fad300a8070 con 0x55e0aa86f410 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac040383a0 0x7fac0403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa881e50 0x55e0aa8842e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa884a30 con 0x55e0aa881e50 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa881e50 0x55e0aa8842e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac040383a0 0x7fac0403a860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55e0aa852710 tx=0x7fad3401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.454+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa881e50 0x55e0aa8842e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 realm 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa884e40 con 0x55e0aa881e50 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa885710 con 0x55e0aa881e50 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa885ab0 con 0x55e0aa881e50 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:32.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa886300 con 0x55e0aa881e50 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 20 searching for the correct realm 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e0aa888070 0x55e0aa88a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e0aa888070 0x55e0aa88a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e0aa888070 0x55e0aa88a460 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3a8f9640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fad300cb060 0x7fad300cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fad300cb060 0x7fad300cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b8fb640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fad300cb060 0x7fad300cba70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fad2c04e040 0x7fad2c045e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.458+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fad2c04e040 0x7fad2c045e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fad2c04e040 0x7fad2c045e70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x7fad2c04e040 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x7fad2c04e040 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x55e0aa881e50 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.462+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c008030 con 0x7fad2c04e040 2024-05-08T18:09:32.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c04ed70 con 0x55e0aa881e50 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fad2c04ed70 con 0x55e0aa881e50 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c04ed70 con 0x7fad2c04e040 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.466+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa888070 2024-05-08T18:09:32.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad2c04e040 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x55e0aa881e50 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.470+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88a9a0 con 0x7fad300cb060 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa886be0 con 0x55e0aa881e50 2024-05-08T18:09:32.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa887430 con 0x55e0aa881e50 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa887430 con 0x55e0aa881e50 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 zone default found 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 4 Realm: () 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:32.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 zonegroup default 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88add0 con 0x7fad2c04e040 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88c810 con 0x55e0aa888070 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88cd00 con 0x55e0aa888070 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 started sync module instance, tier type = 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.474+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88bc50 con 0x7fad300cb060 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94423422124096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88b8b0 con 0x7fad300cb060 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88db20 con 0x55e0aa881e50 2024-05-08T18:09:32.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94423422124096] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94423422128480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88dae0 con 0x55e0aa881e50 2024-05-08T18:09:32.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.478+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88e530 con 0x55e0aa888070 2024-05-08T18:09:32.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94423422128480] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94423422132352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88e920 con 0x55e0aa888070 2024-05-08T18:09:32.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88f2e0 con 0x7fad300cb060 2024-05-08T18:09:32.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94423422136128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88f9d0 con 0x7fad300cb060 2024-05-08T18:09:32.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8904f0 con 0x55e0aa881e50 2024-05-08T18:09:32.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94423422132352] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.482+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94423422136128] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94423422140352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8904b0 con 0x55e0aa881e50 2024-05-08T18:09:32.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa890d90 con 0x7fad2c04e040 2024-05-08T18:09:32.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94423422140352] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94423422129536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa890960 con 0x7fad2c04e040 2024-05-08T18:09:32.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.486+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa891320 con 0x7fad2c04e040 2024-05-08T18:09:32.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94423422144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa891740 con 0x7fad2c04e040 2024-05-08T18:09:32.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa892220 con 0x7fad2c04e040 2024-05-08T18:09:32.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94423422129536] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94423422144112] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94423422147888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa891290 con 0x7fad2c04e040 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=0 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=1 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=2 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=3 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=4 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=5 2024-05-08T18:09:32.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.490+0000 7fad3d5e6980 20 add_watcher() i=6 2024-05-08T18:09:32.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94423422147888] v32'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 20 add_watcher() i=7 2024-05-08T18:09:32.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:32.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa895320 con 0x55e0aa881e50 2024-05-08T18:09:32.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94423422141616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8927a0 con 0x55e0aa881e50 2024-05-08T18:09:32.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94423422141616] v32'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fabf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:32.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:32.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:32.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.494+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89db90 con 0x55e0aa881e50 2024-05-08T18:09:32.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.498+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.498+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e260 con 0x7fad2c04e040 2024-05-08T18:09:32.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.498+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.498+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e260 con 0x55e0aa888070 2024-05-08T18:09:32.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.502+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.502+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e260 con 0x55e0aa881e50 2024-05-08T18:09:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.502+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.502+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e2f0 con 0x7fad300cb060 2024-05-08T18:09:32.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.502+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'62 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.502+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e8c0 con 0x55e0aa888070 2024-05-08T18:09:32.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.506+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.506+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e8c0 con 0x55e0aa881e50 2024-05-08T18:09:32.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.506+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.506+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e990 con 0x7fad2c04e040 2024-05-08T18:09:32.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.510+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.510+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89e990 con 0x7fad300cb060 2024-05-08T18:09:32.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.510+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.510+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f0c0 con 0x55e0aa888070 2024-05-08T18:09:32.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.514+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.514+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f0c0 con 0x7fad300cb060 2024-05-08T18:09:32.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.514+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'63 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.514+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f480 con 0x7fad2c04e040 2024-05-08T18:09:32.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.518+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.518+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f480 con 0x7fad300cb060 2024-05-08T18:09:32.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.518+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.518+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f480 con 0x7fad2c04e040 2024-05-08T18:09:32.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.518+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.522+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f480 con 0x55e0aa881e50 2024-05-08T18:09:32.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.522+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.522+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f480 con 0x55e0aa888070 2024-05-08T18:09:32.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.522+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.522+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f480 con 0x7fad300cb060 2024-05-08T18:09:32.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.526+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.526+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.526+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.526+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa881e50 2024-05-08T18:09:32.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.526+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.530+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa881e50 2024-05-08T18:09:32.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.530+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.530+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.530+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.530+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x7fad300cb060 2024-05-08T18:09:32.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.534+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.534+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.534+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.534+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.534+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.534+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.538+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.538+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.538+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.538+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x7fad2c04e040 2024-05-08T18:09:32.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.542+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.542+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.542+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.542+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x7fad2c04e040 2024-05-08T18:09:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.546+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.546+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x55e0aa888070 2024-05-08T18:09:32.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.546+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.546+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x7fad2c04e040 2024-05-08T18:09:32.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.550+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.550+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89f530 con 0x7fad300cb060 2024-05-08T18:09:32.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fabf0fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:32.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:32.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 20 Filter name: none 2024-05-08T18:09:32.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fab6a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:32.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:32.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8bad10 con 0x55e0aa881e50 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8bd1e0 con 0x7fad300cb060 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.554+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.558 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:09:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fabf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:32.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94423422141616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa89a7e0 con 0x55e0aa881e50 2024-05-08T18:09:32.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94423422141616] v32'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94423422124096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8904b0 con 0x7fad300cb060 2024-05-08T18:09:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94423422124096] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3d5e6980 20 remove_watcher() i=0 2024-05-08T18:09:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3d5e6980 2 removed watcher, disabling cache 2024-05-08T18:09:32.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.558+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94423422128480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8904b0 con 0x55e0aa881e50 2024-05-08T18:09:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.562+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94423422128480] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.562+0000 7fad3d5e6980 20 remove_watcher() i=1 2024-05-08T18:09:32.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.562+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94423422132352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88d160 con 0x55e0aa888070 2024-05-08T18:09:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.562+0000 7fad3a8f9640 1 -- 172.21.15.114:0/919798017 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94423422132352] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad300e8020 con 0x55e0aa888070 2024-05-08T18:09:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.562+0000 7fad3d5e6980 20 remove_watcher() i=2 2024-05-08T18:09:32.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.562+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94423422136128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa8904b0 con 0x7fad300cb060 2024-05-08T18:09:32.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.566+0000 7fad3b8fb640 1 -- 172.21.15.114:0/919798017 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94423422136128] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad3401f070 con 0x7fad300cb060 2024-05-08T18:09:32.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.566+0000 7fad3d5e6980 20 remove_watcher() i=3 2024-05-08T18:09:32.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.566+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94423422140352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88e080 con 0x55e0aa881e50 2024-05-08T18:09:32.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.566+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94423422140352] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x55e0aa881e50 2024-05-08T18:09:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.566+0000 7fad3d5e6980 20 remove_watcher() i=4 2024-05-08T18:09:32.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.566+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94423422129536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88d160 con 0x7fad2c04e040 2024-05-08T18:09:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.570+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94423422129536] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.570+0000 7fad3d5e6980 20 remove_watcher() i=5 2024-05-08T18:09:32.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.570+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94423422144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88ef40 con 0x7fad2c04e040 2024-05-08T18:09:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.570+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94423422144112] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.570+0000 7fad3d5e6980 20 remove_watcher() i=6 2024-05-08T18:09:32.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.570+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94423422147888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e0aa88d610 con 0x7fad2c04e040 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94423422147888] v32'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fad2c054080 con 0x7fad2c04e040 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 20 remove_watcher() i=7 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fad2c04e040 msgr2=0x7fad2c045e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fad2c04e040 0x7fad2c045e70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa881e50 msgr2=0x55e0aa8842e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa881e50 0x55e0aa8842e0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fad300cb060 msgr2=0x7fad300cba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fad300cb060 0x7fad300cba70 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e0aa888070 msgr2=0x55e0aa88a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55e0aa888070 0x55e0aa88a460 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac040383a0 msgr2=0x7fac0403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac040383a0 0x7fac0403a860 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55e0aa852710 tx=0x7fad3401f000 comp rx=0 tx=0).stop 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 msgr2=0x55e0aa876980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/919798017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa86f410 0x55e0aa876980 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fad300b6fd0 tx=0x7fad300e9140 comp rx=0 tx=0).stop 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3b0fa640 1 -- 172.21.15.114:0/919798017 reap_dead start 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 shutdown_connections 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 >> 172.21.15.114:0/919798017 conn(0x55e0aa86b7a0 msgr2=0x55e0aa870c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 shutdown_connections 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/919798017 wait complete. 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac140383f0 msgr2=0x7fac1403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac140383f0 0x7fac1403a8b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55e0aa852f90 tx=0x7fad34005850 comp rx=0 tx=0).stop 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 msgr2=0x55e0aa862760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 0x55e0aa862760 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fad300ae040 tx=0x7fad30018020 comp rx=0 tx=0).stop 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 shutdown_connections 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac140383f0 0x7fac1403a8b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/716297380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa862340 0x55e0aa862760 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 >> 172.21.15.114:0/716297380 conn(0x55e0aa857150 msgr2=0x55e0aa857c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 shutdown_connections 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/716297380 wait complete. 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa75c5b0 msgr2=0x55e0aa851520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.574+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa75c5b0 0x55e0aa851520 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac20038440 msgr2=0x7fac2003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac20038440 0x7fac2003a900 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fad300ad000 tx=0x7fad300a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 msgr2=0x55e0aa84a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa84a630 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55e0aa843ff0 tx=0x7fad2c000bd0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 shutdown_connections 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55e0aa75c5b0 0x55e0aa851520 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fac20038440 0x7fac2003a900 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 --2- 172.21.15.114:0/2221596232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0aa7580f0 0x55e0aa84a630 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 >> 172.21.15.114:0/2221596232 conn(0x55e0aa6cb7d0 msgr2=0x55e0aa83d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 shutdown_connections 2024-05-08T18:09:32.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.578+0000 7fad3d5e6980 1 -- 172.21.15.114:0/2221596232 wait complete. 2024-05-08T18:09:32.590 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:09:32.603 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-08T18:09:32.612 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:32.662 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:32.681 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:32.731 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T18:09:32.741 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:32.742 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:09:32.742 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:09:32.742 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:09:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:32.780 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd96832c980 1 Processor -- start 2024-05-08T18:09:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd96832c980 1 -- start start 2024-05-08T18:09:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd96832c980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5643e5098d80 0x5643e5099160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd96832c980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5643e4f45710 con 0x5643e50996a0 2024-05-08T18:09:32.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd96832c980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5643e4f59f00 con 0x5643e5098d80 2024-05-08T18:09:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd965e40640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5643e5098d80 0x5643e5099160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd965e40640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5643e5098d80 0x5643e5099160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44796/0 (socket says 172.21.15.114:44796) 2024-05-08T18:09:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd965e40640 1 -- 172.21.15.114:0/4015646797 learned_addr learned my addr 172.21.15.114:0/4015646797 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.778+0000 7fd96563f640 1 --1- 172.21.15.114:0/4015646797 >> v1:172.21.15.53:6789/0 conn(0x5643e50996a0 0x5643e509a0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55280/0 (socket says 172.21.15.114:55280) 2024-05-08T18:09:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd965e40640 1 -- 172.21.15.114:0/4015646797 >> v1:172.21.15.53:6789/0 conn(0x5643e50996a0 legacy=0x5643e509a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd965e40640 1 -- 172.21.15.114:0/4015646797 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e4f21ae0 con 0x5643e5098d80 2024-05-08T18:09:32.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd965e40640 1 --2- 172.21.15.114:0/4015646797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5099160 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd95800a4e0 tx=0x7fd95801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa5a05094ed4b98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd964e3e640 1 -- 172.21.15.114:0/4015646797 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9580aa540 con 0x5643e5098d80 2024-05-08T18:09:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd964e3e640 1 -- 172.21.15.114:0/4015646797 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580aa6e0 con 0x5643e5098d80 2024-05-08T18:09:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd964e3e640 1 -- 172.21.15.114:0/4015646797 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9580aaa40 con 0x5643e5098d80 2024-05-08T18:09:32.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 -- 172.21.15.114:0/4015646797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 msgr2=0x5643e5099160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 --2- 172.21.15.114:0/4015646797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5099160 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd95800a4e0 tx=0x7fd95801b090 comp rx=0 tx=0).stop 2024-05-08T18:09:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 -- 172.21.15.114:0/4015646797 shutdown_connections 2024-05-08T18:09:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 --2- 172.21.15.114:0/4015646797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5099160 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 -- 172.21.15.114:0/4015646797 >> 172.21.15.114:0/4015646797 conn(0x5643e5094650 msgr2=0x5643e5096a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 -- 172.21.15.114:0/4015646797 shutdown_connections 2024-05-08T18:09:32.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.782+0000 7fd96832c980 1 -- 172.21.15.114:0/4015646797 wait complete. 2024-05-08T18:09:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.798+0000 7fd96832c980 1 Processor -- start 2024-05-08T18:09:32.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.798+0000 7fd96832c980 1 -- start start 2024-05-08T18:09:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.798+0000 7fd96832c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5185700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.798+0000 7fd96832c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643e4f9df80 con 0x5643e5098d80 2024-05-08T18:09:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5185700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5185700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44808/0 (socket says 172.21.15.114:44808) 2024-05-08T18:09:32.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 -- 172.21.15.114:0/426443021 learned_addr learned my addr 172.21.15.114:0/426443021 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 -- 172.21.15.114:0/426443021 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e4f65da0 con 0x5643e5098d80 2024-05-08T18:09:32.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 --2- 172.21.15.114:0/426443021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5185700 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd958017ca0 tx=0x7fd9580033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79534b13b180b47a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd853e07640 1 -- 172.21.15.114:0/426443021 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9580b9030 con 0x5643e5098d80 2024-05-08T18:09:32.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd853e07640 1 -- 172.21.15.114:0/426443021 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580aaac0 con 0x5643e5098d80 2024-05-08T18:09:32.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd853e07640 1 -- 172.21.15.114:0/426443021 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9580aada0 con 0x5643e5098d80 2024-05-08T18:09:32.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- 172.21.15.114:0/426443021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 msgr2=0x5643e5185700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 --2- 172.21.15.114:0/426443021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5185700 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd958017ca0 tx=0x7fd9580033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- 172.21.15.114:0/426443021 shutdown_connections 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 --2- 172.21.15.114:0/426443021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e5185700 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- 172.21.15.114:0/426443021 >> 172.21.15.114:0/426443021 conn(0x5643e5094650 msgr2=0x5643e5181290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- 172.21.15.114:0/426443021 shutdown_connections 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- 172.21.15.114:0/426443021 wait complete. 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 Processor -- start 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- start start 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e50a45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd96832c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643e500d650 con 0x5643e5098d80 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e50a45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e50a45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44824/0 (socket says 172.21.15.114:44824) 2024-05-08T18:09:32.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 -- 172.21.15.114:0/3130299151 learned_addr learned my addr 172.21.15.114:0/3130299151 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.802+0000 7fd965e40640 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e50a4b30 con 0x5643e5098d80 2024-05-08T18:09:32.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd965e40640 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e50a45f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd95801b0d0 tx=0x7fd958017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd852604640 1 -- 172.21.15.114:0/3130299151 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9580b9030 con 0x5643e5098d80 2024-05-08T18:09:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd852604640 1 -- 172.21.15.114:0/3130299151 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9580c3070 con 0x5643e5098d80 2024-05-08T18:09:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643e50a2d60 con 0x5643e5098d80 2024-05-08T18:09:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd852604640 1 -- 172.21.15.114:0/3130299151 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9580bf750 con 0x5643e5098d80 2024-05-08T18:09:32.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e50a3250 con 0x5643e5098d80 2024-05-08T18:09:32.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd852604640 1 -- 172.21.15.114:0/3130299151 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd9580c5030 con 0x5643e5098d80 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd852604640 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd84c038440 0x7fd84c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd852604640 1 -- 172.21.15.114:0/3130299151 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd9580ba070 con 0x5643e5098d80 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96563f640 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd84c038440 0x7fd84c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e50996a0 0x5643e5195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51963c0 con 0x5643e50996a0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd966641640 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e50996a0 0x5643e5195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96563f640 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd84c038440 0x7fd84c03a900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd950001e40 tx=0x7fd9500013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd966641640 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e50996a0 0x5643e5195e80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd966641640 1 -- 172.21.15.114:0/3130299151 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9600083f0 con 0x5643e50996a0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e5196760 con 0x5643e50996a0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd966641640 1 -- 172.21.15.114:0/3130299151 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9600083f0 con 0x5643e50996a0 2024-05-08T18:09:32.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e5198040 con 0x5643e50996a0 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd966641640 1 -- 172.21.15.114:0/3130299151 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd9600083f0 con 0x5643e50996a0 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.806+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e5197180 con 0x5643e50996a0 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd966641640 1 -- 172.21.15.114:0/3130299151 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9600083f0 con 0x5643e50996a0 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51975a0 con 0x5643e50996a0 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd966641640 1 -- 172.21.15.114:0/3130299151 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd9600083f0 con 0x5643e50996a0 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 Processor -- start 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 -- start start 2024-05-08T18:09:32.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 0x5643e51a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643e4fa1fc0 con 0x5643e51a6980 2024-05-08T18:09:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96563f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 0x5643e51a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96563f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 0x5643e51a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44836/0 (socket says 172.21.15.114:44836) 2024-05-08T18:09:32.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96563f640 1 -- 172.21.15.114:0/2248379568 learned_addr learned my addr 172.21.15.114:0/2248379568 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96563f640 1 -- 172.21.15.114:0/2248379568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e51a72e0 con 0x5643e51a6980 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96563f640 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 0x5643e51a6da0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd95000e670 tx=0x7fd95000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd84b7fe640 1 -- 172.21.15.114:0/2248379568 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd950022070 con 0x5643e51a6980 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643e51a7d80 con 0x5643e51a6980 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd84b7fe640 1 -- 172.21.15.114:0/2248379568 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95000d660 con 0x5643e51a6980 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd84b7fe640 1 -- 172.21.15.114:0/2248379568 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd950006070 con 0x5643e51a6980 2024-05-08T18:09:32.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.810+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e51a8250 con 0x5643e51a6980 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd84b7fe640 1 -- 172.21.15.114:0/2248379568 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd950025070 con 0x5643e51a6980 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd84b7fe640 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8400383f0 0x7fd84003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd84b7fe640 1 -- 172.21.15.114:0/2248379568 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd950050050 con 0x5643e51a6980 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd966641640 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8400383f0 0x7fd84003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 Processor -- start 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- start start 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd966641640 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8400383f0 0x7fd84003a8b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5643e5197520 tx=0x7fd960003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643e5185d90 con 0x5643e51b3b60 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96563f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96563f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44844/0 (socket says 172.21.15.114:44844) 2024-05-08T18:09:32.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96563f640 1 -- 172.21.15.114:0/1349808696 learned_addr learned my addr 172.21.15.114:0/1349808696 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96563f640 1 -- 172.21.15.114:0/1349808696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e51b4550 con 0x5643e51b3b60 2024-05-08T18:09:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96563f640 1 --2- 172.21.15.114:0/1349808696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51b3f80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd95004e3c0 tx=0x7fd950026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcc2200c66b18ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd8497fa640 1 -- 172.21.15.114:0/1349808696 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95003d0d0 con 0x5643e51b3b60 2024-05-08T18:09:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd8497fa640 1 -- 172.21.15.114:0/1349808696 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd95003d270 con 0x5643e51b3b60 2024-05-08T18:09:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd8497fa640 1 -- 172.21.15.114:0/1349808696 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd9500242c0 con 0x5643e51b3b60 2024-05-08T18:09:32.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- 172.21.15.114:0/1349808696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 msgr2=0x5643e51b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 --2- 172.21.15.114:0/1349808696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51b3f80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd95004e3c0 tx=0x7fd950026780 comp rx=0 tx=0).stop 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- 172.21.15.114:0/1349808696 shutdown_connections 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 --2- 172.21.15.114:0/1349808696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51b3f80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- 172.21.15.114:0/1349808696 >> 172.21.15.114:0/1349808696 conn(0x5643e51afef0 msgr2=0x5643e51adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- 172.21.15.114:0/1349808696 shutdown_connections 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- 172.21.15.114:0/1349808696 wait complete. 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 Processor -- start 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.814+0000 7fd96832c980 1 -- start start 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51bb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5643e51b4ca0 con 0x5643e51b3b60 2024-05-08T18:09:32.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96563f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51bb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96563f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51bb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44852/0 (socket says 172.21.15.114:44852) 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 learned_addr learned my addr 172.21.15.114:0/3878868997 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e51bb5b0 con 0x5643e51b3b60 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96563f640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51bb070 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd95000ef00 tx=0x7fd95004e320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd8377fe640 1 -- 172.21.15.114:0/3878868997 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd95003d0d0 con 0x5643e51b3b60 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5643e51bb840 con 0x5643e51b3b60 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd8377fe640 1 -- 172.21.15.114:0/3878868997 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd950024780 con 0x5643e51b3b60 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd8377fe640 1 -- 172.21.15.114:0/3878868997 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd950024970 con 0x5643e51b3b60 2024-05-08T18:09:32.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e51bb840 con 0x5643e51b3b60 2024-05-08T18:09:32.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd8377fe640 1 -- 172.21.15.114:0/3878868997 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd95003e940 con 0x5643e51b3b60 2024-05-08T18:09:32.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd8377fe640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8300383f0 0x7fd83003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd8377fe640 1 -- 172.21.15.114:0/3878868997 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd950046070 con 0x5643e51b3b60 2024-05-08T18:09:32.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd966641640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8300383f0 0x7fd83003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e51c63a0 0x5643e51c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51c8fb0 con 0x5643e51c63a0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd965e40640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e51c63a0 0x5643e51c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd966641640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8300383f0 0x7fd83003a8b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd96000f010 tx=0x7fd96001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.818+0000 7fd965e40640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e51c63a0 0x5643e51c8860 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 realm 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51c93c0 con 0x5643e51c63a0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51c9c90 con 0x5643e51c63a0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51ca030 con 0x5643e51c63a0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51ca880 con 0x5643e51c63a0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 20 searching for the correct realm 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5643e51cc5f0 0x5643e51ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51cc5f0 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96563f640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5643e51cc5f0 0x5643e51ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96563f640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5643e51cc5f0 0x5643e51ce9e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96563f640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd950027060 0x7fd9500278c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd950027060 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd966641640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd950027060 0x7fd9500278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd966641640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd950027060 0x7fd9500278c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd950027060 2024-05-08T18:09:32.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51c63a0 2024-05-08T18:09:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.822+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51c63a0 2024-05-08T18:09:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9580d0ab0 0x7fd9580a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd9580d0ab0 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9580d0ab0 0x7fd9580a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9580d0ab0 0x7fd9580a93c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x7fd9580d0ab0 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd9580d0ab0 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x7fd9580d0ab0 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd950027060 2024-05-08T18:09:32.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51cc5f0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51c63a0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd950027060 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51c63a0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.826+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x7fd950027060 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51cc5f0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cef20 con 0x5643e51cc5f0 2024-05-08T18:09:32.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x7fd9580d0ab0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51cc5f0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51cc5f0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51c63a0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51c63a0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580bfc70 con 0x7fd9580d0ab0 2024-05-08T18:09:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51cc5f0 2024-05-08T18:09:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd950027060 2024-05-08T18:09:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.830+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51c63a0 2024-05-08T18:09:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd9580bfc70 con 0x5643e51c63a0 2024-05-08T18:09:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51cc5f0 2024-05-08T18:09:32.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd950027060 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51cc5f0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x5643e51c63a0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.834+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd95005c040 con 0x7fd950027060 2024-05-08T18:09:32.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cb1d0 con 0x5643e51c63a0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cade0 con 0x5643e51c63a0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cbaf0 con 0x5643e51c63a0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 zone default found 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 4 Realm: () 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 zonegroup default 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51cf350 con 0x7fd9580d0ab0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d1170 con 0x5643e51cc5f0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d1510 con 0x5643e51cc5f0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 started sync module instance, tier type = 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:32.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d0610 con 0x7fd950027060 2024-05-08T18:09:32.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.838+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.842+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94849606683136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d1e50 con 0x7fd950027060 2024-05-08T18:09:32.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.842+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d26a0 con 0x5643e51c63a0 2024-05-08T18:09:32.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.842+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94849606683136] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.842+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.842+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94849606687136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d2270 con 0x5643e51c63a0 2024-05-08T18:09:32.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.842+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d2d90 con 0x5643e51cc5f0 2024-05-08T18:09:32.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94849606687136] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94849606690912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d3630 con 0x5643e51cc5f0 2024-05-08T18:09:32.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d1dc0 con 0x7fd950027060 2024-05-08T18:09:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94849606695744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d4410 con 0x7fd950027060 2024-05-08T18:09:32.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d4dd0 con 0x5643e51c63a0 2024-05-08T18:09:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94849606690912] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.846+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94849606695744] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94849606699296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d4410 con 0x5643e51c63a0 2024-05-08T18:09:32.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d4d40 con 0x7fd9580d0ab0 2024-05-08T18:09:32.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94849606699296] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94849606696800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d4380 con 0x7fd9580d0ab0 2024-05-08T18:09:32.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.850+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d5c00 con 0x7fd9580d0ab0 2024-05-08T18:09:32.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94849606696800] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94849606701360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d5c00 con 0x7fd9580d0ab0 2024-05-08T18:09:32.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d65c0 con 0x7fd9580d0ab0 2024-05-08T18:09:32.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94849606701360] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94849606702928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d67a0 con 0x7fd9580d0ab0 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=0 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=1 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=2 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=3 2024-05-08T18:09:32.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=4 2024-05-08T18:09:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=5 2024-05-08T18:09:32.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.854+0000 7fd96832c980 20 add_watcher() i=6 2024-05-08T18:09:32.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.858+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94849606702928] v32'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.858+0000 7fd96832c980 20 add_watcher() i=7 2024-05-08T18:09:32.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.858+0000 7fd96832c980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:32.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.858+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d9940 con 0x5643e51c63a0 2024-05-08T18:09:32.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.858+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.858+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94849606718224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d66e0 con 0x5643e51c63a0 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94849606718224] v32'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd81bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 5 note: GC not initialized 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd81afe5640 20 reqs_thread_entry: start 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 Filter name: none 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd818fe1640 20 reqs_thread_entry: start 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.864 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51fd860 con 0x7fd950027060 2024-05-08T18:09:32.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:32.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:32.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 : miss 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 rados->read ofs=0 len=0 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:63 8.b 8:d783709b:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e51ff480 con 0x5643e51cc5f0 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(63 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 info.flags=0x17 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 to cache LRU end 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 get_obj_state: octx=0x7fd960005e50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5643e5201b48 s->prefetch_data=0 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 3.1bs0 3:daa916a6:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5643e5202c50 con 0x5643e51cc5f0 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(64 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=848b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+864 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 10 manifest: total_size = 5 2024-05-08T18:09:32.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.862+0000 7fd96832c980 20 get_obj_state: setting s->obj_tag to _k-jcwArNJnsBZ_GYTK43Hg_oWwvHKFh 2024-05-08T18:09:32.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd81bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:32.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94849606718224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51fb130 con 0x5643e51c63a0 2024-05-08T18:09:32.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94849606718224] v32'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94849606683136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51fb130 con 0x7fd950027060 2024-05-08T18:09:32.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94849606683136] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd96832c980 20 remove_watcher() i=0 2024-05-08T18:09:32.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd96832c980 2 removed watcher, disabling cache 2024-05-08T18:09:32.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.866+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94849606687136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51fb130 con 0x5643e51c63a0 2024-05-08T18:09:32.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.870+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94849606687136] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.870+0000 7fd96832c980 20 remove_watcher() i=1 2024-05-08T18:09:32.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.870+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94849606690912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51fb130 con 0x5643e51cc5f0 2024-05-08T18:09:32.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.870+0000 7fd96563f640 1 -- 172.21.15.114:0/3878868997 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94849606690912] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd950024030 con 0x5643e51cc5f0 2024-05-08T18:09:32.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.870+0000 7fd96832c980 20 remove_watcher() i=2 2024-05-08T18:09:32.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.870+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94849606695744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d2860 con 0x7fd950027060 2024-05-08T18:09:32.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.874+0000 7fd966641640 1 -- 172.21.15.114:0/3878868997 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94849606695744] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd96002f040 con 0x7fd950027060 2024-05-08T18:09:32.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.874+0000 7fd96832c980 20 remove_watcher() i=3 2024-05-08T18:09:32.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.874+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94849606699296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51fb130 con 0x5643e51c63a0 2024-05-08T18:09:32.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.874+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94849606699296] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x5643e51c63a0 2024-05-08T18:09:32.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.874+0000 7fd96832c980 20 remove_watcher() i=4 2024-05-08T18:09:32.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.874+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94849606696800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d3b40 con 0x7fd9580d0ab0 2024-05-08T18:09:32.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.878+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94849606696800] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.878+0000 7fd96832c980 20 remove_watcher() i=5 2024-05-08T18:09:32.879 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.878+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94849606701360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d2860 con 0x7fd9580d0ab0 2024-05-08T18:09:32.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.878+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94849606701360] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.878+0000 7fd96832c980 20 remove_watcher() i=6 2024-05-08T18:09:32.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.878+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94849606702928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5643e51d4920 con 0x7fd9580d0ab0 2024-05-08T18:09:32.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94849606702928] v32'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd9580f3040 con 0x7fd9580d0ab0 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 20 remove_watcher() i=7 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9580d0ab0 msgr2=0x7fd9580a93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd9580d0ab0 0x7fd9580a93c0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e51c63a0 msgr2=0x5643e51c8860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e51c63a0 0x5643e51c8860 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd950027060 msgr2=0x7fd9500278c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd950027060 0x7fd9500278c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5643e51cc5f0 msgr2=0x5643e51ce9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5643e51cc5f0 0x5643e51ce9e0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8300383f0 msgr2=0x7fd83003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8300383f0 0x7fd83003a8b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd96000f010 tx=0x7fd96001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 msgr2=0x5643e51bb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51bb070 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd95000ef00 tx=0x7fd95004e320 comp rx=0 tx=0).stop 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd965e40640 1 -- 172.21.15.114:0/3878868997 reap_dead start 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 shutdown_connections 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3878868997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51b3b60 0x5643e51bb070 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 >> 172.21.15.114:0/3878868997 conn(0x5643e51afef0 msgr2=0x5643e51b53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 shutdown_connections 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3878868997 wait complete. 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8400383f0 msgr2=0x7fd84003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8400383f0 0x7fd84003a8b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5643e5197520 tx=0x7fd960003070 comp rx=0 tx=0).stop 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 msgr2=0x5643e51a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 0x5643e51a6da0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd95000e670 tx=0x7fd95000ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 shutdown_connections 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd8400383f0 0x7fd84003a8b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/2248379568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e51a6980 0x5643e51a6da0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 >> 172.21.15.114:0/2248379568 conn(0x5643e519b790 msgr2=0x5643e519c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 shutdown_connections 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/2248379568 wait complete. 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e50996a0 msgr2=0x5643e5195e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e50996a0 0x5643e5195e80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd84c038440 msgr2=0x7fd84c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd84c038440 0x7fd84c03a900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd950001e40 tx=0x7fd9500013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 msgr2=0x5643e50a45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e50a45f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd95801b0d0 tx=0x7fd958017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 shutdown_connections 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5643e50996a0 0x5643e5195e80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd84c038440 0x7fd84c03a900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 --2- 172.21.15.114:0/3130299151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5643e5098d80 0x5643e50a45f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 >> 172.21.15.114:0/3130299151 conn(0x5643e5094650 msgr2=0x5643e517fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 shutdown_connections 2024-05-08T18:09:32.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.882+0000 7fd96832c980 1 -- 172.21.15.114:0/3130299151 wait complete. 2024-05-08T18:09:32.896 INFO:teuthology.orchestra.run.smithi114.stdout:fooFoofooFooFULL_CONTROL 2024-05-08T18:09:32.896 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-08T18:09:32.899 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-08T18:09:32.906 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:32.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:09:32.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T18:09:32.906 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:09:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:32.972 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd4b25f980 1 Processor -- start 2024-05-08T18:09:32.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd4b25f980 1 -- start start 2024-05-08T18:09:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd4b25f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5608bb6493a0 0x5608bb649780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd4b25f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5608bb4f2710 con 0x5608bb649cc0 2024-05-08T18:09:32.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd4b25f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5608bb506f00 con 0x5608bb6493a0 2024-05-08T18:09:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd48d73640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5608bb6493a0 0x5608bb649780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd48d73640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5608bb6493a0 0x5608bb649780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44854/0 (socket says 172.21.15.114:44854) 2024-05-08T18:09:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd48d73640 1 -- 172.21.15.114:0/1956733485 learned_addr learned my addr 172.21.15.114:0/1956733485 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.970+0000 7fcd48572640 1 --1- 172.21.15.114:0/1956733485 >> v1:172.21.15.53:6789/0 conn(0x5608bb649cc0 0x5608bb64a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55284/0 (socket says 172.21.15.114:55284) 2024-05-08T18:09:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd48d73640 1 -- 172.21.15.114:0/1956733485 >> v1:172.21.15.53:6789/0 conn(0x5608bb649cc0 legacy=0x5608bb64a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd48d73640 1 -- 172.21.15.114:0/1956733485 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bb4ceae0 con 0x5608bb6493a0 2024-05-08T18:09:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd48d73640 1 --2- 172.21.15.114:0/1956733485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb649780 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800a4e0 tx=0x7fcd3801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ca3e48525731b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd47d71640 1 -- 172.21.15.114:0/1956733485 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd380aa540 con 0x5608bb6493a0 2024-05-08T18:09:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd47d71640 1 -- 172.21.15.114:0/1956733485 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd380aa6e0 con 0x5608bb6493a0 2024-05-08T18:09:32.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd47d71640 1 -- 172.21.15.114:0/1956733485 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd380aaa40 con 0x5608bb6493a0 2024-05-08T18:09:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 -- 172.21.15.114:0/1956733485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 msgr2=0x5608bb649780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/1956733485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb649780 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800a4e0 tx=0x7fcd3801b090 comp rx=0 tx=0).stop 2024-05-08T18:09:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 -- 172.21.15.114:0/1956733485 shutdown_connections 2024-05-08T18:09:32.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/1956733485 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb649780 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 -- 172.21.15.114:0/1956733485 >> 172.21.15.114:0/1956733485 conn(0x5608bb5bc7f0 msgr2=0x5608bb5bcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 -- 172.21.15.114:0/1956733485 shutdown_connections 2024-05-08T18:09:32.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.974+0000 7fcd4b25f980 1 -- 172.21.15.114:0/1956733485 wait complete. 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd4b25f980 1 Processor -- start 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd4b25f980 1 -- start start 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd4b25f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb7348c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd4b25f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608bb54af80 con 0x5608bb6493a0 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd48d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb7348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd48d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb7348c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44862/0 (socket says 172.21.15.114:44862) 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.990+0000 7fcd48d73640 1 -- 172.21.15.114:0/2253044043 learned_addr learned my addr 172.21.15.114:0/2253044043 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 -- 172.21.15.114:0/2253044043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bb512da0 con 0x5608bb6493a0 2024-05-08T18:09:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 --2- 172.21.15.114:0/2253044043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb7348c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcd38017ca0 tx=0x7fcd380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fd949814587c2f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcc36e0d640 1 -- 172.21.15.114:0/2253044043 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd380b9030 con 0x5608bb6493a0 2024-05-08T18:09:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcc36e0d640 1 -- 172.21.15.114:0/2253044043 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd380aaac0 con 0x5608bb6493a0 2024-05-08T18:09:32.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcc36e0d640 1 -- 172.21.15.114:0/2253044043 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd380aada0 con 0x5608bb6493a0 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- 172.21.15.114:0/2253044043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 msgr2=0x5608bb7348c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/2253044043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb7348c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcd38017ca0 tx=0x7fcd380033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- 172.21.15.114:0/2253044043 shutdown_connections 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/2253044043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb7348c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- 172.21.15.114:0/2253044043 >> 172.21.15.114:0/2253044043 conn(0x5608bb5bc7f0 msgr2=0x5608bb730450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- 172.21.15.114:0/2253044043 shutdown_connections 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- 172.21.15.114:0/2253044043 wait complete. 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 Processor -- start 2024-05-08T18:09:32.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- start start 2024-05-08T18:09:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb73bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608bb6530f0 con 0x5608bb6493a0 2024-05-08T18:09:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb73bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb73bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44868/0 (socket says 172.21.15.114:44868) 2024-05-08T18:09:32.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 -- 172.21.15.114:0/3118448598 learned_addr learned my addr 172.21.15.114:0/3118448598 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bb73c0d0 con 0x5608bb6493a0 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd48d73640 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb73bb90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcd3801b0d0 tx=0x7fcd38017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcc3560a640 1 -- 172.21.15.114:0/3118448598 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd380b9030 con 0x5608bb6493a0 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.994+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608bb73c360 con 0x5608bb6493a0 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcc3560a640 1 -- 172.21.15.114:0/3118448598 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd380c3070 con 0x5608bb6493a0 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcc3560a640 1 -- 172.21.15.114:0/3118448598 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd380bf750 con 0x5608bb6493a0 2024-05-08T18:09:32.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bb73f040 con 0x5608bb6493a0 2024-05-08T18:09:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcc3560a640 1 -- 172.21.15.114:0/3118448598 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcd380c5030 con 0x5608bb6493a0 2024-05-08T18:09:33.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcc3560a640 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc30038440 0x7fcc3003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcc3560a640 1 -- 172.21.15.114:0/3118448598 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fcd380ba070 con 0x5608bb6493a0 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd48572640 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc30038440 0x7fcc3003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb649cc0 0x5608bb742b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb743140 con 0x5608bb649cc0 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd49574640 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb649cc0 0x5608bb742b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd48572640 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc30038440 0x7fcc3003a900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd30001e40 tx=0x7fcd300013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd49574640 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb649cc0 0x5608bb742b20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd49574640 1 -- 172.21.15.114:0/3118448598 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd400083f0 con 0x5608bb649cc0 2024-05-08T18:09:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb743a70 con 0x5608bb649cc0 2024-05-08T18:09:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd49574640 1 -- 172.21.15.114:0/3118448598 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd400083f0 con 0x5608bb649cc0 2024-05-08T18:09:33.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb744e20 con 0x5608bb649cc0 2024-05-08T18:09:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd49574640 1 -- 172.21.15.114:0/3118448598 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd400083f0 con 0x5608bb649cc0 2024-05-08T18:09:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7442c0 con 0x5608bb649cc0 2024-05-08T18:09:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd49574640 1 -- 172.21.15.114:0/3118448598 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd400083f0 con 0x5608bb649cc0 2024-05-08T18:09:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:32.998+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7446e0 con 0x5608bb649cc0 2024-05-08T18:09:33.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd49574640 1 -- 172.21.15.114:0/3118448598 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcd400083f0 con 0x5608bb649cc0 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd4b25f980 1 Processor -- start 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd4b25f980 1 -- start start 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd4b25f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 0x5608bb753d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd4b25f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608bb54efc0 con 0x5608bb753970 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd48572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 0x5608bb753d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd48572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 0x5608bb753d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44870/0 (socket says 172.21.15.114:44870) 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd48572640 1 -- 172.21.15.114:0/754201413 learned_addr learned my addr 172.21.15.114:0/754201413 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd48572640 1 -- 172.21.15.114:0/754201413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bb7542d0 con 0x5608bb753970 2024-05-08T18:09:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd48572640 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 0x5608bb753d90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000e670 tx=0x7fcd3000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcc2e7fc640 1 -- 172.21.15.114:0/754201413 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd30022070 con 0x5608bb753970 2024-05-08T18:09:33.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608bb754d70 con 0x5608bb753970 2024-05-08T18:09:33.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcc2e7fc640 1 -- 172.21.15.114:0/754201413 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3000d660 con 0x5608bb753970 2024-05-08T18:09:33.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bb755240 con 0x5608bb753970 2024-05-08T18:09:33.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcc2e7fc640 1 -- 172.21.15.114:0/754201413 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd30006070 con 0x5608bb753970 2024-05-08T18:09:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcc2e7fc640 1 -- 172.21.15.114:0/754201413 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcd30025070 con 0x5608bb753970 2024-05-08T18:09:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.002+0000 7fcc2e7fc640 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc200383f0 0x7fcc2003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcc2e7fc640 1 -- 172.21.15.114:0/754201413 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fcd30050040 con 0x5608bb753970 2024-05-08T18:09:33.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd49574640 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc200383f0 0x7fcc2003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 Processor -- start 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- start start 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd49574640 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc200383f0 0x7fcc2003a8b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5608bb744660 tx=0x7fcd40003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb760f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608bb734f50 con 0x5608bb760ba0 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb760f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb760f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44874/0 (socket says 172.21.15.114:44874) 2024-05-08T18:09:33.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 -- 172.21.15.114:0/196150751 learned_addr learned my addr 172.21.15.114:0/196150751 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 -- 172.21.15.114:0/196150751 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bb761550 con 0x5608bb760ba0 2024-05-08T18:09:33.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 --2- 172.21.15.114:0/196150751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb760f80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c010 tx=0x7fcd30026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9483f434f41e1a34 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcc1ffff640 1 -- 172.21.15.114:0/196150751 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd3003d0d0 con 0x5608bb760ba0 2024-05-08T18:09:33.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcc1ffff640 1 -- 172.21.15.114:0/196150751 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3003d270 con 0x5608bb760ba0 2024-05-08T18:09:33.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcc1ffff640 1 -- 172.21.15.114:0/196150751 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd300479b0 con 0x5608bb760ba0 2024-05-08T18:09:33.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- 172.21.15.114:0/196150751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 msgr2=0x5608bb760f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/196150751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb760f80 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c010 tx=0x7fcd30026780 comp rx=0 tx=0).stop 2024-05-08T18:09:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- 172.21.15.114:0/196150751 shutdown_connections 2024-05-08T18:09:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/196150751 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb760f80 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- 172.21.15.114:0/196150751 >> 172.21.15.114:0/196150751 conn(0x5608bb75cee0 msgr2=0x5608bb75af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- 172.21.15.114:0/196150751 shutdown_connections 2024-05-08T18:09:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- 172.21.15.114:0/196150751 wait complete. 2024-05-08T18:09:33.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 Processor -- start 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- start start 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb7680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd4b25f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5608bb761d10 con 0x5608bb760ba0 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb7680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb7680e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44882/0 (socket says 172.21.15.114:44882) 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.006+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 learned_addr learned my addr 172.21.15.114:0/3548818562 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608bb768620 con 0x5608bb760ba0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48572640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb7680e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000dfd0 tx=0x7fcd3004e310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcc1e7fc640 1 -- 172.21.15.114:0/3548818562 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd3003d0d0 con 0x5608bb760ba0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcc1e7fc640 1 -- 172.21.15.114:0/3548818562 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3003eb40 con 0x5608bb760ba0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5608bb7688b0 con 0x5608bb760ba0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcc1e7fc640 1 -- 172.21.15.114:0/3548818562 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd3003ee20 con 0x5608bb760ba0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608bb7688b0 con 0x5608bb760ba0 2024-05-08T18:09:33.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcc1e7fc640 1 -- 172.21.15.114:0/3548818562 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcd3001a320 con 0x5608bb760ba0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcc1e7fc640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc140383f0 0x7fcc1403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcc1e7fc640 1 -- 172.21.15.114:0/3548818562 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fcd30043040 con 0x5608bb760ba0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd49574640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc140383f0 0x7fcc1403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb773410 0x5608bb7758d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb776020 con 0x5608bb773410 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48d73640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb773410 0x5608bb7758d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd49574640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc140383f0 0x7fcc1403a8b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000f010 tx=0x7fcd4001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48d73640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb773410 0x5608bb7758d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 realm 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb776430 con 0x5608bb773410 2024-05-08T18:09:33.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb776d00 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.010+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7770a0 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7778f0 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:33.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 20 searching for the correct realm 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608bb779340 0x5608bb77b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48572640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608bb779340 0x5608bb77b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48572640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608bb779340 0x5608bb77b800 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48572640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd30027060 0x7fcd30051430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd49574640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd30027060 0x7fcd30051430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd49574640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd30027060 0x7fcd30051430 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd380e14f0 0x7fcd380bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.014+0000 7fcd48d73640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd380e14f0 0x7fcd380bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd380e14f0 0x7fcd380bd7f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x7fcd380e14f0 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x7fcd380e14f0 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.018+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x7fcd380e14f0 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x7fcd380e14f0 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcd380ea0b0 con 0x5608bb773410 2024-05-08T18:09:33.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380ea0b0 con 0x7fcd380e14f0 2024-05-08T18:09:33.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.022+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb779340 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd380e14f0 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x5608bb773410 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77bed0 con 0x7fcd30027060 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:33.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb777540 con 0x5608bb773410 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb778260 con 0x5608bb773410 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb778780 con 0x5608bb773410 2024-05-08T18:09:33.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 zone default found 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 4 Realm: () 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 zonegroup default 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.026+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77c800 con 0x7fcd380e14f0 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77e450 con 0x5608bb779340 2024-05-08T18:09:33.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77e970 con 0x5608bb779340 2024-05-08T18:09:33.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 started sync module instance, tier type = 2024-05-08T18:09:33.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:33.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77d320 con 0x7fcd30027060 2024-05-08T18:09:33.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94595504920336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77cf80 con 0x7fcd30027060 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.030+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f8a0 con 0x5608bb773410 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94595504920336] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94595504926160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f8a0 con 0x5608bb773410 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb780260 con 0x5608bb779340 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94595504926160] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94595504927728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f810 con 0x5608bb779340 2024-05-08T18:09:33.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.034+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb780f60 con 0x7fcd30027060 2024-05-08T18:09:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94595504933824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb781650 con 0x7fcd30027060 2024-05-08T18:09:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb782170 con 0x5608bb773410 2024-05-08T18:09:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94595504927728] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94595504933824] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94595504938048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb782130 con 0x5608bb773410 2024-05-08T18:09:33.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.038+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb782a10 con 0x7fcd380e14f0 2024-05-08T18:09:33.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.042+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94595504938048] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.042+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.042+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94595504932352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7825e0 con 0x7fcd380e14f0 2024-05-08T18:09:33.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.042+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb782fa0 con 0x7fcd380e14f0 2024-05-08T18:09:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.042+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94595504932352] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94595504939312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb783180 con 0x7fcd380e14f0 2024-05-08T18:09:33.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7839d0 con 0x7fcd380e14f0 2024-05-08T18:09:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94595504943968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb783d70 con 0x7fcd380e14f0 2024-05-08T18:09:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=0 2024-05-08T18:09:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=1 2024-05-08T18:09:33.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=2 2024-05-08T18:09:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=3 2024-05-08T18:09:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=4 2024-05-08T18:09:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=5 2024-05-08T18:09:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94595504939312] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.046+0000 7fcd4b25f980 20 add_watcher() i=6 2024-05-08T18:09:33.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94595504943968] v32'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 add_watcher() i=7 2024-05-08T18:09:33.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:33.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb782cd0 con 0x5608bb773410 2024-05-08T18:09:33.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94595504942288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb784280 con 0x5608bb773410 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94595504942288] v32'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcbfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 5 note: GC not initialized 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcbfdfe3640 20 reqs_thread_entry: start 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:33.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 Filter name: none 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcb6f7fe640 20 reqs_thread_entry: start 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7aacb0 con 0x7fcd30027060 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 : miss 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.050+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:63 8.b 8:d783709b:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7ac8d0 con 0x5608bb779340 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(63 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 info.flags=0x17 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 to cache LRU end 2024-05-08T18:09:33.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 20 get_obj_state: octx=0x7fcd40005e50 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5608bb7aef98 s->prefetch_data=0 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 3.1bs0 3:daa916a6:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7b0040 con 0x5608bb779340 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(64 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 10 manifest: total_size = 5 2024-05-08T18:09:33.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 20 get_obj_state: setting s->obj_tag to _3Kd9Qf0MtmxPt6kFKRcyXrqW3F3mHQC 2024-05-08T18:09:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcbfefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94595504942288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7a8580 con 0x5608bb773410 2024-05-08T18:09:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94595504942288] v32'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.054+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94595504920336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7a8580 con 0x7fcd30027060 2024-05-08T18:09:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94595504920336] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd4b25f980 20 remove_watcher() i=0 2024-05-08T18:09:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd4b25f980 2 removed watcher, disabling cache 2024-05-08T18:09:33.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94595504926160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7a8580 con 0x5608bb773410 2024-05-08T18:09:33.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94595504926160] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd4b25f980 20 remove_watcher() i=1 2024-05-08T18:09:33.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.058+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94595504927728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb7a8580 con 0x5608bb779340 2024-05-08T18:09:33.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd48572640 1 -- 172.21.15.114:0/3548818562 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94595504927728] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd30032020 con 0x5608bb779340 2024-05-08T18:09:33.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd4b25f980 20 remove_watcher() i=2 2024-05-08T18:09:33.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94595504933824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f3f0 con 0x7fcd30027060 2024-05-08T18:09:33.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd49574640 1 -- 172.21.15.114:0/3548818562 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94595504933824] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd4002f040 con 0x7fcd30027060 2024-05-08T18:09:33.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd4b25f980 20 remove_watcher() i=3 2024-05-08T18:09:33.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94595504938048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f3f0 con 0x5608bb773410 2024-05-08T18:09:33.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94595504938048] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x5608bb773410 2024-05-08T18:09:33.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd4b25f980 20 remove_watcher() i=4 2024-05-08T18:09:33.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.062+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94595504932352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f3f0 con 0x7fcd380e14f0 2024-05-08T18:09:33.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.066+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94595504932352] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.066+0000 7fcd4b25f980 20 remove_watcher() i=5 2024-05-08T18:09:33.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.066+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94595504939312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb780600 con 0x7fcd380e14f0 2024-05-08T18:09:33.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.066+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94595504939312] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.066+0000 7fcd4b25f980 20 remove_watcher() i=6 2024-05-08T18:09:33.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.066+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94595504943968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5608bb77f3f0 con 0x7fcd380e14f0 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94595504943968] v32'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd380f2040 con 0x7fcd380e14f0 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 20 remove_watcher() i=7 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd380e14f0 msgr2=0x7fcd380bd7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd380e14f0 0x7fcd380bd7f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb773410 msgr2=0x5608bb7758d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb773410 0x5608bb7758d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd30027060 msgr2=0x7fcd30051430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd30027060 0x7fcd30051430 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608bb779340 msgr2=0x5608bb77b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5608bb779340 0x5608bb77b800 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc140383f0 msgr2=0x7fcc1403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc140383f0 0x7fcc1403a8b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000f010 tx=0x7fcd4001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 msgr2=0x5608bb7680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3548818562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb760ba0 0x5608bb7680e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000dfd0 tx=0x7fcd3004e310 comp rx=0 tx=0).stop 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd48d73640 1 -- 172.21.15.114:0/3548818562 reap_dead start 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 shutdown_connections 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 >> 172.21.15.114:0/3548818562 conn(0x5608bb75cee0 msgr2=0x5608bb75a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 shutdown_connections 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3548818562 wait complete. 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc200383f0 msgr2=0x7fcc2003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc200383f0 0x7fcc2003a8b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x5608bb744660 tx=0x7fcd40003070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 msgr2=0x5608bb753d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 0x5608bb753d90 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000e670 tx=0x7fcd3000ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 shutdown_connections 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc200383f0 0x7fcc2003a8b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/754201413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb753970 0x5608bb753d90 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 >> 172.21.15.114:0/754201413 conn(0x5608bb748780 msgr2=0x5608bb749290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 shutdown_connections 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/754201413 wait complete. 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb649cc0 msgr2=0x5608bb742b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb649cc0 0x5608bb742b20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc30038440 msgr2=0x7fcc3003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc30038440 0x7fcc3003a900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcd30001e40 tx=0x7fcd300013a0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 msgr2=0x5608bb73bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb73bb90 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcd3801b0d0 tx=0x7fcd38017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 shutdown_connections 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5608bb649cc0 0x5608bb742b20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc30038440 0x7fcc3003a900 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 --2- 172.21.15.114:0/3118448598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5608bb6493a0 0x5608bb73bb90 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 >> 172.21.15.114:0/3118448598 conn(0x5608bb5bc7f0 msgr2=0x5608bb72ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 shutdown_connections 2024-05-08T18:09:33.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.070+0000 7fcd4b25f980 1 -- 172.21.15.114:0/3118448598 wait complete. 2024-05-08T18:09:33.085 INFO:teuthology.orchestra.run.smithi114.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T18:09:33.085 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T18:09:33.088 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-08T18:09:33.108 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:33.211 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T18:09:33.211 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T18:09:33.211 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T18:09:33.211 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T18:09:33.211 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T18:09:33.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T18:09:33.211 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-08T18:09:33.251 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:33.251 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:33.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2d1319980 1 Processor -- start 2024-05-08T18:09:33.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2d1319980 1 -- start start 2024-05-08T18:09:33.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2d1319980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558ab84ccf30 0x558ab84cd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2d1319980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ab83ff710 con 0x558ab84caa80 2024-05-08T18:09:33.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2d1319980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x558ab8413f00 con 0x558ab84ccf30 2024-05-08T18:09:33.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2ce62c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558ab84ccf30 0x558ab84cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2cee2d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x558ab84caa80 0x558ab84cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55294/0 (socket says 172.21.15.114:55294) 2024-05-08T18:09:33.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2ce62c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x558ab84ccf30 0x558ab84cd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44894/0 (socket says 172.21.15.114:44894) 2024-05-08T18:09:33.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2cee2d640 1 -- 172.21.15.114:0/264976034 learned_addr learned my addr 172.21.15.114:0/264976034 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:09:33.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2ce62c640 1 -- 172.21.15.114:0/264976034 >> v1:172.21.15.53:6789/0 conn(0x558ab84caa80 legacy=0x558ab84cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.250+0000 7fa2ce62c640 1 -- 172.21.15.114:0/264976034 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab83dbae0 con 0x558ab84ccf30 2024-05-08T18:09:33.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/264976034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84ccf30 0x558ab84cd340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400a480 tx=0x7fa2c401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25d086b2a35f413 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2cde2b640 1 -- 172.21.15.114:0/264976034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40b0070 con 0x558ab84ccf30 2024-05-08T18:09:33.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2cde2b640 1 -- 172.21.15.114:0/264976034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c40ab540 con 0x558ab84ccf30 2024-05-08T18:09:33.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2cde2b640 1 -- 172.21.15.114:0/264976034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40ab840 con 0x558ab84ccf30 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 -- 172.21.15.114:0/264976034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84ccf30 msgr2=0x558ab84cd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 --2- 172.21.15.114:0/264976034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84ccf30 0x558ab84cd340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400a480 tx=0x7fa2c401b280 comp rx=0 tx=0).stop 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 -- 172.21.15.114:0/264976034 shutdown_connections 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 --2- 172.21.15.114:0/264976034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84ccf30 0x558ab84cd340 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 -- 172.21.15.114:0/264976034 >> 172.21.15.114:0/264976034 conn(0x558ab84c97e0 msgr2=0x558ab84c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 -- 172.21.15.114:0/264976034 shutdown_connections 2024-05-08T18:09:33.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.254+0000 7fa2d1319980 1 -- 172.21.15.114:0/264976034 wait complete. 2024-05-08T18:09:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2d1319980 1 Processor -- start 2024-05-08T18:09:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2d1319980 1 -- start start 2024-05-08T18:09:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2d1319980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab8645780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.273 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2d1319980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ab8457f80 con 0x558ab84caa80 2024-05-08T18:09:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2cee2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab8645780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2cee2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab8645780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44910/0 (socket says 172.21.15.114:44910) 2024-05-08T18:09:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2cee2d640 1 -- 172.21.15.114:0/71557237 learned_addr learned my addr 172.21.15.114:0/71557237 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.270+0000 7fa2cee2d640 1 -- 172.21.15.114:0/71557237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab841fda0 con 0x558ab84caa80 2024-05-08T18:09:33.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/71557237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab8645780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0001e50 tx=0x7fa2c0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4e21ad49d2fa58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa1bce09640 1 -- 172.21.15.114:0/71557237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c0012020 con 0x558ab84caa80 2024-05-08T18:09:33.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa1bce09640 1 -- 172.21.15.114:0/71557237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c000e7c0 con 0x558ab84caa80 2024-05-08T18:09:33.275 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa1bce09640 1 -- 172.21.15.114:0/71557237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c000eaa0 con 0x558ab84caa80 2024-05-08T18:09:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/71557237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 msgr2=0x558ab8645780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 --2- 172.21.15.114:0/71557237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab8645780 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0001e50 tx=0x7fa2c0001e80 comp rx=0 tx=0).stop 2024-05-08T18:09:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/71557237 shutdown_connections 2024-05-08T18:09:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 --2- 172.21.15.114:0/71557237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab8645780 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/71557237 >> 172.21.15.114:0/71557237 conn(0x558ab84c97e0 msgr2=0x558ab8641310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/71557237 shutdown_connections 2024-05-08T18:09:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/71557237 wait complete. 2024-05-08T18:09:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 Processor -- start 2024-05-08T18:09:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- start start 2024-05-08T18:09:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab864cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ab84ce330 con 0x558ab84caa80 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2cee2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab864cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2cee2d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab864cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44924/0 (socket says 172.21.15.114:44924) 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2cee2d640 1 -- 172.21.15.114:0/779893114 learned_addr learned my addr 172.21.15.114:0/779893114 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2cee2d640 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab864d1c0 con 0x558ab84caa80 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab864cc80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0000c10 tx=0x7fa2c0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa1bb606640 1 -- 172.21.15.114:0/779893114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c0012030 con 0x558ab84caa80 2024-05-08T18:09:33.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ab864d450 con 0x558ab84caa80 2024-05-08T18:09:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa1bb606640 1 -- 172.21.15.114:0/779893114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c00014b0 con 0x558ab84caa80 2024-05-08T18:09:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa1bb606640 1 -- 172.21.15.114:0/779893114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c001a8a0 con 0x558ab84caa80 2024-05-08T18:09:33.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.274+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab8650130 con 0x558ab84caa80 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa1bb606640 1 -- 172.21.15.114:0/779893114 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa2c0015020 con 0x558ab84caa80 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa1bb606640 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1b4038440 0x7fa1b403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa1bb606640 1 -- 172.21.15.114:0/779893114 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa2c0020070 con 0x558ab84caa80 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1b4038440 0x7fa1b403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab84ccf30 0x558ab8653d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86542c0 con 0x558ab84ccf30 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab84ccf30 0x558ab8653d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1b4038440 0x7fa1b403a900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ad000 tx=0x7fa2c40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab84ccf30 0x558ab8653d80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2cf62e640 1 -- 172.21.15.114:0/779893114 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2c800a4d0 con 0x558ab84ccf30 2024-05-08T18:09:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8651350 con 0x558ab84ccf30 2024-05-08T18:09:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2cf62e640 1 -- 172.21.15.114:0/779893114 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2c800a4d0 con 0x558ab84ccf30 2024-05-08T18:09:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86560c0 con 0x558ab84ccf30 2024-05-08T18:09:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2cf62e640 1 -- 172.21.15.114:0/779893114 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa2c800a4d0 con 0x558ab84ccf30 2024-05-08T18:09:33.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86552f0 con 0x558ab84ccf30 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2cf62e640 1 -- 172.21.15.114:0/779893114 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2c800a4d0 con 0x558ab84ccf30 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.278+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8655710 con 0x558ab84ccf30 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2cf62e640 1 -- 172.21.15.114:0/779893114 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa2c800a4d0 con 0x558ab84ccf30 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2d1319980 1 Processor -- start 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2d1319980 1 -- start start 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2d1319980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 0x558ab8664df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2d1319980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ab845bfc0 con 0x558ab86649d0 2024-05-08T18:09:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2ce62c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 0x558ab8664df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2ce62c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 0x558ab8664df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44930/0 (socket says 172.21.15.114:44930) 2024-05-08T18:09:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2ce62c640 1 -- 172.21.15.114:0/2513516092 learned_addr learned my addr 172.21.15.114:0/2513516092 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2ce62c640 1 -- 172.21.15.114:0/2513516092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab8665330 con 0x558ab86649d0 2024-05-08T18:09:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 0x558ab8664df0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400a480 tx=0x7fa2c4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa1b8e01640 1 -- 172.21.15.114:0/2513516092 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40c6070 con 0x558ab86649d0 2024-05-08T18:09:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ab8665dd0 con 0x558ab86649d0 2024-05-08T18:09:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa1b8e01640 1 -- 172.21.15.114:0/2513516092 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c40b7610 con 0x558ab86649d0 2024-05-08T18:09:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa1b8e01640 1 -- 172.21.15.114:0/2513516092 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40b0040 con 0x558ab86649d0 2024-05-08T18:09:33.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.282+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab8666240 con 0x558ab86649d0 2024-05-08T18:09:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa1b8e01640 1 -- 172.21.15.114:0/2513516092 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa2c40c9070 con 0x558ab86649d0 2024-05-08T18:09:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa1b8e01640 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1a80383f0 0x7fa1a803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa1b8e01640 1 -- 172.21.15.114:0/2513516092 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa2c40be030 con 0x558ab86649d0 2024-05-08T18:09:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1a80383f0 0x7fa1a803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 Processor -- start 2024-05-08T18:09:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- start start 2024-05-08T18:09:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8671e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1a80383f0 0x7fa1a803a8b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x558ab8655690 tx=0x7fa2c8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ab8645ed0 con 0x558ab8671ab0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8671e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8671e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44932/0 (socket says 172.21.15.114:44932) 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 -- 172.21.15.114:0/2633678755 learned_addr learned my addr 172.21.15.114:0/2633678755 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 -- 172.21.15.114:0/2633678755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab8672460 con 0x558ab8671ab0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/2633678755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8671e90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006ce0 tx=0x7fa2c40c1f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bf6316430c813 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa1b27fc640 1 -- 172.21.15.114:0/2633678755 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40b78f0 con 0x558ab8671ab0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa1b27fc640 1 -- 172.21.15.114:0/2633678755 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c40b7c70 con 0x558ab8671ab0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa1b27fc640 1 -- 172.21.15.114:0/2633678755 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40c9360 con 0x558ab8671ab0 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- 172.21.15.114:0/2633678755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 msgr2=0x558ab8671e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 --2- 172.21.15.114:0/2633678755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8671e90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fa2c4006ce0 tx=0x7fa2c40c1f50 comp rx=0 tx=0).stop 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- 172.21.15.114:0/2633678755 shutdown_connections 2024-05-08T18:09:33.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 --2- 172.21.15.114:0/2633678755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8671e90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- 172.21.15.114:0/2633678755 >> 172.21.15.114:0/2633678755 conn(0x558ab866ddf0 msgr2=0x558ab866be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- 172.21.15.114:0/2633678755 shutdown_connections 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- 172.21.15.114:0/2633678755 wait complete. 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 Processor -- start 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- start start 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8678fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2d1319980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x558ab8672c20 con 0x558ab8671ab0 2024-05-08T18:09:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8678fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8678fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44934/0 (socket says 172.21.15.114:44934) 2024-05-08T18:09:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.286+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 learned_addr learned my addr 172.21.15.114:0/3590660627 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab86794f0 con 0x558ab8671ab0 2024-05-08T18:09:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8678fb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40aa6f0 tx=0x7fa2c40e9100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa1b0ff9640 1 -- 172.21.15.114:0/3590660627 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40c9740 con 0x558ab8671ab0 2024-05-08T18:09:33.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ab8679780 con 0x558ab8671ab0 2024-05-08T18:09:33.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa1b0ff9640 1 -- 172.21.15.114:0/3590660627 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c40c98e0 con 0x558ab8671ab0 2024-05-08T18:09:33.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa1b0ff9640 1 -- 172.21.15.114:0/3590660627 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2c40aa910 con 0x558ab8671ab0 2024-05-08T18:09:33.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab867c460 con 0x558ab8671ab0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa1b0ff9640 1 -- 172.21.15.114:0/3590660627 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa2c40aaab0 con 0x558ab8671ab0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa1b0ff9640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa198038440 0x7fa19803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa1b0ff9640 1 -- 172.21.15.114:0/3590660627 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa2c40a8070 con 0x558ab8671ab0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa198038440 0x7fa19803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab8684280 0x558ab8686740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8686e90 con 0x558ab8684280 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab8684280 0x558ab8686740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab8684280 0x558ab8686740 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa198038440 0x7fa19803a900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x558ab8654e10 tx=0x7fa2c801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 20 realm 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.290+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86872a0 con 0x558ab8684280 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8687b70 con 0x558ab8684280 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8687f10 con 0x558ab8684280 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8688760 con 0x558ab8684280 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 20 searching for the correct realm 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ab868a1f0 0x558ab868c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ab868a1f0 0x558ab868c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ab868a1f0 0x558ab868c6b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2ce62c640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa2c40f8040 0x7fa2c4002000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa2c40f8040 0x7fa2c4002000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cf62e640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa2c40f8040 0x7fa2c4002000 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa2c0017050 0x7fa2c0045e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.294+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa2c0017050 0x7fa2c0045e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa2c0017050 0x7fa2c0045e60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.298+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.302+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab868a1f0 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c0017050 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x558ab8684280 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.306+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab868cd80 con 0x7fa2c40f8040 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:33.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8688fb0 con 0x558ab8684280 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8689350 con 0x558ab8684280 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab8689770 con 0x558ab8684280 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 zone default found 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 4 Realm: () 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 zonegroup default 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab868d200 con 0x7fa2c0017050 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab868ebe0 con 0x558ab868a1f0 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab868f120 con 0x558ab868a1f0 2024-05-08T18:09:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 started sync module instance, tier type = 2024-05-08T18:09:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:33.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab868e080 con 0x7fa2c40f8040 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054287729776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab868fa30 con 0x7fa2c40f8040 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.310+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8690280 con 0x558ab8684280 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.314+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054287729776] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.314+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.314+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054287734144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab868fe50 con 0x558ab8684280 2024-05-08T18:09:33.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.314+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8690970 con 0x558ab868a1f0 2024-05-08T18:09:33.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.314+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054287734144] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054287735200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab868fdc0 con 0x558ab868a1f0 2024-05-08T18:09:33.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86916e0 con 0x7fa2c40f8040 2024-05-08T18:09:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054287741456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8691f80 con 0x7fa2c40f8040 2024-05-08T18:09:33.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8692980 con 0x558ab8684280 2024-05-08T18:09:33.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054287735200] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054287741456] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054287740256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8691ad0 con 0x558ab8684280 2024-05-08T18:09:33.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.318+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8693220 con 0x7fa2c0017050 2024-05-08T18:09:33.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.322+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054287740256] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.322+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.322+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054287746192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8691ad0 con 0x7fa2c0017050 2024-05-08T18:09:33.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.322+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86936b0 con 0x7fa2c0017050 2024-05-08T18:09:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054287749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8693ad0 con 0x7fa2c0017050 2024-05-08T18:09:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86945b0 con 0x7fa2c0017050 2024-05-08T18:09:33.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054287746192] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054287749568] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054287750624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86940c0 con 0x7fa2c0017050 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=0 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=1 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=2 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=3 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=4 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=5 2024-05-08T18:09:33.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.326+0000 7fa2d1319980 20 add_watcher() i=6 2024-05-08T18:09:33.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054287750624] v32'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 20 add_watcher() i=7 2024-05-08T18:09:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86975a0 con 0x558ab8684280 2024-05-08T18:09:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054287753408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86949c0 con 0x558ab8684280 2024-05-08T18:09:33.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054287753408] v32'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa1857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:33.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:33.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.330+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869ff50 con 0x558ab8684280 2024-05-08T18:09:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.334+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.334+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a05a0 con 0x7fa2c0017050 2024-05-08T18:09:33.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.334+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.334+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a05a0 con 0x558ab868a1f0 2024-05-08T18:09:33.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.338+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.338+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a09c0 con 0x558ab8684280 2024-05-08T18:09:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.338+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.338+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869fa00 con 0x7fa2c40f8040 2024-05-08T18:09:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.338+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'65 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.338+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1120 con 0x558ab868a1f0 2024-05-08T18:09:33.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.342+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.342+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1120 con 0x558ab8684280 2024-05-08T18:09:33.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.342+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.342+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a11b0 con 0x7fa2c0017050 2024-05-08T18:09:33.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.346+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.346+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a11b0 con 0x7fa2c40f8040 2024-05-08T18:09:33.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.346+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.346+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1720 con 0x558ab868a1f0 2024-05-08T18:09:33.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.350+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.350+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1720 con 0x7fa2c40f8040 2024-05-08T18:09:33.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.350+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'66 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.350+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1c90 con 0x7fa2c0017050 2024-05-08T18:09:33.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.350+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.350+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1c90 con 0x7fa2c40f8040 2024-05-08T18:09:33.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.354+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.354+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c0017050 2024-05-08T18:09:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.354+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.358+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab8684280 2024-05-08T18:09:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.358+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.358+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.358+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.358+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c40f8040 2024-05-08T18:09:33.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.362+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.362+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.362+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.362+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab8684280 2024-05-08T18:09:33.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.366+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.366+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab8684280 2024-05-08T18:09:33.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.366+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.366+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.370+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.370+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c40f8040 2024-05-08T18:09:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.370+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.370+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.374+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.374+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.374+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.374+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.378+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.378+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.378+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.378+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c0017050 2024-05-08T18:09:33.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.382+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.382+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.382+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.382+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c0017050 2024-05-08T18:09:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.386+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.386+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x558ab868a1f0 2024-05-08T18:09:33.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.386+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.386+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c0017050 2024-05-08T18:09:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.390+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.390+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86a1e70 con 0x7fa2c40f8040 2024-05-08T18:09:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa0fffff640 20 reqs_thread_entry: start 2024-05-08T18:09:33.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:33.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 20 Filter name: none 2024-05-08T18:09:33.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:09:33.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa0fdffb640 20 reqs_thread_entry: start 2024-05-08T18:09:33.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86bd490 con 0x7fa2c40f8040 2024-05-08T18:09:33.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:09:33.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 : miss 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:95 8.b 8:d783709b:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86beee0 con 0x558ab868a1f0 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(95 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 info.flags=0x17 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 to cache LRU end 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 4.12 4:4a59ce92:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873c710 con 0x558ab8684280 2024-05-08T18:09:33.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(96 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.394+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:97 4.26 4:65cac1fd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873c710 con 0x7fa2c0017050 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(97 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 4.3e 4:7f688f62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873c710 con 0x7fa2c40f8040 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(98 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 4.20 4:056efd2a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873c710 con 0x558ab8684280 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(99 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 4.6 4:603c3e1e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873c710 con 0x558ab868a1f0 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(100 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 4.1f 4:fa6cf766:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873cbf0 con 0x558ab868a1f0 2024-05-08T18:09:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(101 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 4.19 4:9952c645:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873cbf0 con 0x558ab868a1f0 2024-05-08T18:09:33.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(102 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 [call out=425b] v0'0 uv8 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-08T18:09:33.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:103 4.19 4:9b69a3c8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873cbf0 con 0x558ab868a1f0 2024-05-08T18:09:33.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(103 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:104 4.21 4:865d634c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873cbf0 con 0x7fa2c0017050 2024-05-08T18:09:33.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.398+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(104 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 [call out=426b] v0'0 uv5 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T18:09:33.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:105 4.7 4:e2e9ad62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873cbf0 con 0x7fa2c0017050 2024-05-08T18:09:33.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(105 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:106 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873cbf0 con 0x7fa2c0017050 2024-05-08T18:09:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(106 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [call out=697b] v0'0 uv10 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-08T18:09:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:09:33.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:107 3.cs0 3:335b38dd:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab873a410 con 0x558ab868a1f0 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(107 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 10 manifest: total_size = 6 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.16913756579003078557 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 20 prepare_atomic_modification: state is not atomic. state=0x558ab86bfcb8 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 2024-05-08T18:09:33.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.402+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:108 4.3e 4:7f688f62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4730 con 0x7fa2c40f8040 2024-05-08T18:09:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.406+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(108 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.406+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:109 3.cs0 3:335b38dd:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4730 con 0x558ab868a1f0 2024-05-08T18:09:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.406+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(109 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.406+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:110 4.3e 4:7f688f62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c51c0 con 0x7fa2c40f8040 2024-05-08T18:09:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.406+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.406+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 3.38s0 3:1d8e21bc:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c51c0 con 0x7fa2c0017050 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(111 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 10 manifest: total_size = 3 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.2889349532529789368 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 20 prepare_atomic_modification: state is not atomic. state=0x558ab86bfcb8 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:112 4.19 4:9952c645:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c9ea0 con 0x558ab868a1f0 2024-05-08T18:09:33.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(110 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa1b27fc640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-08T18:09:33.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(112 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 [stat,call,call] v32'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.410+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:113 3.38s0 3:1d8e21bc:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c2650 con 0x7fa2c0017050 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(113 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:114 4.19 4:9952c645:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x558ab868a1f0 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:115 3.11s0 3:89c3f612:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x558ab868a1f0 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(115 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 10 manifest: total_size = 4 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.13028948645509922731 2024-05-08T18:09:33.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 20 prepare_atomic_modification: state is not atomic. state=0x558ab86bfcb8 2024-05-08T18:09:33.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 2024-05-08T18:09:33.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:116 4.21 4:865d634c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c0017050 2024-05-08T18:09:33.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(114 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 [stat,call,call] v32'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.414+0000 7fa1b1ffb640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-08T18:09:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(116 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:117 3.11s0 3:89c3f612:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c59b0 con 0x558ab868a1f0 2024-05-08T18:09:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(117 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:118 4.21 4:865d634c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c0017050 2024-05-08T18:09:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:119 3.2s0 3:4368fe82:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c1af0 con 0x558ab868a1f0 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(119 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 10 manifest: total_size = 5 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5787400294510562405 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 20 prepare_atomic_modification: state is not atomic. state=0x558ab86bfcb8 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 2024-05-08T18:09:33.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.418+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:120 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c0017050 2024-05-08T18:09:33.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(118 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa1b27fc640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T18:09:33.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(120 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:121 3.2s0 3:4368fe82:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c59b0 con 0x558ab868a1f0 2024-05-08T18:09:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(121 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:122 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c0017050 2024-05-08T18:09:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.422+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:123 3.1bs0 3:daa916a6:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x558ab868a1f0 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(123 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=910b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+926 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2d1319980 10 manifest: total_size = 5 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2d1319980 20 get_obj_state: setting s->obj_tag to _3Kd9Qf0MtmxPt6kFKRcyXrqW3F3mHQC 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2d1319980 20 get_obj_state: octx=0x7fa2c800a220 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558ab86bfcb8 s->prefetch_data=0 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2d1319980 20 prepare_atomic_modification: state is not atomic. state=0x558ab86bfcb8 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2d1319980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 2024-05-08T18:09:33.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:124 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c0017050 2024-05-08T18:09:33.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(122 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.426+0000 7fa1b1ffb640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-08T18:09:33.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(124 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:125 3.1bs0 3:daa916a6:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c59b0 con 0x558ab868a1f0 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== osd_op_reply(125 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:126 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c0017050 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 20 list_objects_ordered: starting attempt 1 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:127 4.12 4:4a59ce92:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x558ab8684280 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:128 4.26 4:65cac1fd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4250 con 0x7fa2c0017050 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:129 4.3e 4:7f688f62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4250 con 0x7fa2c40f8040 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:130 4.20 4:056efd2a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d0af0 con 0x558ab8684280 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:131 4.6 4:603c3e1e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d3540 con 0x558ab868a1f0 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:132 4.1f 4:fa6cf766:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d5ea0 con 0x558ab868a1f0 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:133 4.19 4:9952c645:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d8b20 con 0x558ab868a1f0 2024-05-08T18:09:33.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:134 4.19 4:9b69a3c8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86db550 con 0x558ab868a1f0 2024-05-08T18:09:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:135 4.21 4:865d634c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d8b20 con 0x7fa2c0017050 2024-05-08T18:09:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:136 4.7 4:e2e9ad62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86e0430 con 0x7fa2c0017050 2024-05-08T18:09:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:137 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86e2f70 con 0x7fa2c0017050 2024-05-08T18:09:33.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(129 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(127 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(131 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(132 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== osd_op_reply(133 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(130 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(128 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(134 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.430+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(135 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(136 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(126 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa1b1ffb640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-08T18:09:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(137 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [call out=124b] v0'0 uv14 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:09:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:09:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:09:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:09:33.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5])"; uploads.size()=0; is_truncated=0 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:138 4.12 4:4a59ce92:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d85d0 con 0x558ab8684280 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:139 4.26 4:65cac1fd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86bfad0 con 0x7fa2c0017050 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:140 4.3e 4:7f688f62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86dadb0 con 0x7fa2c40f8040 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:141 4.20 4:056efd2a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d85d0 con 0x558ab8684280 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:142 4.6 4:603c3e1e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86dda80 con 0x558ab868a1f0 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:143 4.1f 4:fa6cf766:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86bfad0 con 0x558ab868a1f0 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:144 4.19 4:9952c645:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86dadb0 con 0x558ab868a1f0 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:145 4.19 4:9b69a3c8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86e2e20 con 0x558ab868a1f0 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:146 4.21 4:865d634c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86d85d0 con 0x7fa2c0017050 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:147 4.7 4:e2e9ad62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c27c0 con 0x7fa2c0017050 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:148 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cd000 con 0x7fa2c0017050 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(138 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(141 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(143 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(142 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(144 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 [call out=124b] v0'0 uv10 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== osd_op_reply(145 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(140 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(139 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(146 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.434+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(147 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.438+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(148 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [call out=124b] v0'0 uv14 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.438+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cd000 con 0x7fa2c40f8040 2024-05-08T18:09:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.438+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.438+0000 7fa2d1319980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-08T18:09:33.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.438+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cd000 con 0x7fa2c40f8040 2024-05-08T18:09:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(150 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2d1319980 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:09:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2d1319980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:09:33.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94054288434560 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cd000 con 0x7fa2c0017050 2024-05-08T18:09:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== watch-notify(notify (1) cookie 94054287749568 notify 137438953486 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558ab86a1720 con 0x7fa2c0017050 2024-05-08T18:09:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa1b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94054287749568 notifier 4646 bl.length()=149 2024-05-08T18:09:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa1b27fc640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa194003d70 con 0x7fa2c0017050 2024-05-08T18:09:33.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(151 notify.6 [notify cookie 94054288434560 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== watch-notify(notify_complete (2) cookie 94054288434560 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ab869e730 con 0x7fa2c0017050 2024-05-08T18:09:33.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.442+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:153 8.b 8:d783709b:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cd000 con 0x558ab868a1f0 2024-05-08T18:09:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 49 ==== osd_op_reply(153 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 from cache 2024-05-08T18:09:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5, ofs0, ns] 2024-05-08T18:09:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94054287950416 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cd000 con 0x7fa2c40f8040 2024-05-08T18:09:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== watch-notify(notify (1) cookie 94054287729776 notify 137438953503 ret 0) ==== 248+0+0 (crc 0 0 0) 0x558ab86a0940 con 0x7fa2c40f8040 2024-05-08T18:09:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa1b1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94054287729776 notifier 4646 bl.length()=206 2024-05-08T18:09:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa1b1ffb640 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa104003330 con 0x7fa2c40f8040 2024-05-08T18:09:33.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(154 notify.0 [notify cookie 94054287950416 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== watch-notify(notify_complete (2) cookie 94054287950416 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558ab869f9a0 con 0x7fa2c40f8040 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:156 4.12 4:4a59ce92:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4250 con 0x558ab8684280 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:157 4.26 4:65cac1fd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86bf5a0 con 0x7fa2c0017050 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:158 4.3e 4:7f688f62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c5e60 con 0x7fa2c40f8040 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:159 4.20 4:056efd2a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869b340 con 0x558ab8684280 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:160 4.6 4:603c3e1e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86ca440 con 0x558ab868a1f0 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:161 4.1f 4:fa6cf766:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cad50 con 0x558ab868a1f0 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:162 4.19 4:9952c645:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c3110 con 0x558ab868a1f0 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:163 4.19 4:9b69a3c8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4250 con 0x558ab868a1f0 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:164 4.21 4:865d634c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86bdd30 con 0x7fa2c0017050 2024-05-08T18:09:33.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:165 4.7 4:e2e9ad62:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86ca440 con 0x7fa2c0017050 2024-05-08T18:09:33.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.446+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:166 4.7 4:e0da2653:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869b340 con 0x7fa2c0017050 2024-05-08T18:09:33.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(159 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.3 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(156 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.0 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(158 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.2 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 50 ==== osd_op_reply(160 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.4 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 51 ==== osd_op_reply(162 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.6 [delete] v32'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 52 ==== osd_op_reply(161 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 53 ==== osd_op_reply(163 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.7 [delete] v32'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 46 ==== osd_op_reply(157 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.1 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 47 ==== osd_op_reply(164 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.8 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 48 ==== osd_op_reply(165 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.9 [delete] v32'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 49 ==== osd_op_reply(166 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5.10 [delete] v32'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 : miss 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:167 6.1c 6:3c30a59b:::pubsub..bucket.myfoo%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab86cad50 con 0x558ab868a1f0 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 54 ==== osd_op_reply(167 pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 info.flags=0x0 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 10 adding default.rgw.log++pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 to cache LRU end 2024-05-08T18:09:33.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.450+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:168 6.1c 6:3c30a59b:::pubsub..bucket.myfoo%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4250 con 0x558ab868a1f0 2024-05-08T18:09:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.454+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 55 ==== osd_op_reply(168 pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.5 [delete] v32'31 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.454+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86c4250 con 0x7fa2c40f8040 2024-05-08T18:09:33.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.454+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(169 foo.buckets [call] v32'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa1857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054287753408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869e0e0 con 0x558ab8684280 2024-05-08T18:09:33.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94054287753408] v32'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054287729776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab86940c0 con 0x7fa2c40f8040 2024-05-08T18:09:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94054287729776] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2d1319980 20 remove_watcher() i=0 2024-05-08T18:09:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2d1319980 2 removed watcher, disabling cache 2024-05-08T18:09:33.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.458+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054287734144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869e0e0 con 0x558ab8684280 2024-05-08T18:09:33.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.462+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94054287734144] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.462+0000 7fa2d1319980 20 remove_watcher() i=1 2024-05-08T18:09:33.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.462+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054287735200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab868e470 con 0x558ab868a1f0 2024-05-08T18:09:33.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.462+0000 7fa2ce62c640 1 -- 172.21.15.114:0/3590660627 <== osd.3 v2:172.21.15.114:6808/3988457904 56 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94054287735200] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c40c8030 con 0x558ab868a1f0 2024-05-08T18:09:33.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.462+0000 7fa2d1319980 20 remove_watcher() i=2 2024-05-08T18:09:33.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.462+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054287741456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869e0e0 con 0x7fa2c40f8040 2024-05-08T18:09:33.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.466+0000 7fa2cf62e640 1 -- 172.21.15.114:0/3590660627 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94054287741456] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c801f070 con 0x7fa2c40f8040 2024-05-08T18:09:33.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.466+0000 7fa2d1319980 20 remove_watcher() i=3 2024-05-08T18:09:33.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.466+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054287740256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8691210 con 0x558ab8684280 2024-05-08T18:09:33.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.466+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94054287740256] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x558ab8684280 2024-05-08T18:09:33.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.466+0000 7fa2d1319980 20 remove_watcher() i=4 2024-05-08T18:09:33.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.466+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054287746192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab869e0e0 con 0x7fa2c0017050 2024-05-08T18:09:33.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.470+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 50 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94054287746192] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.470+0000 7fa2d1319980 20 remove_watcher() i=5 2024-05-08T18:09:33.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.470+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054287749568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8690d60 con 0x7fa2c0017050 2024-05-08T18:09:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.470+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 51 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94054287749568] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.470+0000 7fa2d1319980 20 remove_watcher() i=6 2024-05-08T18:09:33.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.470+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054287750624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab8691210 con 0x7fa2c0017050 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 <== osd.0 v2:172.21.15.53:6800/803213352 52 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94054287750624] v32'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2c0008030 con 0x7fa2c0017050 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 20 remove_watcher() i=7 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa2c0017050 msgr2=0x7fa2c0045e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fa2c0017050 0x7fa2c0045e60 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab8684280 msgr2=0x558ab8686740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab8684280 0x558ab8686740 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa2c40f8040 msgr2=0x7fa2c4002000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa2c40f8040 0x7fa2c4002000 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ab868a1f0 msgr2=0x558ab868c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x558ab868a1f0 0x558ab868c6b0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa198038440 msgr2=0x7fa19803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa198038440 0x7fa19803a900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x558ab8654e10 tx=0x7fa2c801f000 comp rx=0 tx=0).stop 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 msgr2=0x558ab8678fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/3590660627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab8671ab0 0x558ab8678fb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40aa6f0 tx=0x7fa2c40e9100 comp rx=0 tx=0).stop 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 reap_dead start 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2cee2d640 1 -- 172.21.15.114:0/3590660627 reap_dead start 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 shutdown_connections 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 >> 172.21.15.114:0/3590660627 conn(0x558ab866ddf0 msgr2=0x558ab866b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 shutdown_connections 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/3590660627 wait complete. 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1a80383f0 msgr2=0x7fa1a803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1a80383f0 0x7fa1a803a8b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x558ab8655690 tx=0x7fa2c8005850 comp rx=0 tx=0).stop 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 msgr2=0x558ab8664df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 0x558ab8664df0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400a480 tx=0x7fa2c4018020 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 shutdown_connections 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1a80383f0 0x7fa1a803a8b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/2513516092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab86649d0 0x558ab8664df0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 >> 172.21.15.114:0/2513516092 conn(0x558ab86597e0 msgr2=0x558ab865a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 shutdown_connections 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/2513516092 wait complete. 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab84ccf30 msgr2=0x558ab8653d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab84ccf30 0x558ab8653d80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1b4038440 msgr2=0x7fa1b403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1b4038440 0x7fa1b403a900 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40ad000 tx=0x7fa2c40a5040 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 msgr2=0x558ab864cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.474+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab864cc80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa2c0000c10 tx=0x7fa2c0000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 shutdown_connections 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x558ab84ccf30 0x558ab8653d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1b4038440 0x7fa1b403a900 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 --2- 172.21.15.114:0/779893114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ab84caa80 0x558ab864cc80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 >> 172.21.15.114:0/779893114 conn(0x558ab84c97e0 msgr2=0x558ab863fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 shutdown_connections 2024-05-08T18:09:33.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.478+0000 7fa2d1319980 1 -- 172.21.15.114:0/779893114 wait complete. 2024-05-08T18:09:33.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:09:33.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:09:33.491 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-08T18:09:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:33.573 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.570+0000 7f0da84fc980 1 Processor -- start 2024-05-08T18:09:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.570+0000 7f0da84fc980 1 -- start start 2024-05-08T18:09:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.570+0000 7f0da84fc980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555776440100 0x5557764404e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.570+0000 7f0da84fc980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557762e9710 con 0x555776440a20 2024-05-08T18:09:33.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.570+0000 7f0da84fc980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5557762fdf00 con 0x555776440100 2024-05-08T18:09:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da6010640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555776440100 0x5557764404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da6010640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555776440100 0x5557764404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44950/0 (socket says 172.21.15.114:44950) 2024-05-08T18:09:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da6010640 1 -- 172.21.15.114:0/1416672114 learned_addr learned my addr 172.21.15.114:0/1416672114 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da580f640 1 --1- 172.21.15.114:0/1416672114 >> v1:172.21.15.53:6789/0 conn(0x555776440a20 0x555776441390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55304/0 (socket says 172.21.15.114:55304) 2024-05-08T18:09:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da6010640 1 -- 172.21.15.114:0/1416672114 >> v1:172.21.15.53:6789/0 conn(0x555776440a20 legacy=0x555776441390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da6010640 1 -- 172.21.15.114:0/1416672114 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557762c5ae0 con 0x555776440100 2024-05-08T18:09:33.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da6010640 1 --2- 172.21.15.114:0/1416672114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x5557764404e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800a4e0 tx=0x7f0d9801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804c507aa340420e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da500e640 1 -- 172.21.15.114:0/1416672114 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980aa540 con 0x555776440100 2024-05-08T18:09:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da500e640 1 -- 172.21.15.114:0/1416672114 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980aa6e0 con 0x555776440100 2024-05-08T18:09:33.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da500e640 1 -- 172.21.15.114:0/1416672114 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980aaa40 con 0x555776440100 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da84fc980 1 -- 172.21.15.114:0/1416672114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 msgr2=0x5557764404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da84fc980 1 --2- 172.21.15.114:0/1416672114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x5557764404e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0d9800a4e0 tx=0x7f0d9801b090 comp rx=0 tx=0).stop 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da84fc980 1 -- 172.21.15.114:0/1416672114 shutdown_connections 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da84fc980 1 --2- 172.21.15.114:0/1416672114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x5557764404e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.574+0000 7f0da84fc980 1 -- 172.21.15.114:0/1416672114 >> 172.21.15.114:0/1416672114 conn(0x5557763b37e0 msgr2=0x5557763b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.578+0000 7f0da84fc980 1 -- 172.21.15.114:0/1416672114 shutdown_connections 2024-05-08T18:09:33.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.578+0000 7f0da84fc980 1 -- 172.21.15.114:0/1416672114 wait complete. 2024-05-08T18:09:33.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.590+0000 7f0da84fc980 1 Processor -- start 2024-05-08T18:09:33.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.590+0000 7f0da84fc980 1 -- start start 2024-05-08T18:09:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.590+0000 7f0da84fc980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x55577652b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.590+0000 7f0da84fc980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555776341f80 con 0x555776440100 2024-05-08T18:09:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x55577652b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x55577652b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44958/0 (socket says 172.21.15.114:44958) 2024-05-08T18:09:33.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 -- 172.21.15.114:0/1502664152 learned_addr learned my addr 172.21.15.114:0/1502664152 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 -- 172.21.15.114:0/1502664152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555776309da0 con 0x555776440100 2024-05-08T18:09:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 --2- 172.21.15.114:0/1502664152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x55577652b870 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0d98017ca0 tx=0x7f0d980033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f35bee6463aecdc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0c94608640 1 -- 172.21.15.114:0/1502664152 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980b9070 con 0x555776440100 2024-05-08T18:09:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0c94608640 1 -- 172.21.15.114:0/1502664152 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980aaa80 con 0x555776440100 2024-05-08T18:09:33.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0c94608640 1 -- 172.21.15.114:0/1502664152 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980aad60 con 0x555776440100 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- 172.21.15.114:0/1502664152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 msgr2=0x55577652b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 --2- 172.21.15.114:0/1502664152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x55577652b870 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f0d98017ca0 tx=0x7f0d980033b0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- 172.21.15.114:0/1502664152 shutdown_connections 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 --2- 172.21.15.114:0/1502664152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x55577652b870 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- 172.21.15.114:0/1502664152 >> 172.21.15.114:0/1502664152 conn(0x5557763b37e0 msgr2=0x555776527400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- 172.21.15.114:0/1502664152 shutdown_connections 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- 172.21.15.114:0/1502664152 wait complete. 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 Processor -- start 2024-05-08T18:09:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- start start 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x555776532bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da84fc980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55577644a100 con 0x555776440100 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x555776532bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x555776532bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44972/0 (socket says 172.21.15.114:44972) 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 -- 172.21.15.114:0/3126887414 learned_addr learned my addr 172.21.15.114:0/3126887414 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.594+0000 7f0da6010640 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557765330f0 con 0x555776440100 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da6010640 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x555776532bb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0d98017ca0 tx=0x7f0d98017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0c92e05640 1 -- 172.21.15.114:0/3126887414 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980b9070 con 0x555776440100 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555776533380 con 0x555776440100 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0c92e05640 1 -- 172.21.15.114:0/3126887414 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d980c7410 con 0x555776440100 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0c92e05640 1 -- 172.21.15.114:0/3126887414 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d980c7730 con 0x555776440100 2024-05-08T18:09:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555776535fc0 con 0x555776440100 2024-05-08T18:09:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0c92e05640 1 -- 172.21.15.114:0/3126887414 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0d980b3040 con 0x555776440100 2024-05-08T18:09:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0c92e05640 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c8c0383f0 0x7f0c8c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0c92e05640 1 -- 172.21.15.114:0/3126887414 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0d980c4070 con 0x555776440100 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da580f640 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c8c0383f0 0x7f0c8c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555776440a20 0x555776539c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577653a190 con 0x555776440a20 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da6811640 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555776440a20 0x555776539c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da580f640 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c8c0383f0 0x7f0c8c03a8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d90001e90 tx=0x7f0d900013f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da6811640 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555776440a20 0x555776539c10 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da6811640 1 -- 172.21.15.114:0/3126887414 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0da00083f0 con 0x555776440a20 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557765371c0 con 0x555776440a20 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da6811640 1 -- 172.21.15.114:0/3126887414 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0da00083f0 con 0x555776440a20 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577653bfe0 con 0x555776440a20 2024-05-08T18:09:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da6811640 1 -- 172.21.15.114:0/3126887414 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0da00083f0 con 0x555776440a20 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.598+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577653b150 con 0x555776440a20 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da6811640 1 -- 172.21.15.114:0/3126887414 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0da00083f0 con 0x555776440a20 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577653b570 con 0x555776440a20 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da6811640 1 -- 172.21.15.114:0/3126887414 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0da00083f0 con 0x555776440a20 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 Processor -- start 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 -- start start 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 0x55577654ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555776345fc0 con 0x55577654a930 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da580f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 0x55577654ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da580f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 0x55577654ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44974/0 (socket says 172.21.15.114:44974) 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da580f640 1 -- 172.21.15.114:0/2274310687 learned_addr learned my addr 172.21.15.114:0/2274310687 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da580f640 1 -- 172.21.15.114:0/2274310687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577654b290 con 0x55577654a930 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da580f640 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 0x55577654ad50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e670 tx=0x7f0d9000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0c8bfff640 1 -- 172.21.15.114:0/2274310687 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d90022070 con 0x55577654a930 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0c8bfff640 1 -- 172.21.15.114:0/2274310687 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9000d660 con 0x55577654a930 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55577654bd30 con 0x55577654a930 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0c8bfff640 1 -- 172.21.15.114:0/2274310687 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d90006070 con 0x55577654a930 2024-05-08T18:09:33.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.602+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577654c200 con 0x55577654a930 2024-05-08T18:09:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0c8bfff640 1 -- 172.21.15.114:0/2274310687 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0d90025070 con 0x55577654a930 2024-05-08T18:09:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0c8bfff640 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c80038440 0x7f0c8003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0c8bfff640 1 -- 172.21.15.114:0/2274310687 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0d90050250 con 0x55577654a930 2024-05-08T18:09:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da6811640 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c80038440 0x7f0c8003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 Processor -- start 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 -- start start 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x555776557ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55577652bf00 con 0x555776557b00 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da6811640 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c80038440 0x7f0c8003a900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55577653b4f0 tx=0x7f0da0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da580f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x555776557ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da580f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x555776557ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44978/0 (socket says 172.21.15.114:44978) 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da580f640 1 -- 172.21.15.114:0/4103909381 learned_addr learned my addr 172.21.15.114:0/4103909381 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da580f640 1 -- 172.21.15.114:0/4103909381 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557765584b0 con 0x555776557b00 2024-05-08T18:09:33.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da580f640 1 --2- 172.21.15.114:0/4103909381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x555776557ee0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0d90026fd0 tx=0x7f0d9000df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b0d8d6321578d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0c89ffb640 1 -- 172.21.15.114:0/4103909381 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d9001bda0 con 0x555776557b00 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0c89ffb640 1 -- 172.21.15.114:0/4103909381 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d900263b0 con 0x555776557b00 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0c89ffb640 1 -- 172.21.15.114:0/4103909381 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d900242c0 con 0x555776557b00 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 -- 172.21.15.114:0/4103909381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 msgr2=0x555776557ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 --2- 172.21.15.114:0/4103909381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x555776557ee0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0d90026fd0 tx=0x7f0d9000df30 comp rx=0 tx=0).stop 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 -- 172.21.15.114:0/4103909381 shutdown_connections 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 --2- 172.21.15.114:0/4103909381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x555776557ee0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.606+0000 7f0da84fc980 1 -- 172.21.15.114:0/4103909381 >> 172.21.15.114:0/4103909381 conn(0x555776553e40 msgr2=0x555776551ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- 172.21.15.114:0/4103909381 shutdown_connections 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- 172.21.15.114:0/4103909381 wait complete. 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 Processor -- start 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- start start 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x55577655efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555776558bb0 con 0x555776557b00 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da580f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x55577655efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da580f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x55577655efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:44988/0 (socket says 172.21.15.114:44988) 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 learned_addr learned my addr 172.21.15.114:0/96382923 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577655f520 con 0x555776557b00 2024-05-08T18:09:33.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da580f640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x55577655efe0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0d9001e040 tx=0x7f0d9000ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0c77fff640 1 -- 172.21.15.114:0/96382923 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d9001a320 con 0x555776557b00 2024-05-08T18:09:33.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0c77fff640 1 -- 172.21.15.114:0/96382923 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d90026ae0 con 0x555776557b00 2024-05-08T18:09:33.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55577655f520 con 0x555776557b00 2024-05-08T18:09:33.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0c77fff640 1 -- 172.21.15.114:0/96382923 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d9003ebb0 con 0x555776557b00 2024-05-08T18:09:33.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577655f520 con 0x555776557b00 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0c77fff640 1 -- 172.21.15.114:0/96382923 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0d9004e8e0 con 0x555776557b00 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0c77fff640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c70038440 0x7f0c7003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0c77fff640 1 -- 172.21.15.114:0/96382923 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0d9001f080 con 0x555776557b00 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da6811640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c70038440 0x7f0c7003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55577656a100 0x55577656c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.610+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656cd10 con 0x55577656a100 2024-05-08T18:09:33.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55577656a100 0x55577656c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6811640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c70038440 0x7f0c7003a900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55577653ac70 tx=0x7f0da001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55577656a100 0x55577656c5c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 realm 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656d120 con 0x55577656a100 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656d9f0 con 0x55577656a100 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656dd90 con 0x55577656a100 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656e5e0 con 0x55577656a100 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:33.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 20 searching for the correct realm 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555776570350 0x555776572740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da580f640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555776570350 0x555776572740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da580f640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555776570350 0x555776572740 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da580f640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0d90031070 0x7f0d9003e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6811640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0d90031070 0x7f0d9003e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6811640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0d90031070 0x7f0d9003e390 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.614+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0d980c6700 0x7f0d980e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0d980c6700 0x7f0d980e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0d980c6700 0x7f0d980e7a80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x7f0d980c6700 2024-05-08T18:09:33.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x7f0d980c6700 2024-05-08T18:09:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.618+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x7f0d980c6700 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.622+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980cd060 con 0x7f0d980c6700 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d980cd060 con 0x55577656a100 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x555776570350 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d980c6700 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.626+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x55577656a100 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555776572c80 con 0x7f0d90031070 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656ef30 con 0x55577656a100 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656eb70 con 0x55577656a100 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577656f800 con 0x55577656a100 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 zone default found 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 4 Realm: () 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:33.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 zonegroup default 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557765730b0 con 0x7f0d980c6700 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555776574a90 con 0x555776570350 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555776574f90 con 0x555776570350 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 started sync module instance, tier type = 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.630+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776573f30 con 0x7f0d90031070 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834135946016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765758a0 con 0x7f0d90031070 2024-05-08T18:09:33.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765760f0 con 0x55577656a100 2024-05-08T18:09:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834135946016] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834135950320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776575cc0 con 0x55577656a100 2024-05-08T18:09:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.634+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776576730 con 0x555776570350 2024-05-08T18:09:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834135950320] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834135951376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776575c30 con 0x555776570350 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765774e0 con 0x7f0d90031070 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834135957456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776577db0 con 0x7f0d90031070 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765787b0 con 0x55577656a100 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834135951376] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.638+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834135957456] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834135956256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776577900 con 0x55577656a100 2024-05-08T18:09:33.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776579050 con 0x7f0d980c6700 2024-05-08T18:09:33.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834135956256] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834135962304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776577900 con 0x7f0d980c6700 2024-05-08T18:09:33.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.642+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776579530 con 0x7f0d980c6700 2024-05-08T18:09:33.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834135962304] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834135964144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765794f0 con 0x7f0d980c6700 2024-05-08T18:09:33.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776579f10 con 0x7f0d980c6700 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834135964144] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834135968256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55577657a0f0 con 0x7f0d980c6700 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=0 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=1 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=2 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=3 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=4 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=5 2024-05-08T18:09:33.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.646+0000 7f0da84fc980 20 add_watcher() i=6 2024-05-08T18:09:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834135968256] v32'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 20 add_watcher() i=7 2024-05-08T18:09:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55577657d4c0 con 0x55577656a100 2024-05-08T18:09:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834135969760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55577657a8b0 con 0x55577656a100 2024-05-08T18:09:33.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834135969760] v32'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0c5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 5 note: GC not initialized 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0bd77fe640 20 reqs_thread_entry: start 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.650+0000 7f0da84fc980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 20 Filter name: none 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0bd57fa640 20 reqs_thread_entry: start 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557765a0de0 con 0x55577656a100 2024-05-08T18:09:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:33.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765a6f80 con 0x55577656a100 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v32'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93834136152592 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557765a2860 con 0x55577656a100 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 93834135956256 notify 137438953488 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f0d980e6040 con 0x55577656a100 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0c89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 93834135956256 notifier 4653 bl.length()=579 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0c89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0c89ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0c89ffb640 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0c6c003eb0 con 0x55577656a100 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 93834136152592 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.654+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 93834136152592 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555776535fc0 con 0x55577656a100 2024-05-08T18:09:33.659 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:33.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0c5cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834135969760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55577659eb10 con 0x55577656a100 2024-05-08T18:09:33.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93834135969760] v32'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834135946016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55577659eb10 con 0x7f0d90031070 2024-05-08T18:09:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93834135946016] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da84fc980 20 remove_watcher() i=0 2024-05-08T18:09:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da84fc980 2 removed watcher, disabling cache 2024-05-08T18:09:33.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.658+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834135950320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55577659eb10 con 0x55577656a100 2024-05-08T18:09:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93834135950320] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da84fc980 20 remove_watcher() i=1 2024-05-08T18:09:33.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834135951376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55577659eb10 con 0x555776570350 2024-05-08T18:09:33.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da580f640 1 -- 172.21.15.114:0/96382923 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93834135951376] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d90024030 con 0x555776570350 2024-05-08T18:09:33.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da84fc980 20 remove_watcher() i=2 2024-05-08T18:09:33.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834135957456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776574320 con 0x7f0d90031070 2024-05-08T18:09:33.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da6811640 1 -- 172.21.15.114:0/96382923 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93834135957456] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0da002f040 con 0x7f0d90031070 2024-05-08T18:09:33.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da84fc980 20 remove_watcher() i=3 2024-05-08T18:09:33.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.662+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834135956256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776574320 con 0x55577656a100 2024-05-08T18:09:33.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.666+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93834135956256] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x55577656a100 2024-05-08T18:09:33.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.666+0000 7f0da84fc980 20 remove_watcher() i=4 2024-05-08T18:09:33.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.666+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834135962304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776574320 con 0x7f0d980c6700 2024-05-08T18:09:33.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.666+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93834135962304] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.666+0000 7f0da84fc980 20 remove_watcher() i=5 2024-05-08T18:09:33.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.666+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834135964144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557765782c0 con 0x7f0d980c6700 2024-05-08T18:09:33.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.670+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93834135964144] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.670+0000 7f0da84fc980 20 remove_watcher() i=6 2024-05-08T18:09:33.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.670+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834135968256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555776574320 con 0x7f0d980c6700 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93834135968256] v32'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d980f9040 con 0x7f0d980c6700 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 20 remove_watcher() i=7 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0d980c6700 msgr2=0x7f0d980e7a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0d980c6700 0x7f0d980e7a80 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55577656a100 msgr2=0x55577656c5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55577656a100 0x55577656c5c0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0d90031070 msgr2=0x7f0d9003e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0d90031070 0x7f0d9003e390 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555776570350 msgr2=0x555776572740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555776570350 0x555776572740 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c70038440 msgr2=0x7f0c7003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c70038440 0x7f0c7003a900 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55577653ac70 tx=0x7f0da001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 msgr2=0x55577655efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x55577655efe0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0d9001e040 tx=0x7f0d9000ff50 comp rx=0 tx=0).stop 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da6010640 1 -- 172.21.15.114:0/96382923 reap_dead start 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 shutdown_connections 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/96382923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776557b00 0x55577655efe0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 >> 172.21.15.114:0/96382923 conn(0x555776553e40 msgr2=0x5557765514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 shutdown_connections 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/96382923 wait complete. 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c80038440 msgr2=0x7f0c8003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c80038440 0x7f0c8003a900 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55577653b4f0 tx=0x7f0da0003070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 msgr2=0x55577654ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 0x55577654ad50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f0d9000e670 tx=0x7f0d9000ea70 comp rx=0 tx=0).stop 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 shutdown_connections 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c80038440 0x7f0c8003a900 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/2274310687 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55577654a930 0x55577654ad50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 >> 172.21.15.114:0/2274310687 conn(0x55577653f740 msgr2=0x555776540250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 shutdown_connections 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/2274310687 wait complete. 2024-05-08T18:09:33.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555776440a20 msgr2=0x555776539c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555776440a20 0x555776539c10 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c8c0383f0 msgr2=0x7f0c8c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c8c0383f0 0x7f0c8c03a8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d90001e90 tx=0x7f0d900013f0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 msgr2=0x555776532bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x555776532bb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f0d98017ca0 tx=0x7f0d98017e30 comp rx=0 tx=0).stop 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 shutdown_connections 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555776440a20 0x555776539c10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0c8c0383f0 0x7f0c8c03a8b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 --2- 172.21.15.114:0/3126887414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555776440100 0x555776532bb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 >> 172.21.15.114:0/3126887414 conn(0x5557763b37e0 msgr2=0x555776525f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 shutdown_connections 2024-05-08T18:09:33.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.674+0000 7f0da84fc980 1 -- 172.21.15.114:0/3126887414 wait complete. 2024-05-08T18:09:33.687 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:33.687 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:09:33.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T18:09:33.687 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f596b3980 1 Processor -- start 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f596b3980 1 -- start start 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f596b3980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56383a6c4330 0x56383a6c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f596b3980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56383a56c710 con 0x56383a6bfdd0 2024-05-08T18:09:33.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f596b3980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56383a580f00 con 0x56383a6c4330 2024-05-08T18:09:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f569c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56383a6c4330 0x56383a6c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f569c6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56383a6c4330 0x56383a6c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45004/0 (socket says 172.21.15.114:45004) 2024-05-08T18:09:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f569c6640 1 -- 172.21.15.114:0/532362349 learned_addr learned my addr 172.21.15.114:0/532362349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f569c6640 1 -- 172.21.15.114:0/532362349 >> v1:172.21.15.53:6789/0 conn(0x56383a6bfdd0 legacy=0x56383a6c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.762+0000 7f5f569c6640 1 -- 172.21.15.114:0/532362349 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a548ae0 con 0x56383a6c4330 2024-05-08T18:09:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f569c6640 1 --2- 172.21.15.114:0/532362349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6c4330 0x56383a6c6720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000a7a0 tx=0x7f5f4001d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfb4d49f93194c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f561c5640 1 -- 172.21.15.114:0/532362349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400b3070 con 0x56383a6c4330 2024-05-08T18:09:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f561c5640 1 -- 172.21.15.114:0/532362349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f400a6720 con 0x56383a6c4330 2024-05-08T18:09:33.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f561c5640 1 -- 172.21.15.114:0/532362349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400a6a20 con 0x56383a6c4330 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 -- 172.21.15.114:0/532362349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6c4330 msgr2=0x56383a6c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 --2- 172.21.15.114:0/532362349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6c4330 0x56383a6c6720 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5f4000a7a0 tx=0x7f5f4001d800 comp rx=0 tx=0).stop 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 -- 172.21.15.114:0/532362349 shutdown_connections 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 --2- 172.21.15.114:0/532362349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6c4330 0x56383a6c6720 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 -- 172.21.15.114:0/532362349 >> 172.21.15.114:0/532362349 conn(0x56383a6bb6a0 msgr2=0x56383a6bdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 -- 172.21.15.114:0/532362349 shutdown_connections 2024-05-08T18:09:33.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.766+0000 7f5f596b3980 1 -- 172.21.15.114:0/532362349 wait complete. 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f596b3980 1 Processor -- start 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f596b3980 1 -- start start 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f596b3980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f596b3980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56383a5c4f80 con 0x56383a6bfdd0 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f571c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f571c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45020/0 (socket says 172.21.15.114:45020) 2024-05-08T18:09:33.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f571c7640 1 -- 172.21.15.114:0/3140959222 learned_addr learned my addr 172.21.15.114:0/3140959222 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f571c7640 1 -- 172.21.15.114:0/3140959222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a58cda0 con 0x56383a6bfdd0 2024-05-08T18:09:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5f571c7640 1 --2- 172.21.15.114:0/3140959222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7a9ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b2d0 tx=0x7f5f4800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3add87c66468d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5e4560a640 1 -- 172.21.15.114:0/3140959222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4800a040 con 0x56383a6bfdd0 2024-05-08T18:09:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5e4560a640 1 -- 172.21.15.114:0/3140959222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4800f750 con 0x56383a6bfdd0 2024-05-08T18:09:33.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.782+0000 7f5e4560a640 1 -- 172.21.15.114:0/3140959222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4800fa70 con 0x56383a6bfdd0 2024-05-08T18:09:33.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/3140959222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 msgr2=0x56383a7a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 --2- 172.21.15.114:0/3140959222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7a9ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b2d0 tx=0x7f5f4800b790 comp rx=0 tx=0).stop 2024-05-08T18:09:33.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/3140959222 shutdown_connections 2024-05-08T18:09:33.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 --2- 172.21.15.114:0/3140959222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7a9ed0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/3140959222 >> 172.21.15.114:0/3140959222 conn(0x56383a6bb6a0 msgr2=0x56383a7a5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/3140959222 shutdown_connections 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/3140959222 wait complete. 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 Processor -- start 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- start start 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56383a6356c0 con 0x56383a6bfdd0 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f571c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f571c7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45030/0 (socket says 172.21.15.114:45030) 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f571c7640 1 -- 172.21.15.114:0/1447307203 learned_addr learned my addr 172.21.15.114:0/1447307203 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f571c7640 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a7b1870 con 0x56383a6bfdd0 2024-05-08T18:09:33.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f571c7640 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7b1330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b7d0 tx=0x7f5f48000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5e43e07640 1 -- 172.21.15.114:0/1447307203 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4801ca40 con 0x56383a6bfdd0 2024-05-08T18:09:33.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56383a7b1b00 con 0x56383a6bfdd0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5e43e07640 1 -- 172.21.15.114:0/1447307203 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f4801cc00 con 0x56383a6bfdd0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5e43e07640 1 -- 172.21.15.114:0/1447307203 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f4801a480 con 0x56383a6bfdd0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.786+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383a7b4790 con 0x56383a6bfdd0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5e43e07640 1 -- 172.21.15.114:0/1447307203 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5f48017050 con 0x56383a6bfdd0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5e43e07640 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e3c0383f0 0x7f5e3c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5e43e07640 1 -- 172.21.15.114:0/1447307203 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5f48015020 con 0x56383a6bfdd0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f569c6640 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e3c0383f0 0x7f5e3c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a6c4330 0x56383a7b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7b8920 con 0x56383a6c4330 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a6c4330 0x56383a7b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f569c6640 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e3c0383f0 0x7f5e3c03a8b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b0000 tx=0x7f5f400a8070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a6c4330 0x56383a7b83e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 -- 172.21.15.114:0/1447307203 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f500083f0 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7b59b0 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 -- 172.21.15.114:0/1447307203 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f500083f0 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7ba790 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 -- 172.21.15.114:0/1447307203 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f500083f0 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7b99c0 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 -- 172.21.15.114:0/1447307203 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f500083f0 con 0x56383a6c4330 2024-05-08T18:09:33.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7b9de0 con 0x56383a6c4330 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f579c8640 1 -- 172.21.15.114:0/1447307203 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f500083f0 con 0x56383a6c4330 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 Processor -- start 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- start start 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 0x56383a7c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f596b3980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56383a5c8fc0 con 0x56383a7c9110 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f569c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 0x56383a7c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f569c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 0x56383a7c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45040/0 (socket says 172.21.15.114:45040) 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.790+0000 7f5f569c6640 1 -- 172.21.15.114:0/4041465749 learned_addr learned my addr 172.21.15.114:0/4041465749 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f569c6640 1 -- 172.21.15.114:0/4041465749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a7c9a70 con 0x56383a7c9110 2024-05-08T18:09:33.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f569c6640 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 0x56383a7c9530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5f4001b430 tx=0x7f5f4001a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5e41602640 1 -- 172.21.15.114:0/4041465749 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400ae440 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5e41602640 1 -- 172.21.15.114:0/4041465749 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f400b4040 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56383a7ca510 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5e41602640 1 -- 172.21.15.114:0/4041465749 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400ae710 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383a7ca920 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5e41602640 1 -- 172.21.15.114:0/4041465749 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5f400cd060 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5e41602640 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038440 0x7f5e3003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5e41602640 1 -- 172.21.15.114:0/4041465749 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5f400c1030 con 0x56383a7c9110 2024-05-08T18:09:33.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f579c8640 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038440 0x7f5e3003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f596b3980 1 Processor -- start 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f596b3980 1 -- start start 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f579c8640 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038440 0x7f5e3003a900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56383a7b9d60 tx=0x7f5f50003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f596b3980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7daa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f596b3980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56383a7aa620 con 0x56383a7da5f0 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f569c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7daa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f569c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7daa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45050/0 (socket says 172.21.15.114:45050) 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.794+0000 7f5f569c6640 1 -- 172.21.15.114:0/2890668515 learned_addr learned my addr 172.21.15.114:0/2890668515 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 -- 172.21.15.114:0/2890668515 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a7dafe0 con 0x56383a7da5f0 2024-05-08T18:09:33.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 --2- 172.21.15.114:0/2890668515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7daa10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f400eb8c0 tx=0x7f5f400ce960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715d4fb284c31da0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5e3affd640 1 -- 172.21.15.114:0/2890668515 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400df070 con 0x56383a7da5f0 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5e3affd640 1 -- 172.21.15.114:0/2890668515 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f400c5c70 con 0x56383a7da5f0 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5e3affd640 1 -- 172.21.15.114:0/2890668515 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400cf7d0 con 0x56383a7da5f0 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- 172.21.15.114:0/2890668515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 msgr2=0x56383a7daa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 --2- 172.21.15.114:0/2890668515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7daa10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f400eb8c0 tx=0x7f5f400ce960 comp rx=0 tx=0).stop 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- 172.21.15.114:0/2890668515 shutdown_connections 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 --2- 172.21.15.114:0/2890668515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7daa10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- 172.21.15.114:0/2890668515 >> 172.21.15.114:0/2890668515 conn(0x56383a7d2570 msgr2=0x56383a7d05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- 172.21.15.114:0/2890668515 shutdown_connections 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- 172.21.15.114:0/2890668515 wait complete. 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 Processor -- start 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- start start 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f596b3980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56383a7db730 con 0x56383a7da5f0 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7e1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45064/0 (socket says 172.21.15.114:45064) 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 learned_addr learned my addr 172.21.15.114:0/743836764 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383a7e20a0 con 0x56383a7da5f0 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5f569c6640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7e1b60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5f400ce9a0 tx=0x7f5f400eb820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.798+0000 7f5e397fa640 1 -- 172.21.15.114:0/743836764 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400ea030 con 0x56383a7da5f0 2024-05-08T18:09:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56383a7e2330 con 0x56383a7da5f0 2024-05-08T18:09:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5e397fa640 1 -- 172.21.15.114:0/743836764 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f400ace20 con 0x56383a7da5f0 2024-05-08T18:09:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5e397fa640 1 -- 172.21.15.114:0/743836764 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f400df040 con 0x56383a7da5f0 2024-05-08T18:09:33.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383a7e5010 con 0x56383a7da5f0 2024-05-08T18:09:33.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5e397fa640 1 -- 172.21.15.114:0/743836764 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5f400eb270 con 0x56383a7da5f0 2024-05-08T18:09:33.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5e397fa640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e200383f0 0x7f5e2003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5e397fa640 1 -- 172.21.15.114:0/743836764 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5f400eb070 con 0x56383a7da5f0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f579c8640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e200383f0 0x7f5e2003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a7ed0a0 0x56383a7ef530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7efc80 con 0x56383a7ed0a0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a7ed0a0 0x56383a7ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f579c8640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e200383f0 0x7f5e2003a8b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000f010 tx=0x7f5f5001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a7ed0a0 0x56383a7ef530 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 realm 2024-05-08T18:09:33.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f0090 con 0x56383a7ed0a0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f0960 con 0x56383a7ed0a0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f0d00 con 0x56383a7ed0a0 2024-05-08T18:09:33.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f1550 con 0x56383a7ed0a0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 20 searching for the correct realm 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56383a7f32c0 0x56383a7f56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.802+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f569c6640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56383a7f32c0 0x56383a7f56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f569c6640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56383a7f32c0 0x56383a7f56b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f569c6640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f400cf070 0x7f5f400af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f579c8640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f400cf070 0x7f5f400af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f579c8640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f400cf070 0x7f5f400af9e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f4801d450 0x7f5f4801a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f4801d450 0x7f5f4801a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.806+0000 7f5f571c7640 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f4801d450 0x7f5f4801a620 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.810+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.814+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7f32c0 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f4801d450 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x56383a7ed0a0 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f5bf0 con 0x7f5f400cf070 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f1ea0 con 0x56383a7ed0a0 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f26f0 con 0x56383a7ed0a0 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f1ae0 con 0x56383a7ed0a0 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 zone default found 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 4 Realm: () 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:33.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 zonegroup default 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.818+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f6020 con 0x7f5f4801d450 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f7a30 con 0x56383a7f32c0 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f7f20 con 0x56383a7f32c0 2024-05-08T18:09:33.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 started sync module instance, tier type = 2024-05-08T18:09:33.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:33.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f6ea0 con 0x7f5f400cf070 2024-05-08T18:09:33.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799499588240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f6b00 con 0x7f5f400cf070 2024-05-08T18:09:33.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f8d40 con 0x56383a7ed0a0 2024-05-08T18:09:33.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.822+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94799499588240] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799499592576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f8d00 con 0x56383a7ed0a0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f9750 con 0x56383a7f32c0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94799499592576] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799499596448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f9b40 con 0x56383a7f32c0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fa500 con 0x7f5f400cf070 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799499600224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fac10 con 0x7f5f400cf070 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.826+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fb730 con 0x56383a7ed0a0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.830+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94799499596448] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.830+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94799499600224] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.830+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.830+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799499604480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fb6f0 con 0x56383a7ed0a0 2024-05-08T18:09:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.830+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fbfd0 con 0x7f5f4801d450 2024-05-08T18:09:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.830+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94799499604480] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799499593632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fbba0 con 0x7f5f4801d450 2024-05-08T18:09:33.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fc560 con 0x7f5f4801d450 2024-05-08T18:09:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94799499593632] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799499606224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fc560 con 0x7f5f4801d450 2024-05-08T18:09:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.834+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fcf20 con 0x7f5f4801d450 2024-05-08T18:09:33.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94799499606224] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799499608240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fd100 con 0x7f5f4801d450 2024-05-08T18:09:33.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=0 2024-05-08T18:09:33.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=1 2024-05-08T18:09:33.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=2 2024-05-08T18:09:33.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=3 2024-05-08T18:09:33.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=4 2024-05-08T18:09:33.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=5 2024-05-08T18:09:33.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=6 2024-05-08T18:09:33.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94799499608240] v32'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 20 add_watcher() i=7 2024-05-08T18:09:33.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:33.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a8002a0 con 0x56383a7ed0a0 2024-05-08T18:09:33.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.838+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799499623472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fd040 con 0x56383a7ed0a0 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94799499623472] v32'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5e0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 5 note: GC not initialized 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5e0cfe1640 20 reqs_thread_entry: start 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 20 Filter name: none 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5d867fc640 20 reqs_thread_entry: start 2024-05-08T18:09:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a823e20 con 0x56383a7ed0a0 2024-05-08T18:09:33.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 20 rados_obj.operate() r=0 bl.length=403 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a829fd0 con 0x56383a7ed0a0 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94799499795008 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56383a8258a0 con 0x56383a7ed0a0 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify (1) cookie 94799499604480 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f5f4805d040 con 0x56383a7ed0a0 2024-05-08T18:09:33.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5e3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94799499604480 notifier 4660 bl.length()=567 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(64 notify.4 [notify cookie 94799499795008 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5e3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5e3affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.842+0000 7f5e3affd640 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5e1c003eb0 con 0x56383a7ed0a0 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== watch-notify(notify_complete (2) cookie 94799499795008 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5f48052040 con 0x56383a7ed0a0 2024-05-08T18:09:33.848 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T18:09:06.813037Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:09:06.813024Z","tags":[],"group_ids":[]} 2024-05-08T18:09:33.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5e0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:33.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799499623472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a821b50 con 0x56383a7ed0a0 2024-05-08T18:09:33.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94799499623472] v32'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799499588240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a821b50 con 0x7f5f400cf070 2024-05-08T18:09:33.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94799499588240] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f596b3980 20 remove_watcher() i=0 2024-05-08T18:09:33.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f596b3980 2 removed watcher, disabling cache 2024-05-08T18:09:33.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.846+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799499592576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a821b50 con 0x56383a7ed0a0 2024-05-08T18:09:33.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.850+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94799499592576] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.850+0000 7f5f596b3980 20 remove_watcher() i=1 2024-05-08T18:09:33.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.850+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799499596448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a821b50 con 0x56383a7f32c0 2024-05-08T18:09:33.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f569c6640 1 -- 172.21.15.114:0/743836764 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94799499596448] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f400e2040 con 0x56383a7f32c0 2024-05-08T18:09:33.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f596b3980 20 remove_watcher() i=2 2024-05-08T18:09:33.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799499600224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f8380 con 0x7f5f400cf070 2024-05-08T18:09:33.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f579c8640 1 -- 172.21.15.114:0/743836764 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94799499600224] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f5002f040 con 0x7f5f400cf070 2024-05-08T18:09:33.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f596b3980 20 remove_watcher() i=3 2024-05-08T18:09:33.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799499604480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f8380 con 0x56383a7ed0a0 2024-05-08T18:09:33.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94799499604480] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x56383a7ed0a0 2024-05-08T18:09:33.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f596b3980 20 remove_watcher() i=4 2024-05-08T18:09:33.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.854+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799499593632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fb200 con 0x7f5f4801d450 2024-05-08T18:09:33.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.858+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94799499593632] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.858+0000 7f5f596b3980 20 remove_watcher() i=5 2024-05-08T18:09:33.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.858+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799499606224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7fb200 con 0x7f5f4801d450 2024-05-08T18:09:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.858+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94799499606224] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.858+0000 7f5f596b3980 20 remove_watcher() i=6 2024-05-08T18:09:33.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.858+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799499608240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56383a7f8830 con 0x7f5f4801d450 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94799499608240] v32'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f4802e070 con 0x7f5f4801d450 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 20 remove_watcher() i=7 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f4801d450 msgr2=0x7f5f4801a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5f4801d450 0x7f5f4801a620 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a7ed0a0 msgr2=0x56383a7ef530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a7ed0a0 0x56383a7ef530 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f400cf070 msgr2=0x7f5f400af9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5f400cf070 0x7f5f400af9e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56383a7f32c0 msgr2=0x56383a7f56b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56383a7f32c0 0x56383a7f56b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e200383f0 msgr2=0x7f5e2003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e200383f0 0x7f5e2003a8b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000f010 tx=0x7f5f5001b070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 msgr2=0x56383a7e1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f571c7640 1 -- 172.21.15.114:0/743836764 reap_dead start 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7e1b60 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5f400ce9a0 tx=0x7f5f400eb820 comp rx=0 tx=0).stop 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 shutdown_connections 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/743836764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7da5f0 0x56383a7e1b60 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 >> 172.21.15.114:0/743836764 conn(0x56383a7d2570 msgr2=0x56383a7dbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 shutdown_connections 2024-05-08T18:09:33.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/743836764 wait complete. 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038440 msgr2=0x7f5e3003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038440 0x7f5e3003a900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x56383a7b9d60 tx=0x7f5f50003070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 msgr2=0x56383a7c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 0x56383a7c9530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5f4001b430 tx=0x7f5f4001a5a0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 shutdown_connections 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e30038440 0x7f5e3003a900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/4041465749 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a7c9110 0x56383a7c9530 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 >> 172.21.15.114:0/4041465749 conn(0x56383a7bdf20 msgr2=0x56383a7bea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 shutdown_connections 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/4041465749 wait complete. 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a6c4330 msgr2=0x56383a7b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a6c4330 0x56383a7b83e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e3c0383f0 msgr2=0x7f5e3c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e3c0383f0 0x7f5e3c03a8b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5f400b0000 tx=0x7f5f400a8070 comp rx=0 tx=0).stop 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 msgr2=0x56383a7b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7b1330 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b7d0 tx=0x7f5f48000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 shutdown_connections 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56383a6c4330 0x56383a7b83e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.862+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5e3c0383f0 0x7f5e3c03a8b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.866+0000 7f5f596b3980 1 --2- 172.21.15.114:0/1447307203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56383a6bfdd0 0x56383a7b1330 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.866+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 >> 172.21.15.114:0/1447307203 conn(0x56383a6bb6a0 msgr2=0x56383a7a4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.866+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 shutdown_connections 2024-05-08T18:09:33.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.866+0000 7f5f596b3980 1 -- 172.21.15.114:0/1447307203 wait complete. 2024-05-08T18:09:33.877 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T18:09:06.813037Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:09:06.813024Z', 'tags': [], 'group_ids': []} 2024-05-08T18:09:33.894 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:33.894 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T18:09:33.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T18:09:33.894 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T18:09:33.949 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:09:33.949 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:09:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.946+0000 7fbbbe3e5980 1 Processor -- start 2024-05-08T18:09:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.946+0000 7fbbbe3e5980 1 -- start start 2024-05-08T18:09:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.946+0000 7fbbbe3e5980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c02ac023c0 0x55c02ac047b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.946+0000 7fbbbe3e5980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c02aaa9710 con 0x55c02abfdf00 2024-05-08T18:09:33.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.946+0000 7fbbbe3e5980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c02aabdf00 con 0x55c02ac023c0 2024-05-08T18:09:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbb6f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c02ac023c0 0x55c02ac047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbb6f8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c02ac023c0 0x55c02ac047b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45068/0 (socket says 172.21.15.114:45068) 2024-05-08T18:09:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2860699662 learned_addr learned my addr 172.21.15.114:0/2860699662 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbbef9640 1 --1- 172.21.15.114:0/2860699662 >> v1:172.21.15.53:6789/0 conn(0x55c02abfdf00 0x55c02abfe2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55328/0 (socket says 172.21.15.114:55328) 2024-05-08T18:09:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2860699662 >> v1:172.21.15.53:6789/0 conn(0x55c02abfdf00 legacy=0x55c02abfe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2860699662 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02aa85ae0 con 0x55c02ac023c0 2024-05-08T18:09:33.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/2860699662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ac023c0 0x55c02ac047b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000a5c0 tx=0x7fbbb001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4505afd95ca22d1f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbaef7640 1 -- 172.21.15.114:0/2860699662 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00a6070 con 0x55c02ac023c0 2024-05-08T18:09:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbaef7640 1 -- 172.21.15.114:0/2860699662 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb00af070 con 0x55c02ac023c0 2024-05-08T18:09:33.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbaef7640 1 -- 172.21.15.114:0/2860699662 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00aa5c0 con 0x55c02ac023c0 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2860699662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ac023c0 msgr2=0x55c02ac047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2860699662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ac023c0 0x55c02ac047b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000a5c0 tx=0x7fbbb001b340 comp rx=0 tx=0).stop 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2860699662 shutdown_connections 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2860699662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ac023c0 0x55c02ac047b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.950+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2860699662 >> 172.21.15.114:0/2860699662 conn(0x55c02abf97d0 msgr2=0x55c02abfbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.954+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2860699662 shutdown_connections 2024-05-08T18:09:33.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.954+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2860699662 wait complete. 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbe3e5980 1 Processor -- start 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbe3e5980 1 -- start start 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbe3e5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02ace8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbe3e5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c02ab01f80 con 0x55c02abfdf00 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbbef9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02ace8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbbef9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02ace8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45084/0 (socket says 172.21.15.114:45084) 2024-05-08T18:09:33.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.966+0000 7fbbbbef9640 1 -- 172.21.15.114:0/1019309166 learned_addr learned my addr 172.21.15.114:0/1019309166 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 -- 172.21.15.114:0/1019309166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02aac9da0 con 0x55c02abfdf00 2024-05-08T18:09:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/1019309166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02ace8f60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00b270 tx=0x7fbbac00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351aad23804ff088 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbaa9e0b640 1 -- 172.21.15.114:0/1019309166 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbac00e5d0 con 0x55c02abfdf00 2024-05-08T18:09:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbaa9e0b640 1 -- 172.21.15.114:0/1019309166 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac00e770 con 0x55c02abfdf00 2024-05-08T18:09:33.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbaa9e0b640 1 -- 172.21.15.114:0/1019309166 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbac00ea70 con 0x55c02abfdf00 2024-05-08T18:09:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/1019309166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 msgr2=0x55c02ace8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/1019309166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02ace8f60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00b270 tx=0x7fbbac00b670 comp rx=0 tx=0).stop 2024-05-08T18:09:33.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/1019309166 shutdown_connections 2024-05-08T18:09:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/1019309166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02ace8f60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/1019309166 >> 172.21.15.114:0/1019309166 conn(0x55c02abf97d0 msgr2=0x55c02ace4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/1019309166 shutdown_connections 2024-05-08T18:09:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/1019309166 wait complete. 2024-05-08T18:09:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 Processor -- start 2024-05-08T18:09:33.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- start start 2024-05-08T18:09:33.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02acf0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbe3e5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c02ac077e0 con 0x55c02abfdf00 2024-05-08T18:09:33.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02acf0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02acf0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45098/0 (socket says 172.21.15.114:45098) 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 -- 172.21.15.114:0/77685841 learned_addr learned my addr 172.21.15.114:0/77685841 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02acf0990 con 0x55c02abfdf00 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02acf0450 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00b6b0 tx=0x7fbbac000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.970+0000 7fbaa3fff640 1 -- 172.21.15.114:0/77685841 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbac00be70 con 0x55c02abfdf00 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02acf0c20 con 0x55c02abfdf00 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbaa3fff640 1 -- 172.21.15.114:0/77685841 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbac00fa40 con 0x55c02abfdf00 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbaa3fff640 1 -- 172.21.15.114:0/77685841 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbac00fd80 con 0x55c02abfdf00 2024-05-08T18:09:33.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02acf3860 con 0x55c02abfdf00 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbaa3fff640 1 -- 172.21.15.114:0/77685841 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbbac017070 con 0x55c02abfdf00 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbaa3fff640 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbaa40383f0 0x7fbaa403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbaa3fff640 1 -- 172.21.15.114:0/77685841 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbbac015020 con 0x55c02abfdf00 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbaa40383f0 0x7fbaa403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ac023c0 0x55c02acf74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02acf7a30 con 0x55c02ac023c0 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ac023c0 0x55c02acf74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbaa40383f0 0x7fbaa403a8b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00ae000 tx=0x7fbbb00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ac023c0 0x55c02acf74b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/77685841 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbb400a4d0 con 0x55c02ac023c0 2024-05-08T18:09:33.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02acf4a60 con 0x55c02ac023c0 2024-05-08T18:09:33.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/77685841 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbb400a4d0 con 0x55c02ac023c0 2024-05-08T18:09:33.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02acf9830 con 0x55c02ac023c0 2024-05-08T18:09:33.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/77685841 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbbb400a4d0 con 0x55c02ac023c0 2024-05-08T18:09:33.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02acf89a0 con 0x55c02ac023c0 2024-05-08T18:09:33.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/77685841 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbb400a4d0 con 0x55c02ac023c0 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.974+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02acf8dc0 con 0x55c02ac023c0 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/77685841 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbbb400a4d0 con 0x55c02ac023c0 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbe3e5980 1 Processor -- start 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbe3e5980 1 -- start start 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbe3e5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 0x55c02ad085a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbe3e5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c02ab05fc0 con 0x55c02ad08180 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbb6f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 0x55c02ad085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbb6f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 0x55c02ad085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45114/0 (socket says 172.21.15.114:45114) 2024-05-08T18:09:33.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/827135958 learned_addr learned my addr 172.21.15.114:0/827135958 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/827135958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02ad08ae0 con 0x55c02ad08180 2024-05-08T18:09:33.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 0x55c02ad085a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00ac040 tx=0x7fbbb00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbaa17fa640 1 -- 172.21.15.114:0/827135958 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00b3b90 con 0x55c02ad08180 2024-05-08T18:09:33.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbaa17fa640 1 -- 172.21.15.114:0/827135958 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb00b3d30 con 0x55c02ad08180 2024-05-08T18:09:33.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02ad09580 con 0x55c02ad08180 2024-05-08T18:09:33.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbaa17fa640 1 -- 172.21.15.114:0/827135958 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00c8560 con 0x55c02ad08180 2024-05-08T18:09:33.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02ad099f0 con 0x55c02ad08180 2024-05-08T18:09:33.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbaa17fa640 1 -- 172.21.15.114:0/827135958 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbbb00d1440 con 0x55c02ad08180 2024-05-08T18:09:33.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbaa17fa640 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba940383f0 0x7fba9403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbaa17fa640 1 -- 172.21.15.114:0/827135958 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbbb00ec0a0 con 0x55c02ad08180 2024-05-08T18:09:33.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.978+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba940383f0 0x7fba9403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 Processor -- start 2024-05-08T18:09:33.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- start start 2024-05-08T18:09:33.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba940383f0 0x7fba9403a8b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55c02acf8d40 tx=0x7fbbb4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ab74880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c02ace96b0 con 0x55c02ab74460 2024-05-08T18:09:33.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ab74880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ab74880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45122/0 (socket says 172.21.15.114:45122) 2024-05-08T18:09:33.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2621687304 learned_addr learned my addr 172.21.15.114:0/2621687304 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2621687304 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02ab72ce0 con 0x55c02ab74460 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/2621687304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ab74880 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00ea3e0 tx=0x7fbbb00bcf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f63778698eb1449 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fba9affd640 1 -- 172.21.15.114:0/2621687304 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00e7030 con 0x55c02ab74460 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fba9affd640 1 -- 172.21.15.114:0/2621687304 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb00bd390 con 0x55c02ab74460 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fba9affd640 1 -- 172.21.15.114:0/2621687304 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00bd670 con 0x55c02ab74460 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2621687304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 msgr2=0x55c02ab74880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2621687304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ab74880 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00ea3e0 tx=0x7fbbb00bcf50 comp rx=0 tx=0).stop 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2621687304 shutdown_connections 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2621687304 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ab74880 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2621687304 >> 172.21.15.114:0/2621687304 conn(0x55c02ad115a0 msgr2=0x55c02ad0f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:33.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2621687304 shutdown_connections 2024-05-08T18:09:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2621687304 wait complete. 2024-05-08T18:09:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 Processor -- start 2024-05-08T18:09:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- start start 2024-05-08T18:09:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ad1e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbe3e5980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c02ab73150 con 0x55c02ab74460 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ad1e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ad1e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:45130/0 (socket says 172.21.15.114:45130) 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.982+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 learned_addr learned my addr 172.21.15.114:0/2392370741 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c02ad1eed0 con 0x55c02ab74460 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ad1e990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00e9300 tx=0x7fbbb00ea370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fba997fa640 1 -- 172.21.15.114:0/2392370741 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00f1070 con 0x55c02ab74460 2024-05-08T18:09:33.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c02ad1f160 con 0x55c02ab74460 2024-05-08T18:09:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fba997fa640 1 -- 172.21.15.114:0/2392370741 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb00d1a00 con 0x55c02ab74460 2024-05-08T18:09:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fba997fa640 1 -- 172.21.15.114:0/2392370741 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbb00c7c10 con 0x55c02ab74460 2024-05-08T18:09:33.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c02ad21e40 con 0x55c02ab74460 2024-05-08T18:09:33.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fba997fa640 1 -- 172.21.15.114:0/2392370741 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbbb00f4070 con 0x55c02ab74460 2024-05-08T18:09:33.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fba997fa640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba840383f0 0x7fba8403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fba997fa640 1 -- 172.21.15.114:0/2392370741 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbbb00e1070 con 0x55c02ab74460 2024-05-08T18:09:33.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba840383f0 0x7fba8403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ad29e70 0x55c02ad2c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2ca60 con 0x55c02ad29e70 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ad29e70 0x55c02ad2c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba840383f0 0x7fba8403a8b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55c02acf84c0 tx=0x7fbbb401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ad29e70 0x55c02ad2c310 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 20 realm 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.986+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2ce70 con 0x55c02ad29e70 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2d740 con 0x55c02ad29e70 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2dae0 con 0x55c02ad29e70 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2e330 con 0x55c02ad29e70 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 20 searching for the correct realm 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c02ad300a0 0x55c02ad32490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c02ad300a0 0x55c02ad32490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c02ad300a0 0x55c02ad32490 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbb6f8640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbbb00f6060 0x7fbbb00eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:33.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbbb00f6060 0x7fbbb00eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbc6fa640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbbb00f6060 0x7fbbb00eca40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbbac04c150 0x7fbbac0193e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:09:33.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.990+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbbac04c150 0x7fbbac0193e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbbac04c150 0x7fbbac0193e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x7fbbac04c150 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x7fbbac04c150 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.994+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x7fbbac04c150 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:34.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac02e070 con 0x7fbbac04c150 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbbac02e070 con 0x55c02ad29e70 2024-05-08T18:09:34.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:33.998+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad300a0 2024-05-08T18:09:34.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbac04c150 2024-05-08T18:09:34.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x55c02ad29e70 2024-05-08T18:09:34.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad329d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:09:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:09:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:09:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:09:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:09:34.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:09:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2ec80 con 0x55c02ad29e70 2024-05-08T18:09:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.012 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2f4d0 con 0x55c02ad29e70 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.002+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad2e8c0 con 0x55c02ad29e70 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 zone default found 2024-05-08T18:09:34.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 4 Realm: () 2024-05-08T18:09:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:09:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:09:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:09:34.014 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 zonegroup default 2024-05-08T18:09:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad32e90 con 0x7fbbac04c150 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34cb0 con 0x55c02ad300a0 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad35050 con 0x55c02ad300a0 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 started sync module instance, tier type = 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34150 con 0x7fbbb00f6060 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94283840570736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad33db0 con 0x7fbbb00f6060 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.006+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad35f30 con 0x55c02ad29e70 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.010+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94283840570736] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.010+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.010+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94283840574560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad35f30 con 0x55c02ad29e70 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.010+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad36940 con 0x55c02ad300a0 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.010+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94283840574560] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.010+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94283840576128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad35ea0 con 0x55c02ad300a0 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad376d0 con 0x7fbbb00f6060 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94283840582112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad37f70 con 0x7fbbb00f6060 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad389b0 con 0x55c02ad29e70 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94283840576128] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94283840582112] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94283840586880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad37ac0 con 0x55c02ad29e70 2024-05-08T18:09:34.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.014+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad39250 con 0x7fbbac04c150 2024-05-08T18:09:34.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.018+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94283840586880] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.018+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.018+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94283840580912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad37ac0 con 0x7fbbac04c150 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.018+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad39790 con 0x7fbbac04c150 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.018+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94283840580912] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94283840590432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad39750 con 0x7fbbac04c150 2024-05-08T18:09:34.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad3a150 con 0x7fbbac04c150 2024-05-08T18:09:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94283840590432] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94283840588736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad3a110 con 0x7fbbac04c150 2024-05-08T18:09:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=0 2024-05-08T18:09:34.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=1 2024-05-08T18:09:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=2 2024-05-08T18:09:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=3 2024-05-08T18:09:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=4 2024-05-08T18:09:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=5 2024-05-08T18:09:34.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.022+0000 7fbbbe3e5980 20 add_watcher() i=6 2024-05-08T18:09:34.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94283840588736] v32'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 20 add_watcher() i=7 2024-05-08T18:09:34.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 2 all 8 watchers are set, enabling cache 2024-05-08T18:09:34.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad3d570 con 0x55c02ad29e70 2024-05-08T18:09:34.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94283840593456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad3aa30 con 0x55c02ad29e70 2024-05-08T18:09:34.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94283840593456] v32'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fba727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:34.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:09:34.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:09:34.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.026+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad3d370 con 0x55c02ad29e70 2024-05-08T18:09:34.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.030+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.030+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad46660 con 0x7fbbac04c150 2024-05-08T18:09:34.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.030+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.030+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad46660 con 0x55c02ad300a0 2024-05-08T18:09:34.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.030+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.034+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad46a20 con 0x55c02ad29e70 2024-05-08T18:09:34.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.034+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.034+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad46a00 con 0x7fbbb00f6060 2024-05-08T18:09:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.034+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'68 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.034+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad46f70 con 0x55c02ad300a0 2024-05-08T18:09:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.038+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.038+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad47310 con 0x55c02ad29e70 2024-05-08T18:09:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.038+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.038+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad473e0 con 0x7fbbac04c150 2024-05-08T18:09:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.042+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.042+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad473e0 con 0x7fbbb00f6060 2024-05-08T18:09:34.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.042+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.042+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad47ab0 con 0x55c02ad300a0 2024-05-08T18:09:34.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.046+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.046+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad47ab0 con 0x7fbbb00f6060 2024-05-08T18:09:34.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.046+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'69 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.046+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48020 con 0x7fbbac04c150 2024-05-08T18:09:34.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.046+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.051 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.046+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48020 con 0x7fbbb00f6060 2024-05-08T18:09:34.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.050+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.050+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad481c0 con 0x7fbbac04c150 2024-05-08T18:09:34.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.050+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.050+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad481c0 con 0x55c02ad29e70 2024-05-08T18:09:34.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.054+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.056 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.054+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad481c0 con 0x55c02ad300a0 2024-05-08T18:09:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.054+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.054+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad481c0 con 0x7fbbb00f6060 2024-05-08T18:09:34.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.058+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.058+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.058+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.058+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad29e70 2024-05-08T18:09:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.062+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.062+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad29e70 2024-05-08T18:09:34.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.062+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.062+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.066+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.066+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x7fbbb00f6060 2024-05-08T18:09:34.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.066+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.066+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.070+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.070+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.070+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.070+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.074+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.074+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.074+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.074+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x7fbbac04c150 2024-05-08T18:09:34.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.078+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.078+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.078+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.078+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x7fbbac04c150 2024-05-08T18:09:34.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.082+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.082+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x55c02ad300a0 2024-05-08T18:09:34.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.082+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.082+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x7fbbac04c150 2024-05-08T18:09:34.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.086+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.086+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad48250 con 0x7fbbb00f6060 2024-05-08T18:09:34.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.086+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.086+0000 7fba717e2640 20 reqs_thread_entry: start 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 20 init_complete bucket index max shards: 11 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 20 Filter name: none 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fba6a7fc640 20 reqs_thread_entry: start 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 20 rados->read ofs=0 len=0 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad639d0 con 0x55c02ad29e70 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad45e20 con 0x7fbbb00f6060 2024-05-08T18:09:34.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fba727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.090+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94283840593456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad244a0 con 0x55c02ad29e70 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94283840593456] v32'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94283840570736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad39e00 con 0x7fbbb00f6060 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94283840570736] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbe3e5980 20 remove_watcher() i=0 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbe3e5980 2 removed watcher, disabling cache 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94283840574560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34570 con 0x55c02ad29e70 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94283840574560] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbe3e5980 20 remove_watcher() i=1 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.094+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94283840576128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34570 con 0x55c02ad300a0 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.098+0000 7fbbbb6f8640 1 -- 172.21.15.114:0/2392370741 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94283840576128] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb00f3030 con 0x55c02ad300a0 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.098+0000 7fbbbe3e5980 20 remove_watcher() i=2 2024-05-08T18:09:34.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.098+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94283840582112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34570 con 0x7fbbb00f6060 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.098+0000 7fbbbc6fa640 1 -- 172.21.15.114:0/2392370741 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94283840582112] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbb401f070 con 0x7fbbb00f6060 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.098+0000 7fbbbe3e5980 20 remove_watcher() i=3 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.098+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94283840586880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34570 con 0x55c02ad29e70 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.102+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94283840586880] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x55c02ad29e70 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.102+0000 7fbbbe3e5980 20 remove_watcher() i=4 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.102+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94283840580912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad38480 con 0x7fbbac04c150 2024-05-08T18:09:34.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.102+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94283840580912] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.102+0000 7fbbbe3e5980 20 remove_watcher() i=5 2024-05-08T18:09:34.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.102+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94283840590432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad34570 con 0x7fbbac04c150 2024-05-08T18:09:34.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.106+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94283840590432] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.106+0000 7fbbbe3e5980 20 remove_watcher() i=6 2024-05-08T18:09:34.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.106+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94283840588736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c02ad39260 con 0x7fbbac04c150 2024-05-08T18:09:34.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.106+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94283840588736] v32'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbbac055040 con 0x7fbbac04c150 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.106+0000 7fbbbe3e5980 20 remove_watcher() i=7 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbbac04c150 msgr2=0x7fbbac0193e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbbac04c150 0x7fbbac0193e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ad29e70 msgr2=0x55c02ad2c310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ad29e70 0x55c02ad2c310 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbbb00f6060 msgr2=0x7fbbb00eca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbbb00f6060 0x7fbbb00eca40 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c02ad300a0 msgr2=0x55c02ad32490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c02ad300a0 0x55c02ad32490 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba840383f0 msgr2=0x7fba8403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba840383f0 0x7fba8403a8b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55c02acf84c0 tx=0x7fbbb401f000 comp rx=0 tx=0).stop 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbbef9640 1 -- 172.21.15.114:0/2392370741 reap_dead start 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 msgr2=0x55c02ad1e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ad1e990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00e9300 tx=0x7fbbb00ea370 comp rx=0 tx=0).stop 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 shutdown_connections 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/2392370741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ab74460 0x55c02ad1e990 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 >> 172.21.15.114:0/2392370741 conn(0x55c02ad115a0 msgr2=0x55c02ad0ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 shutdown_connections 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/2392370741 wait complete. 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba940383f0 msgr2=0x7fba9403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba940383f0 0x7fba9403a8b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55c02acf8d40 tx=0x7fbbb4005850 comp rx=0 tx=0).stop 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 msgr2=0x55c02ad085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 0x55c02ad085a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00ac040 tx=0x7fbbb00180e0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 shutdown_connections 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fba940383f0 0x7fba9403a8b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/827135958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02ad08180 0x55c02ad085a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 >> 172.21.15.114:0/827135958 conn(0x55c02acfcf90 msgr2=0x55c02acfdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 shutdown_connections 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/827135958 wait complete. 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ac023c0 msgr2=0x55c02acf74b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ac023c0 0x55c02acf74b0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbaa40383f0 msgr2=0x7fbaa403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbaa40383f0 0x7fbaa403a8b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00ae000 tx=0x7fbbb00a6000 comp rx=0 tx=0).stop 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 msgr2=0x55c02acf0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02acf0450 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00b6b0 tx=0x7fbbac000ee0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 shutdown_connections 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c02ac023c0 0x55c02acf74b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbaa40383f0 0x7fbaa403a8b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 --2- 172.21.15.114:0/77685841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c02abfdf00 0x55c02acf0450 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 >> 172.21.15.114:0/77685841 conn(0x55c02abf97d0 msgr2=0x55c02ace3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 shutdown_connections 2024-05-08T18:09:34.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:09:34.110+0000 7fbbbe3e5980 1 -- 172.21.15.114:0/77685841 wait complete. 2024-05-08T18:09:34.124 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:09:34.145 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:09:34.152 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T18:10:09.153 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-08T18:10:09.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-08T18:10:09.153 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-08T18:10:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:09.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe44a9e8980 1 Processor -- start 2024-05-08T18:10:09.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe44a9e8980 1 -- start start 2024-05-08T18:10:09.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe44a9e8980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55df02f760f0 0x55df02f764d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe44a9e8980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df02e1f710 con 0x55df02f76a10 2024-05-08T18:10:09.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe44a9e8980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55df02e33f00 con 0x55df02f760f0 2024-05-08T18:10:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe4484fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55df02f760f0 0x55df02f764d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe4484fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55df02f760f0 0x55df02f764d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52154/0 (socket says 172.21.15.114:52154) 2024-05-08T18:10:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe4484fc640 1 -- 172.21.15.114:0/1993127673 learned_addr learned my addr 172.21.15.114:0/1993127673 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.193+0000 7fe447cfb640 1 --1- 172.21.15.114:0/1993127673 >> v1:172.21.15.53:6789/0 conn(0x55df02f76a10 0x55df02f77380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:55102/0 (socket says 172.21.15.114:55102) 2024-05-08T18:10:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe4484fc640 1 -- 172.21.15.114:0/1993127673 >> v1:172.21.15.53:6789/0 conn(0x55df02f76a10 legacy=0x55df02f77380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe4484fc640 1 -- 172.21.15.114:0/1993127673 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df02dfbae0 con 0x55df02f760f0 2024-05-08T18:10:09.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe4484fc640 1 --2- 172.21.15.114:0/1993127673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df02f764d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe43800a4e0 tx=0x7fe43801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0a6cdb9ab91f92 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe4474fa640 1 -- 172.21.15.114:0/1993127673 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380aa540 con 0x55df02f760f0 2024-05-08T18:10:09.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe4474fa640 1 -- 172.21.15.114:0/1993127673 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4380aa6e0 con 0x55df02f760f0 2024-05-08T18:10:09.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe4474fa640 1 -- 172.21.15.114:0/1993127673 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380aaa40 con 0x55df02f760f0 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1993127673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 msgr2=0x55df02f764d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.197+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1993127673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df02f764d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe43800a4e0 tx=0x7fe43801b090 comp rx=0 tx=0).stop 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.201+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1993127673 shutdown_connections 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.201+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1993127673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df02f764d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.201+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1993127673 >> 172.21.15.114:0/1993127673 conn(0x55df02ee97d0 msgr2=0x55df02ee9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.201+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1993127673 shutdown_connections 2024-05-08T18:10:09.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.201+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1993127673 wait complete. 2024-05-08T18:10:09.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.213+0000 7fe44a9e8980 1 Processor -- start 2024-05-08T18:10:09.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.213+0000 7fe44a9e8980 1 -- start start 2024-05-08T18:10:09.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.213+0000 7fe44a9e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df030618b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.213+0000 7fe44a9e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55df02e77f80 con 0x55df02f760f0 2024-05-08T18:10:09.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df030618b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df030618b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52162/0 (socket says 172.21.15.114:52162) 2024-05-08T18:10:09.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 -- 172.21.15.114:0/1333991385 learned_addr learned my addr 172.21.15.114:0/1333991385 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 -- 172.21.15.114:0/1333991385 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df02e3fda0 con 0x55df02f760f0 2024-05-08T18:10:09.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 --2- 172.21.15.114:0/1333991385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df030618b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe438017ca0 tx=0x7fe4380033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e91400989fcab0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe33660c640 1 -- 172.21.15.114:0/1333991385 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380b9030 con 0x55df02f760f0 2024-05-08T18:10:09.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe33660c640 1 -- 172.21.15.114:0/1333991385 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4380aaac0 con 0x55df02f760f0 2024-05-08T18:10:09.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe33660c640 1 -- 172.21.15.114:0/1333991385 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380aada0 con 0x55df02f760f0 2024-05-08T18:10:09.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1333991385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 msgr2=0x55df030618b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1333991385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df030618b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe438017ca0 tx=0x7fe4380033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1333991385 shutdown_connections 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1333991385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f760f0 0x55df030618b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1333991385 >> 172.21.15.114:0/1333991385 conn(0x55df02ee97d0 msgr2=0x55df0305d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1333991385 shutdown_connections 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1333991385 wait complete. 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 Processor -- start 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- start start 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 0x55df03068dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe44a9e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55df02f800f0 con 0x55df02f76a10 2024-05-08T18:10:09.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 0x55df03068dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 0x55df03068dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52174/0 (socket says 172.21.15.114:52174) 2024-05-08T18:10:09.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 -- 172.21.15.114:0/1549366529 learned_addr learned my addr 172.21.15.114:0/1549366529 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.217+0000 7fe4484fc640 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df03069310 con 0x55df02f76a10 2024-05-08T18:10:09.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe4484fc640 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 0x55df03068dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe43801b0d0 tx=0x7fe438017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe334e09640 1 -- 172.21.15.114:0/1549366529 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380b9030 con 0x55df02f76a10 2024-05-08T18:10:09.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df030695a0 con 0x55df02f76a10 2024-05-08T18:10:09.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df0306c230 con 0x55df02f76a10 2024-05-08T18:10:09.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe334e09640 1 -- 172.21.15.114:0/1549366529 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4380c3070 con 0x55df02f76a10 2024-05-08T18:10:09.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe334e09640 1 -- 172.21.15.114:0/1549366529 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4380cc060 con 0x55df02f76a10 2024-05-08T18:10:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe334e09640 1 -- 172.21.15.114:0/1549366529 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe4380c5030 con 0x55df02f76a10 2024-05-08T18:10:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe334e09640 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3300383f0 0x7fe33003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe334e09640 1 -- 172.21.15.114:0/1549366529 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe4380ba070 con 0x55df02f76a10 2024-05-08T18:10:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe447cfb640 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3300383f0 0x7fe33003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df0306dd00 0x55df030700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df03070730 con 0x55df0306dd00 2024-05-08T18:10:09.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe448cfd640 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df0306dd00 0x55df030700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe447cfb640 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3300383f0 0x7fe33003a8b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe43c001e40 tx=0x7fe43c0013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe448cfd640 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df0306dd00 0x55df030700f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe448cfd640 1 -- 172.21.15.114:0/1549366529 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4400083f0 con 0x55df0306dd00 2024-05-08T18:10:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df0306d430 con 0x55df0306dd00 2024-05-08T18:10:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe448cfd640 1 -- 172.21.15.114:0/1549366529 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4400083f0 con 0x55df0306dd00 2024-05-08T18:10:09.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.221+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df03072550 con 0x55df0306dd00 2024-05-08T18:10:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe448cfd640 1 -- 172.21.15.114:0/1549366529 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4400083f0 con 0x55df0306dd00 2024-05-08T18:10:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df03071780 con 0x55df0306dd00 2024-05-08T18:10:09.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe448cfd640 1 -- 172.21.15.114:0/1549366529 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4400083f0 con 0x55df0306dd00 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df03071ba0 con 0x55df0306dd00 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe448cfd640 1 -- 172.21.15.114:0/1549366529 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4400083f0 con 0x55df0306dd00 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 Processor -- start 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 -- start start 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 0x55df030812e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55df02e7bfc0 con 0x55df03080ec0 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe447cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 0x55df030812e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe447cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 0x55df030812e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52178/0 (socket says 172.21.15.114:52178) 2024-05-08T18:10:09.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe447cfb640 1 -- 172.21.15.114:0/3114082778 learned_addr learned my addr 172.21.15.114:0/3114082778 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe447cfb640 1 -- 172.21.15.114:0/3114082778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df03081820 con 0x55df03080ec0 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe447cfb640 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 0x55df030812e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00e670 tx=0x7fe43c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe32dffb640 1 -- 172.21.15.114:0/3114082778 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43c022070 con 0x55df03080ec0 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df030822c0 con 0x55df03080ec0 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df03082790 con 0x55df03080ec0 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe32dffb640 1 -- 172.21.15.114:0/3114082778 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c00d660 con 0x55df03080ec0 2024-05-08T18:10:09.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.225+0000 7fe32dffb640 1 -- 172.21.15.114:0/3114082778 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43c006070 con 0x55df03080ec0 2024-05-08T18:10:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe32dffb640 1 -- 172.21.15.114:0/3114082778 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe43c025070 con 0x55df03080ec0 2024-05-08T18:10:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe32dffb640 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe320038440 0x7fe32003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe32dffb640 1 -- 172.21.15.114:0/3114082778 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe43c0500c0 con 0x55df03080ec0 2024-05-08T18:10:09.227 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe448cfd640 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe320038440 0x7fe32003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 Processor -- start 2024-05-08T18:10:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- start start 2024-05-08T18:10:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe448cfd640 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe320038440 0x7fe32003a900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55df03071b20 tx=0x7fe440003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df0308e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55df03061f40 con 0x55df0308e0f0 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe447cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df0308e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe447cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df0308e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52194/0 (socket says 172.21.15.114:52194) 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe447cfb640 1 -- 172.21.15.114:0/551132163 learned_addr learned my addr 172.21.15.114:0/551132163 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe447cfb640 1 -- 172.21.15.114:0/551132163 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df0308eae0 con 0x55df0308e0f0 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe447cfb640 1 --2- 172.21.15.114:0/551132163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df0308e510 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe43c04e340 tx=0x7fe43c03d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b57937197ef573 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe3277fe640 1 -- 172.21.15.114:0/551132163 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43c01aa30 con 0x55df0308e0f0 2024-05-08T18:10:09.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe3277fe640 1 -- 172.21.15.114:0/551132163 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c04b030 con 0x55df0308e0f0 2024-05-08T18:10:09.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe3277fe640 1 -- 172.21.15.114:0/551132163 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43c01ad00 con 0x55df0308e0f0 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- 172.21.15.114:0/551132163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 msgr2=0x55df0308e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/551132163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df0308e510 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe43c04e340 tx=0x7fe43c03d420 comp rx=0 tx=0).stop 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- 172.21.15.114:0/551132163 shutdown_connections 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/551132163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df0308e510 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- 172.21.15.114:0/551132163 >> 172.21.15.114:0/551132163 conn(0x55df0308a480 msgr2=0x55df030884e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- 172.21.15.114:0/551132163 shutdown_connections 2024-05-08T18:10:09.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- 172.21.15.114:0/551132163 wait complete. 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 Processor -- start 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.229+0000 7fe44a9e8980 1 -- start start 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df03095620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55df0308f1f0 con 0x55df0308e0f0 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe447cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df03095620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe447cfb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df03095620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:52196/0 (socket says 172.21.15.114:52196) 2024-05-08T18:10:09.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 learned_addr learned my addr 172.21.15.114:0/85056143 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df03095b60 con 0x55df0308e0f0 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe447cfb640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df03095620 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00dfd0 tx=0x7fe43c04e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe325ffb640 1 -- 172.21.15.114:0/85056143 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43c00c2b0 con 0x55df0308e0f0 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df03095df0 con 0x55df0308e0f0 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe325ffb640 1 -- 172.21.15.114:0/85056143 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c00c450 con 0x55df0308e0f0 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe325ffb640 1 -- 172.21.15.114:0/85056143 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe43c00c600 con 0x55df0308e0f0 2024-05-08T18:10:09.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df03095df0 con 0x55df0308e0f0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe325ffb640 1 -- 172.21.15.114:0/85056143 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe43c01a530 con 0x55df0308e0f0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe325ffb640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3180383f0 0x7fe31803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe325ffb640 1 -- 172.21.15.114:0/85056143 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe43c035d50 con 0x55df0308e0f0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe448cfd640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3180383f0 0x7fe31803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df030a0900 0x55df030a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a34c0 con 0x55df030a0900 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.233+0000 7fe4484fc640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df030a0900 0x55df030a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3180383f0 0x7fe31803a8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe44000f010 tx=0x7fe44001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.235 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe4484fc640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df030a0900 0x55df030a2d70 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 realm 2024-05-08T18:10:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a38d0 con 0x55df030a0900 2024-05-08T18:10:09.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a41a0 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a4540 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a49a0 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 20 searching for the correct realm 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55df030a6910 0x55df030a8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe447cfb640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55df030a6910 0x55df030a8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe447cfb640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55df030a6910 0x55df030a8d00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe447cfb640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe43c027060 0x7fe43c03d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe43c027060 0x7fe43c03d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe43c027060 0x7fe43c03d510 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.237+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55df02f760f0 0x7fe4380be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55df02f760f0 0x7fe4380be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55df02f760f0 0x7fe4380be940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df02f760f0 2024-05-08T18:10:09.243 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df02f760f0 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.241+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df02f760f0 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.245+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df02f760f0 2024-05-08T18:10:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4380bf470 con 0x55df030a0900 2024-05-08T18:10:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380bf470 con 0x55df02f760f0 2024-05-08T18:10:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a6910 2024-05-08T18:10:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.249+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df02f760f0 2024-05-08T18:10:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x55df030a0900 2024-05-08T18:10:09.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df030a9380 con 0x7fe43c027060 2024-05-08T18:10:09.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a5380 con 0x55df030a0900 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a4fc0 con 0x55df030a0900 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a5cd0 con 0x55df030a0900 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 zone default found 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 4 Realm: () 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 zonegroup default 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030a97e0 con 0x55df02f760f0 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.255 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030ab670 con 0x55df030a6910 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030aba10 con 0x55df030a6910 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 started sync module instance, tier type = 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:09.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.253+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaab0 con 0x7fe43c027060 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94416317099728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ac260 con 0x7fe43c027060 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030acab0 con 0x55df030a0900 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94416317099728] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94416317103536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ac680 con 0x55df030a0900 2024-05-08T18:10:09.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.257+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ad140 con 0x55df030a6910 2024-05-08T18:10:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94416317103536] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94416317104592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ac5f0 con 0x55df030a6910 2024-05-08T18:10:09.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030adef0 con 0x7fe43c027060 2024-05-08T18:10:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94416317110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ae790 con 0x7fe43c027060 2024-05-08T18:10:09.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.261+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030af1d0 con 0x55df030a0900 2024-05-08T18:10:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94416317104592] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94416317110752] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94416317115552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ae2e0 con 0x55df030a0900 2024-05-08T18:10:09.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030afa70 con 0x55df02f760f0 2024-05-08T18:10:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94416317115552] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94416317109552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ae2e0 con 0x55df02f760f0 2024-05-08T18:10:09.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.265+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aff00 con 0x55df02f760f0 2024-05-08T18:10:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.269+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94416317109552] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.269+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.269+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94416317118960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030afec0 con 0x55df02f760f0 2024-05-08T18:10:09.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.269+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030b08e0 con 0x55df02f760f0 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94416317118960] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94416317121488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030b08a0 con 0x55df02f760f0 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=0 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=1 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=2 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=3 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=4 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=5 2024-05-08T18:10:09.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=6 2024-05-08T18:10:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94416317121488] v32'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 20 add_watcher() i=7 2024-05-08T18:10:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030b3cd0 con 0x55df030a0900 2024-05-08T18:10:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.273+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94416317117312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030b11f0 con 0x55df030a0900 2024-05-08T18:10:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94416317117312] v32'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe2fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:09.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 5 note: GC not initialized 2024-05-08T18:10:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe2fd7e2640 20 reqs_thread_entry: start 2024-05-08T18:10:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 20 Filter name: none 2024-05-08T18:10:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe276ffd640 20 reqs_thread_entry: start 2024-05-08T18:10:09.277 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7b40 con 0x55df030a0900 2024-05-08T18:10:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7b40 con 0x7fe43c027060 2024-05-08T18:10:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7b00 con 0x55df030a0900 2024-05-08T18:10:09.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7b00 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8040 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8430 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8820 con 0x55df030a0900 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.277+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8820 con 0x55df030a0900 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8820 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8820 con 0x55df030a6910 2024-05-08T18:10:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8810 con 0x55df02f760f0 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a0900 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x7fe43c027060 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df02f760f0 2024-05-08T18:10:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.281+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df02f760f0 2024-05-08T18:10:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df02f760f0 2024-05-08T18:10:09.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv6 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a0900 2024-05-08T18:10:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df02f760f0 2024-05-08T18:10:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x7fe43c027060 2024-05-08T18:10:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df02f760f0 2024-05-08T18:10:09.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a0900 2024-05-08T18:10:09.287 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.285+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a0900 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a0900 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.288 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a0900 2024-05-08T18:10:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.289 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df030a6910 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df030d7630 con 0x55df02f760f0 2024-05-08T18:10:09.290 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe2fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.291 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.289+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94416317117312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030d8c50 con 0x55df030a0900 2024-05-08T18:10:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.293+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94416317117312] v32'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.292 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.293+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94416317099728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030d6550 con 0x7fe43c027060 2024-05-08T18:10:09.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.293+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94416317099728] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.293+0000 7fe44a9e8980 20 remove_watcher() i=0 2024-05-08T18:10:09.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.293+0000 7fe44a9e8980 2 removed watcher, disabling cache 2024-05-08T18:10:09.293 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.293+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94416317103536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaed0 con 0x55df030a0900 2024-05-08T18:10:09.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94416317103536] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe44a9e8980 20 remove_watcher() i=1 2024-05-08T18:10:09.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94416317104592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaed0 con 0x55df030a6910 2024-05-08T18:10:09.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe447cfb640 1 -- 172.21.15.114:0/85056143 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94416317104592] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe43c03b070 con 0x55df030a6910 2024-05-08T18:10:09.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe44a9e8980 20 remove_watcher() i=2 2024-05-08T18:10:09.297 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94416317110752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaed0 con 0x7fe43c027060 2024-05-08T18:10:09.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe448cfd640 1 -- 172.21.15.114:0/85056143 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94416317110752] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44002f040 con 0x7fe43c027060 2024-05-08T18:10:09.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe44a9e8980 20 remove_watcher() i=3 2024-05-08T18:10:09.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.297+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94416317115552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaed0 con 0x55df030a0900 2024-05-08T18:10:09.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.301+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94416317115552] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df030a0900 2024-05-08T18:10:09.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.301+0000 7fe44a9e8980 20 remove_watcher() i=4 2024-05-08T18:10:09.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.301+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94416317109552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaed0 con 0x55df02f760f0 2024-05-08T18:10:09.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.305+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94416317109552] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.305+0000 7fe44a9e8980 20 remove_watcher() i=5 2024-05-08T18:10:09.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.305+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94416317118960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030ad530 con 0x55df02f760f0 2024-05-08T18:10:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.305+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94416317118960] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.305+0000 7fe44a9e8980 20 remove_watcher() i=6 2024-05-08T18:10:09.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.305+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94416317121488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df030aaed0 con 0x55df02f760f0 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94416317121488] v32'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4380f9040 con 0x55df02f760f0 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 20 remove_watcher() i=7 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55df02f760f0 msgr2=0x7fe4380be940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55df02f760f0 0x7fe4380be940 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df030a0900 msgr2=0x55df030a2d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df030a0900 0x55df030a2d70 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe43c027060 msgr2=0x7fe43c03d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe43c027060 0x7fe43c03d510 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55df030a6910 msgr2=0x55df030a8d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55df030a6910 0x55df030a8d00 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3180383f0 msgr2=0x7fe31803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3180383f0 0x7fe31803a8b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe44000f010 tx=0x7fe44001b070 comp rx=0 tx=0).stop 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe4484fc640 1 -- 172.21.15.114:0/85056143 reap_dead start 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 msgr2=0x55df03095620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df03095620 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00dfd0 tx=0x7fe43c04e2d0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 shutdown_connections 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/85056143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df0308e0f0 0x55df03095620 secure :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00dfd0 tx=0x7fe43c04e2d0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 >> 172.21.15.114:0/85056143 conn(0x55df0308a480 msgr2=0x55df03087ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 shutdown_connections 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/85056143 wait complete. 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe320038440 msgr2=0x7fe32003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe320038440 0x7fe32003a900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55df03071b20 tx=0x7fe440003070 comp rx=0 tx=0).stop 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 msgr2=0x55df030812e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 0x55df030812e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00e670 tx=0x7fe43c00ea70 comp rx=0 tx=0).stop 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 shutdown_connections 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe320038440 0x7fe32003a900 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/3114082778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df03080ec0 0x55df030812e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 >> 172.21.15.114:0/3114082778 conn(0x55df03075cd0 msgr2=0x55df030767e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 shutdown_connections 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/3114082778 wait complete. 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df0306dd00 msgr2=0x55df030700f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df0306dd00 0x55df030700f0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3300383f0 msgr2=0x7fe33003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3300383f0 0x7fe33003a8b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe43c001e40 tx=0x7fe43c0013a0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 msgr2=0x55df03068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 0x55df03068dd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe43801b0d0 tx=0x7fe438017e30 comp rx=0 tx=0).stop 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 shutdown_connections 2024-05-08T18:10:09.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55df0306dd00 0x55df030700f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe3300383f0 0x7fe33003a8b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 --2- 172.21.15.114:0/1549366529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df02f76a10 0x55df03068dd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 >> 172.21.15.114:0/1549366529 conn(0x55df02ee97d0 msgr2=0x55df0305bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 shutdown_connections 2024-05-08T18:10:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.309+0000 7fe44a9e8980 1 -- 172.21.15.114:0/1549366529 wait complete. 2024-05-08T18:10:09.320 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:09.320 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:09.320 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T18:10:09.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T18:10:09.321 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T18:10:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4974e25980 1 Processor -- start 2024-05-08T18:10:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4974e25980 1 -- start start 2024-05-08T18:10:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4974e25980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627bbd8e2c0 0x5627bbd906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4974e25980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627bbc35710 con 0x5627bbcfe7d0 2024-05-08T18:10:09.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4974e25980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5627bbc49f00 con 0x5627bbd8e2c0 2024-05-08T18:10:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4972138640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5627bbd8e2c0 0x5627bbd906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4972939640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5627bbcfe7d0 0x5627bbd8cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47832/0 (socket says 172.21.15.114:47832) 2024-05-08T18:10:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4972939640 1 -- 172.21.15.114:0/116562073 learned_addr learned my addr 172.21.15.114:0/116562073 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4972138640 1 -- 172.21.15.114:0/116562073 >> v1:172.21.15.53:6789/0 conn(0x5627bbcfe7d0 legacy=0x5627bbd8cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.393+0000 7f4972138640 1 -- 172.21.15.114:0/116562073 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bbc11ae0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4972138640 1 --2- 172.21.15.114:0/116562073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbd8e2c0 0x5627bbd906b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f496800a480 tx=0x7f496801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc5131729bdf10d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4971937640 1 -- 172.21.15.114:0/116562073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680b0070 con 0x5627bbd8e2c0 2024-05-08T18:10:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4971937640 1 -- 172.21.15.114:0/116562073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49680ab540 con 0x5627bbd8e2c0 2024-05-08T18:10:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4971937640 1 -- 172.21.15.114:0/116562073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680ab840 con 0x5627bbd8e2c0 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 -- 172.21.15.114:0/116562073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbd8e2c0 msgr2=0x5627bbd906b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 --2- 172.21.15.114:0/116562073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbd8e2c0 0x5627bbd906b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f496800a480 tx=0x7f496801b280 comp rx=0 tx=0).stop 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 -- 172.21.15.114:0/116562073 shutdown_connections 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 --2- 172.21.15.114:0/116562073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbd8e2c0 0x5627bbd906b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 -- 172.21.15.114:0/116562073 >> 172.21.15.114:0/116562073 conn(0x5627bbd84680 msgr2=0x5627bbd86aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 -- 172.21.15.114:0/116562073 shutdown_connections 2024-05-08T18:10:09.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.397+0000 7f4974e25980 1 -- 172.21.15.114:0/116562073 wait complete. 2024-05-08T18:10:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4974e25980 1 Processor -- start 2024-05-08T18:10:09.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4974e25980 1 -- start start 2024-05-08T18:10:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4974e25980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbe74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4974e25980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627bbc8df80 con 0x5627bbcfe7d0 2024-05-08T18:10:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4972939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbe74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4972939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbe74f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42558/0 (socket says 172.21.15.114:42558) 2024-05-08T18:10:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4972939640 1 -- 172.21.15.114:0/2510049248 learned_addr learned my addr 172.21.15.114:0/2510049248 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.413+0000 7f4972939640 1 -- 172.21.15.114:0/2510049248 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bbc55da0 con 0x5627bbcfe7d0 2024-05-08T18:10:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4972939640 1 --2- 172.21.15.114:0/2510049248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbe74f40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4964001e00 tx=0x7f496400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e87a6e9fdaac16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4860e09640 1 -- 172.21.15.114:0/2510049248 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964012020 con 0x5627bbcfe7d0 2024-05-08T18:10:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4860e09640 1 -- 172.21.15.114:0/2510049248 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496400e690 con 0x5627bbcfe7d0 2024-05-08T18:10:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4860e09640 1 -- 172.21.15.114:0/2510049248 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496400ea10 con 0x5627bbcfe7d0 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- 172.21.15.114:0/2510049248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 msgr2=0x5627bbe74f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 --2- 172.21.15.114:0/2510049248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbe74f40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4964001e00 tx=0x7f496400b6d0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- 172.21.15.114:0/2510049248 shutdown_connections 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 --2- 172.21.15.114:0/2510049248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbe74f40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- 172.21.15.114:0/2510049248 >> 172.21.15.114:0/2510049248 conn(0x5627bbd84680 msgr2=0x5627bbe70ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- 172.21.15.114:0/2510049248 shutdown_connections 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- 172.21.15.114:0/2510049248 wait complete. 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 Processor -- start 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- start start 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbd8a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627bbd91790 con 0x5627bbcfe7d0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4972939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbd8a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4972939640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbd8a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42570/0 (socket says 172.21.15.114:42570) 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4972939640 1 -- 172.21.15.114:0/3159385700 learned_addr learned my addr 172.21.15.114:0/3159385700 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4972939640 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bbd8a950 con 0x5627bbcfe7d0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4972939640 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbd8a410 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5627bbe75dd0 tx=0x7f4964000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f485f606640 1 -- 172.21.15.114:0/3159385700 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4964012030 con 0x5627bbcfe7d0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627bbd88b80 con 0x5627bbcfe7d0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f485f606640 1 -- 172.21.15.114:0/3159385700 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496401a750 con 0x5627bbcfe7d0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.417+0000 7f485f606640 1 -- 172.21.15.114:0/3159385700 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f496401aa50 con 0x5627bbcfe7d0 2024-05-08T18:10:09.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627bbd890d0 con 0x5627bbcfe7d0 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f485f606640 1 -- 172.21.15.114:0/3159385700 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f4964015020 con 0x5627bbcfe7d0 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f485f606640 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f48580383f0 0x7f485803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f485f606640 1 -- 172.21.15.114:0/3159385700 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f4964020030 con 0x5627bbcfe7d0 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4972138640 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f48580383f0 0x7f485803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbd8e2c0 0x5627bbe85800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbe85d40 con 0x5627bbd8e2c0 2024-05-08T18:10:09.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f497313a640 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbd8e2c0 0x5627bbe85800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4972138640 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f48580383f0 0x7f485803a8b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f49680ad000 tx=0x7f49680a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f497313a640 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbd8e2c0 0x5627bbe85800 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f497313a640 1 -- 172.21.15.114:0/3159385700 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f496c00a4d0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbe860e0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f497313a640 1 -- 172.21.15.114:0/3159385700 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f496c00a4d0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbe879e0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f497313a640 1 -- 172.21.15.114:0/3159385700 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f496c00a4d0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.421+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbe86c10 con 0x5627bbd8e2c0 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f497313a640 1 -- 172.21.15.114:0/3159385700 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f496c00a4d0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbe87060 con 0x5627bbd8e2c0 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f497313a640 1 -- 172.21.15.114:0/3159385700 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f496c00a4d0 con 0x5627bbd8e2c0 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 Processor -- start 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 -- start start 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 0x5627bbe96740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627bbc91fc0 con 0x5627bbe96320 2024-05-08T18:10:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4972138640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 0x5627bbe96740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4972138640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 0x5627bbe96740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42572/0 (socket says 172.21.15.114:42572) 2024-05-08T18:10:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4972138640 1 -- 172.21.15.114:0/972382222 learned_addr learned my addr 172.21.15.114:0/972382222 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4972138640 1 -- 172.21.15.114:0/972382222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bbe96c80 con 0x5627bbe96320 2024-05-08T18:10:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4972138640 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 0x5627bbe96740 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f49680ae040 tx=0x7f4968018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f485ce01640 1 -- 172.21.15.114:0/972382222 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680c6070 con 0x5627bbe96320 2024-05-08T18:10:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627bbe97720 con 0x5627bbe96320 2024-05-08T18:10:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f485ce01640 1 -- 172.21.15.114:0/972382222 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49680b7740 con 0x5627bbe96320 2024-05-08T18:10:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f485ce01640 1 -- 172.21.15.114:0/972382222 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680b0040 con 0x5627bbe96320 2024-05-08T18:10:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627bbe97b90 con 0x5627bbe96320 2024-05-08T18:10:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.425+0000 7f485ce01640 1 -- 172.21.15.114:0/972382222 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f49680c9070 con 0x5627bbe96320 2024-05-08T18:10:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f485ce01640 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f484c0383f0 0x7f484c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f485ce01640 1 -- 172.21.15.114:0/972382222 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f49680be030 con 0x5627bbe96320 2024-05-08T18:10:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f497313a640 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f484c0383f0 0x7f484c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 Processor -- start 2024-05-08T18:10:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- start start 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbea3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627bbe75690 con 0x5627bbea3450 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f497313a640 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f484c0383f0 0x7f484c03a8b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5627bbe86730 tx=0x7f496c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbea3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbea3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42578/0 (socket says 172.21.15.114:42578) 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 -- 172.21.15.114:0/1128169635 learned_addr learned my addr 172.21.15.114:0/1128169635 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 -- 172.21.15.114:0/1128169635 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bbea3e00 con 0x5627bbea3450 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 --2- 172.21.15.114:0/1128169635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbea3830 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49680e9240 tx=0x7f49680caca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74ed76035031a8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f48567fc640 1 -- 172.21.15.114:0/1128169635 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680d9020 con 0x5627bbea3450 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f48567fc640 1 -- 172.21.15.114:0/1128169635 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49680065a0 con 0x5627bbea3450 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f48567fc640 1 -- 172.21.15.114:0/1128169635 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680e9620 con 0x5627bbea3450 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- 172.21.15.114:0/1128169635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 msgr2=0x5627bbea3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 --2- 172.21.15.114:0/1128169635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbea3830 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49680e9240 tx=0x7f49680caca0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- 172.21.15.114:0/1128169635 shutdown_connections 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 --2- 172.21.15.114:0/1128169635 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbea3830 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- 172.21.15.114:0/1128169635 >> 172.21.15.114:0/1128169635 conn(0x5627bbe9f790 msgr2=0x5627bbe9d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- 172.21.15.114:0/1128169635 shutdown_connections 2024-05-08T18:10:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- 172.21.15.114:0/1128169635 wait complete. 2024-05-08T18:10:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 Processor -- start 2024-05-08T18:10:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- start start 2024-05-08T18:10:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbeaa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4974e25980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5627bbea45c0 con 0x5627bbea3450 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbeaa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbeaa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42580/0 (socket says 172.21.15.114:42580) 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.429+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 learned_addr learned my addr 172.21.15.114:0/3842326527 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627bbeaaed0 con 0x5627bbea3450 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4972138640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbeaa990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f49680b6cf0 tx=0x7f49680e91a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4854ff9640 1 -- 172.21.15.114:0/3842326527 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680c9570 con 0x5627bbea3450 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627bbeab160 con 0x5627bbea3450 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4854ff9640 1 -- 172.21.15.114:0/3842326527 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49680c9710 con 0x5627bbea3450 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4854ff9640 1 -- 172.21.15.114:0/3842326527 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f49680c99f0 con 0x5627bbea3450 2024-05-08T18:10:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627bbeade40 con 0x5627bbea3450 2024-05-08T18:10:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4854ff9640 1 -- 172.21.15.114:0/3842326527 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f49680dc020 con 0x5627bbea3450 2024-05-08T18:10:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4854ff9640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f483c0383f0 0x7f483c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4854ff9640 1 -- 172.21.15.114:0/3842326527 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f49680a8070 con 0x5627bbea3450 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f497313a640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f483c0383f0 0x7f483c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbeb5e40 0x5627bbeb82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeb8a00 con 0x5627bbeb5e40 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4972939640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbeb5e40 0x5627bbeb82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f497313a640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f483c0383f0 0x7f483c03a8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5627bbd89b10 tx=0x7f496c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.433+0000 7f4972939640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbeb5e40 0x5627bbeb82b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 realm 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeb8e10 con 0x5627bbeb5e40 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeb96e0 con 0x5627bbeb5e40 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeb9a80 con 0x5627bbeb5e40 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeb9ee0 con 0x5627bbeb5e40 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 20 searching for the correct realm 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627bbebbe50 0x5627bbebe240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972138640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627bbebbe50 0x5627bbebe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972138640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627bbebbe50 0x5627bbebe240 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972138640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f49680de030 0x7f49680cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f497313a640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f49680de030 0x7f49680cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f497313a640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f49680de030 0x7f49680cdab0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4964017050 0x7f4964016570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.437+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4964017050 0x7f4964016570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4964017050 0x7f4964016570 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.441+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.445+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbebbe50 2024-05-08T18:10:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f4964017050 2024-05-08T18:10:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.449+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebe8f0 con 0x7f49680de030 2024-05-08T18:10:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeba8f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeba530 con 0x5627bbeb5e40 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebb1c0 con 0x5627bbeb5e40 2024-05-08T18:10:09.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 zone default found 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 4 Realm: () 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 zonegroup default 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebb1c0 con 0x7f4964017050 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec0730 con 0x5627bbebbe50 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec0ad0 con 0x5627bbebbe50 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 started sync module instance, tier type = 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.453+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbebfbd0 con 0x7f49680de030 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728656519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec1390 con 0x7f49680de030 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec1be0 con 0x5627bbeb5e40 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728656519104] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728656522976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec17f0 con 0x5627bbeb5e40 2024-05-08T18:10:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.457+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec22b0 con 0x5627bbebbe50 2024-05-08T18:10:09.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728656522976] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728656526720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec26a0 con 0x5627bbebbe50 2024-05-08T18:10:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec3060 con 0x7f49680de030 2024-05-08T18:10:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728656530656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec3900 con 0x7f49680de030 2024-05-08T18:10:09.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec4320 con 0x5627bbeb5e40 2024-05-08T18:10:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728656526720] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.461+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728656530656] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728656535056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec3450 con 0x5627bbeb5e40 2024-05-08T18:10:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec4bc0 con 0x7f4964017050 2024-05-08T18:10:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728656536928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec4e30 con 0x7f4964017050 2024-05-08T18:10:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec5680 con 0x7f4964017050 2024-05-08T18:10:09.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.465+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728656535056] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728656536928] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728656537984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec5250 con 0x7f4964017050 2024-05-08T18:10:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec5ae0 con 0x7f4964017050 2024-05-08T18:10:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728656540240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec6170 con 0x7f4964017050 2024-05-08T18:10:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=0 2024-05-08T18:10:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=1 2024-05-08T18:10:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=2 2024-05-08T18:10:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=3 2024-05-08T18:10:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=4 2024-05-08T18:10:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=5 2024-05-08T18:10:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728656537984] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.469+0000 7f4974e25980 20 add_watcher() i=6 2024-05-08T18:10:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728656540240] v32'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 20 add_watcher() i=7 2024-05-08T18:10:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:09.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec9090 con 0x5627bbeb5e40 2024-05-08T18:10:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728656542640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbec6480 con 0x5627bbeb5e40 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728656542640] v32'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f48297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.473+0000 7f4974e25980 5 note: GC not initialized 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f47a3fff640 20 reqs_thread_entry: start 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:09.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 20 Filter name: none 2024-05-08T18:10:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f47a1ffb640 20 reqs_thread_entry: start 2024-05-08T18:10:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeecd40 con 0x5627bbeb5e40 2024-05-08T18:10:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeecd40 con 0x7f49680de030 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeecd40 con 0x5627bbeb5e40 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeecd00 con 0x5627bbebbe50 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed250 con 0x5627bbebbe50 2024-05-08T18:10:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed250 con 0x5627bbebbe50 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed250 con 0x5627bbeb5e40 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed250 con 0x5627bbeb5e40 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed1e0 con 0x5627bbebbe50 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed1c0 con 0x5627bbebbe50 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.477+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeed1c0 con 0x7f4964017050 2024-05-08T18:10:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f49680de030 2024-05-08T18:10:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f4964017050 2024-05-08T18:10:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f4964017050 2024-05-08T18:10:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.481+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f4964017050 2024-05-08T18:10:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv6 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f4964017050 2024-05-08T18:10:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f49680de030 2024-05-08T18:10:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f4964017050 2024-05-08T18:10:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.485+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeee1d0 con 0x7f4964017050 2024-05-08T18:10:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f48297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.489+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728656542640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.493+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94728656542640] v32'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.493+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728656519104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x7f49680de030 2024-05-08T18:10:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.493+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94728656519104] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.493+0000 7f4974e25980 20 remove_watcher() i=0 2024-05-08T18:10:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.493+0000 7f4974e25980 2 removed watcher, disabling cache 2024-05-08T18:10:09.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.493+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728656522976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.497+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94728656522976] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.497+0000 7f4974e25980 20 remove_watcher() i=1 2024-05-08T18:10:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.497+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728656526720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x5627bbebbe50 2024-05-08T18:10:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.497+0000 7f4972138640 1 -- 172.21.15.114:0/3842326527 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94728656526720] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f49680c8030 con 0x5627bbebbe50 2024-05-08T18:10:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.497+0000 7f4974e25980 20 remove_watcher() i=2 2024-05-08T18:10:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.497+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728656530656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x7f49680de030 2024-05-08T18:10:09.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.501+0000 7f497313a640 1 -- 172.21.15.114:0/3842326527 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94728656530656] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f496c01f070 con 0x7f49680de030 2024-05-08T18:10:09.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.501+0000 7f4974e25980 20 remove_watcher() i=3 2024-05-08T18:10:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.501+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728656535056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x5627bbeb5e40 2024-05-08T18:10:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.501+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94728656535056] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x5627bbeb5e40 2024-05-08T18:10:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.501+0000 7f4974e25980 20 remove_watcher() i=4 2024-05-08T18:10:09.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.501+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728656536928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x7f4964017050 2024-05-08T18:10:09.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.505+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94728656536928] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.505+0000 7f4974e25980 20 remove_watcher() i=5 2024-05-08T18:10:09.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.505+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728656537984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x7f4964017050 2024-05-08T18:10:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.505+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94728656537984] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.505+0000 7f4974e25980 20 remove_watcher() i=6 2024-05-08T18:10:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.505+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728656540240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5627bbeea1d0 con 0x7f4964017050 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94728656540240] v32'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4964008030 con 0x7f4964017050 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 20 remove_watcher() i=7 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4964017050 msgr2=0x7f4964016570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f4964017050 0x7f4964016570 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbeb5e40 msgr2=0x5627bbeb82b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbeb5e40 0x5627bbeb82b0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f49680de030 msgr2=0x7f49680cdab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f49680de030 0x7f49680cdab0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627bbebbe50 msgr2=0x5627bbebe240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5627bbebbe50 0x5627bbebe240 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f483c0383f0 msgr2=0x7f483c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f483c0383f0 0x7f483c03a8b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5627bbd89b10 tx=0x7f496c01f000 comp rx=0 tx=0).stop 2024-05-08T18:10:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 msgr2=0x5627bbeaa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4972939640 1 -- 172.21.15.114:0/3842326527 reap_dead start 2024-05-08T18:10:09.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbeaa990 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f49680b6cf0 tx=0x7f49680e91a0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 shutdown_connections 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3842326527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbea3450 0x5627bbeaa990 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 >> 172.21.15.114:0/3842326527 conn(0x5627bbe9f790 msgr2=0x5627bbea4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 shutdown_connections 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3842326527 wait complete. 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f484c0383f0 msgr2=0x7f484c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f484c0383f0 0x7f484c03a8b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x5627bbe86730 tx=0x7f496c005850 comp rx=0 tx=0).stop 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 msgr2=0x5627bbe96740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 0x5627bbe96740 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f49680ae040 tx=0x7f4968018020 comp rx=0 tx=0).stop 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 shutdown_connections 2024-05-08T18:10:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f484c0383f0 0x7f484c03a8b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/972382222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbe96320 0x5627bbe96740 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 >> 172.21.15.114:0/972382222 conn(0x5627bbe8b130 msgr2=0x5627bbe8bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 shutdown_connections 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/972382222 wait complete. 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbd8e2c0 msgr2=0x5627bbe85800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbd8e2c0 0x5627bbe85800 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f48580383f0 msgr2=0x7f485803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f48580383f0 0x7f485803a8b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f49680ad000 tx=0x7f49680a5040 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 msgr2=0x5627bbd8a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbd8a410 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x5627bbe75dd0 tx=0x7f4964000bd0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 shutdown_connections 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5627bbd8e2c0 0x5627bbe85800 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f48580383f0 0x7f485803a8b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 --2- 172.21.15.114:0/3159385700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627bbcfe7d0 0x5627bbd8a410 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 >> 172.21.15.114:0/3159385700 conn(0x5627bbd84680 msgr2=0x5627bbe6f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 shutdown_connections 2024-05-08T18:10:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.509+0000 7f4974e25980 1 -- 172.21.15.114:0/3159385700 wait complete. 2024-05-08T18:10:09.523 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:09.523 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:09.523 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T18:10:09.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T18:10:09.523 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T18:10:09.606 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:09.607 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd25a1b6980 1 Processor -- start 2024-05-08T18:10:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd25a1b6980 1 -- start start 2024-05-08T18:10:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd25a1b6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c78a1c42d0 0x55c78a1c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd25a1b6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c78a06c710 con 0x55c78a1bfd70 2024-05-08T18:10:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd25a1b6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c78a080f00 con 0x55c78a1c42d0 2024-05-08T18:10:09.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd2574c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c78a1c42d0 0x55c78a1c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd257cca640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55c78a1bfd70 0x55c78a1c0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47846/0 (socket says 172.21.15.114:47846) 2024-05-08T18:10:09.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd2574c9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c78a1c42d0 0x55c78a1c66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42596/0 (socket says 172.21.15.114:42596) 2024-05-08T18:10:09.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd257cca640 1 -- 172.21.15.114:0/1775882424 learned_addr learned my addr 172.21.15.114:0/1775882424 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:09.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd2574c9640 1 -- 172.21.15.114:0/1775882424 >> v1:172.21.15.53:6789/0 conn(0x55c78a1bfd70 legacy=0x55c78a1c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.609+0000 7fd2574c9640 1 -- 172.21.15.114:0/1775882424 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78a048ae0 con 0x55c78a1c42d0 2024-05-08T18:10:09.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd2574c9640 1 --2- 172.21.15.114:0/1775882424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1c42d0 0x55c78a1c66c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00a480 tx=0x7fd24c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c29be0dc052db0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd256cc8640 1 -- 172.21.15.114:0/1775882424 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0b0070 con 0x55c78a1c42d0 2024-05-08T18:10:09.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd256cc8640 1 -- 172.21.15.114:0/1775882424 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0ab540 con 0x55c78a1c42d0 2024-05-08T18:10:09.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd256cc8640 1 -- 172.21.15.114:0/1775882424 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0ab840 con 0x55c78a1c42d0 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 -- 172.21.15.114:0/1775882424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1c42d0 msgr2=0x55c78a1c66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/1775882424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1c42d0 0x55c78a1c66c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd24c00a480 tx=0x7fd24c01b280 comp rx=0 tx=0).stop 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 -- 172.21.15.114:0/1775882424 shutdown_connections 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/1775882424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1c42d0 0x55c78a1c66c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 -- 172.21.15.114:0/1775882424 >> 172.21.15.114:0/1775882424 conn(0x55c78a1bb640 msgr2=0x55c78a1bda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 -- 172.21.15.114:0/1775882424 shutdown_connections 2024-05-08T18:10:09.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.613+0000 7fd25a1b6980 1 -- 172.21.15.114:0/1775882424 wait complete. 2024-05-08T18:10:09.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd25a1b6980 1 Processor -- start 2024-05-08T18:10:09.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd25a1b6980 1 -- start start 2024-05-08T18:10:09.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd25a1b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd25a1b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c78a0c4f80 con 0x55c78a1bfd70 2024-05-08T18:10:09.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd257cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd257cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42608/0 (socket says 172.21.15.114:42608) 2024-05-08T18:10:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd257cca640 1 -- 172.21.15.114:0/3984351118 learned_addr learned my addr 172.21.15.114:0/3984351118 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd257cca640 1 -- 172.21.15.114:0/3984351118 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78a08cda0 con 0x55c78a1bfd70 2024-05-08T18:10:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd257cca640 1 --2- 172.21.15.114:0/3984351118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2aae70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2480017b0 tx=0x7fd248001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a447adb32a9d8471 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd145e0b640 1 -- 172.21.15.114:0/3984351118 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2480044f0 con 0x55c78a1bfd70 2024-05-08T18:10:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd145e0b640 1 -- 172.21.15.114:0/3984351118 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2480046b0 con 0x55c78a1bfd70 2024-05-08T18:10:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.629+0000 7fd145e0b640 1 -- 172.21.15.114:0/3984351118 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248004a10 con 0x55c78a1bfd70 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/3984351118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 msgr2=0x55c78a2aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/3984351118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2aae70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd2480017b0 tx=0x7fd248001c70 comp rx=0 tx=0).stop 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/3984351118 shutdown_connections 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/3984351118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2aae70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/3984351118 >> 172.21.15.114:0/3984351118 conn(0x55c78a1bb640 msgr2=0x55c78a2a6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/3984351118 shutdown_connections 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/3984351118 wait complete. 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 Processor -- start 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- start start 2024-05-08T18:10:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c78a1c96f0 con 0x55c78a1bfd70 2024-05-08T18:10:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd257cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd257cca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42616/0 (socket says 172.21.15.114:42616) 2024-05-08T18:10:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd257cca640 1 -- 172.21.15.114:0/354003441 learned_addr learned my addr 172.21.15.114:0/354003441 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd257cca640 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78a2b3950 con 0x55c78a1bfd70 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd257cca640 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2b3410 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd248001cb0 tx=0x7fd248000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd13ffff640 1 -- 172.21.15.114:0/354003441 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248022020 con 0x55c78a1bfd70 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c78a2b3be0 con 0x55c78a1bfd70 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd13ffff640 1 -- 172.21.15.114:0/354003441 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2480148b0 con 0x55c78a1bfd70 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd13ffff640 1 -- 172.21.15.114:0/354003441 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd248014bd0 con 0x55c78a1bfd70 2024-05-08T18:10:09.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c78a2b6870 con 0x55c78a1bfd70 2024-05-08T18:10:09.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.633+0000 7fd13ffff640 1 -- 172.21.15.114:0/354003441 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd248025020 con 0x55c78a1bfd70 2024-05-08T18:10:09.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd13ffff640 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1400383f0 0x7fd14003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd13ffff640 1 -- 172.21.15.114:0/354003441 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd248018030 con 0x55c78a1bfd70 2024-05-08T18:10:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2574c9640 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1400383f0 0x7fd14003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a1c42d0 0x55c78a2ba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2baa40 con 0x55c78a1c42d0 2024-05-08T18:10:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a1c42d0 0x55c78a2ba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2574c9640 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1400383f0 0x7fd14003a8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0ad000 tx=0x7fd24c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a1c42d0 0x55c78a2ba4c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 -- 172.21.15.114:0/354003441 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd2500083f0 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2b7a90 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 -- 172.21.15.114:0/354003441 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd2500083f0 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2bc840 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 -- 172.21.15.114:0/354003441 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd2500083f0 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2bb9b0 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 -- 172.21.15.114:0/354003441 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd2500083f0 con 0x55c78a1c42d0 2024-05-08T18:10:09.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2bbe00 con 0x55c78a1c42d0 2024-05-08T18:10:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2584cb640 1 -- 172.21.15.114:0/354003441 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd2500083f0 con 0x55c78a1c42d0 2024-05-08T18:10:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 Processor -- start 2024-05-08T18:10:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- start start 2024-05-08T18:10:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 0x55c78a2cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd25a1b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c78a0c8fc0 con 0x55c78a2cb170 2024-05-08T18:10:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2574c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 0x55c78a2cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2574c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 0x55c78a2cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42632/0 (socket says 172.21.15.114:42632) 2024-05-08T18:10:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.637+0000 7fd2574c9640 1 -- 172.21.15.114:0/2876232469 learned_addr learned my addr 172.21.15.114:0/2876232469 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2574c9640 1 -- 172.21.15.114:0/2876232469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78a2cbad0 con 0x55c78a2cb170 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2574c9640 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 0x55c78a2cb590 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0ae040 tx=0x7fd24c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd13d7fa640 1 -- 172.21.15.114:0/2876232469 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0c6070 con 0x55c78a2cb170 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd13d7fa640 1 -- 172.21.15.114:0/2876232469 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0b7740 con 0x55c78a2cb170 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c78a2cc570 con 0x55c78a2cb170 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd13d7fa640 1 -- 172.21.15.114:0/2876232469 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0b0040 con 0x55c78a2cb170 2024-05-08T18:10:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c78a2cc9e0 con 0x55c78a2cb170 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd13d7fa640 1 -- 172.21.15.114:0/2876232469 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd24c0c9070 con 0x55c78a2cb170 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd13d7fa640 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1300383f0 0x7fd13003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd13d7fa640 1 -- 172.21.15.114:0/2876232469 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd24c0be030 con 0x55c78a2cb170 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2584cb640 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1300383f0 0x7fd13003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd25a1b6980 1 Processor -- start 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd25a1b6980 1 -- start start 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2584cb640 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1300383f0 0x7fd13003a8b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55c78a2bb4d0 tx=0x7fd250003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd25a1b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2a96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd25a1b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c78a2ab5c0 con 0x55c78a2a92b0 2024-05-08T18:10:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2574c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2a96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2574c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2a96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42648/0 (socket says 172.21.15.114:42648) 2024-05-08T18:10:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.641+0000 7fd2574c9640 1 -- 172.21.15.114:0/2533483006 learned_addr learned my addr 172.21.15.114:0/2533483006 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 -- 172.21.15.114:0/2533483006 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78a2a7b30 con 0x55c78a2a92b0 2024-05-08T18:10:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 --2- 172.21.15.114:0/2533483006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2a96d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0e9240 tx=0x7fd24c0caca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ecd810d5093922 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd136ffd640 1 -- 172.21.15.114:0/2533483006 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0066d0 con 0x55c78a2a92b0 2024-05-08T18:10:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd136ffd640 1 -- 172.21.15.114:0/2533483006 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0db070 con 0x55c78a2a92b0 2024-05-08T18:10:09.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd136ffd640 1 -- 172.21.15.114:0/2533483006 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0ea3d0 con 0x55c78a2a92b0 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2533483006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 msgr2=0x55c78a2a96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/2533483006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2a96d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0e9240 tx=0x7fd24c0caca0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2533483006 shutdown_connections 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/2533483006 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2a96d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2533483006 >> 172.21.15.114:0/2533483006 conn(0x55c78a2d45d0 msgr2=0x55c78a2d2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2533483006 shutdown_connections 2024-05-08T18:10:09.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2533483006 wait complete. 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 Processor -- start 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- start start 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c78a2a7fa0 con 0x55c78a2a92b0 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2e19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42656/0 (socket says 172.21.15.114:42656) 2024-05-08T18:10:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 learned_addr learned my addr 172.21.15.114:0/957341326 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78a2e1f00 con 0x55c78a2a92b0 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd2574c9640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2e19c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0cace0 tx=0x7fd24c0e91a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd1357fa640 1 -- 172.21.15.114:0/957341326 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0ee020 con 0x55c78a2a92b0 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c78a2e2190 con 0x55c78a2a92b0 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd1357fa640 1 -- 172.21.15.114:0/957341326 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c0c9360 con 0x55c78a2a92b0 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd1357fa640 1 -- 172.21.15.114:0/957341326 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0c9660 con 0x55c78a2a92b0 2024-05-08T18:10:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.645+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c78a2e4e70 con 0x55c78a2a92b0 2024-05-08T18:10:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd1357fa640 1 -- 172.21.15.114:0/957341326 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd24c0c9850 con 0x55c78a2a92b0 2024-05-08T18:10:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd1357fa640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1200383f0 0x7fd12003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd1357fa640 1 -- 172.21.15.114:0/957341326 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd24c0a8070 con 0x55c78a2a92b0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd2584cb640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1200383f0 0x7fd12003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a2ece50 0x55c78a2ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2efa10 con 0x55c78a2ece50 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a2ece50 0x55c78a2ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd2584cb640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1200383f0 0x7fd12003a8b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd250008fd0 tx=0x7fd25001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a2ece50 0x55c78a2ef2c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 realm 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2efe20 con 0x55c78a2ece50 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f06f0 con 0x55c78a2ece50 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f0a90 con 0x55c78a2ece50 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f0f30 con 0x55c78a2ece50 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 20 searching for the correct realm 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c78a2f2ea0 0x55c78a2f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2f2ea0 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.649+0000 7fd2574c9640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c78a2f2ea0 0x55c78a2f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2574c9640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c78a2f2ea0 0x55c78a2f5290 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2574c9640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd24c0f3020 0x7fd24c0e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd24c0f3020 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2584cb640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd24c0f3020 0x7fd24c0e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2584cb640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd24c0f3020 0x7fd24c0e17a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd24c0f3020 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2ece50 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2ece50 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd248027020 0x7fd24801e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd248027020 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd248027020 0x7fd24801e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd248027020 0x7fd24801e3f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x7fd248027020 2024-05-08T18:10:09.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.653+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd248027020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x7fd248027020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd24c0f3020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2f2ea0 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2ece50 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd24c0f3020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2ece50 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd24c0f3020 2024-05-08T18:10:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2f2ea0 2024-05-08T18:10:09.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2f2ea0 2024-05-08T18:10:09.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x7fd248027020 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x7fd248027020 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2f2ea0 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.657+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2f2ea0 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f5910 con 0x55c78a2ece50 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x55c78a2ece50 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd248027020 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24801b070 con 0x7fd248027020 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x55c78a2f2ea0 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd24c0f3020 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x55c78a2ece50 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd24801b070 con 0x55c78a2ece50 2024-05-08T18:10:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd248027020 2024-05-08T18:10:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x55c78a2f2ea0 2024-05-08T18:10:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.661+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd248027020 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd24c0f3020 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x55c78a2f2ea0 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd248027020 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x55c78a2ece50 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24804ec60 con 0x7fd24c0f3020 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f1810 con 0x55c78a2ece50 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f1bb0 con 0x55c78a2ece50 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f1bb0 con 0x55c78a2ece50 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 zone default found 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 4 Realm: () 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 zonegroup default 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f1fd0 con 0x7fd248027020 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f2410 con 0x55c78a2f2ea0 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.665+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f7770 con 0x55c78a2f2ea0 2024-05-08T18:10:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 20 started sync module instance, tier type = 2024-05-08T18:10:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:09.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f6c10 con 0x7fd24c0f3020 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94315505217584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8010 con 0x7fd24c0f3020 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8860 con 0x55c78a2ece50 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94315505217584] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.669+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.673+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94315505220448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8470 con 0x55c78a2ece50 2024-05-08T18:10:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.673+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8f70 con 0x55c78a2f2ea0 2024-05-08T18:10:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.673+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94315505220448] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.673+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.673+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94315505224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f9360 con 0x55c78a2f2ea0 2024-05-08T18:10:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.673+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f9d20 con 0x7fd24c0f3020 2024-05-08T18:10:09.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94315505228192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fa5c0 con 0x7fd24c0f3020 2024-05-08T18:10:09.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fafe0 con 0x55c78a2ece50 2024-05-08T18:10:09.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94315505224288] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94315505228192] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94315505232592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fa110 con 0x55c78a2ece50 2024-05-08T18:10:09.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.677+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fb880 con 0x7fd248027020 2024-05-08T18:10:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94315505232592] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94315505221504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fa110 con 0x7fd248027020 2024-05-08T18:10:09.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fbdd0 con 0x7fd248027020 2024-05-08T18:10:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94315505236128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fbd90 con 0x7fd248027020 2024-05-08T18:10:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fcd30 con 0x7fd248027020 2024-05-08T18:10:09.682 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.681+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94315505221504] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94315505236128] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94315505240128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fcd30 con 0x7fd248027020 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=0 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=1 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=2 2024-05-08T18:10:09.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=3 2024-05-08T18:10:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=4 2024-05-08T18:10:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=5 2024-05-08T18:10:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=6 2024-05-08T18:10:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94315505240128] v32'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 20 add_watcher() i=7 2024-05-08T18:10:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fc0e0 con 0x55c78a2ece50 2024-05-08T18:10:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.685+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94315505234464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fc0e0 con 0x55c78a2ece50 2024-05-08T18:10:09.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94315505234464] v32'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd10dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 5 note: GC not initialized 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd10cfe1640 20 reqs_thread_entry: start 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 20 Filter name: none 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd0867fc640 20 reqs_thread_entry: start 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a323130 con 0x55c78a2ece50 2024-05-08T18:10:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c78a324680 con 0x7fd248027020 2024-05-08T18:10:09.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.689+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd10dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94315505234464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a322b50 con 0x55c78a2ece50 2024-05-08T18:10:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94315505234464] v32'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94315505217584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fb220 con 0x7fd24c0f3020 2024-05-08T18:10:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94315505217584] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd25a1b6980 20 remove_watcher() i=0 2024-05-08T18:10:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd25a1b6980 2 removed watcher, disabling cache 2024-05-08T18:10:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.693+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94315505220448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fb220 con 0x55c78a2ece50 2024-05-08T18:10:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.697+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94315505220448] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.697+0000 7fd25a1b6980 20 remove_watcher() i=1 2024-05-08T18:10:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.697+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94315505224288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fb220 con 0x55c78a2f2ea0 2024-05-08T18:10:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.697+0000 7fd2574c9640 1 -- 172.21.15.114:0/957341326 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94315505224288] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c0f0020 con 0x55c78a2f2ea0 2024-05-08T18:10:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.697+0000 7fd25a1b6980 20 remove_watcher() i=2 2024-05-08T18:10:09.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.697+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94315505228192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8a60 con 0x7fd24c0f3020 2024-05-08T18:10:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.701+0000 7fd2584cb640 1 -- 172.21.15.114:0/957341326 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94315505228192] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25002f040 con 0x7fd24c0f3020 2024-05-08T18:10:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.701+0000 7fd25a1b6980 20 remove_watcher() i=3 2024-05-08T18:10:09.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.701+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94315505232592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2fb220 con 0x55c78a2ece50 2024-05-08T18:10:09.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.701+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94315505232592] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x55c78a2ece50 2024-05-08T18:10:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.701+0000 7fd25a1b6980 20 remove_watcher() i=4 2024-05-08T18:10:09.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.701+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94315505221504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8a60 con 0x7fd248027020 2024-05-08T18:10:09.703 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.705+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94315505221504] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.705+0000 7fd25a1b6980 20 remove_watcher() i=5 2024-05-08T18:10:09.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.705+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94315505236128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8a60 con 0x7fd248027020 2024-05-08T18:10:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.705+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94315505236128] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.705+0000 7fd25a1b6980 20 remove_watcher() i=6 2024-05-08T18:10:09.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.705+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94315505240128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c78a2f8a60 con 0x7fd248027020 2024-05-08T18:10:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94315505240128] v32'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd248056040 con 0x7fd248027020 2024-05-08T18:10:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 20 remove_watcher() i=7 2024-05-08T18:10:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd248027020 msgr2=0x7fd24801e3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd248027020 0x7fd24801e3f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a2ece50 msgr2=0x55c78a2ef2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a2ece50 0x55c78a2ef2c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd24c0f3020 msgr2=0x7fd24c0e17a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd24c0f3020 0x7fd24c0e17a0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c78a2f2ea0 msgr2=0x55c78a2f5290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c78a2f2ea0 0x55c78a2f5290 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1200383f0 msgr2=0x7fd12003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1200383f0 0x7fd12003a8b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd250008fd0 tx=0x7fd25001b070 comp rx=0 tx=0).stop 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 msgr2=0x55c78a2e19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/957341326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2a92b0 0x55c78a2e19c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0cace0 tx=0x7fd24c0e91a0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 reap_dead start 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd257cca640 1 -- 172.21.15.114:0/957341326 reap_dead start 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 shutdown_connections 2024-05-08T18:10:09.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 >> 172.21.15.114:0/957341326 conn(0x55c78a2d45d0 msgr2=0x55c78a2d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 shutdown_connections 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/957341326 wait complete. 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1300383f0 msgr2=0x7fd13003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1300383f0 0x7fd13003a8b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55c78a2bb4d0 tx=0x7fd250003070 comp rx=0 tx=0).stop 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 msgr2=0x55c78a2cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 0x55c78a2cb590 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0ae040 tx=0x7fd24c018020 comp rx=0 tx=0).stop 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 shutdown_connections 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1300383f0 0x7fd13003a8b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/2876232469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a2cb170 0x55c78a2cb590 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 >> 172.21.15.114:0/2876232469 conn(0x55c78a2bff80 msgr2=0x55c78a2c0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 shutdown_connections 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/2876232469 wait complete. 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a1c42d0 msgr2=0x55c78a2ba4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a1c42d0 0x55c78a2ba4c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1400383f0 msgr2=0x7fd14003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1400383f0 0x7fd14003a8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0ad000 tx=0x7fd24c0a5040 comp rx=0 tx=0).stop 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 msgr2=0x55c78a2b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2b3410 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd248001cb0 tx=0x7fd248000f50 comp rx=0 tx=0).stop 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 shutdown_connections 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c78a1c42d0 0x55c78a2ba4c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fd1400383f0 0x7fd14003a8b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 --2- 172.21.15.114:0/354003441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c78a1bfd70 0x55c78a2b3410 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 >> 172.21.15.114:0/354003441 conn(0x55c78a1bb640 msgr2=0x55c78a2a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 shutdown_connections 2024-05-08T18:10:09.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.709+0000 7fd25a1b6980 1 -- 172.21.15.114:0/354003441 wait complete. 2024-05-08T18:10:09.720 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:09.720 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:09.720 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T18:10:09.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T18:10:09.721 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-08T18:10:09.801 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:09.802 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.801+0000 7f5d9c8db980 1 Processor -- start 2024-05-08T18:10:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.801+0000 7f5d9c8db980 1 -- start start 2024-05-08T18:10:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d9c8db980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7b5ea2a60 0x55b7b5ea4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d9c8db980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7b5d4b710 con 0x55b7b5e9e500 2024-05-08T18:10:09.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d9c8db980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55b7b5d5ff00 con 0x55b7b5ea2a60 2024-05-08T18:10:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d99bee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7b5ea2a60 0x55b7b5ea4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d99bee640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55b7b5ea2a60 0x55b7b5ea4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42672/0 (socket says 172.21.15.114:42672) 2024-05-08T18:10:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d99bee640 1 -- 172.21.15.114:0/601921101 learned_addr learned my addr 172.21.15.114:0/601921101 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d99bee640 1 -- 172.21.15.114:0/601921101 >> v1:172.21.15.53:6789/0 conn(0x55b7b5e9e500 legacy=0x55b7b5e9e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d99bee640 1 -- 172.21.15.114:0/601921101 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b5d27ae0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d99bee640 1 --2- 172.21.15.114:0/601921101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5ea2a60 0x55b7b5ea4e50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400a5c0 tx=0x7f5d8401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce482f6491571d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d993ed640 1 -- 172.21.15.114:0/601921101 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840aa520 con 0x55b7b5ea2a60 2024-05-08T18:10:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d993ed640 1 -- 172.21.15.114:0/601921101 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840af070 con 0x55b7b5ea2a60 2024-05-08T18:10:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.805+0000 7f5d993ed640 1 -- 172.21.15.114:0/601921101 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840aa810 con 0x55b7b5ea2a60 2024-05-08T18:10:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 -- 172.21.15.114:0/601921101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5ea2a60 msgr2=0x55b7b5ea4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/601921101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5ea2a60 0x55b7b5ea4e50 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400a5c0 tx=0x7f5d8401b340 comp rx=0 tx=0).stop 2024-05-08T18:10:09.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 -- 172.21.15.114:0/601921101 shutdown_connections 2024-05-08T18:10:09.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/601921101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5ea2a60 0x55b7b5ea4e50 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 -- 172.21.15.114:0/601921101 >> 172.21.15.114:0/601921101 conn(0x55b7b5e99dd0 msgr2=0x55b7b5e9c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 -- 172.21.15.114:0/601921101 shutdown_connections 2024-05-08T18:10:09.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.809+0000 7f5d9c8db980 1 -- 172.21.15.114:0/601921101 wait complete. 2024-05-08T18:10:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 Processor -- start 2024-05-08T18:10:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- start start 2024-05-08T18:10:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5ea66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7b5da3f80 con 0x55b7b5e9e500 2024-05-08T18:10:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5ea66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5ea66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42676/0 (socket says 172.21.15.114:42676) 2024-05-08T18:10:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/4130603632 learned_addr learned my addr 172.21.15.114:0/4130603632 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/4130603632 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b5d6bda0 con 0x55b7b5e9e500 2024-05-08T18:10:09.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/4130603632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5ea66c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5d94001690 tx=0x7f5d94001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33588c66a771c118 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5c88608640 1 -- 172.21.15.114:0/4130603632 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94016070 con 0x55b7b5e9e500 2024-05-08T18:10:09.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5c88608640 1 -- 172.21.15.114:0/4130603632 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d9400f640 con 0x55b7b5e9e500 2024-05-08T18:10:09.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5c88608640 1 -- 172.21.15.114:0/4130603632 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d9400f960 con 0x55b7b5e9e500 2024-05-08T18:10:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- 172.21.15.114:0/4130603632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 msgr2=0x55b7b5ea66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/4130603632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5ea66c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f5d94001690 tx=0x7f5d94001b50 comp rx=0 tx=0).stop 2024-05-08T18:10:09.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- 172.21.15.114:0/4130603632 shutdown_connections 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/4130603632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5ea66c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- 172.21.15.114:0/4130603632 >> 172.21.15.114:0/4130603632 conn(0x55b7b5e99dd0 msgr2=0x55b7b5f862c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- 172.21.15.114:0/4130603632 shutdown_connections 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- 172.21.15.114:0/4130603632 wait complete. 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 Processor -- start 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- start start 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5f92d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9c8db980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7b5ea5e70 con 0x55b7b5e9e500 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5f92d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5f92d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42686/0 (socket says 172.21.15.114:42686) 2024-05-08T18:10:09.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.825+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/418572850 learned_addr learned my addr 172.21.15.114:0/418572850 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b5f93250 con 0x55b7b5e9e500 2024-05-08T18:10:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5f92d10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400f610 tx=0x7f5d94001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5c86e05640 1 -- 172.21.15.114:0/418572850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94021020 con 0x55b7b5e9e500 2024-05-08T18:10:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b5f934e0 con 0x55b7b5e9e500 2024-05-08T18:10:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b5f96170 con 0x55b7b5e9e500 2024-05-08T18:10:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5c86e05640 1 -- 172.21.15.114:0/418572850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d940116c0 con 0x55b7b5e9e500 2024-05-08T18:10:09.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5c86e05640 1 -- 172.21.15.114:0/418572850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94016040 con 0x55b7b5e9e500 2024-05-08T18:10:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5c86e05640 1 -- 172.21.15.114:0/418572850 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5d94024020 con 0x55b7b5e9e500 2024-05-08T18:10:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5c86e05640 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c800383f0 0x7f5c8003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5c86e05640 1 -- 172.21.15.114:0/418572850 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5d9404dff0 con 0x55b7b5e9e500 2024-05-08T18:10:09.830 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d99bee640 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c800383f0 0x7f5c8003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5ea2a60 0x55b7b5f99c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5f9a2e0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5ea2a60 0x55b7b5f99c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d99bee640 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c800383f0 0x7f5c8003a8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ae000 tx=0x7f5d840a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5ea2a60 0x55b7b5f99c70 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9abf0640 1 -- 172.21.15.114:0/418572850 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d8c0083f0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.829+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5f97390 con 0x55b7b5ea2a60 2024-05-08T18:10:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9abf0640 1 -- 172.21.15.114:0/418572850 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d8c0083f0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5f9c120 con 0x55b7b5ea2a60 2024-05-08T18:10:09.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9abf0640 1 -- 172.21.15.114:0/418572850 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d8c0083f0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5f9b350 con 0x55b7b5ea2a60 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9abf0640 1 -- 172.21.15.114:0/418572850 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d8c0083f0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5f9b7a0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9abf0640 1 -- 172.21.15.114:0/418572850 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d8c0083f0 con 0x55b7b5ea2a60 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 Processor -- start 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- start start 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 0x55b7b5faae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7b5da7fc0 con 0x55b7b5faaa60 2024-05-08T18:10:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d99bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 0x55b7b5faae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d99bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 0x55b7b5faae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42702/0 (socket says 172.21.15.114:42702) 2024-05-08T18:10:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d99bee640 1 -- 172.21.15.114:0/896512285 learned_addr learned my addr 172.21.15.114:0/896512285 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d99bee640 1 -- 172.21.15.114:0/896512285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b5fab3c0 con 0x55b7b5faaa60 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d99bee640 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 0x55b7b5faae80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5d8401b380 tx=0x7f5d840180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5c7ffff640 1 -- 172.21.15.114:0/896512285 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840aa8e0 con 0x55b7b5faaa60 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b5fabe60 con 0x55b7b5faaa60 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5c7ffff640 1 -- 172.21.15.114:0/896512285 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840aaa80 con 0x55b7b5faaa60 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5c7ffff640 1 -- 172.21.15.114:0/896512285 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840aada0 con 0x55b7b5faaa60 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.833+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b5fac2d0 con 0x55b7b5faaa60 2024-05-08T18:10:09.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5c7ffff640 1 -- 172.21.15.114:0/896512285 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5d840c9470 con 0x55b7b5faaa60 2024-05-08T18:10:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5c7ffff640 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5c7ffff640 1 -- 172.21.15.114:0/896512285 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5d840ebda0 con 0x55b7b5faaa60 2024-05-08T18:10:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9c8db980 1 Processor -- start 2024-05-08T18:10:09.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9c8db980 1 -- start start 2024-05-08T18:10:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55b7b5f9ae70 tx=0x7f5d8c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9c8db980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fb7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9c8db980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7b5ea6e10 con 0x55b7b5fb7b40 2024-05-08T18:10:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d99bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fb7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d99bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fb7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42710/0 (socket says 172.21.15.114:42710) 2024-05-08T18:10:09.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d99bee640 1 -- 172.21.15.114:0/3489984386 learned_addr learned my addr 172.21.15.114:0/3489984386 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d99bee640 1 -- 172.21.15.114:0/3489984386 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b5fb84f0 con 0x55b7b5fb7b40 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d99bee640 1 --2- 172.21.15.114:0/3489984386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fb7f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c8540 tx=0x7f5d840c9b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba227ad9731047d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5c7dffb640 1 -- 172.21.15.114:0/3489984386 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840bf410 con 0x55b7b5fb7b40 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5c7dffb640 1 -- 172.21.15.114:0/3489984386 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840bf5b0 con 0x55b7b5fb7b40 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5c7dffb640 1 -- 172.21.15.114:0/3489984386 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840bdac0 con 0x55b7b5fb7b40 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9c8db980 1 -- 172.21.15.114:0/3489984386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 msgr2=0x55b7b5fb7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.837+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/3489984386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fb7f20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5d840c8540 tx=0x7f5d840c9b30 comp rx=0 tx=0).stop 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- 172.21.15.114:0/3489984386 shutdown_connections 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/3489984386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fb7f20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- 172.21.15.114:0/3489984386 >> 172.21.15.114:0/3489984386 conn(0x55b7b5fb3e80 msgr2=0x55b7b5fb1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- 172.21.15.114:0/3489984386 shutdown_connections 2024-05-08T18:10:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- 172.21.15.114:0/3489984386 wait complete. 2024-05-08T18:10:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 Processor -- start 2024-05-08T18:10:09.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- start start 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fbf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55b7b5fb8cb0 con 0x55b7b5fb7b40 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d99bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fbf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d99bee640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fbf050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42726/0 (socket says 172.21.15.114:42726) 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 learned_addr learned my addr 172.21.15.114:0/2517600835 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b5fbf590 con 0x55b7b5fb7b40 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d99bee640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fbf050 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5d840e9f80 tx=0x7f5d840e9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5c6bfff640 1 -- 172.21.15.114:0/2517600835 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840bf410 con 0x55b7b5fb7b40 2024-05-08T18:10:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b5fbf820 con 0x55b7b5fb7b40 2024-05-08T18:10:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5c6bfff640 1 -- 172.21.15.114:0/2517600835 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840c0b60 con 0x55b7b5fb7b40 2024-05-08T18:10:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b5fc2500 con 0x55b7b5fb7b40 2024-05-08T18:10:09.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5c6bfff640 1 -- 172.21.15.114:0/2517600835 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840c0e40 con 0x55b7b5fb7b40 2024-05-08T18:10:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5c6bfff640 1 -- 172.21.15.114:0/2517600835 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5d840bd3b0 con 0x55b7b5fb7b40 2024-05-08T18:10:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5c6bfff640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c64038350 0x7f5c6403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5c6bfff640 1 -- 172.21.15.114:0/2517600835 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5d840f4d00 con 0x55b7b5fb7b40 2024-05-08T18:10:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.841+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c64038350 0x7f5c6403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.843 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5fca500 0x55b7b5fcc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fcd0f0 con 0x55b7b5fca500 2024-05-08T18:10:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5fca500 0x55b7b5fcc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c64038350 0x7f5c6403a810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00f010 tx=0x7f5d8c01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5fca500 0x55b7b5fcc9a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 realm 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fcd500 con 0x55b7b5fca500 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:09.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fcddd0 con 0x55b7b5fca500 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fce170 con 0x55b7b5fca500 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fce5d0 con 0x55b7b5fca500 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 20 searching for the correct realm 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7b5fd0540 0x55b7b5fd2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.848 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d99bee640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7b5fd0540 0x55b7b5fd2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d99bee640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7b5fd0540 0x55b7b5fd2930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d99bee640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d84009040 0x7f5d840f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d84009040 0x7f5d840f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9abf0640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d84009040 0x7f5d840f27b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.845+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94026020 0x7f5d9401a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94026020 0x7f5d9401a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94026020 0x7f5d9401a750 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.852 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.849+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.853+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.857 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fd0540 2024-05-08T18:10:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.859 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.857+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d94026020 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x55b7b5fca500 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd2fb0 con 0x7f5d84009040 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:09.861 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fcefb0 con 0x55b7b5fca500 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fcebc0 con 0x55b7b5fca500 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:09.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fcf910 con 0x55b7b5fca500 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 zone default found 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 4 Realm: () 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 zonegroup default 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd3410 con 0x7f5d94026020 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd52a0 con 0x55b7b5fd0540 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd5640 con 0x55b7b5fd0540 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:09.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 started sync module instance, tier type = 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.861+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd46e0 con 0x7f5d84009040 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247520649776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd59e0 con 0x7f5d84009040 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd62b0 con 0x55b7b5fca500 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247520649776] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247520651984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd5e90 con 0x55b7b5fca500 2024-05-08T18:10:09.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.865+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd6cc0 con 0x55b7b5fd0540 2024-05-08T18:10:09.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247520651984] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247520655840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd5e00 con 0x55b7b5fd0540 2024-05-08T18:10:09.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd79c0 con 0x7f5d84009040 2024-05-08T18:10:09.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247520663072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd8260 con 0x7f5d84009040 2024-05-08T18:10:09.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd8c60 con 0x55b7b5fca500 2024-05-08T18:10:09.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.869+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247520655840] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.873+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.873+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247520661600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd8c20 con 0x55b7b5fca500 2024-05-08T18:10:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.873+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd95e0 con 0x7f5d94026020 2024-05-08T18:10:09.873 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.873+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247520663072] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.873+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247520661600] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247520665008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9130 con 0x7f5d94026020 2024-05-08T18:10:09.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9af0 con 0x7f5d94026020 2024-05-08T18:10:09.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247520671296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9f10 con 0x7f5d94026020 2024-05-08T18:10:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fdaa00 con 0x7f5d94026020 2024-05-08T18:10:09.878 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.877+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247520665008] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247520671296] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247520675024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd8770 con 0x7f5d94026020 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=0 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=1 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=2 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=3 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=4 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=5 2024-05-08T18:10:09.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=6 2024-05-08T18:10:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247520675024] v32'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.882 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 20 add_watcher() i=7 2024-05-08T18:10:09.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:09.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fdd9f0 con 0x55b7b5fca500 2024-05-08T18:10:09.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.881+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247520672352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fdae70 con 0x55b7b5fca500 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247520672352] v32'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5c50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 5 note: GC not initialized 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5bcb7fe640 20 reqs_thread_entry: start 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 20 Filter name: none 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5bc97fa640 20 reqs_thread_entry: start 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 20 rados->read ofs=0 len=0 2024-05-08T18:10:09.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b6000e00 con 0x55b7b5fca500 2024-05-08T18:10:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b7b6002350 con 0x7f5d94026020 2024-05-08T18:10:09.886 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.885+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5c50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:09.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247520672352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b6000820 con 0x55b7b5fca500 2024-05-08T18:10:09.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94247520672352] v32'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.889 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247520649776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9a60 con 0x7f5d84009040 2024-05-08T18:10:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94247520649776] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9c8db980 20 remove_watcher() i=0 2024-05-08T18:10:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9c8db980 2 removed watcher, disabling cache 2024-05-08T18:10:09.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.889+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247520651984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9a60 con 0x55b7b5fca500 2024-05-08T18:10:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.893+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94247520651984] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.893+0000 7f5d9c8db980 20 remove_watcher() i=1 2024-05-08T18:10:09.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.893+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247520655840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd4ad0 con 0x55b7b5fd0540 2024-05-08T18:10:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.893+0000 7f5d99bee640 1 -- 172.21.15.114:0/2517600835 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94247520655840] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d840c8b20 con 0x55b7b5fd0540 2024-05-08T18:10:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.893+0000 7f5d9c8db980 20 remove_watcher() i=2 2024-05-08T18:10:09.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.893+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247520663072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9a60 con 0x7f5d84009040 2024-05-08T18:10:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.897+0000 7f5d9abf0640 1 -- 172.21.15.114:0/2517600835 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94247520663072] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d8c02f040 con 0x7f5d84009040 2024-05-08T18:10:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.897+0000 7f5d9c8db980 20 remove_watcher() i=3 2024-05-08T18:10:09.895 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.897+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247520661600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd59e0 con 0x55b7b5fca500 2024-05-08T18:10:09.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.897+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94247520661600] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x55b7b5fca500 2024-05-08T18:10:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.897+0000 7f5d9c8db980 20 remove_watcher() i=4 2024-05-08T18:10:09.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.897+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247520665008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9a60 con 0x7f5d94026020 2024-05-08T18:10:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.901+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94247520665008] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.901+0000 7f5d9c8db980 20 remove_watcher() i=5 2024-05-08T18:10:09.900 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.901+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247520671296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd9a60 con 0x7f5d94026020 2024-05-08T18:10:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94247520671296] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 20 remove_watcher() i=6 2024-05-08T18:10:09.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247520675024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b7b5fd7060 con 0x7f5d94026020 2024-05-08T18:10:09.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94247520675024] v32'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d9400f070 con 0x7f5d94026020 2024-05-08T18:10:09.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 20 remove_watcher() i=7 2024-05-08T18:10:09.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94026020 msgr2=0x7f5d9401a750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94026020 0x7f5d9401a750 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5fca500 msgr2=0x55b7b5fcc9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5fca500 0x55b7b5fcc9a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d84009040 msgr2=0x7f5d840f27b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d84009040 0x7f5d840f27b0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7b5fd0540 msgr2=0x55b7b5fd2930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55b7b5fd0540 0x55b7b5fd2930 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c64038350 msgr2=0x7f5c6403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c64038350 0x7f5c6403a810 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00f010 tx=0x7f5d8c01b070 comp rx=0 tx=0).stop 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 msgr2=0x55b7b5fbf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fbf050 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5d840e9f80 tx=0x7f5d840e9fb0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9a3ef640 1 -- 172.21.15.114:0/2517600835 reap_dead start 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 shutdown_connections 2024-05-08T18:10:09.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/2517600835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5fb7b40 0x55b7b5fbf050 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 >> 172.21.15.114:0/2517600835 conn(0x55b7b5fb3e80 msgr2=0x55b7b5fb9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 shutdown_connections 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/2517600835 wait complete. 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 msgr2=0x7f5c7403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55b7b5f9ae70 tx=0x7f5d8c003070 comp rx=0 tx=0).stop 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 msgr2=0x55b7b5faae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 0x55b7b5faae80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5d8401b380 tx=0x7f5d840180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 shutdown_connections 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/896512285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5faaa60 0x55b7b5faae80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 >> 172.21.15.114:0/896512285 conn(0x55b7b5f9f870 msgr2=0x55b7b5fa0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 shutdown_connections 2024-05-08T18:10:09.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.905+0000 7f5d9c8db980 1 -- 172.21.15.114:0/896512285 wait complete. 2024-05-08T18:10:09.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5ea2a60 msgr2=0x55b7b5f99c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5ea2a60 0x55b7b5f99c70 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c800383f0 msgr2=0x7f5c8003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c800383f0 0x7f5c8003a8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ae000 tx=0x7f5d840a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 msgr2=0x55b7b5f92d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5f92d10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400f610 tx=0x7f5d94001260 comp rx=0 tx=0).stop 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 shutdown_connections 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55b7b5ea2a60 0x55b7b5f99c70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c800383f0 0x7f5c8003a8b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 --2- 172.21.15.114:0/418572850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b7b5e9e500 0x55b7b5f92d10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 >> 172.21.15.114:0/418572850 conn(0x55b7b5e99dd0 msgr2=0x55b7b5f84dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 shutdown_connections 2024-05-08T18:10:09.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.908+0000 7f5d9c8db980 1 -- 172.21.15.114:0/418572850 wait complete. 2024-05-08T18:10:09.918 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:09.919 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:09.919 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T18:10:09.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T18:10:09.919 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-08T18:10:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:09.997 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:09.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.996+0000 7fc9ffaf0980 1 Processor -- start 2024-05-08T18:10:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.996+0000 7fc9ffaf0980 1 -- start start 2024-05-08T18:10:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:09.996+0000 7fc9ffaf0980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7fb686830 0x55d7fb716f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9ffaf0980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7fb5bd710 con 0x55d7fb7174c0 2024-05-08T18:10:09.999 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9ffaf0980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d7fb5d1f00 con 0x55d7fb686830 2024-05-08T18:10:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9fd604640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7fb686830 0x55d7fb716f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9fd604640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7fb686830 0x55d7fb716f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42742/0 (socket says 172.21.15.114:42742) 2024-05-08T18:10:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9fd604640 1 -- 172.21.15.114:0/3045465077 learned_addr learned my addr 172.21.15.114:0/3045465077 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9fd604640 1 -- 172.21.15.114:0/3045465077 >> v1:172.21.15.53:6789/0 conn(0x55d7fb7174c0 legacy=0x55d7fb7198b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9fd604640 1 -- 172.21.15.114:0/3045465077 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7fb599ae0 con 0x55d7fb686830 2024-05-08T18:10:10.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9fd604640 1 --2- 172.21.15.114:0/3045465077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb716f80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000a5c0 tx=0x7fc9f001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bab40d741c919 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9f7fff640 1 -- 172.21.15.114:0/3045465077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00a6070 con 0x55d7fb686830 2024-05-08T18:10:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9f7fff640 1 -- 172.21.15.114:0/3045465077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f00af070 con 0x55d7fb686830 2024-05-08T18:10:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.000+0000 7fc9f7fff640 1 -- 172.21.15.114:0/3045465077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00aa5c0 con 0x55d7fb686830 2024-05-08T18:10:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3045465077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 msgr2=0x55d7fb716f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3045465077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb716f80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000a5c0 tx=0x7fc9f001b340 comp rx=0 tx=0).stop 2024-05-08T18:10:10.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3045465077 shutdown_connections 2024-05-08T18:10:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3045465077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb716f80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3045465077 >> 172.21.15.114:0/3045465077 conn(0x55d7fb70c6a0 msgr2=0x55d7fb70eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3045465077 shutdown_connections 2024-05-08T18:10:10.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.004+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3045465077 wait complete. 2024-05-08T18:10:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.016+0000 7fc9ffaf0980 1 Processor -- start 2024-05-08T18:10:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- start start 2024-05-08T18:10:10.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb7ff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7fb615f80 con 0x55d7fb686830 2024-05-08T18:10:10.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb7ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb7ff1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42750/0 (socket says 172.21.15.114:42750) 2024-05-08T18:10:10.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 -- 172.21.15.114:0/3019849162 learned_addr learned my addr 172.21.15.114:0/3019849162 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 -- 172.21.15.114:0/3019849162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7fb5ddda0 con 0x55d7fb686830 2024-05-08T18:10:10.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 --2- 172.21.15.114:0/3019849162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb7ff1f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00199f0 tx=0x7fc9f0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e48bfe21b38d01a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc8eb606640 1 -- 172.21.15.114:0/3019849162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00aaa00 con 0x55d7fb686830 2024-05-08T18:10:10.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc8eb606640 1 -- 172.21.15.114:0/3019849162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f00aaba0 con 0x55d7fb686830 2024-05-08T18:10:10.021 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc8eb606640 1 -- 172.21.15.114:0/3019849162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00bd3f0 con 0x55d7fb686830 2024-05-08T18:10:10.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3019849162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 msgr2=0x55d7fb7ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3019849162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb7ff1f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00199f0 tx=0x7fc9f0003030 comp rx=0 tx=0).stop 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3019849162 shutdown_connections 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3019849162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb7ff1f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3019849162 >> 172.21.15.114:0/3019849162 conn(0x55d7fb70c6a0 msgr2=0x55d7fb7fad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3019849162 shutdown_connections 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3019849162 wait complete. 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 Processor -- start 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- start start 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb806430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9ffaf0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7fb71da90 con 0x55d7fb686830 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb806430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb806430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42756/0 (socket says 172.21.15.114:42756) 2024-05-08T18:10:10.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.020+0000 7fc9fd604640 1 -- 172.21.15.114:0/2074785373 learned_addr learned my addr 172.21.15.114:0/2074785373 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9fd604640 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7fb806970 con 0x55d7fb686830 2024-05-08T18:10:10.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9fd604640 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb806430 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc9f001b170 tx=0x7fc9f00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc8e9e03640 1 -- 172.21.15.114:0/2074785373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00bd7c0 con 0x55d7fb686830 2024-05-08T18:10:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7fb806c00 con 0x55d7fb686830 2024-05-08T18:10:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc8e9e03640 1 -- 172.21.15.114:0/2074785373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f00bd960 con 0x55d7fb686830 2024-05-08T18:10:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc8e9e03640 1 -- 172.21.15.114:0/2074785373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9f00bdc40 con 0x55d7fb686830 2024-05-08T18:10:10.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7fb8098e0 con 0x55d7fb686830 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc8e9e03640 1 -- 172.21.15.114:0/2074785373 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc9f00ce020 con 0x55d7fb686830 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc8e9e03640 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8e40383f0 0x7fc8e403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc8e9e03640 1 -- 172.21.15.114:0/2074785373 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc9f00cc020 con 0x55d7fb686830 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9fce03640 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8e40383f0 0x7fc8e403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb7174c0 0x55d7fb80d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb80da70 con 0x55d7fb7174c0 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9fde05640 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb7174c0 0x55d7fb80d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9fce03640 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8e40383f0 0x7fc8e403a8b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8001ec0 tx=0x7fc9e8001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.024+0000 7fc9fde05640 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb7174c0 0x55d7fb80d530 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fde05640 1 -- 172.21.15.114:0/2074785373 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f800a4d0 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb80e340 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fde05640 1 -- 172.21.15.114:0/2074785373 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9f800a4d0 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb80f6f0 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fde05640 1 -- 172.21.15.114:0/2074785373 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc9f800a4d0 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb80eb90 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fde05640 1 -- 172.21.15.114:0/2074785373 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9f800a4d0 con 0x55d7fb7174c0 2024-05-08T18:10:10.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb80efb0 con 0x55d7fb7174c0 2024-05-08T18:10:10.029 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fde05640 1 -- 172.21.15.114:0/2074785373 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc9f800a4d0 con 0x55d7fb7174c0 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 Processor -- start 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 -- start start 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 0x55d7fb81e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9ffaf0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7fb619fc0 con 0x55d7fb81e220 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fce03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 0x55d7fb81e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fce03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 0x55d7fb81e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42768/0 (socket says 172.21.15.114:42768) 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fce03640 1 -- 172.21.15.114:0/3688464793 learned_addr learned my addr 172.21.15.114:0/3688464793 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fce03640 1 -- 172.21.15.114:0/3688464793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7fb81eb80 con 0x55d7fb81e220 2024-05-08T18:10:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc9fce03640 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 0x55d7fb81e640 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8010fd0 tx=0x7fc9e800f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc8e2ffd640 1 -- 172.21.15.114:0/3688464793 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e800a040 con 0x55d7fb81e220 2024-05-08T18:10:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.028+0000 7fc8e2ffd640 1 -- 172.21.15.114:0/3688464793 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8017050 con 0x55d7fb81e220 2024-05-08T18:10:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7fb81f620 con 0x55d7fb81e220 2024-05-08T18:10:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc8e2ffd640 1 -- 172.21.15.114:0/3688464793 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e800e6b0 con 0x55d7fb81e220 2024-05-08T18:10:10.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7fb81faf0 con 0x55d7fb81e220 2024-05-08T18:10:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc8e2ffd640 1 -- 172.21.15.114:0/3688464793 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc9e800e8e0 con 0x55d7fb81e220 2024-05-08T18:10:10.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc8e2ffd640 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8d40383f0 0x7fc8d403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc8e2ffd640 1 -- 172.21.15.114:0/3688464793 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc9e80506d0 con 0x55d7fb81e220 2024-05-08T18:10:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fde05640 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8d40383f0 0x7fc8d403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9ffaf0980 1 Processor -- start 2024-05-08T18:10:10.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9ffaf0980 1 -- start start 2024-05-08T18:10:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fde05640 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8d40383f0 0x7fc8d403a8b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55d7fb80ef30 tx=0x7fc9f8005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9ffaf0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb82b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9ffaf0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7fb7ff880 con 0x55d7fb82b400 2024-05-08T18:10:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fce03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb82b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fce03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb82b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42782/0 (socket says 172.21.15.114:42782) 2024-05-08T18:10:10.034 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fce03640 1 -- 172.21.15.114:0/3787620674 learned_addr learned my addr 172.21.15.114:0/3787620674 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fce03640 1 -- 172.21.15.114:0/3787620674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7fb82bdf0 con 0x55d7fb82b400 2024-05-08T18:10:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc9fce03640 1 --2- 172.21.15.114:0/3787620674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb82b820 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9e804ea40 tx=0x7fc9e801aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a364ec47e0200e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.032+0000 7fc8e0ff9640 1 -- 172.21.15.114:0/3787620674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e8043070 con 0x55d7fb82b400 2024-05-08T18:10:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc8e0ff9640 1 -- 172.21.15.114:0/3787620674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e801a310 con 0x55d7fb82b400 2024-05-08T18:10:10.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc8e0ff9640 1 -- 172.21.15.114:0/3787620674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e801a690 con 0x55d7fb82b400 2024-05-08T18:10:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3787620674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 msgr2=0x55d7fb82b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3787620674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb82b820 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9e804ea40 tx=0x7fc9e801aee0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3787620674 shutdown_connections 2024-05-08T18:10:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3787620674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb82b820 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.036 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3787620674 >> 172.21.15.114:0/3787620674 conn(0x55d7fb827790 msgr2=0x55d7fb8257f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3787620674 shutdown_connections 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3787620674 wait complete. 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 Processor -- start 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- start start 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb832910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7fb82c540 con 0x55d7fb82b400 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9fce03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb832910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9fce03640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb832910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42788/0 (socket says 172.21.15.114:42788) 2024-05-08T18:10:10.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 learned_addr learned my addr 172.21.15.114:0/1284251794 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7fb832e50 con 0x55d7fb82b400 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9fce03640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb832910 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800fcf0 tx=0x7fc9e804e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc8d2ffd640 1 -- 172.21.15.114:0/1284251794 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e8034070 con 0x55d7fb82b400 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7fb8330e0 con 0x55d7fb82b400 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc8d2ffd640 1 -- 172.21.15.114:0/1284251794 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e80504c0 con 0x55d7fb82b400 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc8d2ffd640 1 -- 172.21.15.114:0/1284251794 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9e8043040 con 0x55d7fb82b400 2024-05-08T18:10:10.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7fb835dc0 con 0x55d7fb82b400 2024-05-08T18:10:10.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.036+0000 7fc8d2ffd640 1 -- 172.21.15.114:0/1284251794 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc9e8037070 con 0x55d7fb82b400 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc8d2ffd640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8c80383f0 0x7fc8c803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc8d2ffd640 1 -- 172.21.15.114:0/1284251794 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc9e8039460 con 0x55d7fb82b400 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fde05640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8c80383f0 0x7fc8c803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb83de40 0x55d7fb8402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb840a30 con 0x55d7fb83de40 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb83de40 0x55d7fb8402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fde05640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8c80383f0 0x7fc8c803a8b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55d7fb80e1c0 tx=0x7fc9f801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb83de40 0x55d7fb8402e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 realm 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb840e40 con 0x55d7fb83de40 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb841710 con 0x55d7fb83de40 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb841ab0 con 0x55d7fb83de40 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb841f50 con 0x55d7fb83de40 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 20 searching for the correct realm 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7fb843ec0 0x55d7fb8462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fce03640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7fb843ec0 0x55d7fb8462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fce03640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7fb843ec0 0x55d7fb8462b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fce03640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc9e8039060 0x7fc9e804d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fde05640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc9e8039060 0x7fc9e804d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.040+0000 7fc9fde05640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc9e8039060 0x7fc9e804d290 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc9f00e9040 0x7fc9f00cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc9f00e9040 0x7fc9f00cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc9f00e9040 0x7fc9f00cfa30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.044+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.049 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.050 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.048+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.057 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb843ec0 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.052+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9f00e9040 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x55d7fb83de40 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb846930 con 0x7fc9e8039060 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:10.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb842960 con 0x55d7fb83de40 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb842570 con 0x55d7fb83de40 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb843200 con 0x55d7fb83de40 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 zone default found 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 4 Realm: () 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 zonegroup default 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb843200 con 0x7fc9f00e9040 2024-05-08T18:10:10.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb848770 con 0x55d7fb843ec0 2024-05-08T18:10:10.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb848b10 con 0x55d7fb843ec0 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 started sync module instance, tier type = 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.056+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb847c10 con 0x7fc9e8039060 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94386126094256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb8483d0 con 0x7fc9e8039060 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb849810 con 0x55d7fb83de40 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94386126094256] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94386126098096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb849780 con 0x55d7fb83de40 2024-05-08T18:10:10.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.060+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84a280 con 0x55d7fb843ec0 2024-05-08T18:10:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94386126101872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84ab20 con 0x55d7fb843ec0 2024-05-08T18:10:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84b520 con 0x7fc9e8039060 2024-05-08T18:10:10.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94386126098096] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94386126099152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84b940 con 0x7fc9e8039060 2024-05-08T18:10:10.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.064+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84c300 con 0x55d7fb83de40 2024-05-08T18:10:10.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94386126101872] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94386126099152] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94386126106672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84be50 con 0x55d7fb83de40 2024-05-08T18:10:10.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84cba0 con 0x7fc9f00e9040 2024-05-08T18:10:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94386126106672] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94386126104176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84be50 con 0x7fc9f00e9040 2024-05-08T18:10:10.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.068+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84d010 con 0x7fc9f00e9040 2024-05-08T18:10:10.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.072+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.072+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94386126113504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84d480 con 0x7fc9f00e9040 2024-05-08T18:10:10.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.072+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84df50 con 0x7fc9f00e9040 2024-05-08T18:10:10.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.072+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94386126104176] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.072+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94386126113504] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94386126117440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84cfd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=0 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=1 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=2 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=3 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=4 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=5 2024-05-08T18:10:10.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=6 2024-05-08T18:10:10.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94386126117440] v32'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 20 add_watcher() i=7 2024-05-08T18:10:10.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:10.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb851050 con 0x55d7fb83de40 2024-05-08T18:10:10.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.076+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94386126111712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84e4d0 con 0x55d7fb83de40 2024-05-08T18:10:10.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94386126111712] v32'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc8b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 5 note: GC not initialized 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc8b27e4640 20 reqs_thread_entry: start 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 20 Filter name: none 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc823fff640 20 reqs_thread_entry: start 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb874330 con 0x55d7fb83de40 2024-05-08T18:10:10.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:10.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb875880 con 0x7fc9f00e9040 2024-05-08T18:10:10.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc8b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.080+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94386126111712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb873d50 con 0x55d7fb83de40 2024-05-08T18:10:10.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.084+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94386126111712] v32'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.084+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94386126094256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84c3e0 con 0x7fc9e8039060 2024-05-08T18:10:10.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.084+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94386126094256] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.084+0000 7fc9ffaf0980 20 remove_watcher() i=0 2024-05-08T18:10:10.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.084+0000 7fc9ffaf0980 2 removed watcher, disabling cache 2024-05-08T18:10:10.085 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.084+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94386126098096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84c3e0 con 0x55d7fb83de40 2024-05-08T18:10:10.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.088+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94386126098096] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.088+0000 7fc9ffaf0980 20 remove_watcher() i=1 2024-05-08T18:10:10.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.088+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94386126101872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb848eb0 con 0x55d7fb843ec0 2024-05-08T18:10:10.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.088+0000 7fc9fce03640 1 -- 172.21.15.114:0/1284251794 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94386126101872] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9e8036030 con 0x55d7fb843ec0 2024-05-08T18:10:10.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.088+0000 7fc9ffaf0980 20 remove_watcher() i=2 2024-05-08T18:10:10.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.088+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94386126099152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84c3e0 con 0x7fc9e8039060 2024-05-08T18:10:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9fde05640 1 -- 172.21.15.114:0/1284251794 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94386126099152] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f801f070 con 0x7fc9e8039060 2024-05-08T18:10:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9ffaf0980 20 remove_watcher() i=3 2024-05-08T18:10:10.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94386126106672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb849d70 con 0x55d7fb83de40 2024-05-08T18:10:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94386126106672] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x55d7fb83de40 2024-05-08T18:10:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9ffaf0980 20 remove_watcher() i=4 2024-05-08T18:10:10.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94386126104176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84c3e0 con 0x7fc9f00e9040 2024-05-08T18:10:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.092+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94386126104176] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.096+0000 7fc9ffaf0980 20 remove_watcher() i=5 2024-05-08T18:10:10.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.096+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94386126113504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb84b030 con 0x7fc9f00e9040 2024-05-08T18:10:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.096+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94386126113504] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.096+0000 7fc9ffaf0980 20 remove_watcher() i=6 2024-05-08T18:10:10.097 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.096+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94386126117440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7fb849d70 con 0x7fc9f00e9040 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94386126117440] v32'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc9f00c6cd0 con 0x7fc9f00e9040 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 20 remove_watcher() i=7 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc9f00e9040 msgr2=0x7fc9f00cfa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc9f00e9040 0x7fc9f00cfa30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb83de40 msgr2=0x55d7fb8402e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb83de40 0x55d7fb8402e0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc9e8039060 msgr2=0x7fc9e804d290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc9e8039060 0x7fc9e804d290 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7fb843ec0 msgr2=0x55d7fb8462b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7fb843ec0 0x55d7fb8462b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8c80383f0 msgr2=0x7fc8c803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8c80383f0 0x7fc8c803a8b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x55d7fb80e1c0 tx=0x7fc9f801f000 comp rx=0 tx=0).stop 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 msgr2=0x55d7fb832910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9fd604640 1 -- 172.21.15.114:0/1284251794 reap_dead start 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb832910 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc9e800fcf0 tx=0x7fc9e804e9a0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 shutdown_connections 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/1284251794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb82b400 0x55d7fb832910 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 >> 172.21.15.114:0/1284251794 conn(0x55d7fb827790 msgr2=0x55d7fb82cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 shutdown_connections 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/1284251794 wait complete. 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8d40383f0 msgr2=0x7fc8d403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8d40383f0 0x7fc8d403a8b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x55d7fb80ef30 tx=0x7fc9f8005850 comp rx=0 tx=0).stop 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 msgr2=0x55d7fb81e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 0x55d7fb81e640 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8010fd0 tx=0x7fc9e800f7a0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 shutdown_connections 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8d40383f0 0x7fc8d403a8b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/3688464793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb81e220 0x55d7fb81e640 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 >> 172.21.15.114:0/3688464793 conn(0x55d7fb813030 msgr2=0x55d7fb813b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 shutdown_connections 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/3688464793 wait complete. 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb7174c0 msgr2=0x55d7fb80d530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb7174c0 0x55d7fb80d530 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8e40383f0 msgr2=0x7fc8e403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8e40383f0 0x7fc8e403a8b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8001ec0 tx=0x7fc9e8001440 comp rx=0 tx=0).stop 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 msgr2=0x55d7fb806430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb806430 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc9f001b170 tx=0x7fc9f00180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 shutdown_connections 2024-05-08T18:10:10.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7fb7174c0 0x55d7fb80d530 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc8e40383f0 0x7fc8e403a8b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 --2- 172.21.15.114:0/2074785373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7fb686830 0x55d7fb806430 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 >> 172.21.15.114:0/2074785373 conn(0x55d7fb70c6a0 msgr2=0x55d7fb7f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 shutdown_connections 2024-05-08T18:10:10.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.100+0000 7fc9ffaf0980 1 -- 172.21.15.114:0/2074785373 wait complete. 2024-05-08T18:10:10.111 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:10.111 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:10.111 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T18:10:10.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T18:10:10.111 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-08T18:10:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:10.187 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37b20c8980 1 Processor -- start 2024-05-08T18:10:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37b20c8980 1 -- start start 2024-05-08T18:10:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37b20c8980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56296af76fa0 0x56296b005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37b20c8980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56296aeae710 con 0x56296b006070 2024-05-08T18:10:10.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37b20c8980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56296aec2f00 con 0x56296af76fa0 2024-05-08T18:10:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37afbdc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56296af76fa0 0x56296b005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37af3db640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56296b006070 0x56296b008460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47868/0 (socket says 172.21.15.114:47868) 2024-05-08T18:10:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37afbdc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56296af76fa0 0x56296b005b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42804/0 (socket says 172.21.15.114:42804) 2024-05-08T18:10:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37af3db640 1 -- 172.21.15.114:0/3218728084 learned_addr learned my addr 172.21.15.114:0/3218728084 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37afbdc640 1 -- 172.21.15.114:0/3218728084 >> v1:172.21.15.53:6789/0 conn(0x56296b006070 legacy=0x56296b008460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.188+0000 7f37afbdc640 1 -- 172.21.15.114:0/3218728084 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296ae8aae0 con 0x56296af76fa0 2024-05-08T18:10:10.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37afbdc640 1 --2- 172.21.15.114:0/3218728084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b005b30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f37a800a420 tx=0x7f37a801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dcb529a080d0b81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37aebda640 1 -- 172.21.15.114:0/3218728084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80af070 con 0x56296af76fa0 2024-05-08T18:10:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37aebda640 1 -- 172.21.15.114:0/3218728084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a80aa530 con 0x56296af76fa0 2024-05-08T18:10:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37aebda640 1 -- 172.21.15.114:0/3218728084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80aa850 con 0x56296af76fa0 2024-05-08T18:10:10.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 -- 172.21.15.114:0/3218728084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 msgr2=0x56296b005b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 --2- 172.21.15.114:0/3218728084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b005b30 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f37a800a420 tx=0x7f37a801afd0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 -- 172.21.15.114:0/3218728084 shutdown_connections 2024-05-08T18:10:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 --2- 172.21.15.114:0/3218728084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b005b30 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 -- 172.21.15.114:0/3218728084 >> 172.21.15.114:0/3218728084 conn(0x56296affd650 msgr2=0x56296afffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 -- 172.21.15.114:0/3218728084 shutdown_connections 2024-05-08T18:10:10.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.192+0000 7f37b20c8980 1 -- 172.21.15.114:0/3218728084 wait complete. 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.204+0000 7f37b20c8980 1 Processor -- start 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.204+0000 7f37b20c8980 1 -- start start 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0edf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56296af06f80 con 0x56296af76fa0 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0edf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0edf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42806/0 (socket says 172.21.15.114:42806) 2024-05-08T18:10:10.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 -- 172.21.15.114:0/4180293146 learned_addr learned my addr 172.21.15.114:0/4180293146 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 -- 172.21.15.114:0/4180293146 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296aeceda0 con 0x56296af76fa0 2024-05-08T18:10:10.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 --2- 172.21.15.114:0/4180293146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0edf30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f37a800a420 tx=0x7f37a80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33efbc00b08193dd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f369de0b640 1 -- 172.21.15.114:0/4180293146 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80af050 con 0x56296af76fa0 2024-05-08T18:10:10.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f369de0b640 1 -- 172.21.15.114:0/4180293146 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a80b0040 con 0x56296af76fa0 2024-05-08T18:10:10.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f369de0b640 1 -- 172.21.15.114:0/4180293146 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80aac60 con 0x56296af76fa0 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- 172.21.15.114:0/4180293146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 msgr2=0x56296b0edf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 --2- 172.21.15.114:0/4180293146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0edf30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f37a800a420 tx=0x7f37a80033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- 172.21.15.114:0/4180293146 shutdown_connections 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 --2- 172.21.15.114:0/4180293146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0edf30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- 172.21.15.114:0/4180293146 >> 172.21.15.114:0/4180293146 conn(0x56296affd650 msgr2=0x56296b0e9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- 172.21.15.114:0/4180293146 shutdown_connections 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- 172.21.15.114:0/4180293146 wait complete. 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 Processor -- start 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- start start 2024-05-08T18:10:10.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37b20c8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56296b00a690 con 0x56296af76fa0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0f5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42818/0 (socket says 172.21.15.114:42818) 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.208+0000 7f37afbdc640 1 -- 172.21.15.114:0/1514637132 learned_addr learned my addr 172.21.15.114:0/1514637132 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37afbdc640 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296b0f57b0 con 0x56296af76fa0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37afbdc640 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0f5270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f37a801b010 tx=0x7f37a8019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f3697fff640 1 -- 172.21.15.114:0/1514637132 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80c5030 con 0x56296af76fa0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56296b0f5a40 con 0x56296af76fa0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296b0f8720 con 0x56296af76fa0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f3697fff640 1 -- 172.21.15.114:0/1514637132 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a80c15b0 con 0x56296af76fa0 2024-05-08T18:10:10.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f3697fff640 1 -- 172.21.15.114:0/1514637132 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a80c1890 con 0x56296af76fa0 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f3697fff640 1 -- 172.21.15.114:0/1514637132 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f37a80c8070 con 0x56296af76fa0 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f3697fff640 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36980383f0 0x7f369803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f3697fff640 1 -- 172.21.15.114:0/1514637132 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f37a80c6070 con 0x56296af76fa0 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37af3db640 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36980383f0 0x7f369803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b006070 0x56296b0fc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b0fc8f0 con 0x56296b006070 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b03dd640 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b006070 0x56296b0fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37af3db640 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36980383f0 0x7f369803a8b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37a4004180 tx=0x7f37a4001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b03dd640 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b006070 0x56296b0fc370 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b03dd640 1 -- 172.21.15.114:0/1514637132 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37a00083f0 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b0fd1c0 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b03dd640 1 -- 172.21.15.114:0/1514637132 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37a00083f0 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.212+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b0fe570 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b03dd640 1 -- 172.21.15.114:0/1514637132 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f37a00083f0 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b0fda10 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b03dd640 1 -- 172.21.15.114:0/1514637132 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37a00083f0 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b0fde60 con 0x56296b006070 2024-05-08T18:10:10.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b03dd640 1 -- 172.21.15.114:0/1514637132 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f37a00083f0 con 0x56296b006070 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 Processor -- start 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 -- start start 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 0x56296b10d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56296af0afc0 con 0x56296b10d080 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37af3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 0x56296b10d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37af3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 0x56296b10d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42820/0 (socket says 172.21.15.114:42820) 2024-05-08T18:10:10.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37af3db640 1 -- 172.21.15.114:0/1191738670 learned_addr learned my addr 172.21.15.114:0/1191738670 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37af3db640 1 -- 172.21.15.114:0/1191738670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296b10d9e0 con 0x56296b10d080 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37af3db640 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 0x56296b10d4a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f37a400d660 tx=0x7f37a400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f36957fa640 1 -- 172.21.15.114:0/1191738670 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a400c6b0 con 0x56296b10d080 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56296b10e480 con 0x56296b10d080 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f36957fa640 1 -- 172.21.15.114:0/1191738670 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a400c850 con 0x56296b10d080 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f36957fa640 1 -- 172.21.15.114:0/1191738670 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a400cb30 con 0x56296b10d080 2024-05-08T18:10:10.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.216+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296b10e950 con 0x56296b10d080 2024-05-08T18:10:10.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f36957fa640 1 -- 172.21.15.114:0/1191738670 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f37a4023020 con 0x56296b10d080 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f36957fa640 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36880383f0 0x7f368803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f36957fa640 1 -- 172.21.15.114:0/1191738670 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f37a4021020 con 0x56296b10d080 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b03dd640 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36880383f0 0x7f368803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 Processor -- start 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- start start 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b11a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56296b0ee5c0 con 0x56296b11a310 2024-05-08T18:10:10.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b03dd640 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36880383f0 0x7f368803a8b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37a000e3f0 tx=0x7f37a0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b11a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b11a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42834/0 (socket says 172.21.15.114:42834) 2024-05-08T18:10:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 -- 172.21.15.114:0/2017783733 learned_addr learned my addr 172.21.15.114:0/2017783733 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 -- 172.21.15.114:0/2017783733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296b11acc0 con 0x56296b11a310 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 --2- 172.21.15.114:0/2017783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b11a6f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f37a404f2f0 tx=0x7f37a40193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3a4b19674c0ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f368effd640 1 -- 172.21.15.114:0/2017783733 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a401bcc0 con 0x56296b11a310 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f368effd640 1 -- 172.21.15.114:0/2017783733 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a403e0d0 con 0x56296b11a310 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f368effd640 1 -- 172.21.15.114:0/2017783733 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a401be60 con 0x56296b11a310 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- 172.21.15.114:0/2017783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 msgr2=0x56296b11a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 --2- 172.21.15.114:0/2017783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b11a6f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f37a404f2f0 tx=0x7f37a40193e0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- 172.21.15.114:0/2017783733 shutdown_connections 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 --2- 172.21.15.114:0/2017783733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b11a6f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- 172.21.15.114:0/2017783733 >> 172.21.15.114:0/2017783733 conn(0x56296b116650 msgr2=0x56296b1146b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- 172.21.15.114:0/2017783733 shutdown_connections 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- 172.21.15.114:0/2017783733 wait complete. 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 Processor -- start 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- start start 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.223 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37b20c8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56296b11b480 con 0x56296b11a310 2024-05-08T18:10:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b121860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42840/0 (socket says 172.21.15.114:42840) 2024-05-08T18:10:10.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.220+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 learned_addr learned my addr 172.21.15.114:0/867851073 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56296b121da0 con 0x56296b11a310 2024-05-08T18:10:10.225 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37af3db640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b121860 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f37a400dfd0 tx=0x7f37a404f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f368d7fa640 1 -- 172.21.15.114:0/867851073 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a4032020 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56296b122030 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f368d7fa640 1 -- 172.21.15.114:0/867851073 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a401b760 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56296b122030 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f368d7fa640 1 -- 172.21.15.114:0/867851073 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a403f870 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f368d7fa640 1 -- 172.21.15.114:0/867851073 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f37a4035020 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f368d7fa640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36780383f0 0x7f367803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f368d7fa640 1 -- 172.21.15.114:0/867851073 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f37a4005030 con 0x56296b11a310 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b03dd640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36780383f0 0x7f367803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b12cb40 0x56296b12f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b12f750 con 0x56296b12cb40 2024-05-08T18:10:10.226 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37afbdc640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b12cb40 0x56296b12f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b03dd640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36780383f0 0x7f367803a8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f37a000f010 tx=0x7f37a001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37afbdc640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b12cb40 0x56296b12f000 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 20 realm 2024-05-08T18:10:10.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b12fb60 con 0x56296b12cb40 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.224+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b130400 con 0x56296b12cb40 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b1307a0 con 0x56296b12cb40 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b130ff0 con 0x56296b12cb40 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 20 searching for the correct realm 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56296b132d60 0x56296b135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37af3db640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56296b132d60 0x56296b135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37af3db640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56296b132d60 0x56296b135150 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37af3db640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f37a4037020 0x7f37a4036810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b03dd640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f37a4037020 0x7f37a4036810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b03dd640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f37a4037020 0x7f37a4036810 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.232 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f37a80ca030 0x7f37a80c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.233 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.228+0000 7f37afbdc640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f37a80ca030 0x7f37a80c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f37a80ca030 0x7f37a80c1a30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x7f37a80ca030 2024-05-08T18:10:10.237 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x7f37a80ca030 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.232+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x7f37a80ca030 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.239 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f37a80b2070 con 0x56296b12cb40 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80b2070 con 0x7f37a80ca030 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.240 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.244 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.236+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b132d60 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a80ca030 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x56296b12cb40 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.245 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56296b135690 con 0x7f37a4037020 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b131940 con 0x56296b12cb40 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b131580 con 0x56296b12cb40 2024-05-08T18:10:10.246 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b132210 con 0x56296b12cb40 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 zone default found 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 4 Realm: () 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 zonegroup default 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b132210 con 0x7f37a80ca030 2024-05-08T18:10:10.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b1374a0 con 0x56296b132d60 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.240+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b137840 con 0x56296b132d60 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 20 started sync module instance, tier type = 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b136940 con 0x7f37a4037020 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.248 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94735890083040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b137100 con 0x7f37a4037020 2024-05-08T18:10:10.249 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b1385a0 con 0x56296b12cb40 2024-05-08T18:10:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94735890083040] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94735890086880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b138560 con 0x56296b12cb40 2024-05-08T18:10:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.244+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b138fb0 con 0x56296b132d60 2024-05-08T18:10:10.250 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94735890090752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b139850 con 0x56296b132d60 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13a270 con 0x7f37a4037020 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94735890086880] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94735890095456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13a660 con 0x7f37a4037020 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13b020 con 0x56296b12cb40 2024-05-08T18:10:10.251 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.248+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94735890090752] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94735890095456] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94735890087936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13ab70 con 0x56296b12cb40 2024-05-08T18:10:10.252 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13b460 con 0x7f37a80ca030 2024-05-08T18:10:10.253 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94735890087936] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94735890092960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13b020 con 0x7f37a80ca030 2024-05-08T18:10:10.254 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.252+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13be70 con 0x7f37a80ca030 2024-05-08T18:10:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94735890092960] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94735890099328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13be70 con 0x7f37a80ca030 2024-05-08T18:10:10.256 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13c830 con 0x7f37a80ca030 2024-05-08T18:10:10.257 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94735890099328] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94735890102992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13c830 con 0x7f37a80ca030 2024-05-08T18:10:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=0 2024-05-08T18:10:10.258 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=1 2024-05-08T18:10:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=2 2024-05-08T18:10:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=3 2024-05-08T18:10:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=4 2024-05-08T18:10:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=5 2024-05-08T18:10:10.259 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.256+0000 7f37b20c8980 20 add_watcher() i=6 2024-05-08T18:10:10.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94735890102992] v32'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 add_watcher() i=7 2024-05-08T18:10:10.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:10.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b13fb60 con 0x56296b12cb40 2024-05-08T18:10:10.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.261 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94735890118032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13c9a0 con 0x56296b12cb40 2024-05-08T18:10:10.262 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94735890118032] v32'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f3665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 5 note: GC not initialized 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f3664fe1640 20 reqs_thread_entry: start 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 Filter name: none 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f35de7fc640 20 reqs_thread_entry: start 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b163140 con 0x56296b12cb40 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:10.263 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.260+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56296b164690 con 0x7f37a80ca030 2024-05-08T18:10:10.264 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.264+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.264+0000 7f3665fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.265 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.264+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94735890118032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b162b60 con 0x56296b12cb40 2024-05-08T18:10:10.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.264+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94735890118032] v32'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.266 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.264+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94735890083040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13f590 con 0x7f37a4037020 2024-05-08T18:10:10.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94735890083040] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37b20c8980 20 remove_watcher() i=0 2024-05-08T18:10:10.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37b20c8980 2 removed watcher, disabling cache 2024-05-08T18:10:10.267 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94735890086880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13f590 con 0x56296b12cb40 2024-05-08T18:10:10.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94735890086880] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37b20c8980 20 remove_watcher() i=1 2024-05-08T18:10:10.269 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.268+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94735890090752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b137be0 con 0x56296b132d60 2024-05-08T18:10:10.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37af3db640 1 -- 172.21.15.114:0/867851073 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94735890090752] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a4045070 con 0x56296b132d60 2024-05-08T18:10:10.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b20c8980 20 remove_watcher() i=2 2024-05-08T18:10:10.271 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94735890095456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13f590 con 0x7f37a4037020 2024-05-08T18:10:10.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b03dd640 1 -- 172.21.15.114:0/867851073 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94735890095456] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a002f040 con 0x7f37a4037020 2024-05-08T18:10:10.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b20c8980 20 remove_watcher() i=3 2024-05-08T18:10:10.272 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94735890087936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b137be0 con 0x56296b12cb40 2024-05-08T18:10:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94735890087936] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x56296b12cb40 2024-05-08T18:10:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b20c8980 20 remove_watcher() i=4 2024-05-08T18:10:10.274 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.272+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94735890092960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b13f590 con 0x7f37a80ca030 2024-05-08T18:10:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.276+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94735890092960] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.276+0000 7f37b20c8980 20 remove_watcher() i=5 2024-05-08T18:10:10.276 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.276+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94735890099328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b1393a0 con 0x7f37a80ca030 2024-05-08T18:10:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.276+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94735890099328] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.276+0000 7f37b20c8980 20 remove_watcher() i=6 2024-05-08T18:10:10.278 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.276+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94735890102992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56296b1393a0 con 0x7f37a80ca030 2024-05-08T18:10:10.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94735890102992] v32'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f37a80ef080 con 0x7f37a80ca030 2024-05-08T18:10:10.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 20 remove_watcher() i=7 2024-05-08T18:10:10.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f37a80ca030 msgr2=0x7f37a80c1a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f37a80ca030 0x7f37a80c1a30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b12cb40 msgr2=0x56296b12f000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b12cb40 0x56296b12f000 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f37a4037020 msgr2=0x7f37a4036810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f37a4037020 0x7f37a4036810 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56296b132d60 msgr2=0x56296b135150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56296b132d60 0x56296b135150 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36780383f0 msgr2=0x7f367803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36780383f0 0x7f367803a8b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f37a000f010 tx=0x7f37a001b070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 msgr2=0x56296b121860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37afbdc640 1 -- 172.21.15.114:0/867851073 reap_dead start 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b121860 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f37a400dfd0 tx=0x7f37a404f250 comp rx=0 tx=0).stop 2024-05-08T18:10:10.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 shutdown_connections 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/867851073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b11a310 0x56296b121860 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 >> 172.21.15.114:0/867851073 conn(0x56296b116650 msgr2=0x56296b113cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 shutdown_connections 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/867851073 wait complete. 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36880383f0 msgr2=0x7f368803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36880383f0 0x7f368803a8b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f37a000e3f0 tx=0x7f37a0003070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 msgr2=0x56296b10d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 0x56296b10d4a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f37a400d660 tx=0x7f37a400da60 comp rx=0 tx=0).stop 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 shutdown_connections 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36880383f0 0x7f368803a8b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1191738670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296b10d080 0x56296b10d4a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 >> 172.21.15.114:0/1191738670 conn(0x56296b101e90 msgr2=0x56296b1029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 shutdown_connections 2024-05-08T18:10:10.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1191738670 wait complete. 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b006070 msgr2=0x56296b0fc370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b006070 0x56296b0fc370 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36980383f0 msgr2=0x7f369803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36980383f0 0x7f369803a8b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37a4004180 tx=0x7f37a4001340 comp rx=0 tx=0).stop 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 msgr2=0x56296b0f5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0f5270 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f37a801b010 tx=0x7f37a8019810 comp rx=0 tx=0).stop 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 shutdown_connections 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56296b006070 0x56296b0fc370 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f36980383f0 0x7f369803a8b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 --2- 172.21.15.114:0/1514637132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56296af76fa0 0x56296b0f5270 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 >> 172.21.15.114:0/1514637132 conn(0x56296affd650 msgr2=0x56296b0e85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 shutdown_connections 2024-05-08T18:10:10.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.280+0000 7f37b20c8980 1 -- 172.21.15.114:0/1514637132 wait complete. 2024-05-08T18:10:10.291 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:10.291 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:10.291 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T18:10:10.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T18:10:10.292 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-08T18:10:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:10.365 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:10.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.364+0000 7f7296bbf980 1 Processor -- start 2024-05-08T18:10:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.364+0000 7f7296bbf980 1 -- start start 2024-05-08T18:10:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.364+0000 7f7296bbf980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5599b89cb6a0 0x5599b89cda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.364+0000 7f7296bbf980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5599b8870710 con 0x5599b8939830 2024-05-08T18:10:10.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.364+0000 7f7296bbf980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5599b8884f00 con 0x5599b89cb6a0 2024-05-08T18:10:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7293ed2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5599b89cb6a0 0x5599b89cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7293ed2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5599b89cb6a0 0x5599b89cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42854/0 (socket says 172.21.15.114:42854) 2024-05-08T18:10:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7293ed2640 1 -- 172.21.15.114:0/3552897065 learned_addr learned my addr 172.21.15.114:0/3552897065 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f72946d3640 1 --1- 172.21.15.114:0/3552897065 >> v1:172.21.15.53:6789/0 conn(0x5599b8939830 0x5599b89c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47870/0 (socket says 172.21.15.114:47870) 2024-05-08T18:10:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7293ed2640 1 -- 172.21.15.114:0/3552897065 >> v1:172.21.15.53:6789/0 conn(0x5599b8939830 legacy=0x5599b89c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7293ed2640 1 -- 172.21.15.114:0/3552897065 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b884cae0 con 0x5599b89cb6a0 2024-05-08T18:10:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7293ed2640 1 --2- 172.21.15.114:0/3552897065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b89cb6a0 0x5599b89cda90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f728800a5c0 tx=0x7f728801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a882dd0fad0e6ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f72936d1640 1 -- 172.21.15.114:0/3552897065 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880a6070 con 0x5599b89cb6a0 2024-05-08T18:10:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f72936d1640 1 -- 172.21.15.114:0/3552897065 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72880af070 con 0x5599b89cb6a0 2024-05-08T18:10:10.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f72936d1640 1 -- 172.21.15.114:0/3552897065 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880aa5c0 con 0x5599b89cb6a0 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7296bbf980 1 -- 172.21.15.114:0/3552897065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b89cb6a0 msgr2=0x5599b89cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3552897065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b89cb6a0 0x5599b89cda90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f728800a5c0 tx=0x7f728801b340 comp rx=0 tx=0).stop 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7296bbf980 1 -- 172.21.15.114:0/3552897065 shutdown_connections 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3552897065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b89cb6a0 0x5599b89cda90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.368+0000 7f7296bbf980 1 -- 172.21.15.114:0/3552897065 >> 172.21.15.114:0/3552897065 conn(0x5599b89bf6a0 msgr2=0x5599b89c1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.372+0000 7f7296bbf980 1 -- 172.21.15.114:0/3552897065 shutdown_connections 2024-05-08T18:10:10.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.372+0000 7f7296bbf980 1 -- 172.21.15.114:0/3552897065 wait complete. 2024-05-08T18:10:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 Processor -- start 2024-05-08T18:10:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- start start 2024-05-08T18:10:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599b88c8f80 con 0x5599b8939830 2024-05-08T18:10:10.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f72946d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f72946d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42856/0 (socket says 172.21.15.114:42856) 2024-05-08T18:10:10.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f72946d3640 1 -- 172.21.15.114:0/2702172124 learned_addr learned my addr 172.21.15.114:0/2702172124 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f72946d3640 1 -- 172.21.15.114:0/2702172124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b8890da0 con 0x5599b8939830 2024-05-08T18:10:10.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f72946d3640 1 --2- 172.21.15.114:0/2702172124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab22a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f728c001680 tx=0x7f728c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e7ba81a16d7822 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f718260c640 1 -- 172.21.15.114:0/2702172124 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c013420 con 0x5599b8939830 2024-05-08T18:10:10.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f718260c640 1 -- 172.21.15.114:0/2702172124 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c0135c0 con 0x5599b8939830 2024-05-08T18:10:10.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f718260c640 1 -- 172.21.15.114:0/2702172124 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c0138e0 con 0x5599b8939830 2024-05-08T18:10:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- 172.21.15.114:0/2702172124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 msgr2=0x5599b8ab22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2702172124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab22a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f728c001680 tx=0x7f728c001b40 comp rx=0 tx=0).stop 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- 172.21.15.114:0/2702172124 shutdown_connections 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2702172124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab22a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- 172.21.15.114:0/2702172124 >> 172.21.15.114:0/2702172124 conn(0x5599b89bf6a0 msgr2=0x5599b8aade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- 172.21.15.114:0/2702172124 shutdown_connections 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.384+0000 7f7296bbf980 1 -- 172.21.15.114:0/2702172124 wait complete. 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 Processor -- start 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 -- start start 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599b89d0a90 con 0x5599b8939830 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f72946d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f72946d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42858/0 (socket says 172.21.15.114:42858) 2024-05-08T18:10:10.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f72946d3640 1 -- 172.21.15.114:0/2269701768 learned_addr learned my addr 172.21.15.114:0/2269701768 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f72946d3640 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b8ab9b80 con 0x5599b8939830 2024-05-08T18:10:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f72946d3640 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab9640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f728c002260 tx=0x7f728c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7180e09640 1 -- 172.21.15.114:0/2269701768 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c0037a0 con 0x5599b8939830 2024-05-08T18:10:10.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599b8ab9e10 con 0x5599b8939830 2024-05-08T18:10:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b8abcaa0 con 0x5599b8939830 2024-05-08T18:10:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7180e09640 1 -- 172.21.15.114:0/2269701768 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728c023070 con 0x5599b8939830 2024-05-08T18:10:10.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7180e09640 1 -- 172.21.15.114:0/2269701768 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728c003a70 con 0x5599b8939830 2024-05-08T18:10:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7180e09640 1 -- 172.21.15.114:0/2269701768 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f728c010070 con 0x5599b8939830 2024-05-08T18:10:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7180e09640 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f717c0383f0 0x7f717c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7180e09640 1 -- 172.21.15.114:0/2269701768 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f728c04e800 con 0x5599b8939830 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7293ed2640 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f717c0383f0 0x7f717c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b89cb6a0 0x5599b8ac05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8ac0c10 con 0x5599b89cb6a0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.388+0000 7f7294ed4640 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b89cb6a0 0x5599b8ac05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7293ed2640 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f717c0383f0 0x7f717c03a8b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72880ae000 tx=0x7f72880a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7294ed4640 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b89cb6a0 0x5599b8ac05a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7294ed4640 1 -- 172.21.15.114:0/2269701768 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72840083f0 con 0x5599b89cb6a0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8abdcc0 con 0x5599b89cb6a0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7294ed4640 1 -- 172.21.15.114:0/2269701768 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72840083f0 con 0x5599b89cb6a0 2024-05-08T18:10:10.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8ac2a50 con 0x5599b89cb6a0 2024-05-08T18:10:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7294ed4640 1 -- 172.21.15.114:0/2269701768 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72840083f0 con 0x5599b89cb6a0 2024-05-08T18:10:10.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8ac1c80 con 0x5599b89cb6a0 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7294ed4640 1 -- 172.21.15.114:0/2269701768 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72840083f0 con 0x5599b89cb6a0 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8ac20d0 con 0x5599b89cb6a0 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7294ed4640 1 -- 172.21.15.114:0/2269701768 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72840083f0 con 0x5599b89cb6a0 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 Processor -- start 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 -- start start 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 0x5599b8ad17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7296bbf980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599b88ccfc0 con 0x5599b8ad1390 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7293ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 0x5599b8ad17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7293ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 0x5599b8ad17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42866/0 (socket says 172.21.15.114:42866) 2024-05-08T18:10:10.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7293ed2640 1 -- 172.21.15.114:0/2973444551 learned_addr learned my addr 172.21.15.114:0/2973444551 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7293ed2640 1 -- 172.21.15.114:0/2973444551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b8ad1cf0 con 0x5599b8ad1390 2024-05-08T18:10:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7293ed2640 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 0x5599b8ad17b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f72880199f0 tx=0x7f72880180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.392+0000 7f7179ffb640 1 -- 172.21.15.114:0/2973444551 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880b3b90 con 0x5599b8ad1390 2024-05-08T18:10:10.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7179ffb640 1 -- 172.21.15.114:0/2973444551 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72880b3d30 con 0x5599b8ad1390 2024-05-08T18:10:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599b8ad2790 con 0x5599b8ad1390 2024-05-08T18:10:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7179ffb640 1 -- 172.21.15.114:0/2973444551 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880c8560 con 0x5599b8ad1390 2024-05-08T18:10:10.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b8ad2c00 con 0x5599b8ad1390 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7179ffb640 1 -- 172.21.15.114:0/2973444551 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f72880d1440 con 0x5599b8ad1390 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7179ffb640 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f716c038440 0x7f716c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7179ffb640 1 -- 172.21.15.114:0/2973444551 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f72880ec050 con 0x5599b8ad1390 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7294ed4640 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f716c038440 0x7f716c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7296bbf980 1 Processor -- start 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7296bbf980 1 -- start start 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7296bbf980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ade830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7296bbf980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599b8ab29f0 con 0x5599b8ade450 2024-05-08T18:10:10.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7294ed4640 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f716c038440 0x7f716c03a900 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5599b8ac17a0 tx=0x7f7284003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7293ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ade830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7293ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ade830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42882/0 (socket says 172.21.15.114:42882) 2024-05-08T18:10:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7293ed2640 1 -- 172.21.15.114:0/1976022208 learned_addr learned my addr 172.21.15.114:0/1976022208 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7293ed2640 1 -- 172.21.15.114:0/1976022208 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b8adee00 con 0x5599b8ade450 2024-05-08T18:10:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f7293ed2640 1 --2- 172.21.15.114:0/1976022208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ade830 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f72880ea3c0 tx=0x7f72880d1a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7db4c43bdaa161 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f71737fe640 1 -- 172.21.15.114:0/1976022208 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880bd390 con 0x5599b8ade450 2024-05-08T18:10:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f71737fe640 1 -- 172.21.15.114:0/1976022208 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72880bd530 con 0x5599b8ade450 2024-05-08T18:10:10.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.396+0000 7f71737fe640 1 -- 172.21.15.114:0/1976022208 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880be410 con 0x5599b8ade450 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/1976022208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 msgr2=0x5599b8ade830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 --2- 172.21.15.114:0/1976022208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ade830 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f72880ea3c0 tx=0x7f72880d1a80 comp rx=0 tx=0).stop 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/1976022208 shutdown_connections 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 --2- 172.21.15.114:0/1976022208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ade830 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/1976022208 >> 172.21.15.114:0/1976022208 conn(0x5599b8ada790 msgr2=0x5599b8ad87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/1976022208 shutdown_connections 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/1976022208 wait complete. 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 Processor -- start 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- start start 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ae5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5599b8adf5c0 con 0x5599b8ade450 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7293ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ae5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7293ed2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ae5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42890/0 (socket says 172.21.15.114:42890) 2024-05-08T18:10:10.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 learned_addr learned my addr 172.21.15.114:0/3975300850 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599b8ae5e90 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7293ed2640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ae5950 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f72880d1ac0 tx=0x7f72880ea320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7171ffb640 1 -- 172.21.15.114:0/3975300850 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880f2070 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5599b8ae6120 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599b8ae8e00 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7171ffb640 1 -- 172.21.15.114:0/3975300850 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72880be710 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7171ffb640 1 -- 172.21.15.114:0/3975300850 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72880bd390 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7171ffb640 1 -- 172.21.15.114:0/3975300850 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f72880f5070 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7171ffb640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f71640383f0 0x7f716403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7171ffb640 1 -- 172.21.15.114:0/3975300850 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f72880e1070 con 0x5599b8ade450 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7294ed4640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f71640383f0 0x7f716403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b8af0dd0 0x5599b8af3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.400+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af39c0 con 0x5599b8af0dd0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b8af0dd0 0x5599b8af3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f71640383f0 0x7f716403a8b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f728400f010 tx=0x7f728401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b8af0dd0 0x5599b8af3270 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 realm 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af3dd0 con 0x5599b8af0dd0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af4670 con 0x5599b8af0dd0 2024-05-08T18:10:10.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af4a10 con 0x5599b8af0dd0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af5260 con 0x5599b8af0dd0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 20 searching for the correct realm 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5599b8af6fd0 0x5599b8af93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7293ed2640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5599b8af6fd0 0x5599b8af93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7293ed2640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5599b8af6fd0 0x5599b8af93c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7293ed2640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f72880f7060 0x7f72880eda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f72880f7060 0x7f72880eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f72880f7060 0x7f72880eda40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f728c028980 0x7f728c04e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.404+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f728c028980 0x7f728c04e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f728c028980 0x7f728c04e0b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.408+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.412+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af6fd0 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f728c028980 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x5599b8af0dd0 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af9900 con 0x7f72880f7060 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af5bb0 con 0x5599b8af0dd0 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af57f0 con 0x5599b8af0dd0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af6480 con 0x5599b8af0dd0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 zone default found 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 4 Realm: () 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 zonegroup default 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8af6480 con 0x7f728c028980 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.416+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afb710 con 0x5599b8af6fd0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afbab0 con 0x5599b8af6fd0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 20 started sync module instance, tier type = 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afabb0 con 0x7f72880f7060 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94118716878752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afc300 con 0x7f72880f7060 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afcb50 con 0x5599b8af0dd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94118716878752] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94118716882512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afc720 con 0x5599b8af0dd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.420+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afd220 con 0x5599b8af6fd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94118716882512] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94118716883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afc690 con 0x5599b8af6fd0 2024-05-08T18:10:10.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afdf70 con 0x7f72880f7060 2024-05-08T18:10:10.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94118716890096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afe810 con 0x7f72880f7060 2024-05-08T18:10:10.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.424+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8aff210 con 0x5599b8af0dd0 2024-05-08T18:10:10.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.428+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94118716883568] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.428+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94118716890096] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.428+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.428+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94118716888592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afe360 con 0x5599b8af0dd0 2024-05-08T18:10:10.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.428+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8affae0 con 0x7f728c028980 2024-05-08T18:10:10.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94118716888592] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94118716894496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afe360 con 0x7f728c028980 2024-05-08T18:10:10.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afff90 con 0x7f728c028980 2024-05-08T18:10:10.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94118716894496] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94118716897920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afff50 con 0x7f728c028980 2024-05-08T18:10:10.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.432+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8b00950 con 0x7f728c028980 2024-05-08T18:10:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94118716900448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8b00d70 con 0x7f728c028980 2024-05-08T18:10:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=0 2024-05-08T18:10:10.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=1 2024-05-08T18:10:10.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=2 2024-05-08T18:10:10.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=3 2024-05-08T18:10:10.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=4 2024-05-08T18:10:10.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=5 2024-05-08T18:10:10.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94118716897920] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=6 2024-05-08T18:10:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94118716900448] v32'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 20 add_watcher() i=7 2024-05-08T18:10:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:10.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8aff430 con 0x5599b8af0dd0 2024-05-08T18:10:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.436+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94118716896304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8b01280 con 0x5599b8af0dd0 2024-05-08T18:10:10.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94118716896304] v32'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f714a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 5 note: GC not initialized 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f71497e2640 20 reqs_thread_entry: start 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 20 Filter name: none 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f70baffd640 20 reqs_thread_entry: start 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8b27320 con 0x5599b8af0dd0 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:10.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5599b8b28870 con 0x7f728c028980 2024-05-08T18:10:10.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv29 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f714a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.440+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94118716896304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8b26d40 con 0x5599b8af0dd0 2024-05-08T18:10:10.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.444+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94118716896304] v32'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.444+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94118716878752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8aff430 con 0x7f72880f7060 2024-05-08T18:10:10.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.444+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94118716878752] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.444+0000 7f7296bbf980 20 remove_watcher() i=0 2024-05-08T18:10:10.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.444+0000 7f7296bbf980 2 removed watcher, disabling cache 2024-05-08T18:10:10.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.444+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94118716882512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afafa0 con 0x5599b8af0dd0 2024-05-08T18:10:10.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94118716882512] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7296bbf980 20 remove_watcher() i=1 2024-05-08T18:10:10.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94118716883568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afafa0 con 0x5599b8af6fd0 2024-05-08T18:10:10.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7293ed2640 1 -- 172.21.15.114:0/3975300850 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94118716883568] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72880f4030 con 0x5599b8af6fd0 2024-05-08T18:10:10.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7296bbf980 20 remove_watcher() i=2 2024-05-08T18:10:10.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94118716890096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8aff430 con 0x7f72880f7060 2024-05-08T18:10:10.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7294ed4640 1 -- 172.21.15.114:0/3975300850 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94118716890096] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728402f040 con 0x7f72880f7060 2024-05-08T18:10:10.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7296bbf980 20 remove_watcher() i=3 2024-05-08T18:10:10.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.448+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94118716888592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8aff430 con 0x5599b8af0dd0 2024-05-08T18:10:10.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.452+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94118716888592] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x5599b8af0dd0 2024-05-08T18:10:10.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.452+0000 7f7296bbf980 20 remove_watcher() i=4 2024-05-08T18:10:10.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.452+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94118716894496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afd610 con 0x7f728c028980 2024-05-08T18:10:10.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.452+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94118716894496] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.452+0000 7f7296bbf980 20 remove_watcher() i=5 2024-05-08T18:10:10.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.452+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94118716897920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8afd610 con 0x7f728c028980 2024-05-08T18:10:10.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94118716897920] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 20 remove_watcher() i=6 2024-05-08T18:10:10.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94118716900448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5599b8affa80 con 0x7f728c028980 2024-05-08T18:10:10.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94118716900448] v32'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f728c00f030 con 0x7f728c028980 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 20 remove_watcher() i=7 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f728c028980 msgr2=0x7f728c04e0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f728c028980 0x7f728c04e0b0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b8af0dd0 msgr2=0x5599b8af3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b8af0dd0 0x5599b8af3270 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f72880f7060 msgr2=0x7f72880eda40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f72880f7060 0x7f72880eda40 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5599b8af6fd0 msgr2=0x5599b8af93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.456+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5599b8af6fd0 0x5599b8af93c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f71640383f0 msgr2=0x7f716403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f71640383f0 0x7f716403a8b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f728400f010 tx=0x7f728401b070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f72946d3640 1 -- 172.21.15.114:0/3975300850 reap_dead start 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 msgr2=0x5599b8ae5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ae5950 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f72880d1ac0 tx=0x7f72880ea320 comp rx=0 tx=0).stop 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 shutdown_connections 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/3975300850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ade450 0x5599b8ae5950 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 >> 172.21.15.114:0/3975300850 conn(0x5599b8ada790 msgr2=0x5599b8ad7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 shutdown_connections 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/3975300850 wait complete. 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f716c038440 msgr2=0x7f716c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f716c038440 0x7f716c03a900 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5599b8ac17a0 tx=0x7f7284003070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 msgr2=0x5599b8ad17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 0x5599b8ad17b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f72880199f0 tx=0x7f72880180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 shutdown_connections 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f716c038440 0x7f716c03a900 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2973444551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8ad1390 0x5599b8ad17b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 >> 172.21.15.114:0/2973444551 conn(0x5599b8ac61a0 msgr2=0x5599b8ac6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 shutdown_connections 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2973444551 wait complete. 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b89cb6a0 msgr2=0x5599b8ac05a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b89cb6a0 0x5599b8ac05a0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f717c0383f0 msgr2=0x7f717c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f717c0383f0 0x7f717c03a8b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f72880ae000 tx=0x7f72880a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 msgr2=0x5599b8ab9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab9640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f728c002260 tx=0x7f728c000f50 comp rx=0 tx=0).stop 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 shutdown_connections 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5599b89cb6a0 0x5599b8ac05a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f717c0383f0 0x7f717c03a8b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 --2- 172.21.15.114:0/2269701768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599b8939830 0x5599b8ab9640 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 >> 172.21.15.114:0/2269701768 conn(0x5599b89bf6a0 msgr2=0x5599b8aac940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 shutdown_connections 2024-05-08T18:10:10.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.460+0000 7f7296bbf980 1 -- 172.21.15.114:0/2269701768 wait complete. 2024-05-08T18:10:10.470 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-05-08T18:00:00.000000Z","epoch":1715191200,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-05-08T18:10:10.470 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:10:10.470 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T18:10:10.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T18:10:10.470 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-08T18:10:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:10.551 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df3c7c980 1 Processor -- start 2024-05-08T18:10:10.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df3c7c980 1 -- start start 2024-05-08T18:10:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df3c7c980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56479c0fe130 0x56479c0fe510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df3c7c980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56479bfa7710 con 0x56479c0fea50 2024-05-08T18:10:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df3c7c980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56479bfbbf00 con 0x56479c0fe130 2024-05-08T18:10:10.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df1790640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56479c0fe130 0x56479c0fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df0f8f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x56479c0fea50 0x56479c0ff3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47886/0 (socket says 172.21.15.114:47886) 2024-05-08T18:10:10.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df1790640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56479c0fe130 0x56479c0fe510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42896/0 (socket says 172.21.15.114:42896) 2024-05-08T18:10:10.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df0f8f640 1 -- 172.21.15.114:0/2172741231 learned_addr learned my addr 172.21.15.114:0/2172741231 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:10.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df1790640 1 -- 172.21.15.114:0/2172741231 >> v1:172.21.15.53:6789/0 conn(0x56479c0fea50 legacy=0x56479c0ff3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.552+0000 7f5df1790640 1 -- 172.21.15.114:0/2172741231 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479bf83ae0 con 0x56479c0fe130 2024-05-08T18:10:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df1790640 1 --2- 172.21.15.114:0/2172741231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c0fe510 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5de400a420 tx=0x7f5de401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a07a9bf3219efb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5de3fff640 1 -- 172.21.15.114:0/2172741231 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de40af070 con 0x56479c0fe130 2024-05-08T18:10:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5de3fff640 1 -- 172.21.15.114:0/2172741231 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40aa530 con 0x56479c0fe130 2024-05-08T18:10:10.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5de3fff640 1 -- 172.21.15.114:0/2172741231 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de40aa850 con 0x56479c0fe130 2024-05-08T18:10:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 -- 172.21.15.114:0/2172741231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 msgr2=0x56479c0fe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/2172741231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c0fe510 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5de400a420 tx=0x7f5de401afd0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 -- 172.21.15.114:0/2172741231 shutdown_connections 2024-05-08T18:10:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/2172741231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c0fe510 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 -- 172.21.15.114:0/2172741231 >> 172.21.15.114:0/2172741231 conn(0x56479c071810 msgr2=0x56479c071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 -- 172.21.15.114:0/2172741231 shutdown_connections 2024-05-08T18:10:10.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.556+0000 7f5df3c7c980 1 -- 172.21.15.114:0/2172741231 wait complete. 2024-05-08T18:10:10.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.568+0000 7f5df3c7c980 1 Processor -- start 2024-05-08T18:10:10.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.568+0000 7f5df3c7c980 1 -- start start 2024-05-08T18:10:10.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.568+0000 7f5df3c7c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1e9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.568+0000 7f5df3c7c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56479bffff80 con 0x56479c0fe130 2024-05-08T18:10:10.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1e9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42908/0 (socket says 172.21.15.114:42908) 2024-05-08T18:10:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 -- 172.21.15.114:0/1351566406 learned_addr learned my addr 172.21.15.114:0/1351566406 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 -- 172.21.15.114:0/1351566406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479bfc7da0 con 0x56479c0fe130 2024-05-08T18:10:10.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 --2- 172.21.15.114:0/1351566406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1e9960 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5de400a420 tx=0x7f5de40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a06dfb06a8e6ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5cdf606640 1 -- 172.21.15.114:0/1351566406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de40af050 con 0x56479c0fe130 2024-05-08T18:10:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5cdf606640 1 -- 172.21.15.114:0/1351566406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40b0040 con 0x56479c0fe130 2024-05-08T18:10:10.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5cdf606640 1 -- 172.21.15.114:0/1351566406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de40aac60 con 0x56479c0fe130 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- 172.21.15.114:0/1351566406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 msgr2=0x56479c1e9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/1351566406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1e9960 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5de400a420 tx=0x7f5de40033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- 172.21.15.114:0/1351566406 shutdown_connections 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/1351566406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1e9960 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- 172.21.15.114:0/1351566406 >> 172.21.15.114:0/1351566406 conn(0x56479c071810 msgr2=0x56479c1e54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- 172.21.15.114:0/1351566406 shutdown_connections 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- 172.21.15.114:0/1351566406 wait complete. 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 Processor -- start 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- start start 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df3c7c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56479c108130 con 0x56479c0fe130 2024-05-08T18:10:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1f0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42912/0 (socket says 172.21.15.114:42912) 2024-05-08T18:10:10.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 -- 172.21.15.114:0/825440829 learned_addr learned my addr 172.21.15.114:0/825440829 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.572+0000 7f5df1790640 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479c1f11e0 con 0x56479c0fe130 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df1790640 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1f0ca0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5de401b010 tx=0x7f5de4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5cdde03640 1 -- 172.21.15.114:0/825440829 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de40c5030 con 0x56479c0fe130 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56479c1f1470 con 0x56479c0fe130 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479c1f4100 con 0x56479c0fe130 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5cdde03640 1 -- 172.21.15.114:0/825440829 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de40c15b0 con 0x56479c0fe130 2024-05-08T18:10:10.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5cdde03640 1 -- 172.21.15.114:0/825440829 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de40c1890 con 0x56479c0fe130 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5cdde03640 1 -- 172.21.15.114:0/825440829 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5de40c8070 con 0x56479c0fe130 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5cdde03640 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cd8038440 0x7f5cd803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5cdde03640 1 -- 172.21.15.114:0/825440829 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5de40c6070 con 0x56479c0fe130 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cd8038440 0x7f5cd803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c0fea50 0x56479c1f7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c1f82d0 con 0x56479c0fea50 2024-05-08T18:10:10.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df1f91640 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c0fea50 0x56479c1f7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cd8038440 0x7f5cd803a900 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5de8001d80 tx=0x7f5de80012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df1f91640 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c0fea50 0x56479c1f7d50 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df1f91640 1 -- 172.21.15.114:0/825440829 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5dec0083f0 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c1f8ba0 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df1f91640 1 -- 172.21.15.114:0/825440829 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5dec0083f0 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c1f9f50 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df1f91640 1 -- 172.21.15.114:0/825440829 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5dec0083f0 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.576+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c1f93f0 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df1f91640 1 -- 172.21.15.114:0/825440829 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5dec0083f0 con 0x56479c0fea50 2024-05-08T18:10:10.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c1f9840 con 0x56479c0fea50 2024-05-08T18:10:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df1f91640 1 -- 172.21.15.114:0/825440829 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5dec0083f0 con 0x56479c0fea50 2024-05-08T18:10:10.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 Processor -- start 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 -- start start 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 0x56479c208e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56479c003fc0 con 0x56479c208a60 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 0x56479c208e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 0x56479c208e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42918/0 (socket says 172.21.15.114:42918) 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df0f8f640 1 -- 172.21.15.114:0/4280852120 learned_addr learned my addr 172.21.15.114:0/4280852120 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df0f8f640 1 -- 172.21.15.114:0/4280852120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479c2093c0 con 0x56479c208a60 2024-05-08T18:10:10.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 0x56479c208e80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5de800d660 tx=0x7f5de800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5cd6ffd640 1 -- 172.21.15.114:0/4280852120 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de800c6b0 con 0x56479c208a60 2024-05-08T18:10:10.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56479c209e60 con 0x56479c208a60 2024-05-08T18:10:10.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5cd6ffd640 1 -- 172.21.15.114:0/4280852120 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de800c850 con 0x56479c208a60 2024-05-08T18:10:10.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5cd6ffd640 1 -- 172.21.15.114:0/4280852120 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de800cb30 con 0x56479c208a60 2024-05-08T18:10:10.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.580+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479c20a330 con 0x56479c208a60 2024-05-08T18:10:10.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5cd6ffd640 1 -- 172.21.15.114:0/4280852120 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5de8023020 con 0x56479c208a60 2024-05-08T18:10:10.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5cd6ffd640 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cc80383f0 0x7f5cc803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5cd6ffd640 1 -- 172.21.15.114:0/4280852120 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5de8021020 con 0x56479c208a60 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df1f91640 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cc80383f0 0x7f5cc803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 Processor -- start 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- start start 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df1f91640 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cc80383f0 0x7f5cc803a8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e3f0 tx=0x7f5dec003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c2160c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.584 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56479c1e9ff0 con 0x56479c215ca0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c2160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c2160c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42926/0 (socket says 172.21.15.114:42926) 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 -- 172.21.15.114:0/193772820 learned_addr learned my addr 172.21.15.114:0/193772820 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 -- 172.21.15.114:0/193772820 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479c216690 con 0x56479c215ca0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/193772820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c2160c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5de804f2c0 tx=0x7f5de80193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb92e31ee2b52a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5cd4ff9640 1 -- 172.21.15.114:0/193772820 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de801bcc0 con 0x56479c215ca0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5cd4ff9640 1 -- 172.21.15.114:0/193772820 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de803e0d0 con 0x56479c215ca0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5cd4ff9640 1 -- 172.21.15.114:0/193772820 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de801be60 con 0x56479c215ca0 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- 172.21.15.114:0/193772820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 msgr2=0x56479c2160c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/193772820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c2160c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f5de804f2c0 tx=0x7f5de80193e0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- 172.21.15.114:0/193772820 shutdown_connections 2024-05-08T18:10:10.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/193772820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c2160c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- 172.21.15.114:0/193772820 >> 172.21.15.114:0/193772820 conn(0x56479c212030 msgr2=0x56479c210090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- 172.21.15.114:0/193772820 shutdown_connections 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- 172.21.15.114:0/193772820 wait complete. 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 Processor -- start 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- start start 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c21d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df3c7c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56479c216de0 con 0x56479c215ca0 2024-05-08T18:10:10.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c21d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c21d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42934/0 (socket says 172.21.15.114:42934) 2024-05-08T18:10:10.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.584+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 learned_addr learned my addr 172.21.15.114:0/3387718879 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56479c21d740 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c21d200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5de80238a0 tx=0x7f5de804f220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5cc6ffd640 1 -- 172.21.15.114:0/3387718879 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de804c070 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56479c21d9d0 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5cc6ffd640 1 -- 172.21.15.114:0/3387718879 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de8035070 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5cc6ffd640 1 -- 172.21.15.114:0/3387718879 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5de801b8b0 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56479c21d9d0 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5cc6ffd640 1 -- 172.21.15.114:0/3387718879 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5de803f050 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5cc6ffd640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cbc0383a0 0x7f5cbc03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5cc6ffd640 1 -- 172.21.15.114:0/3387718879 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5de8005030 con 0x56479c215ca0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1f91640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cbc0383a0 0x7f5cbc03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c2284f0 0x56479c22a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22b0d0 con 0x56479c2284f0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1790640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c2284f0 0x56479c22a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1f91640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cbc0383a0 0x7f5cbc03a860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00f010 tx=0x7f5dec01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1790640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c2284f0 0x56479c22a980 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 realm 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22b4e0 con 0x56479c2284f0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22bdb0 con 0x56479c2284f0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22c150 con 0x56479c2284f0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.588+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22c9a0 con 0x56479c2284f0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df3c7c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df3c7c980 20 searching for the correct realm 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56479c22e710 0x56479c230b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56479c22e710 0x56479c230b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56479c22e710 0x56479c230b00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de803fd60 con 0x56479c22e710 2024-05-08T18:10:10.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df0f8f640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5de803a7e0 0x7f5de8047a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1f91640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5de803a7e0 0x7f5de8047a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1f91640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5de803a7e0 0x7f5de8047a40 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5de40d4040 0x7f5de40090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5de40d4040 0x7f5de40090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5de40d4040 0x7f5de40090d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x7f5de40d4040 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.592+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x7f5de40d4040 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80247a0 con 0x56479c22e710 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80247a0 con 0x56479c22e710 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80247a0 con 0x56479c22e710 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x7f5de40d4040 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de80247a0 con 0x56479c22e710 2024-05-08T18:10:10.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.596+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5de40b2070 con 0x56479c2284f0 2024-05-08T18:10:10.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40b2070 con 0x7f5de40d4040 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.600+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c22e710 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de40d4040 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x56479c2284f0 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56479c231040 con 0x7f5de803a7e0 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:10.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22d280 con 0x56479c2284f0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22dad0 con 0x56479c2284f0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c22dad0 con 0x56479c2284f0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 zone default found 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 4 Realm: () 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 zonegroup default 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c231470 con 0x7f5de40d4040 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c232ee0 con 0x56479c22e710 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c233370 con 0x56479c22e710 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 started sync module instance, tier type = 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.604+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2322f0 con 0x7f5de803a7e0 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94865562216160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c232b00 con 0x7f5de803a7e0 2024-05-08T18:10:10.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c234190 con 0x56479c2284f0 2024-05-08T18:10:10.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94865562216160] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94865562220496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2345b0 con 0x56479c2284f0 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.608+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c234f70 con 0x56479c22e710 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94865562220496] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94865562225344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2357c0 con 0x56479c22e710 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c233c10 con 0x7f5de803a7e0 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94865562229968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2365a0 con 0x7f5de803a7e0 2024-05-08T18:10:10.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c236f60 con 0x56479c2284f0 2024-05-08T18:10:10.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94865562229968] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.612+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94865562225344] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94865562233520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2365a0 con 0x56479c2284f0 2024-05-08T18:10:10.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c236ed0 con 0x7f5de40d4040 2024-05-08T18:10:10.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94865562233520] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94865562231024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c236510 con 0x7f5de40d4040 2024-05-08T18:10:10.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.616+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c237d90 con 0x7f5de40d4040 2024-05-08T18:10:10.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94865562231024] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94865562235584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c237d90 con 0x7f5de40d4040 2024-05-08T18:10:10.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c238750 con 0x7f5de40d4040 2024-05-08T18:10:10.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94865562235584] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94865562239648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2386c0 con 0x7f5de40d4040 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=0 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=1 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=2 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=3 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=4 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=5 2024-05-08T18:10:10.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.620+0000 7f5df3c7c980 20 add_watcher() i=6 2024-05-08T18:10:10.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94865562239648] v32'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 20 add_watcher() i=7 2024-05-08T18:10:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c23bbb0 con 0x56479c2284f0 2024-05-08T18:10:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94865562237152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c2390d0 con 0x56479c2284f0 2024-05-08T18:10:10.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94865562237152] v32'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5ca7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 5 note: GC not initialized 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5ca6fe5640 20 reqs_thread_entry: start 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 20 Filter name: none 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5ca4fe1640 20 reqs_thread_entry: start 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.624+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c25f610 con 0x7f5de40d4040 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c25dc50 con 0x56479c2284f0 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T18:10:10.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.628+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25e520 con 0x7f5de40d4040 2024-05-08T18:10:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T18:10:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:10:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T18:10:10.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94865562394736 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c2630b0 con 0x7f5de40d4040 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== watch-notify(notify (1) cookie 94865562239648 notify 137438953488 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56479c25e8c0 con 0x7f5de40d4040 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5cd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94865562239648 notifier 4723 bl.length()=556 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(65 notify.7 [notify cookie 94865562394736 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5cd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5cd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5cd4ff9640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5cb4003eb0 con 0x7f5de40d4040 2024-05-08T18:10:10.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== watch-notify(notify_complete (2) cookie 94865562394736 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56479c25f060 con 0x7f5de40d4040 2024-05-08T18:10:10.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25e020 con 0x56479c2284f0 2024-05-08T18:10:10.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:10:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:10:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:10:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.632+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94865562394656 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56479c263090 con 0x7f5de40d4040 2024-05-08T18:10:10.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== watch-notify(notify (1) cookie 94865562231024 notify 137438953489 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56479c25f060 con 0x7f5de40d4040 2024-05-08T18:10:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(68 notify.5 [notify cookie 94865562394656 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5cd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94865562231024 notifier 4723 bl.length()=177 2024-05-08T18:10:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5cd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:10:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5cd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:10:10.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5cd4ff9640 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5cb4003eb0 con 0x7f5de40d4040 2024-05-08T18:10:10.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== watch-notify(notify_complete (2) cookie 94865562394656 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56479c1f4100 con 0x7f5de40d4040 2024-05-08T18:10:10.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.637 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T18:10:10.630404Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:10.630383Z","tags":[],"group_ids":[]} 2024-05-08T18:10:10.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5ca7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.636+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94865562237152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x56479c2284f0 2024-05-08T18:10:10.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94865562237152] v32'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94865562216160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x7f5de803a7e0 2024-05-08T18:10:10.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94865562216160] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df3c7c980 20 remove_watcher() i=0 2024-05-08T18:10:10.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df3c7c980 2 removed watcher, disabling cache 2024-05-08T18:10:10.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94865562220496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x56479c2284f0 2024-05-08T18:10:10.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94865562220496] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df3c7c980 20 remove_watcher() i=1 2024-05-08T18:10:10.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.640+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94865562225344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x56479c22e710 2024-05-08T18:10:10.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.644+0000 7f5df0f8f640 1 -- 172.21.15.114:0/3387718879 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94865562225344] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de8069040 con 0x56479c22e710 2024-05-08T18:10:10.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.644+0000 7f5df3c7c980 20 remove_watcher() i=2 2024-05-08T18:10:10.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.644+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94865562229968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x7f5de803a7e0 2024-05-08T18:10:10.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.644+0000 7f5df1f91640 1 -- 172.21.15.114:0/3387718879 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94865562229968] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5dec02f040 con 0x7f5de803a7e0 2024-05-08T18:10:10.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.644+0000 7f5df3c7c980 20 remove_watcher() i=3 2024-05-08T18:10:10.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.644+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94865562233520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x56479c2284f0 2024-05-08T18:10:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.648+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94865562233520] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x56479c2284f0 2024-05-08T18:10:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.648+0000 7f5df3c7c980 20 remove_watcher() i=4 2024-05-08T18:10:10.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.648+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94865562231024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x7f5de40d4040 2024-05-08T18:10:10.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.648+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94865562231024] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.648+0000 7f5df3c7c980 20 remove_watcher() i=5 2024-05-08T18:10:10.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.648+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94865562235584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x7f5de40d4040 2024-05-08T18:10:10.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94865562235584] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 20 remove_watcher() i=6 2024-05-08T18:10:10.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94865562239648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56479c25d2b0 con 0x7f5de40d4040 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94865562239648] v32'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5de40f0080 con 0x7f5de40d4040 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 20 remove_watcher() i=7 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5de40d4040 msgr2=0x7f5de40090d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5de40d4040 0x7f5de40090d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c2284f0 msgr2=0x56479c22a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c2284f0 0x56479c22a980 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5de803a7e0 msgr2=0x7f5de8047a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5de803a7e0 0x7f5de8047a40 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56479c22e710 msgr2=0x56479c230b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56479c22e710 0x56479c230b00 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cbc0383a0 msgr2=0x7f5cbc03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cbc0383a0 0x7f5cbc03a860 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00f010 tx=0x7f5dec01b070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 msgr2=0x56479c21d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/3387718879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c215ca0 0x56479c21d200 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5de80238a0 tx=0x7f5de804f220 comp rx=0 tx=0).stop 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 reap_dead start 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df1790640 1 -- 172.21.15.114:0/3387718879 reap_dead start 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 shutdown_connections 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 >> 172.21.15.114:0/3387718879 conn(0x56479c212030 msgr2=0x56479c217500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 shutdown_connections 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/3387718879 wait complete. 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.652+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cc80383f0 msgr2=0x7f5cc803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cc80383f0 0x7f5cc803a8b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00e3f0 tx=0x7f5dec003070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 msgr2=0x56479c208e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 0x56479c208e80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5de800d660 tx=0x7f5de800da60 comp rx=0 tx=0).stop 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 shutdown_connections 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cc80383f0 0x7f5cc803a8b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/4280852120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c208a60 0x56479c208e80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 >> 172.21.15.114:0/4280852120 conn(0x56479c1fd870 msgr2=0x56479c1fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 shutdown_connections 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/4280852120 wait complete. 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c0fea50 msgr2=0x56479c1f7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c0fea50 0x56479c1f7d50 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cd8038440 msgr2=0x7f5cd803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cd8038440 0x7f5cd803a900 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5de8001d80 tx=0x7f5de80012e0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 msgr2=0x56479c1f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1f0ca0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5de401b010 tx=0x7f5de4019810 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 shutdown_connections 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56479c0fea50 0x56479c1f7d50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5cd8038440 0x7f5cd803a900 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 --2- 172.21.15.114:0/825440829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56479c0fe130 0x56479c1f0ca0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 >> 172.21.15.114:0/825440829 conn(0x56479c071810 msgr2=0x56479c1e4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 shutdown_connections 2024-05-08T18:10:10.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.656+0000 7f5df3c7c980 1 -- 172.21.15.114:0/825440829 wait complete. 2024-05-08T18:10:10.664 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T18:10:10.630404Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:10.630383Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:10.678 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:10:10.683 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-08T18:10:10.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T18:10:10.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T18:10:10.684 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-08T18:10:10.745 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:10.745 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:10.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.744+0000 7fcd5f70a980 1 Processor -- start 2024-05-08T18:10:10.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.744+0000 7fcd5f70a980 1 -- start start 2024-05-08T18:10:10.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.744+0000 7fcd5f70a980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563e6f87a3d0 0x563e6f87c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.744+0000 7fcd5f70a980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563e6f721710 con 0x563e6f875f10 2024-05-08T18:10:10.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.744+0000 7fcd5f70a980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x563e6f735f00 con 0x563e6f87a3d0 2024-05-08T18:10:10.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5ca1d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563e6f87a3d0 0x563e6f87c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5ca1d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x563e6f87a3d0 0x563e6f87c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42948/0 (socket says 172.21.15.114:42948) 2024-05-08T18:10:10.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2857880315 learned_addr learned my addr 172.21.15.114:0/2857880315 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5d21e640 1 --1- 172.21.15.114:0/2857880315 >> v1:172.21.15.53:6789/0 conn(0x563e6f875f10 0x563e6f8762f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47888/0 (socket says 172.21.15.114:47888) 2024-05-08T18:10:10.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2857880315 >> v1:172.21.15.53:6789/0 conn(0x563e6f875f10 legacy=0x563e6f8762f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2857880315 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6f6fdae0 con 0x563e6f87a3d0 2024-05-08T18:10:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/2857880315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f87a3d0 0x563e6f87c7c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800a5c0 tx=0x7fcd4801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f787694bdba17a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd57fff640 1 -- 172.21.15.114:0/2857880315 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480a6070 con 0x563e6f87a3d0 2024-05-08T18:10:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd57fff640 1 -- 172.21.15.114:0/2857880315 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480af070 con 0x563e6f87a3d0 2024-05-08T18:10:10.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd57fff640 1 -- 172.21.15.114:0/2857880315 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480aa5c0 con 0x563e6f87a3d0 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2857880315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f87a3d0 msgr2=0x563e6f87c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2857880315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f87a3d0 0x563e6f87c7c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800a5c0 tx=0x7fcd4801b340 comp rx=0 tx=0).stop 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2857880315 shutdown_connections 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2857880315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f87a3d0 0x563e6f87c7c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2857880315 >> 172.21.15.114:0/2857880315 conn(0x563e6f8717e0 msgr2=0x563e6f873c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2857880315 shutdown_connections 2024-05-08T18:10:10.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.748+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2857880315 wait complete. 2024-05-08T18:10:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 Processor -- start 2024-05-08T18:10:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- start start 2024-05-08T18:10:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f960f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e6f779f80 con 0x563e6f875f10 2024-05-08T18:10:10.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5d21e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f960f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5d21e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f960f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42952/0 (socket says 172.21.15.114:42952) 2024-05-08T18:10:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2454904921 learned_addr learned my addr 172.21.15.114:0/2454904921 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2454904921 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6f741da0 con 0x563e6f875f10 2024-05-08T18:10:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/2454904921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f960f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcd58001680 tx=0x7fcd58001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a74c59326dc5666 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcc4b606640 1 -- 172.21.15.114:0/2454904921 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd58013420 con 0x563e6f875f10 2024-05-08T18:10:10.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcc4b606640 1 -- 172.21.15.114:0/2454904921 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd580135c0 con 0x563e6f875f10 2024-05-08T18:10:10.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcc4b606640 1 -- 172.21.15.114:0/2454904921 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd580138e0 con 0x563e6f875f10 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2454904921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 msgr2=0x563e6f960f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2454904921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f960f70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcd58001680 tx=0x7fcd58001b40 comp rx=0 tx=0).stop 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2454904921 shutdown_connections 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2454904921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f960f70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2454904921 >> 172.21.15.114:0/2454904921 conn(0x563e6f8717e0 msgr2=0x563e6f95cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2454904921 shutdown_connections 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2454904921 wait complete. 2024-05-08T18:10:10.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.764+0000 7fcd5f70a980 1 Processor -- start 2024-05-08T18:10:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 -- start start 2024-05-08T18:10:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f968460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e6f87f7f0 con 0x563e6f875f10 2024-05-08T18:10:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5d21e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f968460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5d21e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f968460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42966/0 (socket says 172.21.15.114:42966) 2024-05-08T18:10:10.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5d21e640 1 -- 172.21.15.114:0/1649173604 learned_addr learned my addr 172.21.15.114:0/1649173604 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5d21e640 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6f9689a0 con 0x563e6f875f10 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f968460 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcd58002260 tx=0x7fcd58000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcc49e03640 1 -- 172.21.15.114:0/1649173604 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd580037a0 con 0x563e6f875f10 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e6f968c30 con 0x563e6f875f10 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcc49e03640 1 -- 172.21.15.114:0/1649173604 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd58023070 con 0x563e6f875f10 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcc49e03640 1 -- 172.21.15.114:0/1649173604 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd58003a70 con 0x563e6f875f10 2024-05-08T18:10:10.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6f96b870 con 0x563e6f875f10 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcc49e03640 1 -- 172.21.15.114:0/1649173604 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcd58010070 con 0x563e6f875f10 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcc49e03640 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc440383f0 0x7fcc4403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcc49e03640 1 -- 172.21.15.114:0/1649173604 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fcd5804e7d0 con 0x563e6f875f10 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc440383f0 0x7fcc4403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f87a3d0 0x563e6f96f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f96f9d0 con 0x563e6f87a3d0 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f87a3d0 0x563e6f96f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc440383f0 0x7fcc4403a8b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd480ae000 tx=0x7fcd480a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.768+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f87a3d0 0x563e6f96f390 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5da1f640 1 -- 172.21.15.114:0/1649173604 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd500083f0 con 0x563e6f87a3d0 2024-05-08T18:10:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f96ca90 con 0x563e6f87a3d0 2024-05-08T18:10:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5da1f640 1 -- 172.21.15.114:0/1649173604 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd500083f0 con 0x563e6f87a3d0 2024-05-08T18:10:10.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f971810 con 0x563e6f87a3d0 2024-05-08T18:10:10.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5da1f640 1 -- 172.21.15.114:0/1649173604 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcd500083f0 con 0x563e6f87a3d0 2024-05-08T18:10:10.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f970a40 con 0x563e6f87a3d0 2024-05-08T18:10:10.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5da1f640 1 -- 172.21.15.114:0/1649173604 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd500083f0 con 0x563e6f87a3d0 2024-05-08T18:10:10.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f970e60 con 0x563e6f87a3d0 2024-05-08T18:10:10.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5da1f640 1 -- 172.21.15.114:0/1649173604 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcd500083f0 con 0x563e6f87a3d0 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 Processor -- start 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- start start 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 0x563e6f9805b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e6f77dfc0 con 0x563e6f980190 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5ca1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 0x563e6f9805b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5ca1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 0x563e6f9805b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42982/0 (socket says 172.21.15.114:42982) 2024-05-08T18:10:10.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2446302077 learned_addr learned my addr 172.21.15.114:0/2446302077 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2446302077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6f980af0 con 0x563e6f980190 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 0x563e6f9805b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcd480199f0 tx=0x7fcd480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcc42ffd640 1 -- 172.21.15.114:0/2446302077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480b3b90 con 0x563e6f980190 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e6f981590 con 0x563e6f980190 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcc42ffd640 1 -- 172.21.15.114:0/2446302077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480b3d30 con 0x563e6f980190 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcc42ffd640 1 -- 172.21.15.114:0/2446302077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480c8560 con 0x563e6f980190 2024-05-08T18:10:10.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.772+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6f981a00 con 0x563e6f980190 2024-05-08T18:10:10.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcc42ffd640 1 -- 172.21.15.114:0/2446302077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcd480d1440 con 0x563e6f980190 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcc42ffd640 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc340383f0 0x7fcc3403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcc42ffd640 1 -- 172.21.15.114:0/2446302077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fcd480ec0e0 con 0x563e6f980190 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc340383f0 0x7fcc3403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 Processor -- start 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- start start 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc340383f0 0x7fcc3403a8b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x563e6f970de0 tx=0x7fcd50003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f98f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e6f9616c0 con 0x563e6f98f450 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5ca1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f98f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5ca1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f98f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42996/0 (socket says 172.21.15.114:42996) 2024-05-08T18:10:10.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/3671275785 learned_addr learned my addr 172.21.15.114:0/3671275785 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/3671275785 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6f98fe20 con 0x563e6f98f450 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/3671275785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f98f850 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcd480befd0 tx=0x7fcd480d1a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=117371559e5dd6c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcc40ff9640 1 -- 172.21.15.114:0/3671275785 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480bd390 con 0x563e6f98f450 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcc40ff9640 1 -- 172.21.15.114:0/3671275785 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480bd530 con 0x563e6f98f450 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcc40ff9640 1 -- 172.21.15.114:0/3671275785 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480be410 con 0x563e6f98f450 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- 172.21.15.114:0/3671275785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 msgr2=0x563e6f98f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/3671275785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f98f850 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcd480befd0 tx=0x7fcd480d1a80 comp rx=0 tx=0).stop 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- 172.21.15.114:0/3671275785 shutdown_connections 2024-05-08T18:10:10.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/3671275785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f98f850 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- 172.21.15.114:0/3671275785 >> 172.21.15.114:0/3671275785 conn(0x563e6f98b790 msgr2=0x563e6f9897f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- 172.21.15.114:0/3671275785 shutdown_connections 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- 172.21.15.114:0/3671275785 wait complete. 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 Processor -- start 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.776+0000 7fcd5f70a980 1 -- start start 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f996930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x563e6f990560 con 0x563e6f98f450 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5ca1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f996930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5ca1d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f996930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42998/0 (socket says 172.21.15.114:42998) 2024-05-08T18:10:10.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 learned_addr learned my addr 172.21.15.114:0/2415774308 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e6f996e70 con 0x563e6f98f450 2024-05-08T18:10:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f996930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcd480c8750 tx=0x7fcd480ea3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcc32ffd640 1 -- 172.21.15.114:0/2415774308 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480bd390 con 0x563e6f98f450 2024-05-08T18:10:10.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563e6f997100 con 0x563e6f98f450 2024-05-08T18:10:10.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcc32ffd640 1 -- 172.21.15.114:0/2415774308 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd480e0070 con 0x563e6f98f450 2024-05-08T18:10:10.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e6f999de0 con 0x563e6f98f450 2024-05-08T18:10:10.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcc32ffd640 1 -- 172.21.15.114:0/2415774308 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd480bf910 con 0x563e6f98f450 2024-05-08T18:10:10.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcc32ffd640 1 -- 172.21.15.114:0/2415774308 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fcd480f3060 con 0x563e6f98f450 2024-05-08T18:10:10.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcc32ffd640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc280383f0 0x7fcc2803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcc32ffd640 1 -- 172.21.15.114:0/2415774308 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fcd480f6d10 con 0x563e6f98f450 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc280383f0 0x7fcc2803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f9a1e30 0x563e6f9a42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a49f0 con 0x563e6f9a1e30 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f9a1e30 0x563e6f9a42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc280383f0 0x7fcc2803a8b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000f010 tx=0x7fcd5001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f9a1e30 0x563e6f9a42a0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 20 realm 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.780+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a4e00 con 0x563e6f9a1e30 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a56d0 con 0x563e6f9a1e30 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a5a70 con 0x563e6f9a1e30 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a62c0 con 0x563e6f9a1e30 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 20 searching for the correct realm 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563e6f9a8030 0x563e6f9aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563e6f9a8030 0x563e6f9aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563e6f9a8030 0x563e6f9aa420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5ca1d640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd48009040 0x7fcd480caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd48009040 0x7fcd480caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5da1f640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd48009040 0x7fcd480caaf0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd5804b2b0 0x7fcd58028460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.784+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd5804b2b0 0x7fcd58028460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:10.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd5804b2b0 0x7fcd58028460 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:10.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x7fcd5804b2b0 2024-05-08T18:10:10.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x7fcd5804b2b0 2024-05-08T18:10:10.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.788+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x7fcd5804b2b0 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5800f030 con 0x7fcd5804b2b0 2024-05-08T18:10:10.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcd5800f030 con 0x563e6f9a1e30 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.792+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a8030 2024-05-08T18:10:10.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd5804b2b0 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x563e6f9a1e30 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aa960 con 0x7fcd48009040 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a6c10 con 0x563e6f9a1e30 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a7460 con 0x563e6f9a1e30 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9a6850 con 0x563e6f9a1e30 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 zone default found 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 4 Realm: () 2024-05-08T18:10:10.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 zonegroup default 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aad90 con 0x7fcd5804b2b0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.796+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9ac800 con 0x563e6f9a8030 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9acc90 con 0x563e6f9a8030 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 20 started sync module instance, tier type = 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9abc10 con 0x7fcd48009040 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94826160373760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9ac420 con 0x7fcd48009040 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9adad0 con 0x563e6f9a1e30 2024-05-08T18:10:10.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94826160373760] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94826160378096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9adec0 con 0x563e6f9a1e30 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.800+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9ae880 con 0x563e6f9a8030 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94826160382928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9af120 con 0x563e6f9a8030 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9afb20 con 0x7fcd48009040 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94826160378096] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94826160379152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9aff10 con 0x7fcd48009040 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b08d0 con 0x563e6f9a1e30 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.804+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94826160382928] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94826160379152] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94826160387632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b0420 con 0x563e6f9a1e30 2024-05-08T18:10:10.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b0cb0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94826160387632] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94826160385136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b08d0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.810 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.808+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b16c0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94826160385136] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94826160394768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b1ae0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b0420 con 0x7fcd5804b2b0 2024-05-08T18:10:10.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94826160394768] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94826160395824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b1a50 con 0x7fcd5804b2b0 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=0 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=1 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=2 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=3 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=4 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=5 2024-05-08T18:10:10.815 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.812+0000 7fcd5f70a980 20 add_watcher() i=6 2024-05-08T18:10:10.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94826160395824] v32'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 20 add_watcher() i=7 2024-05-08T18:10:10.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:10.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b5580 con 0x563e6f9a1e30 2024-05-08T18:10:10.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94826160398496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9b29a0 con 0x563e6f9a1e30 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94826160398496] v32'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcc137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.816+0000 7fcd5f70a980 5 note: GC not initialized 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcc127e4640 20 reqs_thread_entry: start 2024-05-08T18:10:10.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:10.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 20 Filter name: none 2024-05-08T18:10:10.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcb83fff640 20 reqs_thread_entry: start 2024-05-08T18:10:10.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T18:10:10.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9d8e60 con 0x7fcd5804b2b0 2024-05-08T18:10:10.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dd1b0 con 0x7fcd48009040 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:10:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:10:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:10:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94826160569184 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dde80 con 0x7fcd5804b2b0 2024-05-08T18:10:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== watch-notify(notify (1) cookie 94826160385136 notify 137438953490 ret 0) ==== 424+0+0 (crc 0 0 0) 0x563e6f96b870 con 0x7fcd5804b2b0 2024-05-08T18:10:10.822 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcc40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94826160385136 notifier 4730 bl.length()=382 2024-05-08T18:10:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcc40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:10:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcc40ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:10:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcc40ff9640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcc20003eb0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.820+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(64 notify.5 [notify cookie 94826160569184 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== watch-notify(notify_complete (2) cookie 94826160569184 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e6f968c30 con 0x7fcd5804b2b0 2024-05-08T18:10:10.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9ddd80 con 0x563e6f9a1e30 2024-05-08T18:10:10.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 : miss 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 20 rados->read ofs=0 len=0 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 8.4 8:2183c35c:root::.bucket.meta.myfoo6%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9db300 con 0x7fcd48009040 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(67 .bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x17 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 2024-05-08T18:10:10.825 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 8.4 8:2183c35c:root::.bucket.meta.myfoo6%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e50e0 con 0x7fcd48009040 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(68 .bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x17 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9, ofs0, ns] 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94826160566640 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e3d30 con 0x7fcd48009040 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== watch-notify(notify (1) cookie 94826160379152 notify 137438953509 ret 0) ==== 790+0+0 (crc 0 0 0) 0x563e6f9db6f0 con 0x7fcd48009040 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcc33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94826160379152 notifier 4730 bl.length()=748 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(69 notify.3 [notify cookie 94826160566640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcc33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x17 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcc33fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcc33fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:10:10.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcc33fff640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcb90003540 con 0x7fcd48009040 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.824+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== watch-notify(notify_complete (2) cookie 94826160566640 notify 137438953509 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e6f9dab50 con 0x7fcd48009040 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): orig_sources= new_sources= 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): potential sources added=[] removed=[] 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): orig_dests= new_dests= 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): potential dests added=[] removed=[] 2024-05-08T18:10:10.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9db170 con 0x563e6f9a1e30 2024-05-08T18:10:10.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9db170 con 0x563e6f9a1e30 2024-05-08T18:10:10.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(72 bud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.829 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9db170 con 0x563e6f9a1e30 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v32'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94826160566640 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9de510 con 0x7fcd48009040 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== watch-notify(notify (1) cookie 94826160379152 notify 137438953510 ret 0) ==== 358+0+0 (crc 0 0 0) 0x7fcd50039040 con 0x7fcd48009040 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcc33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94826160379152 notifier 4730 bl.length()=316 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcc33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcc33fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcc33fff640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcb90003570 con 0x7fcd48009040 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(74 notify.3 [notify cookie 94826160566640 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== watch-notify(notify_complete (2) cookie 94826160566640 notify 137438953510 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcd50010040 con 0x7fcd48009040 2024-05-08T18:10:10.831 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 : hit (requested=0x17, cached=0x17) 2024-05-08T18:10:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 2024-05-08T18:10:10.832 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.828+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:76 8.4 8:2183c35c:root::.bucket.meta.myfoo6%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc410 con 0x7fcd48009040 2024-05-08T18:10:10.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(76 .bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v32'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x17 2024-05-08T18:10:10.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:10.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:10:10.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9, ofs0, ns] 2024-05-08T18:10:10.833 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94826160568880 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc300 con 0x7fcd48009040 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== watch-notify(notify (1) cookie 94826160379152 notify 137438953511 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fcd50010040 con 0x7fcd48009040 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcc40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953511 cookie 94826160379152 notifier 4730 bl.length()=748 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcc40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x17 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcc40ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcc40ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcc40ff9640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcc20003eb0 con 0x7fcd48009040 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(77 notify.3 [notify cookie 94826160568880 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== watch-notify(notify_complete (2) cookie 94826160568880 notify 137438953511 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fcd500269d0 con 0x7fcd48009040 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): orig_sources= new_sources= 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): potential sources added=[] removed=[] 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): orig_dests= new_dests= 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 20 handle_bi_update(): bucket=:myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]): potential dests added=[] removed=[] 2024-05-08T18:10:10.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:79 4.33 4:cd5cc723:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dbee0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(79 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 4.22 4:4688c518:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dba30 con 0x563e6f9a1e30 2024-05-08T18:10:10.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58054040 con 0x563e6f9a1e30 2024-05-08T18:10:10.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.832+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:81 4.21 4:862ab0bc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dba30 con 0x7fcd5804b2b0 2024-05-08T18:10:10.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(81 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58054040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:82 4.11 4:89397c57:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dba30 con 0x7fcd5804b2b0 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(82 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:83 4.1f 4:fa20cbd7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dba30 con 0x563e6f9a8030 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(83 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:84 4.27 4:e52db099:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc370 con 0x563e6f9a1e30 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(84 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:85 4.38 4:1c8034eb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc370 con 0x563e6f9a1e30 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(85 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:86 4.37 4:eef4fc33:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc350 con 0x7fcd5804b2b0 2024-05-08T18:10:10.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(86 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:87 4.2b 4:d4450661:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc350 con 0x563e6f9a1e30 2024-05-08T18:10:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(87 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.836+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:88 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc350 con 0x563e6f9a1e30 2024-05-08T18:10:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(88 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [call out=378b] v0'0 uv10 ondisk = 0) ==== 194+0+378 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 10 cls_bucket_list_unordered: got thirteen 2024-05-08T18:10:10.839 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:89 4.7 4:e34cfe37:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9dc350 con 0x7fcd5804b2b0 2024-05-08T18:10:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(89 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 get_obj_state: octx=0x7fcd50005e50 obj=myfoo6:thirteen state=0x563e6f9e3a68 s->prefetch_data=0 2024-05-08T18:10:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:90 3.3as0 3:5e457f3d:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e24c0 con 0x7fcd48009040 2024-05-08T18:10:10.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(90 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+872 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 10 manifest: total_size = 8 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11114938812715875551 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.acl 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.etag 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 get_obj_state: octx=0x7fcd50005e50 obj=myfoo6:thirteen state=0x563e6f9e3a68 s->prefetch_data=0 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 : hit (requested=0x17, cached=0x17) 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 2024-05-08T18:10:10.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:91 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e87b0 con 0x563e6f9a1e30 2024-05-08T18:10:10.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(91 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [stat,call,call] v32'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.842 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.840+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:92 3.3as0 3:5e457f3d:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen:head [cmpxattr user.rgw.idtag (63) op 1 mode 1 in=77b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6c40 con 0x7fcd48009040 2024-05-08T18:10:10.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(92 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen [cmpxattr (63) op 1 mode 1,setxattr (117),setxattr (33)] v32'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:93 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x563e6f9a1e30 2024-05-08T18:10:10.844 INFO:teuthology.orchestra.run.smithi114.stderr:1 objects processed in :myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9]). Next marker thirteen 2024-05-08T18:10:10.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x7fcd48009040 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(93 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [stat,call,call] v32'12 uv12 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v32'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcc33fff640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5f70a980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:10:10.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94826160570016 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== watch-notify(notify (1) cookie 94826160385136 notify 137438953491 ret 0) ==== 598+0+0 (crc 0 0 0) 0x563e6f9de2b0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcc40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94826160385136 notifier 4730 bl.length()=556 2024-05-08T18:10:10.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcc40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T18:10:10.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcc40ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:10:10.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcc40ff9640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcc20003eb0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.846 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.844+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(95 notify.5 [notify cookie 94826160570016 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== watch-notify(notify_complete (2) cookie 94826160570016 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e6f9e22f0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.847 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x563e6f9a1e30 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5f70a980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5f70a980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94826160570016 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== watch-notify(notify (1) cookie 94826160385136 notify 137438953492 ret 0) ==== 219+0+0 (crc 0 0 0) 0x563e6f9e22f0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcc33fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 94826160385136 notifier 4730 bl.length()=177 2024-05-08T18:10:10.849 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcc33fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T18:10:10.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcc33fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T18:10:10.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcc33fff640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcb90003570 con 0x7fcd5804b2b0 2024-05-08T18:10:10.850 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(98 notify.5 [notify cookie 94826160570016 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.848+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== watch-notify(notify_complete (2) cookie 94826160570016 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e6f968c30 con 0x7fcd5804b2b0 2024-05-08T18:10:10.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5f70a980 10 removing user index: bar 2024-05-08T18:10:10.851 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(100 bar [delete] v32'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5f70a980 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-08T18:10:10.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5f70a980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T18:10:10.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94826160570016 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9e6bd0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== watch-notify(notify (1) cookie 94826160395824 notify 137438953493 ret 0) ==== 194+0+0 (crc 0 0 0) 0x563e6f968c30 con 0x7fcd5804b2b0 2024-05-08T18:10:10.853 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcc40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94826160395824 notifier 4730 bl.length()=152 2024-05-08T18:10:10.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcc40ff9640 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcc20003eb0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(101 notify.7 [notify cookie 94826160570016 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.854 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== watch-notify(notify_complete (2) cookie 94826160570016 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563e6f9689a0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.854 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T18:10:10.630404Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:10.630383Z","tags":[],"group_ids":[]} 2024-05-08T18:10:10.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.852+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcc137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:10.855 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94826160398496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9d6b90 con 0x563e6f9a1e30 2024-05-08T18:10:10.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94826160398496] v32'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.856 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94826160373760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9d6b90 con 0x7fcd48009040 2024-05-08T18:10:10.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94826160373760] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5f70a980 20 remove_watcher() i=0 2024-05-08T18:10:10.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5f70a980 2 removed watcher, disabling cache 2024-05-08T18:10:10.858 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.856+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94826160378096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9d6b90 con 0x563e6f9a1e30 2024-05-08T18:10:10.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.860+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94826160378096] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.860+0000 7fcd5f70a980 20 remove_watcher() i=1 2024-05-08T18:10:10.860 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.860+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94826160382928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9d6b90 con 0x563e6f9a8030 2024-05-08T18:10:10.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.860+0000 7fcd5ca1d640 1 -- 172.21.15.114:0/2415774308 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94826160382928] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd480ce020 con 0x563e6f9a8030 2024-05-08T18:10:10.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.860+0000 7fcd5f70a980 20 remove_watcher() i=2 2024-05-08T18:10:10.862 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.860+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94826160379152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9c95e0 con 0x7fcd48009040 2024-05-08T18:10:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.864+0000 7fcd5da1f640 1 -- 172.21.15.114:0/2415774308 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94826160379152] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd5002f040 con 0x7fcd48009040 2024-05-08T18:10:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.864+0000 7fcd5f70a980 20 remove_watcher() i=3 2024-05-08T18:10:10.863 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.864+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94826160387632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9c95e0 con 0x563e6f9a1e30 2024-05-08T18:10:10.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.864+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94826160387632] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x563e6f9a1e30 2024-05-08T18:10:10.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.864+0000 7fcd5f70a980 20 remove_watcher() i=4 2024-05-08T18:10:10.865 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.864+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94826160385136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9c95e0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.868+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94826160385136] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.868+0000 7fcd5f70a980 20 remove_watcher() i=5 2024-05-08T18:10:10.868 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.868+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94826160394768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9c95e0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.868+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94826160394768] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.868+0000 7fcd5f70a980 20 remove_watcher() i=6 2024-05-08T18:10:10.870 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.868+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94826160395824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563e6f9c95e0 con 0x7fcd5804b2b0 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94826160395824] v32'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcd58066040 con 0x7fcd5804b2b0 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 20 remove_watcher() i=7 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd5804b2b0 msgr2=0x7fcd58028460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fcd5804b2b0 0x7fcd58028460 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f9a1e30 msgr2=0x563e6f9a42a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f9a1e30 0x563e6f9a42a0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd48009040 msgr2=0x7fcd480caaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fcd48009040 0x7fcd480caaf0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563e6f9a8030 msgr2=0x563e6f9aa420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x563e6f9a8030 0x563e6f9aa420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc280383f0 msgr2=0x7fcc2803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc280383f0 0x7fcc2803a8b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000f010 tx=0x7fcd5001b070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 msgr2=0x563e6f996930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2415774308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f98f450 0x563e6f996930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcd480c8750 tx=0x7fcd480ea3b0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5d21e640 1 -- 172.21.15.114:0/2415774308 reap_dead start 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 shutdown_connections 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 >> 172.21.15.114:0/2415774308 conn(0x563e6f98b790 msgr2=0x563e6f9897c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 shutdown_connections 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2415774308 wait complete. 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc340383f0 msgr2=0x7fcc3403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc340383f0 0x7fcc3403a8b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x563e6f970de0 tx=0x7fcd50003070 comp rx=0 tx=0).stop 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 msgr2=0x563e6f9805b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 0x563e6f9805b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fcd480199f0 tx=0x7fcd480180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 shutdown_connections 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc340383f0 0x7fcc3403a8b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.875 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/2446302077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f980190 0x563e6f9805b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 >> 172.21.15.114:0/2446302077 conn(0x563e6f974fa0 msgr2=0x563e6f975ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 shutdown_connections 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/2446302077 wait complete. 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f87a3d0 msgr2=0x563e6f96f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f87a3d0 0x563e6f96f390 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc440383f0 msgr2=0x7fcc4403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc440383f0 0x7fcc4403a8b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd480ae000 tx=0x7fcd480a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 msgr2=0x563e6f968460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f968460 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcd58002260 tx=0x7fcd58000f50 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 shutdown_connections 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x563e6f87a3d0 0x563e6f96f390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcc440383f0 0x7fcc4403a8b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 --2- 172.21.15.114:0/1649173604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563e6f875f10 0x563e6f968460 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:10.876 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 >> 172.21.15.114:0/1649173604 conn(0x563e6f8717e0 msgr2=0x563e6f95b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 shutdown_connections 2024-05-08T18:10:10.877 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:10.872+0000 7fcd5f70a980 1 -- 172.21.15.114:0/1649173604 wait complete. 2024-05-08T18:10:10.884 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T18:10:10.630404Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:10.630383Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:15.895 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:10:15.895 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:10:15.895 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T18:10:15.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T18:10:15.896 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-08T18:10:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:15.943 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43090c0980 1 Processor -- start 2024-05-08T18:10:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43090c0980 1 -- start start 2024-05-08T18:10:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43090c0980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56349ecc6d20 0x56349ed54b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43090c0980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56349ebfd710 con 0x56349ecc8010 2024-05-08T18:10:15.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43090c0980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56349ec11f00 con 0x56349ecc6d20 2024-05-08T18:10:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43063d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56349ecc6d20 0x56349ed54b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43063d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56349ecc6d20 0x56349ed54b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43002/0 (socket says 172.21.15.114:43002) 2024-05-08T18:10:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43063d3640 1 -- 172.21.15.114:0/3429401237 learned_addr learned my addr 172.21.15.114:0/3429401237 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f4306bd4640 1 --1- 172.21.15.114:0/3429401237 >> v1:172.21.15.53:6789/0 conn(0x56349ecc8010 0x56349ecc6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47896/0 (socket says 172.21.15.114:47896) 2024-05-08T18:10:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43063d3640 1 -- 172.21.15.114:0/3429401237 >> v1:172.21.15.53:6789/0 conn(0x56349ecc8010 legacy=0x56349ecc6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:15.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.944+0000 7f43063d3640 1 -- 172.21.15.114:0/3429401237 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349ebd9ae0 con 0x56349ecc6d20 2024-05-08T18:10:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43063d3640 1 --2- 172.21.15.114:0/3429401237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ed54b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f42f000a5c0 tx=0x7f42f001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bdf94d477e2bf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f4305bd2640 1 -- 172.21.15.114:0/3429401237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00a6070 con 0x56349ecc6d20 2024-05-08T18:10:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f4305bd2640 1 -- 172.21.15.114:0/3429401237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00af070 con 0x56349ecc6d20 2024-05-08T18:10:15.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f4305bd2640 1 -- 172.21.15.114:0/3429401237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00aa5c0 con 0x56349ecc6d20 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 -- 172.21.15.114:0/3429401237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 msgr2=0x56349ed54b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 --2- 172.21.15.114:0/3429401237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ed54b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f42f000a5c0 tx=0x7f42f001b340 comp rx=0 tx=0).stop 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 -- 172.21.15.114:0/3429401237 shutdown_connections 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 --2- 172.21.15.114:0/3429401237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ed54b00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 -- 172.21.15.114:0/3429401237 >> 172.21.15.114:0/3429401237 conn(0x56349ed4d7e0 msgr2=0x56349ed4fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 -- 172.21.15.114:0/3429401237 shutdown_connections 2024-05-08T18:10:15.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.948+0000 7f43090c0980 1 -- 172.21.15.114:0/3429401237 wait complete. 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 Processor -- start 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- start start 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee43bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56349ec55f80 con 0x56349ecc6d20 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f4306bd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee43bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f4306bd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee43bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43012/0 (socket says 172.21.15.114:43012) 2024-05-08T18:10:15.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f4306bd4640 1 -- 172.21.15.114:0/612022409 learned_addr learned my addr 172.21.15.114:0/612022409 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f4306bd4640 1 -- 172.21.15.114:0/612022409 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349ec1dda0 con 0x56349ecc6d20 2024-05-08T18:10:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f4306bd4640 1 --2- 172.21.15.114:0/612022409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee43bf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f42f80016f0 tx=0x7f42f8001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dbbc2344cda37b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f41f4e09640 1 -- 172.21.15.114:0/612022409 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f8003460 con 0x56349ecc6d20 2024-05-08T18:10:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f41f4e09640 1 -- 172.21.15.114:0/612022409 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8003620 con 0x56349ecc6d20 2024-05-08T18:10:15.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f41f4e09640 1 -- 172.21.15.114:0/612022409 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f8003940 con 0x56349ecc6d20 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- 172.21.15.114:0/612022409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 msgr2=0x56349ee43bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 --2- 172.21.15.114:0/612022409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee43bf0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f42f80016f0 tx=0x7f42f8001bb0 comp rx=0 tx=0).stop 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- 172.21.15.114:0/612022409 shutdown_connections 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 --2- 172.21.15.114:0/612022409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee43bf0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- 172.21.15.114:0/612022409 >> 172.21.15.114:0/612022409 conn(0x56349ed4d7e0 msgr2=0x56349ee3f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- 172.21.15.114:0/612022409 shutdown_connections 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 -- 172.21.15.114:0/612022409 wait complete. 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.964+0000 7f43090c0980 1 Processor -- start 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 -- start start 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee4afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56349ed55af0 con 0x56349ecc6d20 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f4306bd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee4afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f4306bd4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee4afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43024/0 (socket says 172.21.15.114:43024) 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f4306bd4640 1 -- 172.21.15.114:0/2215805336 learned_addr learned my addr 172.21.15.114:0/2215805336 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f4306bd4640 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349ee4b4f0 con 0x56349ecc6d20 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f4306bd4640 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee4afb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f42f80012f0 tx=0x7f42f8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f41f3606640 1 -- 172.21.15.114:0/2215805336 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f8022020 con 0x56349ecc6d20 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f41f3606640 1 -- 172.21.15.114:0/2215805336 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f8006820 con 0x56349ecc6d20 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56349ee4b780 con 0x56349ecc6d20 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f41f3606640 1 -- 172.21.15.114:0/2215805336 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f8003e10 con 0x56349ecc6d20 2024-05-08T18:10:15.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349ee4e3c0 con 0x56349ecc6d20 2024-05-08T18:10:15.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f41f3606640 1 -- 172.21.15.114:0/2215805336 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f42f8025020 con 0x56349ecc6d20 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f41f3606640 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41ec0383a0 0x7f41ec03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f41f3606640 1 -- 172.21.15.114:0/2215805336 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f42f804e840 con 0x56349ecc6d20 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43063d3640 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41ec0383a0 0x7f41ec03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ecc8010 0x56349ee52010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee52550 con 0x56349ecc8010 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.968+0000 7f43073d5640 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ecc8010 0x56349ee52010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43063d3640 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41ec0383a0 0x7f41ec03a860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f42f00ae000 tx=0x7f42f00a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43073d5640 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ecc8010 0x56349ee52010 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43073d5640 1 -- 172.21.15.114:0/2215805336 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43000083f0 con 0x56349ecc8010 2024-05-08T18:10:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee4f5c0 con 0x56349ecc8010 2024-05-08T18:10:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43073d5640 1 -- 172.21.15.114:0/2215805336 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43000083f0 con 0x56349ecc8010 2024-05-08T18:10:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee54330 con 0x56349ecc8010 2024-05-08T18:10:15.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43073d5640 1 -- 172.21.15.114:0/2215805336 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43000083f0 con 0x56349ecc8010 2024-05-08T18:10:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee534a0 con 0x56349ecc8010 2024-05-08T18:10:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43073d5640 1 -- 172.21.15.114:0/2215805336 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43000083f0 con 0x56349ecc8010 2024-05-08T18:10:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee538c0 con 0x56349ecc8010 2024-05-08T18:10:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43073d5640 1 -- 172.21.15.114:0/2215805336 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43000083f0 con 0x56349ecc8010 2024-05-08T18:10:15.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 Processor -- start 2024-05-08T18:10:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 -- start start 2024-05-08T18:10:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 0x56349ee630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43090c0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56349ec59fc0 con 0x56349ee62c80 2024-05-08T18:10:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43063d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 0x56349ee630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43063d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 0x56349ee630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43038/0 (socket says 172.21.15.114:43038) 2024-05-08T18:10:15.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43063d3640 1 -- 172.21.15.114:0/2244382557 learned_addr learned my addr 172.21.15.114:0/2244382557 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43063d3640 1 -- 172.21.15.114:0/2244382557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349ee635e0 con 0x56349ee62c80 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.972+0000 7f43063d3640 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 0x56349ee630a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f42f00ac040 tx=0x7f42f00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41f0e01640 1 -- 172.21.15.114:0/2244382557 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00b3a10 con 0x56349ee62c80 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41f0e01640 1 -- 172.21.15.114:0/2244382557 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00b3bb0 con 0x56349ee62c80 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56349ee64080 con 0x56349ee62c80 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41f0e01640 1 -- 172.21.15.114:0/2244382557 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00c8430 con 0x56349ee62c80 2024-05-08T18:10:15.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349ee644f0 con 0x56349ee62c80 2024-05-08T18:10:15.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41f0e01640 1 -- 172.21.15.114:0/2244382557 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f42f00d1440 con 0x56349ee62c80 2024-05-08T18:10:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41f0e01640 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41e00383f0 0x7f41e003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41f0e01640 1 -- 172.21.15.114:0/2244382557 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f42f00ebf50 con 0x56349ee62c80 2024-05-08T18:10:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43073d5640 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41e00383f0 0x7f41e003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43090c0980 1 Processor -- start 2024-05-08T18:10:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43073d5640 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41e00383f0 0x7f41e003a8b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x56349ee53840 tx=0x7f4300003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43090c0980 1 -- start start 2024-05-08T18:10:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43090c0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee70110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43090c0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56349ee442e0 con 0x56349ee6fcf0 2024-05-08T18:10:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43063d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee70110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43063d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee70110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43054/0 (socket says 172.21.15.114:43054) 2024-05-08T18:10:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43063d3640 1 -- 172.21.15.114:0/3339002722 learned_addr learned my addr 172.21.15.114:0/3339002722 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:15.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43063d3640 1 -- 172.21.15.114:0/3339002722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349ee706e0 con 0x56349ee6fcf0 2024-05-08T18:10:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f43063d3640 1 --2- 172.21.15.114:0/3339002722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee70110 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f42f0005bb0 tx=0x7f42f00ea480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c8e17f6577294a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.976+0000 7f41ea7fc640 1 -- 172.21.15.114:0/3339002722 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00d1860 con 0x56349ee6fcf0 2024-05-08T18:10:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f41ea7fc640 1 -- 172.21.15.114:0/3339002722 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00d1a00 con 0x56349ee6fcf0 2024-05-08T18:10:15.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f41ea7fc640 1 -- 172.21.15.114:0/3339002722 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00bd4c0 con 0x56349ee6fcf0 2024-05-08T18:10:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/3339002722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 msgr2=0x56349ee70110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 --2- 172.21.15.114:0/3339002722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee70110 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f42f0005bb0 tx=0x7f42f00ea480 comp rx=0 tx=0).stop 2024-05-08T18:10:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/3339002722 shutdown_connections 2024-05-08T18:10:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 --2- 172.21.15.114:0/3339002722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee70110 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/3339002722 >> 172.21.15.114:0/3339002722 conn(0x56349ee6c080 msgr2=0x56349ee6a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:15.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/3339002722 shutdown_connections 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/3339002722 wait complete. 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 Processor -- start 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- start start 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee77260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56349ee70e30 con 0x56349ee6fcf0 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43063d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee77260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43063d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee77260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43060/0 (socket says 172.21.15.114:43060) 2024-05-08T18:10:15.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 learned_addr learned my addr 172.21.15.114:0/2791915569 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56349ee777a0 con 0x56349ee6fcf0 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43063d3640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee77260 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f42f0005bb0 tx=0x7f42f00ea160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f41e8ff9640 1 -- 172.21.15.114:0/2791915569 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00be540 con 0x56349ee6fcf0 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56349ee77a30 con 0x56349ee6fcf0 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f41e8ff9640 1 -- 172.21.15.114:0/2791915569 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00be6e0 con 0x56349ee6fcf0 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f41e8ff9640 1 -- 172.21.15.114:0/2791915569 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42f00c7c10 con 0x56349ee6fcf0 2024-05-08T18:10:15.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56349ee7a710 con 0x56349ee6fcf0 2024-05-08T18:10:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.980+0000 7f41e8ff9640 1 -- 172.21.15.114:0/2791915569 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f42f00bf940 con 0x56349ee6fcf0 2024-05-08T18:10:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f41e8ff9640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41d00383f0 0x7f41d003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f41e8ff9640 1 -- 172.21.15.114:0/2791915569 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f42f00e1070 con 0x56349ee6fcf0 2024-05-08T18:10:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:15.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43073d5640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41d00383f0 0x7f41d003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ee82720 0x56349ee84bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee85300 con 0x56349ee82720 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ee82720 0x56349ee84bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43073d5640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41d00383f0 0x7f41d003a8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4300008fd0 tx=0x7f430001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ee82720 0x56349ee84bb0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 realm 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee85710 con 0x56349ee82720 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:15.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee85fe0 con 0x56349ee82720 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee86380 con 0x56349ee82720 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee86bd0 con 0x56349ee82720 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 20 searching for the correct realm 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56349ee88600 0x56349ee8aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43063d3640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56349ee88600 0x56349ee8aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43063d3640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56349ee88600 0x56349ee8aac0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f00ed070 con 0x56349ee88600 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43063d3640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f42f00f0070 0x7f42f00f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43073d5640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f42f00f0070 0x7f42f00f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.984+0000 7f43073d5640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f42f00f0070 0x7f42f00f83a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:15.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f42f8027020 0x7f42f80119f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f42f8027020 0x7f42f80119f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f42f8027020 0x7f42f80119f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:15.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:15.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.988+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.992+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:15.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:15.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:15.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:15.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:15.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:15.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee88600 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:15.996+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f8027020 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x56349ee82720 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8b190 con 0x7f42f00f0070 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:16.001 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee86820 con 0x56349ee82720 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee87570 con 0x56349ee82720 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee87a50 con 0x56349ee82720 2024-05-08T18:10:16.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 zone default found 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 4 Realm: () 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 zonegroup default 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.003 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8bac0 con 0x7f42f8027020 2024-05-08T18:10:16.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8d890 con 0x56349ee88600 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8dc30 con 0x56349ee88600 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 started sync module instance, tier type = 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.000+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8cd30 con 0x7f42f00f0070 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94784004346144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8c990 con 0x7f42f00f0070 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8eb90 con 0x56349ee82720 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94784004346144] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.006 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94784004350144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8eb90 con 0x56349ee82720 2024-05-08T18:10:16.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.004+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8f550 con 0x56349ee88600 2024-05-08T18:10:16.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:16.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94784004354208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8fda0 con 0x56349ee88600 2024-05-08T18:10:16.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee907a0 con 0x7f42f00f0070 2024-05-08T18:10:16.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94784004350144] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94784004351712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee90b90 con 0x7f42f00f0070 2024-05-08T18:10:16.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee91550 con 0x56349ee82720 2024-05-08T18:10:16.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94784004354208] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:16.010 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94784004351712] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.008+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94784004358832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee910a0 con 0x56349ee82720 2024-05-08T18:10:16.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.012+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee91df0 con 0x7f42f8027020 2024-05-08T18:10:16.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.012+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94784004358832] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.012+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.012+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94784004356336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee91ae0 con 0x7f42f8027020 2024-05-08T18:10:16.013 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.012+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee92330 con 0x7f42f8027020 2024-05-08T18:10:16.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94784004365536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee926f0 con 0x7f42f8027020 2024-05-08T18:10:16.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee93210 con 0x7f42f8027020 2024-05-08T18:10:16.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94784004356336] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94784004365536] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94784004369632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee92140 con 0x7f42f8027020 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=0 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=1 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=2 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=3 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=4 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=5 2024-05-08T18:10:16.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.016+0000 7f43090c0980 20 add_watcher() i=6 2024-05-08T18:10:16.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94784004369632] v32'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 20 add_watcher() i=7 2024-05-08T18:10:16.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:16.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349ee96200 con 0x56349ee82720 2024-05-08T18:10:16.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.020 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94784004363824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee93680 con 0x56349ee82720 2024-05-08T18:10:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94784004363824] v32'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f41bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 5 note: GC not initialized 2024-05-08T18:10:16.022 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f4137fff640 20 reqs_thread_entry: start 2024-05-08T18:10:16.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:16.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 20 Filter name: none 2024-05-08T18:10:16.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f4135ffb640 20 reqs_thread_entry: start 2024-05-08T18:10:16.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:10:16.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.023 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.020+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb9b60 con 0x7f42f8027020 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb81a0 con 0x7f42f8027020 2024-05-08T18:10:16.024 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T18:10:16.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:10:16.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:10:16.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T18:10:16.025 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb8a40 con 0x7f42f8027020 2024-05-08T18:10:16.026 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:10:16.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:10:16.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:10:16.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.024+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94784004523408 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349eebd600 con 0x7f42f8027020 2024-05-08T18:10:16.027 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== watch-notify(notify (1) cookie 94784004356336 notify 137438953494 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56349eeb8de0 con 0x7f42f8027020 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41ea7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94784004356336 notifier 4737 bl.length()=556 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41ea7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41ea7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41ea7fc640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f41cc003eb0 con 0x7f42f8027020 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(65 notify.5 [notify cookie 94784004523408 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== watch-notify(notify_complete (2) cookie 94784004523408 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56349eeb95b0 con 0x7f42f8027020 2024-05-08T18:10:16.028 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349eebb090 con 0x7f42f8027020 2024-05-08T18:10:16.030 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43090c0980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43090c0980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43090c0980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94784004523328 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56349eebd560 con 0x56349ee88600 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== watch-notify(notify (1) cookie 94784004354208 notify 137438953478 ret 0) ==== 219+0+0 (crc 0 0 0) 0x56349ee77a30 con 0x56349ee88600 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94784004354208 notifier 4737 bl.length()=177 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(68 notify.2 [notify cookie 94784004523328 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42f0104040 con 0x56349ee88600 2024-05-08T18:10:16.031 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.028+0000 7f41e9ffb640 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f413c003410 con 0x56349ee88600 2024-05-08T18:10:16.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.032+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== watch-notify(notify_complete (2) cookie 94784004523328 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f42f010e020 con 0x56349ee88600 2024-05-08T18:10:16.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.032+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f0110040 con 0x56349ee88600 2024-05-08T18:10:16.032 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T18:10:16.026710Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:16.026684Z","tags":[],"group_ids":[]} 2024-05-08T18:10:16.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.032+0000 7f41bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.032 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.032+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94784004363824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb7800 con 0x56349ee82720 2024-05-08T18:10:16.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.032+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94784004363824] v32'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.033 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.032+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94784004346144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb7800 con 0x7f42f00f0070 2024-05-08T18:10:16.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94784004346144] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f43090c0980 20 remove_watcher() i=0 2024-05-08T18:10:16.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f43090c0980 2 removed watcher, disabling cache 2024-05-08T18:10:16.035 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94784004350144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb7800 con 0x56349ee82720 2024-05-08T18:10:16.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94784004350144] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f43090c0980 20 remove_watcher() i=1 2024-05-08T18:10:16.037 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.036+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94784004354208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349eeb7800 con 0x56349ee88600 2024-05-08T18:10:16.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.040+0000 7f43063d3640 1 -- 172.21.15.114:0/2791915569 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94784004354208] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f0110040 con 0x56349ee88600 2024-05-08T18:10:16.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.040+0000 7f43090c0980 20 remove_watcher() i=2 2024-05-08T18:10:16.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.040+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94784004351712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8e0c0 con 0x7f42f00f0070 2024-05-08T18:10:16.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.040+0000 7f43073d5640 1 -- 172.21.15.114:0/2791915569 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94784004351712] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f430002f040 con 0x7f42f00f0070 2024-05-08T18:10:16.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.040+0000 7f43090c0980 20 remove_watcher() i=3 2024-05-08T18:10:16.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.040+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94784004358832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8e6e0 con 0x56349ee82720 2024-05-08T18:10:16.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.044+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94784004358832] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x56349ee82720 2024-05-08T18:10:16.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.044+0000 7f43090c0980 20 remove_watcher() i=4 2024-05-08T18:10:16.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.044+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94784004356336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee902b0 con 0x7f42f8027020 2024-05-08T18:10:16.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.044+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94784004356336] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.044+0000 7f43090c0980 20 remove_watcher() i=5 2024-05-08T18:10:16.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.044+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94784004365536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8e6e0 con 0x7f42f8027020 2024-05-08T18:10:16.047 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94784004365536] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 20 remove_watcher() i=6 2024-05-08T18:10:16.048 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94784004369632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56349ee8f8f0 con 0x7f42f8027020 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94784004369632] v32'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42f801b040 con 0x7f42f8027020 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 20 remove_watcher() i=7 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f42f8027020 msgr2=0x7f42f80119f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f42f8027020 0x7f42f80119f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ee82720 msgr2=0x56349ee84bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ee82720 0x56349ee84bb0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f42f00f0070 msgr2=0x7f42f00f83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f42f00f0070 0x7f42f00f83a0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.052 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56349ee88600 msgr2=0x56349ee8aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56349ee88600 0x56349ee8aac0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41d00383f0 msgr2=0x7f41d003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41d00383f0 0x7f41d003a8b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4300008fd0 tx=0x7f430001b070 comp rx=0 tx=0).stop 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 msgr2=0x56349ee77260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 --2- 172.21.15.114:0/2791915569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee6fcf0 0x56349ee77260 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f42f0005bb0 tx=0x7f42f00ea160 comp rx=0 tx=0).stop 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 reap_dead start 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f4306bd4640 1 -- 172.21.15.114:0/2791915569 reap_dead start 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 shutdown_connections 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 >> 172.21.15.114:0/2791915569 conn(0x56349ee6c080 msgr2=0x56349ee71550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 shutdown_connections 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.048+0000 7f43090c0980 1 -- 172.21.15.114:0/2791915569 wait complete. 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41e00383f0 msgr2=0x7f41e003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41e00383f0 0x7f41e003a8b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x56349ee53840 tx=0x7f4300003070 comp rx=0 tx=0).stop 2024-05-08T18:10:16.053 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 msgr2=0x56349ee630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 0x56349ee630a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f42f00ac040 tx=0x7f42f00180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 shutdown_connections 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41e00383f0 0x7f41e003a8b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2244382557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ee62c80 0x56349ee630a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 >> 172.21.15.114:0/2244382557 conn(0x56349ee57a90 msgr2=0x56349ee585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 shutdown_connections 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2244382557 wait complete. 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ecc8010 msgr2=0x56349ee52010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ecc8010 0x56349ee52010 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41ec0383a0 msgr2=0x7f41ec03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41ec0383a0 0x7f41ec03a860 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f42f00ae000 tx=0x7f42f00a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 msgr2=0x56349ee4afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee4afb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f42f80012f0 tx=0x7f42f8001260 comp rx=0 tx=0).stop 2024-05-08T18:10:16.054 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 shutdown_connections 2024-05-08T18:10:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56349ecc8010 0x56349ee52010 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f41ec0383a0 0x7f41ec03a860 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 --2- 172.21.15.114:0/2215805336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56349ecc6d20 0x56349ee4afb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 >> 172.21.15.114:0/2215805336 conn(0x56349ed4d7e0 msgr2=0x56349ee3e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 shutdown_connections 2024-05-08T18:10:16.055 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.052+0000 7f43090c0980 1 -- 172.21.15.114:0/2215805336 wait complete. 2024-05-08T18:10:16.063 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T18:10:16.026710Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:16.026684Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:16.082 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:10:16.089 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-08T18:10:16.089 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T18:10:16.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T18:10:16.089 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-08T18:10:16.125 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:16.125 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.124+0000 7fb35130f980 1 Processor -- start 2024-05-08T18:10:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.124+0000 7fb35130f980 1 -- start start 2024-05-08T18:10:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.124+0000 7fb35130f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560a4a0c0f10 0x560a4a0c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.124+0000 7fb35130f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560a49f6c710 con 0x560a4a0c1830 2024-05-08T18:10:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.124+0000 7fb35130f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560a49f80f00 con 0x560a4a0c0f10 2024-05-08T18:10:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34ee23640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560a4a0c0f10 0x560a4a0c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34e622640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560a4a0c1830 0x560a4a0c21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47904/0 (socket says 172.21.15.114:47904) 2024-05-08T18:10:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34ee23640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560a4a0c0f10 0x560a4a0c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43070/0 (socket says 172.21.15.114:43070) 2024-05-08T18:10:16.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34e622640 1 -- 172.21.15.114:0/565189247 learned_addr learned my addr 172.21.15.114:0/565189247 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:16.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34ee23640 1 -- 172.21.15.114:0/565189247 >> v1:172.21.15.53:6789/0 conn(0x560a4a0c1830 legacy=0x560a4a0c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34ee23640 1 -- 172.21.15.114:0/565189247 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a49f48ae0 con 0x560a4a0c0f10 2024-05-08T18:10:16.129 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34ee23640 1 --2- 172.21.15.114:0/565189247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a0c12f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb34000a480 tx=0x7fb34001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390afde11d1b57b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34de21640 1 -- 172.21.15.114:0/565189247 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3400b0070 con 0x560a4a0c0f10 2024-05-08T18:10:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34de21640 1 -- 172.21.15.114:0/565189247 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3400ab540 con 0x560a4a0c0f10 2024-05-08T18:10:16.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb34de21640 1 -- 172.21.15.114:0/565189247 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3400ab840 con 0x560a4a0c0f10 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb35130f980 1 -- 172.21.15.114:0/565189247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 msgr2=0x560a4a0c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb35130f980 1 --2- 172.21.15.114:0/565189247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a0c12f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb34000a480 tx=0x7fb34001b280 comp rx=0 tx=0).stop 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.128+0000 7fb35130f980 1 -- 172.21.15.114:0/565189247 shutdown_connections 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.132+0000 7fb35130f980 1 --2- 172.21.15.114:0/565189247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a0c12f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.132+0000 7fb35130f980 1 -- 172.21.15.114:0/565189247 >> 172.21.15.114:0/565189247 conn(0x560a4a0bc7e0 msgr2=0x560a4a0bec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.132+0000 7fb35130f980 1 -- 172.21.15.114:0/565189247 shutdown_connections 2024-05-08T18:10:16.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.132+0000 7fb35130f980 1 -- 172.21.15.114:0/565189247 wait complete. 2024-05-08T18:10:16.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb35130f980 1 Processor -- start 2024-05-08T18:10:16.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb35130f980 1 -- start start 2024-05-08T18:10:16.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb35130f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a037650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb35130f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a49fc4f80 con 0x560a4a0c0f10 2024-05-08T18:10:16.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb34ee23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a037650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb34ee23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a037650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43086/0 (socket says 172.21.15.114:43086) 2024-05-08T18:10:16.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.144+0000 7fb34ee23640 1 -- 172.21.15.114:0/1651296119 learned_addr learned my addr 172.21.15.114:0/1651296119 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 -- 172.21.15.114:0/1651296119 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a49f8cda0 con 0x560a4a0c0f10 2024-05-08T18:10:16.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 --2- 172.21.15.114:0/1651296119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a037650 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb3400ae040 tx=0x7fb340003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cbb62b811ba487 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb23ce09640 1 -- 172.21.15.114:0/1651296119 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3400b0040 con 0x560a4a0c0f10 2024-05-08T18:10:16.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb23ce09640 1 -- 172.21.15.114:0/1651296119 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3400ab9d0 con 0x560a4a0c0f10 2024-05-08T18:10:16.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb23ce09640 1 -- 172.21.15.114:0/1651296119 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3400abcf0 con 0x560a4a0c0f10 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/1651296119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 msgr2=0x560a4a037650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 --2- 172.21.15.114:0/1651296119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a037650 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb3400ae040 tx=0x7fb340003030 comp rx=0 tx=0).stop 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/1651296119 shutdown_connections 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 --2- 172.21.15.114:0/1651296119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c0f10 0x560a4a037650 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/1651296119 >> 172.21.15.114:0/1651296119 conn(0x560a4a0bc7e0 msgr2=0x560a4a1a8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/1651296119 shutdown_connections 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/1651296119 wait complete. 2024-05-08T18:10:16.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 Processor -- start 2024-05-08T18:10:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- start start 2024-05-08T18:10:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 0x560a4a1b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a4a0caf10 con 0x560a4a0c1830 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 0x560a4a1b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 0x560a4a1b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43094/0 (socket says 172.21.15.114:43094) 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 -- 172.21.15.114:0/2654193226 learned_addr learned my addr 172.21.15.114:0/2654193226 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4a1b6300 con 0x560a4a0c1830 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb34ee23640 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 0x560a4a1b5dc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb340018eb0 tx=0x7fb340018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb23b606640 1 -- 172.21.15.114:0/2654193226 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3400c5070 con 0x560a4a0c1830 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb23b606640 1 -- 172.21.15.114:0/2654193226 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3400b67b0 con 0x560a4a0c1830 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a4a1b6590 con 0x560a4a0c1830 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb23b606640 1 -- 172.21.15.114:0/2654193226 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb3400b0050 con 0x560a4a0c1830 2024-05-08T18:10:16.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.148+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4a1b9270 con 0x560a4a0c1830 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb23b606640 1 -- 172.21.15.114:0/2654193226 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb3400c8070 con 0x560a4a0c1830 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb23b606640 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb23b606640 1 -- 172.21.15.114:0/2654193226 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb3400bc070 con 0x560a4a0c1830 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34e622640 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1bad40 0x560a4a1bd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1bd700 con 0x560a4a1bad40 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34f624640 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1bad40 0x560a4a1bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34e622640 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb338001d80 tx=0x7fb3380012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34f624640 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1bad40 0x560a4a1bd130 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34f624640 1 -- 172.21.15.114:0/2654193226 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb34800a4d0 con 0x560a4a1bad40 2024-05-08T18:10:16.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1bdfc0 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34f624640 1 -- 172.21.15.114:0/2654193226 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb34800a4d0 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1bf370 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34f624640 1 -- 172.21.15.114:0/2654193226 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb34800a4d0 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1be810 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb34f624640 1 -- 172.21.15.114:0/2654193226 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb34800a4d0 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.152+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1bec30 con 0x560a4a1bad40 2024-05-08T18:10:16.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34f624640 1 -- 172.21.15.114:0/2654193226 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb34800a4d0 con 0x560a4a1bad40 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb35130f980 1 Processor -- start 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb35130f980 1 -- start start 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb35130f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 0x560a4a1ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb35130f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a49fc8fc0 con 0x560a4a1cdec0 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34e622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 0x560a4a1ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34e622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 0x560a4a1ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43096/0 (socket says 172.21.15.114:43096) 2024-05-08T18:10:16.156 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34e622640 1 -- 172.21.15.114:0/388493691 learned_addr learned my addr 172.21.15.114:0/388493691 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34e622640 1 -- 172.21.15.114:0/388493691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4a1ce820 con 0x560a4a1cdec0 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34e622640 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 0x560a4a1ce2e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb33800d660 tx=0x7fb33800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb238e01640 1 -- 172.21.15.114:0/388493691 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33800c6b0 con 0x560a4a1cdec0 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb238e01640 1 -- 172.21.15.114:0/388493691 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33800c850 con 0x560a4a1cdec0 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a4a1cf2c0 con 0x560a4a1cdec0 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb238e01640 1 -- 172.21.15.114:0/388493691 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33800cb30 con 0x560a4a1cdec0 2024-05-08T18:10:16.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4a1cf790 con 0x560a4a1cdec0 2024-05-08T18:10:16.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb238e01640 1 -- 172.21.15.114:0/388493691 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb338023020 con 0x560a4a1cdec0 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb238e01640 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb228038440 0x7fb22803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb238e01640 1 -- 172.21.15.114:0/388493691 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb338021020 con 0x560a4a1cdec0 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.156+0000 7fb34f624640 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb228038440 0x7fb22803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 Processor -- start 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- start start 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34f624640 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb228038440 0x7fb22803a900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560a4a1bebb0 tx=0x7fb348005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1db520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a4a037ce0 con 0x560a4a1db100 2024-05-08T18:10:16.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1db520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1db520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43106/0 (socket says 172.21.15.114:43106) 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 -- 172.21.15.114:0/1580383671 learned_addr learned my addr 172.21.15.114:0/1580383671 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 -- 172.21.15.114:0/1580383671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4a1dbaf0 con 0x560a4a1db100 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 --2- 172.21.15.114:0/1580383671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1db520 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb33804f200 tx=0x7fb338024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1df73e0a2e613a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb2327fc640 1 -- 172.21.15.114:0/1580383671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb338044070 con 0x560a4a1db100 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb2327fc640 1 -- 172.21.15.114:0/1580383671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb33800ccd0 con 0x560a4a1db100 2024-05-08T18:10:16.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb2327fc640 1 -- 172.21.15.114:0/1580383671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33801bcc0 con 0x560a4a1db100 2024-05-08T18:10:16.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- 172.21.15.114:0/1580383671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 msgr2=0x560a4a1db520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 --2- 172.21.15.114:0/1580383671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1db520 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb33804f200 tx=0x7fb338024740 comp rx=0 tx=0).stop 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- 172.21.15.114:0/1580383671 shutdown_connections 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 --2- 172.21.15.114:0/1580383671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1db520 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- 172.21.15.114:0/1580383671 >> 172.21.15.114:0/1580383671 conn(0x560a4a1d7490 msgr2=0x560a4a1d54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- 172.21.15.114:0/1580383671 shutdown_connections 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- 172.21.15.114:0/1580383671 wait complete. 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 Processor -- start 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- start start 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1e2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb35130f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560a4a1dc240 con 0x560a4a1db100 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1e2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1e2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43112/0 (socket says 172.21.15.114:43112) 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.160+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 learned_addr learned my addr 172.21.15.114:0/1349665849 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a4a1e2ba0 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34e622640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1e2660 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb338042040 tx=0x7fb33804f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb230ff9640 1 -- 172.21.15.114:0/1349665849 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb338044070 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560a4a1e2e30 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb230ff9640 1 -- 172.21.15.114:0/1349665849 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb338045040 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb230ff9640 1 -- 172.21.15.114:0/1349665849 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb33801b420 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a4a1e2e30 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb230ff9640 1 -- 172.21.15.114:0/1349665849 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb338035020 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb230ff9640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2180383f0 0x7fb21803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb230ff9640 1 -- 172.21.15.114:0/1349665849 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb338033020 con 0x560a4a1db100 2024-05-08T18:10:16.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34f624640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2180383f0 0x7fb21803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1ed940 0x560a4a1efe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f0550 con 0x560a4a1ed940 2024-05-08T18:10:16.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34ee23640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1ed940 0x560a4a1efe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34f624640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2180383f0 0x7fb21803a8b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x560a4a1bde40 tx=0x7fb34801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34ee23640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1ed940 0x560a4a1efe00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 realm 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f0960 con 0x560a4a1ed940 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1200 con 0x560a4a1ed940 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f15a0 con 0x560a4a1ed940 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.164+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 20 searching for the correct realm 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a4a1f3b60 0x560a4a1f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f6490 con 0x560a4a1f3b60 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34e622640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a4a1f3b60 0x560a4a1f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34e622640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a4a1f3b60 0x560a4a1f5f50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34e622640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb33803bc40 0x7fb33803c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f6490 con 0x7fb33803bc40 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34f624640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb33803bc40 0x7fb33803c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34f624640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb33803bc40 0x7fb33803c200 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f6490 con 0x7fb33803bc40 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f6490 con 0x560a4a1ed940 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb3400ca060 0x7fb3400e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb3400ca060 0x7fb3400e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.168+0000 7fb34ee23640 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb3400ca060 0x7fb3400e80b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb33803bc40 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb33803bc40 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb33803bc40 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.172+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb33803bc40 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.176+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb33803bc40 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1f3b60 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb3400ca060 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x560a4a1ed940 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f1df0 con 0x7fb33803bc40 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f2640 con 0x560a4a1ed940 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f2a30 con 0x560a4a1ed940 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f2a30 con 0x560a4a1ed940 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 zone default found 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 4 Realm: () 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 zonegroup default 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.180+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f2220 con 0x7fb3400ca060 2024-05-08T18:10:16.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f22a0 con 0x560a4a1f3b60 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f8390 con 0x560a4a1f3b60 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 started sync module instance, tier type = 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:16.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f7740 con 0x7fb33803bc40 2024-05-08T18:10:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94602193238832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f8ca0 con 0x7fb33803bc40 2024-05-08T18:10:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f94f0 con 0x560a4a1ed940 2024-05-08T18:10:16.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.184+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94602193238832] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94602193242096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f90c0 con 0x560a4a1ed940 2024-05-08T18:10:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f9b70 con 0x560a4a1f3b60 2024-05-08T18:10:16.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94602193242096] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94602193243152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1f9030 con 0x560a4a1f3b60 2024-05-08T18:10:16.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.188+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fa920 con 0x7fb33803bc40 2024-05-08T18:10:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94602193249296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fa8e0 con 0x7fb33803bc40 2024-05-08T18:10:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fb850 con 0x560a4a1ed940 2024-05-08T18:10:16.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94602193243152] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94602193249296] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94602193251648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fb360 con 0x560a4a1ed940 2024-05-08T18:10:16.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.192+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fc0f0 con 0x7fb3400ca060 2024-05-08T18:10:16.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94602193251648] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94602193248096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fbdd0 con 0x7fb3400ca060 2024-05-08T18:10:16.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fc620 con 0x7fb3400ca060 2024-05-08T18:10:16.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94602193248096] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94602193255168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fc4b0 con 0x7fb3400ca060 2024-05-08T18:10:16.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.196+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fcfa0 con 0x7fb3400ca060 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94602193255168] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94602193259120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fcf60 con 0x7fb3400ca060 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=0 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=1 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=2 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=3 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=4 2024-05-08T18:10:16.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=5 2024-05-08T18:10:16.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.200+0000 7fb35130f980 20 add_watcher() i=6 2024-05-08T18:10:16.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94602193259120] v32'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 add_watcher() i=7 2024-05-08T18:10:16.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:16.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a200420 con 0x560a4a1ed940 2024-05-08T18:10:16.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.204 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94602193256224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a1fd8d0 con 0x560a4a1ed940 2024-05-08T18:10:16.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94602193256224] v32'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 5 note: GC not initialized 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb204fe1640 20 reqs_thread_entry: start 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 Filter name: none 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb1fdffb640 20 reqs_thread_entry: start 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560a4a223e80 con 0x7fb33803bc40 2024-05-08T18:10:16.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:10:16.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T18:10:16.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:10:16.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:16.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.204+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a228260 con 0x7fb3400ca060 2024-05-08T18:10:16.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.208+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v32'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.208 INFO:teuthology.orchestra.run.smithi114.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-08T18:10:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.208+0000 7fb205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.208+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94602193256224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x560a4a1ed940 2024-05-08T18:10:16.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.208+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94602193256224] v32'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.210 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.208+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94602193238832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x7fb33803bc40 2024-05-08T18:10:16.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94602193238832] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb35130f980 20 remove_watcher() i=0 2024-05-08T18:10:16.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb35130f980 2 removed watcher, disabling cache 2024-05-08T18:10:16.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94602193242096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x560a4a1ed940 2024-05-08T18:10:16.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94602193242096] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb35130f980 20 remove_watcher() i=1 2024-05-08T18:10:16.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.212+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94602193243152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x560a4a1f3b60 2024-05-08T18:10:16.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.216+0000 7fb34e622640 1 -- 172.21.15.114:0/1349665849 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94602193243152] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb338015ba0 con 0x560a4a1f3b60 2024-05-08T18:10:16.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.216+0000 7fb35130f980 20 remove_watcher() i=2 2024-05-08T18:10:16.216 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.216+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94602193249296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x7fb33803bc40 2024-05-08T18:10:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.216+0000 7fb34f624640 1 -- 172.21.15.114:0/1349665849 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94602193249296] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb34801f070 con 0x7fb33803bc40 2024-05-08T18:10:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.216+0000 7fb35130f980 20 remove_watcher() i=3 2024-05-08T18:10:16.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.216+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94602193251648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x560a4a1ed940 2024-05-08T18:10:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.220+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94602193251648] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x560a4a1ed940 2024-05-08T18:10:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.220+0000 7fb35130f980 20 remove_watcher() i=4 2024-05-08T18:10:16.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.220+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94602193248096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x7fb3400ca060 2024-05-08T18:10:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.220+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94602193248096] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.220+0000 7fb35130f980 20 remove_watcher() i=5 2024-05-08T18:10:16.222 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.220+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94602193255168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x7fb3400ca060 2024-05-08T18:10:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94602193255168] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 20 remove_watcher() i=6 2024-05-08T18:10:16.224 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94602193259120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560a4a221bb0 con 0x7fb3400ca060 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94602193259120] v32'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb3400c7030 con 0x7fb3400ca060 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 20 remove_watcher() i=7 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb3400ca060 msgr2=0x7fb3400e80b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb3400ca060 0x7fb3400e80b0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1ed940 msgr2=0x560a4a1efe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1ed940 0x560a4a1efe00 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb33803bc40 msgr2=0x7fb33803c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb33803bc40 0x7fb33803c200 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a4a1f3b60 msgr2=0x560a4a1f5f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.228 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560a4a1f3b60 0x560a4a1f5f50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2180383f0 msgr2=0x7fb21803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2180383f0 0x7fb21803a8b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x560a4a1bde40 tx=0x7fb34801f000 comp rx=0 tx=0).stop 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 msgr2=0x560a4a1e2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb34ee23640 1 -- 172.21.15.114:0/1349665849 reap_dead start 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1e2660 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb338042040 tx=0x7fb33804f190 comp rx=0 tx=0).stop 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 shutdown_connections 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 --2- 172.21.15.114:0/1349665849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1db100 0x560a4a1e2660 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 >> 172.21.15.114:0/1349665849 conn(0x560a4a1d7490 msgr2=0x560a4a1dc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 shutdown_connections 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.224+0000 7fb35130f980 1 -- 172.21.15.114:0/1349665849 wait complete. 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb228038440 msgr2=0x7fb22803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb228038440 0x7fb22803a900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x560a4a1bebb0 tx=0x7fb348005850 comp rx=0 tx=0).stop 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 msgr2=0x560a4a1ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.229 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 0x560a4a1ce2e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb33800d660 tx=0x7fb33800da60 comp rx=0 tx=0).stop 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 shutdown_connections 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb228038440 0x7fb22803a900 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/388493691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a1cdec0 0x560a4a1ce2e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 >> 172.21.15.114:0/388493691 conn(0x560a4a1c2cd0 msgr2=0x560a4a1c37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 shutdown_connections 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/388493691 wait complete. 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1bad40 msgr2=0x560a4a1bd130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1bad40 0x560a4a1bd130 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 msgr2=0x7fb23403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb338001d80 tx=0x7fb3380012e0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 msgr2=0x560a4a1b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.230 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 0x560a4a1b5dc0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb340018eb0 tx=0x7fb340018020 comp rx=0 tx=0).stop 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 shutdown_connections 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560a4a1bad40 0x560a4a1bd130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb2340383f0 0x7fb23403a8b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 --2- 172.21.15.114:0/2654193226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a4a0c1830 0x560a4a1b5dc0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 >> 172.21.15.114:0/2654193226 conn(0x560a4a0bc7e0 msgr2=0x560a4a036100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 shutdown_connections 2024-05-08T18:10:16.231 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.228+0000 7fb35130f980 1 -- 172.21.15.114:0/2654193226 wait complete. 2024-05-08T18:10:16.239 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T18:10:16.245 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:10:16.245 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:10:16.250 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T18:10:16.250 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-08T18:10:16.250 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T18:10:16.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T18:10:16.251 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-08T18:10:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:16.316 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:16.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9feed7980 1 Processor -- start 2024-05-08T18:10:16.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9feed7980 1 -- start start 2024-05-08T18:10:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9feed7980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562a7c1f9fa0 0x562a7c28af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9feed7980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a7c131710 con 0x562a7c28b470 2024-05-08T18:10:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9feed7980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562a7c145f00 con 0x562a7c1f9fa0 2024-05-08T18:10:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9fc9eb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562a7c1f9fa0 0x562a7c28af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9fc9eb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562a7c1f9fa0 0x562a7c28af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43116/0 (socket says 172.21.15.114:43116) 2024-05-08T18:10:16.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.316+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/2883410317 learned_addr learned my addr 172.21.15.114:0/2883410317 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/2883410317 >> v1:172.21.15.53:6789/0 conn(0x562a7c28b470 legacy=0x562a7c28d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/2883410317 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7c10dae0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/2883410317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c28af30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a5c0 tx=0x7fa9ec01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7f6dde7013ef9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9fb9e9640 1 -- 172.21.15.114:0/2883410317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec0a6070 con 0x562a7c1f9fa0 2024-05-08T18:10:16.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9fb9e9640 1 -- 172.21.15.114:0/2883410317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0af070 con 0x562a7c1f9fa0 2024-05-08T18:10:16.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9fb9e9640 1 -- 172.21.15.114:0/2883410317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec0aa5c0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 -- 172.21.15.114:0/2883410317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 msgr2=0x562a7c28af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 --2- 172.21.15.114:0/2883410317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c28af30 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00a5c0 tx=0x7fa9ec01b340 comp rx=0 tx=0).stop 2024-05-08T18:10:16.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 -- 172.21.15.114:0/2883410317 shutdown_connections 2024-05-08T18:10:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 --2- 172.21.15.114:0/2883410317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c28af30 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 -- 172.21.15.114:0/2883410317 >> 172.21.15.114:0/2883410317 conn(0x562a7c280650 msgr2=0x562a7c282a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 -- 172.21.15.114:0/2883410317 shutdown_connections 2024-05-08T18:10:16.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.320+0000 7fa9feed7980 1 -- 172.21.15.114:0/2883410317 wait complete. 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9feed7980 1 Processor -- start 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9feed7980 1 -- start start 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9feed7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c373150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9feed7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a7c189f80 con 0x562a7c1f9fa0 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9fc9eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c373150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9fc9eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c373150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43124/0 (socket says 172.21.15.114:43124) 2024-05-08T18:10:16.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/2284140837 learned_addr learned my addr 172.21.15.114:0/2284140837 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.336+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/2284140837 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7c151da0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/2284140837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c373150 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0199f0 tx=0x7fa9ec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaff45600e87623 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa8eae0d640 1 -- 172.21.15.114:0/2284140837 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec0aaa00 con 0x562a7c1f9fa0 2024-05-08T18:10:16.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa8eae0d640 1 -- 172.21.15.114:0/2284140837 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0aaba0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa8eae0d640 1 -- 172.21.15.114:0/2284140837 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec0bd3f0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- 172.21.15.114:0/2284140837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 msgr2=0x562a7c373150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 --2- 172.21.15.114:0/2284140837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c373150 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec0199f0 tx=0x7fa9ec003030 comp rx=0 tx=0).stop 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- 172.21.15.114:0/2284140837 shutdown_connections 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 --2- 172.21.15.114:0/2284140837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c1f9fa0 0x562a7c373150 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- 172.21.15.114:0/2284140837 >> 172.21.15.114:0/2284140837 conn(0x562a7c280650 msgr2=0x562a7c36ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- 172.21.15.114:0/2284140837 shutdown_connections 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- 172.21.15.114:0/2284140837 wait complete. 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 Processor -- start 2024-05-08T18:10:16.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- start start 2024-05-08T18:10:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 0x562a7c37a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9feed7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a7c291a40 con 0x562a7c28b470 2024-05-08T18:10:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9fc9eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 0x562a7c37a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9fc9eb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 0x562a7c37a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43134/0 (socket says 172.21.15.114:43134) 2024-05-08T18:10:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1173784373 learned_addr learned my addr 172.21.15.114:0/1173784373 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7c37ac40 con 0x562a7c28b470 2024-05-08T18:10:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.340+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 0x562a7c37a700 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec01b380 tx=0x7fa9ec0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa8e960a640 1 -- 172.21.15.114:0/1173784373 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec0c6690 con 0x562a7c28b470 2024-05-08T18:10:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a7c37aed0 con 0x562a7c28b470 2024-05-08T18:10:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a7c37db60 con 0x562a7c28b470 2024-05-08T18:10:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa8e960a640 1 -- 172.21.15.114:0/1173784373 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0c6830 con 0x562a7c28b470 2024-05-08T18:10:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa8e960a640 1 -- 172.21.15.114:0/1173784373 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9ec0c6b10 con 0x562a7c28b470 2024-05-08T18:10:16.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa8e960a640 1 -- 172.21.15.114:0/1173784373 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa9ec0ce020 con 0x562a7c28b470 2024-05-08T18:10:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa8e960a640 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8e40383f0 0x7fa8e403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa8e960a640 1 -- 172.21.15.114:0/1173784373 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa9ec0cc020 con 0x562a7c28b470 2024-05-08T18:10:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8e40383f0 0x7fa8e403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c37f7a0 0x562a7c381b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3820d0 con 0x562a7c37f7a0 2024-05-08T18:10:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c37f7a0 0x562a7c381b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8e40383f0 0x7fa8e403a8b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001ec0 tx=0x7fa9f0001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c37f7a0 0x562a7c381b90 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1173784373 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9f400a4d0 con 0x562a7c37f7a0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c382990 con 0x562a7c37f7a0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1173784373 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9f400a4d0 con 0x562a7c37f7a0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c383d40 con 0x562a7c37f7a0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1173784373 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9f400a4d0 con 0x562a7c37f7a0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.344+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3831e0 con 0x562a7c37f7a0 2024-05-08T18:10:16.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1173784373 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9f400a4d0 con 0x562a7c37f7a0 2024-05-08T18:10:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c383630 con 0x562a7c37f7a0 2024-05-08T18:10:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1173784373 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9f400a4d0 con 0x562a7c37f7a0 2024-05-08T18:10:16.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 Processor -- start 2024-05-08T18:10:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 -- start start 2024-05-08T18:10:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 0x562a7c392c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a7c18dfc0 con 0x562a7c392850 2024-05-08T18:10:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fc1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 0x562a7c392c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fc1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 0x562a7c392c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43136/0 (socket says 172.21.15.114:43136) 2024-05-08T18:10:16.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/3896669491 learned_addr learned my addr 172.21.15.114:0/3896669491 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/3896669491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7c3931b0 con 0x562a7c392850 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 0x562a7c392c70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0010fd0 tx=0x7fa9f000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa8e27fc640 1 -- 172.21.15.114:0/3896669491 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f000a040 con 0x562a7c392850 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa8e27fc640 1 -- 172.21.15.114:0/3896669491 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f0017050 con 0x562a7c392850 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a7c393c50 con 0x562a7c392850 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa8e27fc640 1 -- 172.21.15.114:0/3896669491 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f000e6b0 con 0x562a7c392850 2024-05-08T18:10:16.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.348+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a7c394120 con 0x562a7c392850 2024-05-08T18:10:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa8e27fc640 1 -- 172.21.15.114:0/3896669491 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa9f000e8e0 con 0x562a7c392850 2024-05-08T18:10:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa8e27fc640 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8d40383f0 0x7fa8d403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa8e27fc640 1 -- 172.21.15.114:0/3896669491 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f00506f0 con 0x562a7c392850 2024-05-08T18:10:16.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8d40383f0 0x7fa8d403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 Processor -- start 2024-05-08T18:10:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- start start 2024-05-08T18:10:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8d40383f0 0x7fa8d403a8b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x562a7c382870 tx=0x7fa9f4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c39fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a7c3737e0 con 0x562a7c39fa80 2024-05-08T18:10:16.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fc1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c39fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fc1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c39fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43140/0 (socket says 172.21.15.114:43140) 2024-05-08T18:10:16.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1982025592 learned_addr learned my addr 172.21.15.114:0/1982025592 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1982025592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7c3a0450 con 0x562a7c39fa80 2024-05-08T18:10:16.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1982025592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c39fe80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa9f001cfd0 tx=0x7fa9f001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea3fa2404677df5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa8d3fff640 1 -- 172.21.15.114:0/1982025592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0043070 con 0x562a7c39fa80 2024-05-08T18:10:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa8d3fff640 1 -- 172.21.15.114:0/1982025592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f001c930 con 0x562a7c39fa80 2024-05-08T18:10:16.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa8d3fff640 1 -- 172.21.15.114:0/1982025592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f001cae0 con 0x562a7c39fa80 2024-05-08T18:10:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- 172.21.15.114:0/1982025592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 msgr2=0x562a7c39fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1982025592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c39fe80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa9f001cfd0 tx=0x7fa9f001ab60 comp rx=0 tx=0).stop 2024-05-08T18:10:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- 172.21.15.114:0/1982025592 shutdown_connections 2024-05-08T18:10:16.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1982025592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c39fe80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- 172.21.15.114:0/1982025592 >> 172.21.15.114:0/1982025592 conn(0x562a7c39bdc0 msgr2=0x562a7c399e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- 172.21.15.114:0/1982025592 shutdown_connections 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- 172.21.15.114:0/1982025592 wait complete. 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 Processor -- start 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 -- start start 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.352+0000 7fa9feed7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c3a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9feed7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562a7c3a0b90 con 0x562a7c39fa80 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c3a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc1ea640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c3a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43142/0 (socket says 172.21.15.114:43142) 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 learned_addr learned my addr 172.21.15.114:0/1568313603 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7c3a7480 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c3a6f40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0041040 tx=0x7fa9f004e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa8d27fc640 1 -- 172.21.15.114:0/1568313603 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0034070 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa8d27fc640 1 -- 172.21.15.114:0/1568313603 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9f001a310 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a7c3a7710 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa8d27fc640 1 -- 172.21.15.114:0/1568313603 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0043040 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a7c3aa3f0 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa8d27fc640 1 -- 172.21.15.114:0/1568313603 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa9f0050a90 con 0x562a7c39fa80 2024-05-08T18:10:16.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa8d27fc640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8c80383f0 0x7fa8c803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa8d27fc640 1 -- 172.21.15.114:0/1568313603 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa9f0039d00 con 0x562a7c39fa80 2024-05-08T18:10:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8c80383f0 0x7fa8c803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c3b23e0 0x562a7c3b48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b4ff0 con 0x562a7c3b23e0 2024-05-08T18:10:16.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c3b23e0 0x562a7c3b48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8c80383f0 0x7fa8c803a8b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x562a7c37eca0 tx=0x7fa9f401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.356+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c3b23e0 0x562a7c3b48a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 realm 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b5400 con 0x562a7c3b23e0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b5cd0 con 0x562a7c3b23e0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b6070 con 0x562a7c3b23e0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b68c0 con 0x562a7c3b23e0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:16.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 20 searching for the correct realm 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562a7c3b8310 0x562a7c3ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562a7c3b8310 0x562a7c3ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562a7c3b8310 0x562a7c3ba7d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc1ea640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa9f001c030 0x7fa9f00196f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa9f001c030 0x7fa9f00196f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fd1ec640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa9f001c030 0x7fa9f00196f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x562a7c1f9fa0 0x7fa9ec0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.360+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x562a7c1f9fa0 0x7fa9ec0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x562a7c1f9fa0 0x7fa9ec0d0410 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.364+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa9ec0c6cb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.368+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b8310 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x562a7c3b23e0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3baea0 con 0x7fa9f001c030 2024-05-08T18:10:16.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b7110 con 0x562a7c3b23e0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.372+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b74b0 con 0x562a7c3b23e0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.379 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3b78d0 con 0x562a7c3b23e0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 zone default found 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 4 Realm: () 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 zonegroup default 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bb320 con 0x562a7c1f9fa0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bcd60 con 0x562a7c3b8310 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bd1f0 con 0x562a7c3b8310 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 started sync module instance, tier type = 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bc1a0 con 0x7fa9f001c030 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94740472907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bc9b0 con 0x7fa9f001c030 2024-05-08T18:10:16.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.376+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3be120 con 0x562a7c3b23e0 2024-05-08T18:10:16.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.380+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94740472907152] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.380+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.380+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94740472913008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3be090 con 0x562a7c3b23e0 2024-05-08T18:10:16.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.380+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3beef0 con 0x562a7c3b8310 2024-05-08T18:10:16.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94740472916416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bf790 con 0x562a7c3b8310 2024-05-08T18:10:16.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c0190 con 0x7fa9f001c030 2024-05-08T18:10:16.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94740472913008] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94740472915216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c0580 con 0x7fa9f001c030 2024-05-08T18:10:16.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c0f40 con 0x562a7c3b23e0 2024-05-08T18:10:16.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94740472916416] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94740472915216] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94740472921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c0a90 con 0x562a7c3b23e0 2024-05-08T18:10:16.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.384+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c17e0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.388+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94740472921248] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.388+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.388+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94740472918752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c14d0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.388+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c1d20 con 0x562a7c1f9fa0 2024-05-08T18:10:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94740472927920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c2120 con 0x562a7c1f9fa0 2024-05-08T18:10:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c2c40 con 0x562a7c1f9fa0 2024-05-08T18:10:16.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94740472918752] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94740472932112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c2c00 con 0x562a7c1f9fa0 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=0 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=1 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=2 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=3 2024-05-08T18:10:16.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=4 2024-05-08T18:10:16.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=5 2024-05-08T18:10:16.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94740472927920] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.392+0000 7fa9feed7980 20 add_watcher() i=6 2024-05-08T18:10:16.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94740472932112] v32'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 20 add_watcher() i=7 2024-05-08T18:10:16.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:16.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c1bb0 con 0x562a7c3b23e0 2024-05-08T18:10:16.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94740472929136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3c3030 con 0x562a7c3b23e0 2024-05-08T18:10:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94740472929136] v32'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa8b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:16.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.396+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ce5c0 con 0x562a7c3b23e0 2024-05-08T18:10:16.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.400+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.400+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cec90 con 0x562a7c1f9fa0 2024-05-08T18:10:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.400+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.400+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cec90 con 0x562a7c3b8310 2024-05-08T18:10:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.404+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.404+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cec90 con 0x562a7c3b23e0 2024-05-08T18:10:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.404+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.404+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cdd40 con 0x7fa9f001c030 2024-05-08T18:10:16.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.404+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'71 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.404+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cdd40 con 0x562a7c3b8310 2024-05-08T18:10:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.408+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.408+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cdf10 con 0x562a7c3b23e0 2024-05-08T18:10:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.408+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.408+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cf6d0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.412+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.412+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cf6d0 con 0x7fa9f001c030 2024-05-08T18:10:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.412+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.412+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ca220 con 0x562a7c3b8310 2024-05-08T18:10:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.416+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.416+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ca220 con 0x7fa9f001c030 2024-05-08T18:10:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.416+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'72 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.416+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ca220 con 0x562a7c1f9fa0 2024-05-08T18:10:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.416+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.416+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x7fa9f001c030 2024-05-08T18:10:16.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.420+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.420+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c1f9fa0 2024-05-08T18:10:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.420+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.420+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b23e0 2024-05-08T18:10:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.424+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.424+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b8310 2024-05-08T18:10:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.424+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.424+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x7fa9f001c030 2024-05-08T18:10:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.428+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.428+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b8310 2024-05-08T18:10:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.428+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.428+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b23e0 2024-05-08T18:10:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.432+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.432+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b23e0 2024-05-08T18:10:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.432+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.432+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b8310 2024-05-08T18:10:16.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.432+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.432+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x7fa9f001c030 2024-05-08T18:10:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.436+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.436+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b8310 2024-05-08T18:10:16.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.436+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.436+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0230 con 0x562a7c3b8310 2024-05-08T18:10:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.440+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.440+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c3b8310 2024-05-08T18:10:16.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.440+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.440+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c3b8310 2024-05-08T18:10:16.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.444+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.444+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c1f9fa0 2024-05-08T18:10:16.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.444+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.444+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c3b8310 2024-05-08T18:10:16.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.448+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.448+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c1f9fa0 2024-05-08T18:10:16.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.448+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.448+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c3b8310 2024-05-08T18:10:16.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.452+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.452+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x562a7c1f9fa0 2024-05-08T18:10:16.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3d0400 con 0x7fa9f001c030 2024-05-08T18:10:16.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa8b1fe3640 20 reqs_thread_entry: start 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa9feed7980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa9feed7980 20 Filter name: none 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa8237fe640 20 reqs_thread_entry: start 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.456+0000 7fa9feed7980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3eb830 con 0x7fa9f001c030 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ede00 con 0x562a7c3b23e0 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 : miss 2024-05-08T18:10:16.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:96 8.4 8:2183c35c:root::.bucket.meta.myfoo6%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ee1c0 con 0x7fa9f001c030 2024-05-08T18:10:16.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(96 .bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv6 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x17 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:97 4.33 4:cd5cc723:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b370 con 0x562a7c1f9fa0 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(97 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:98 4.22 4:4688c518:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c3b23e0 2024-05-08T18:10:16.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(98 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.460+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:99 4.21 4:862ab0bc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(99 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 4.11 4:89397c57:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(100 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 4.1f 4:fa20cbd7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c3b8310 2024-05-08T18:10:16.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(101 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:102 4.27 4:e52db099:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c3b23e0 2024-05-08T18:10:16.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(102 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:103 4.38 4:1c8034eb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c3b23e0 2024-05-08T18:10:16.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(103 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec0f9040 con 0x562a7c3b23e0 2024-05-08T18:10:16.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.464+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:104 4.37 4:eef4fc33:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(104 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 4.2b 4:d4450661:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c3b23e0 2024-05-08T18:10:16.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(105 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:106 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b3b0 con 0x562a7c3b23e0 2024-05-08T18:10:16.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(106 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [call out=289b] v0'0 uv12 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 10 cls_bucket_list_unordered: got thirteen 2024-05-08T18:10:16.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:107 4.7 4:e34cfe37:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c46b370 con 0x562a7c1f9fa0 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(107 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 20 get_obj_state: octx=0x7fa9f400a220 obj=myfoo6:thirteen state=0x562a7c3eede8 s->prefetch_data=0 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:108 3.3as0 3:5e457f3d:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3efc10 con 0x7fa9f001c030 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(108 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen [getxattrs out=820b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+836 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 10 manifest: total_size = 8 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 20 get_obj_state: setting s->obj_tag to _ERr2SVMbUhYSukazxvWbqR2mEz8Tw1T 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 20 get_obj_state: octx=0x7fa9f400a220 obj=myfoo6:thirteen state=0x562a7c3eede8 s->prefetch_data=0 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 20 prepare_atomic_modification: state is not atomic. state=0x562a7c3eede8 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 2024-05-08T18:10:16.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.468+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:109 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f44e0 con 0x562a7c3b23e0 2024-05-08T18:10:16.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(109 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [stat,call,call] v32'13 uv13 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:110 3.3as0 3:5e457f3d:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f24c0 con 0x7fa9f001c030 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(110 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9_thirteen [call] v32'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:111 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f4f70 con 0x562a7c3b23e0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 20 list_objects_ordered: starting attempt 1 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:112 4.33 4:cd5cc723:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f4f70 con 0x562a7c1f9fa0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:113 4.22 4:4688c518:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f92c0 con 0x562a7c3b23e0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:114 4.21 4:862ab0bc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3fbc20 con 0x562a7c1f9fa0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:115 4.11 4:89397c57:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3fe690 con 0x562a7c1f9fa0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:116 4.1f 4:fa20cbd7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c4011d0 con 0x562a7c3b8310 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:117 4.27 4:e52db099:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c404000 con 0x562a7c3b23e0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:118 4.38 4:1c8034eb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c406e50 con 0x562a7c3b23e0 2024-05-08T18:10:16.475 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:119 4.37 4:eef4fc33:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c409b80 con 0x562a7c1f9fa0 2024-05-08T18:10:16.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:120 4.2b 4:d4450661:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40c650 con 0x562a7c3b23e0 2024-05-08T18:10:16.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:121 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c3b23e0 2024-05-08T18:10:16.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.472+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:122 4.7 4:e34cfe37:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c412290 con 0x562a7c1f9fa0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(116 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(113 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(120 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== osd_op_reply(117 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(118 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(112 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(119 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(114 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(115 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(122 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 40 ==== osd_op_reply(111 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [stat,call,call] v32'14 uv14 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa8d3fff640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 41 ==== osd_op_reply(121 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9])"; uploads.size()=0; is_truncated=0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:123 4.33 4:cd5cc723:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c404000 con 0x562a7c1f9fa0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:124 4.22 4:4688c518:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40c650 con 0x562a7c3b23e0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:125 4.21 4:862ab0bc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c406e50 con 0x562a7c1f9fa0 2024-05-08T18:10:16.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:126 4.11 4:89397c57:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c1f9fa0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:127 4.1f 4:fa20cbd7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c404000 con 0x562a7c3b8310 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:128 4.27 4:e52db099:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c406e50 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:129 4.38 4:1c8034eb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f4f70 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:130 4.37 4:eef4fc33:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40c650 con 0x562a7c1f9fa0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:131 4.2b 4:d4450661:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c404000 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:132 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:133 4.7 4:e34cfe37:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40c650 con 0x562a7c1f9fa0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(127 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 42 ==== osd_op_reply(124 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 43 ==== osd_op_reply(128 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 44 ==== osd_op_reply(129 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 45 ==== osd_op_reply(132 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [call out=124b] v0'0 uv14 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 46 ==== osd_op_reply(131 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(123 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0 [call out=85b] v0'0 uv13 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(125 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(126 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(130 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(133 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10 [call out=85b] v0'0 uv17 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.476+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c3b23e0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 47 ==== osd_op_reply(134 bud.buckets [call] v32'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c3b23e0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 48 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 20 rados_obj.operate() r=0 bl.length=166 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-08T18:10:16.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T18:10:16.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c3b23e0 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 49 ==== osd_op_reply(136 myfoo6 [call,call,delete] v32'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94740473246816 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c401080 con 0x7fa9f001c030 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== watch-notify(notify (1) cookie 94740472915216 notify 137438953513 ret 0) ==== 192+0+0 (crc 0 0 0) 0x562a7c3ed0c0 con 0x7fa9f001c030 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa8d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953513 cookie 94740472915216 notifier 4751 bl.length()=150 2024-05-08T18:10:16.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(137 notify.3 [notify cookie 94740473246816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa8d37fe640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa8300032d0 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== watch-notify(notify_complete (2) cookie 94740473246816 notify 137438953513 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a7c3ce580 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.480+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:139 8.4 8:2183c35c:root::.bucket.meta.myfoo6%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== osd_op_reply(139 .bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [call,call,delete] v32'8 uv8 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 from cache 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9, ofs0, ns] 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify cookie 94740473246816 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40c610 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== watch-notify(notify (1) cookie 94740472915216 notify 137438953514 ret 0) ==== 249+0+0 (crc 0 0 0) 0x562a7c3ce580 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa8d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953514 cookie 94740472915216 notifier 4751 bl.length()=207 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa8d3fff640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:141 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa8c0003d70 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(140 notify.3 [notify cookie 94740473246816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== watch-notify(notify_complete (2) cookie 94740473246816 notify 137438953514 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a7c3cdd40 con 0x7fa9f001c030 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(141 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:142 4.33 4:cd5cc723:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c1f9fa0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:143 4.22 4:4688c518:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c4038a0 con 0x562a7c3b23e0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:144 4.21 4:862ab0bc:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f4980 con 0x562a7c1f9fa0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:145 4.11 4:89397c57:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40e0d0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:146 4.1f 4:fa20cbd7:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ebf50 con 0x562a7c3b8310 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:147 4.27 4:e52db099:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ec8a0 con 0x562a7c3b23e0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:148 4.38 4:1c8034eb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40f460 con 0x562a7c3b23e0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:149 4.37 4:eef4fc33:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40d460 con 0x562a7c1f9fa0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:150 4.2b 4:d4450661:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3f4980 con 0x562a7c3b23e0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:151 4.38 4:1e899500:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c40e0d0 con 0x562a7c3b23e0 2024-05-08T18:10:16.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.484+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:152 4.7 4:e34cfe37:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c4027e0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(142 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.0 [delete] v32'14 uv14 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 50 ==== osd_op_reply(143 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.1 [delete] v32'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 51 ==== osd_op_reply(147 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.5 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 52 ==== osd_op_reply(148 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.6 [delete] v32'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 53 ==== osd_op_reply(150 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.8 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(144 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.2 [delete] v32'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 54 ==== osd_op_reply(151 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.9 [delete] v32'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(145 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(149 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.7 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(152 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.10 [delete] v32'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(146 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9.4 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 : miss 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:153 6.7 6:e45a01eb:::pubsub..bucket.myfoo6%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ebf50 con 0x562a7c3b8310 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(153 pubsub..bucket.myfoo6/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 info.flags=0x0 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 10 adding default.rgw.log++pubsub..bucket.myfoo6/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 to cache LRU end 2024-05-08T18:10:16.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.488+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:154 6.7 6:e45a01eb:::pubsub..bucket.myfoo6%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ebf50 con 0x562a7c3b8310 2024-05-08T18:10:16.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(154 pubsub..bucket.myfoo6/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9 [delete] v32'65 uv49 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3ebf50 con 0x562a7c3b23e0 2024-05-08T18:10:16.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 55 ==== osd_op_reply(155 bud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9feed7980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-08T18:10:16.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c406800 con 0x562a7c3b23e0 2024-05-08T18:10:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 56 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v32'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9feed7980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T18:10:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94740473244816 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c4038a0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== watch-notify(notify (1) cookie 94740472918752 notify 137438953495 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562a7c3ca940 con 0x562a7c1f9fa0 2024-05-08T18:10:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa8d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94740472918752 notifier 4751 bl.length()=170 2024-05-08T18:10:16.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa8d37fe640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa8300032b0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.492+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(157 notify.5 [notify cookie 94740473244816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== watch-notify(notify_complete (2) cookie 94740473244816 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa9ec0e3040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 10 removing email index: 2024-05-08T18:10:16.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 10 removing user buckets index 2024-05-08T18:10:16.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c406800 con 0x562a7c3b23e0 2024-05-08T18:10:16.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 57 ==== osd_op_reply(159 bud.buckets [delete] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-08T18:10:16.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94740473244816 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c4038a0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 46 ==== watch-notify(notify (1) cookie 94740472927920 notify 137438953496 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7fa9ec0e3040 con 0x562a7c1f9fa0 2024-05-08T18:10:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa8d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94740472927920 notifier 4751 bl.length()=160 2024-05-08T18:10:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 47 ==== osd_op_reply(160 notify.6 [notify cookie 94740473244816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa8d3fff640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa8c0003d70 con 0x562a7c1f9fa0 2024-05-08T18:10:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 48 ==== watch-notify(notify_complete (2) cookie 94740473244816 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a7c37db60 con 0x562a7c1f9fa0 2024-05-08T18:10:16.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 10 removing user index: bud 2024-05-08T18:10:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c406800 con 0x7fa9f001c030 2024-05-08T18:10:16.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.496+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 49 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(162 bud [call,call,delete] v32'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9feed7980 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-08T18:10:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9feed7980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T18:10:16.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94740473244816 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562a7c4038a0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 50 ==== watch-notify(notify (1) cookie 94740472918752 notify 137438953497 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562a7c37db60 con 0x562a7c1f9fa0 2024-05-08T18:10:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa8d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94740472918752 notifier 4751 bl.length()=152 2024-05-08T18:10:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 51 ==== osd_op_reply(163 notify.5 [notify cookie 94740473244816 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa8d37fe640 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa8300032b0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 52 ==== watch-notify(notify_complete (2) cookie 94740473244816 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a7c37aed0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.500+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 53 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa8b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94740472929136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cfc20 con 0x562a7c3b23e0 2024-05-08T18:10:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 58 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94740472929136] v32'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94740472907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cfc20 con 0x7fa9f001c030 2024-05-08T18:10:16.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94740472907152] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9feed7980 20 remove_watcher() i=0 2024-05-08T18:10:16.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9feed7980 2 removed watcher, disabling cache 2024-05-08T18:10:16.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.504+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94740472913008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bc590 con 0x562a7c3b23e0 2024-05-08T18:10:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.508+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 59 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94740472913008] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.508+0000 7fa9feed7980 20 remove_watcher() i=1 2024-05-08T18:10:16.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.508+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94740472916416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cfc20 con 0x562a7c3b8310 2024-05-08T18:10:16.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.508+0000 7fa9fc1ea640 1 -- 172.21.15.114:0/1568313603 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94740472916416] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f0046040 con 0x562a7c3b8310 2024-05-08T18:10:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.508+0000 7fa9feed7980 20 remove_watcher() i=2 2024-05-08T18:10:16.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.508+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94740472915216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bc590 con 0x7fa9f001c030 2024-05-08T18:10:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.512+0000 7fa9fd1ec640 1 -- 172.21.15.114:0/1568313603 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94740472915216] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9f401f070 con 0x7fa9f001c030 2024-05-08T18:10:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.512+0000 7fa9feed7980 20 remove_watcher() i=3 2024-05-08T18:10:16.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.512+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94740472921248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3cfc20 con 0x562a7c3b23e0 2024-05-08T18:10:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.512+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.1 v2:172.21.15.114:6800/1559856467 60 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94740472921248] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c3b23e0 2024-05-08T18:10:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.512+0000 7fa9feed7980 20 remove_watcher() i=4 2024-05-08T18:10:16.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.512+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94740472918752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3be510 con 0x562a7c1f9fa0 2024-05-08T18:10:16.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.516+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 54 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94740472918752] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.516+0000 7fa9feed7980 20 remove_watcher() i=5 2024-05-08T18:10:16.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.516+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94740472927920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bc590 con 0x562a7c1f9fa0 2024-05-08T18:10:16.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.516+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 55 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94740472927920] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.516+0000 7fa9feed7980 20 remove_watcher() i=6 2024-05-08T18:10:16.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.516+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94740472932112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562a7c3bfca0 con 0x562a7c1f9fa0 2024-05-08T18:10:16.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 <== osd.0 v2:172.21.15.53:6800/803213352 56 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94740472932112] v32'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9ec10a060 con 0x562a7c1f9fa0 2024-05-08T18:10:16.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 20 remove_watcher() i=7 2024-05-08T18:10:16.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x562a7c1f9fa0 msgr2=0x7fa9ec0d0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x562a7c1f9fa0 0x7fa9ec0d0410 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c3b23e0 msgr2=0x562a7c3b48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c3b23e0 0x562a7c3b48a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa9f001c030 msgr2=0x7fa9f00196f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa9f001c030 0x7fa9f00196f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562a7c3b8310 msgr2=0x562a7c3ba7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562a7c3b8310 0x562a7c3ba7d0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8c80383f0 msgr2=0x7fa8c803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8c80383f0 0x7fa8c803a8b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x562a7c37eca0 tx=0x7fa9f401f000 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9fc9eb640 1 -- 172.21.15.114:0/1568313603 reap_dead start 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 msgr2=0x562a7c3a6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c3a6f40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0041040 tx=0x7fa9f004e9c0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 shutdown_connections 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1568313603 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c39fa80 0x562a7c3a6f40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 >> 172.21.15.114:0/1568313603 conn(0x562a7c39bdc0 msgr2=0x562a7c399420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 shutdown_connections 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/1568313603 wait complete. 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8d40383f0 msgr2=0x7fa8d403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8d40383f0 0x7fa8d403a8b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x562a7c382870 tx=0x7fa9f4005850 comp rx=0 tx=0).stop 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 msgr2=0x562a7c392c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 0x562a7c392c70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0010fd0 tx=0x7fa9f000f7a0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 shutdown_connections 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8d40383f0 0x7fa8d403a8b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 --2- 172.21.15.114:0/3896669491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c392850 0x562a7c392c70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 >> 172.21.15.114:0/3896669491 conn(0x562a7c387660 msgr2=0x562a7c388170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 shutdown_connections 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.520+0000 7fa9feed7980 1 -- 172.21.15.114:0/3896669491 wait complete. 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c37f7a0 msgr2=0x562a7c381b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c37f7a0 0x562a7c381b90 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8e40383f0 msgr2=0x7fa8e403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8e40383f0 0x7fa8e403a8b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001ec0 tx=0x7fa9f0001440 comp rx=0 tx=0).stop 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 msgr2=0x562a7c37a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 0x562a7c37a700 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec01b380 tx=0x7fa9ec0180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 shutdown_connections 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562a7c37f7a0 0x562a7c381b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa8e40383f0 0x7fa8e403a8b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 --2- 172.21.15.114:0/1173784373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7c28b470 0x562a7c37a700 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 >> 172.21.15.114:0/1173784373 conn(0x562a7c280650 msgr2=0x562a7c36d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 shutdown_connections 2024-05-08T18:10:16.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.524+0000 7fa9feed7980 1 -- 172.21.15.114:0/1173784373 wait complete. 2024-05-08T18:10:16.535 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T18:10:16.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T18:10:16.535 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-08T18:10:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:16.612 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6d1d9980 1 Processor -- start 2024-05-08T18:10:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6d1d9980 1 -- start start 2024-05-08T18:10:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6d1d9980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5638a7860100 0x5638a78604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6d1d9980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638a7709710 con 0x5638a7860a20 2024-05-08T18:10:16.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6d1d9980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5638a771df00 con 0x5638a7860100 2024-05-08T18:10:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6aced640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5638a7860100 0x5638a78604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6a4ec640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5638a7860a20 0x5638a7861390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:47916/0 (socket says 172.21.15.114:47916) 2024-05-08T18:10:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6aced640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5638a7860100 0x5638a78604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43154/0 (socket says 172.21.15.114:43154) 2024-05-08T18:10:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/3273138871 learned_addr learned my addr 172.21.15.114:0/3273138871 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:16.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6aced640 1 -- 172.21.15.114:0/3273138871 >> v1:172.21.15.53:6789/0 conn(0x5638a7860a20 legacy=0x5638a7861390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.612+0000 7fbd6aced640 1 -- 172.21.15.114:0/3273138871 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a76e5ae0 con 0x5638a7860100 2024-05-08T18:10:16.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6aced640 1 --2- 172.21.15.114:0/3273138871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a78604e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00a480 tx=0x7fbd5c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4a284834117b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd69ceb640 1 -- 172.21.15.114:0/3273138871 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c0b0070 con 0x5638a7860100 2024-05-08T18:10:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd69ceb640 1 -- 172.21.15.114:0/3273138871 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0ab540 con 0x5638a7860100 2024-05-08T18:10:16.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd69ceb640 1 -- 172.21.15.114:0/3273138871 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c0ab840 con 0x5638a7860100 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3273138871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 msgr2=0x5638a78604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/3273138871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a78604e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00a480 tx=0x7fbd5c01b280 comp rx=0 tx=0).stop 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3273138871 shutdown_connections 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/3273138871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a78604e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3273138871 >> 172.21.15.114:0/3273138871 conn(0x5638a77d37e0 msgr2=0x5638a77d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3273138871 shutdown_connections 2024-05-08T18:10:16.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.616+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3273138871 wait complete. 2024-05-08T18:10:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6d1d9980 1 Processor -- start 2024-05-08T18:10:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6d1d9980 1 -- start start 2024-05-08T18:10:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6d1d9980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a794b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6d1d9980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5638a7761f80 con 0x5638a7860100 2024-05-08T18:10:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6aced640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a794b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6aced640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a794b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43162/0 (socket says 172.21.15.114:43162) 2024-05-08T18:10:16.634 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6aced640 1 -- 172.21.15.114:0/1406578339 learned_addr learned my addr 172.21.15.114:0/1406578339 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6aced640 1 -- 172.21.15.114:0/1406578339 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a7729da0 con 0x5638a7860100 2024-05-08T18:10:16.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.632+0000 7fbd6aced640 1 --2- 172.21.15.114:0/1406578339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a794b820 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0ae040 tx=0x7fbd5c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af7664484da5344 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbc58e09640 1 -- 172.21.15.114:0/1406578339 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c0b0040 con 0x5638a7860100 2024-05-08T18:10:16.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbc58e09640 1 -- 172.21.15.114:0/1406578339 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0ab9b0 con 0x5638a7860100 2024-05-08T18:10:16.635 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbc58e09640 1 -- 172.21.15.114:0/1406578339 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c0abc90 con 0x5638a7860100 2024-05-08T18:10:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1406578339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 msgr2=0x5638a794b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1406578339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a794b820 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0ae040 tx=0x7fbd5c003030 comp rx=0 tx=0).stop 2024-05-08T18:10:16.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1406578339 shutdown_connections 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1406578339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a794b820 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1406578339 >> 172.21.15.114:0/1406578339 conn(0x5638a77d37e0 msgr2=0x5638a79473b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1406578339 shutdown_connections 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1406578339 wait complete. 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 Processor -- start 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- start start 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a7952b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5638a786a100 con 0x5638a7860100 2024-05-08T18:10:16.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6aced640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a7952b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6aced640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a7952b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43174/0 (socket says 172.21.15.114:43174) 2024-05-08T18:10:16.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6aced640 1 -- 172.21.15.114:0/1596466019 learned_addr learned my addr 172.21.15.114:0/1596466019 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6aced640 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a7953040 con 0x5638a7860100 2024-05-08T18:10:16.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6aced640 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a7952b00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c01bb20 tx=0x7fbd5c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbc57606640 1 -- 172.21.15.114:0/1596466019 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c0c5070 con 0x5638a7860100 2024-05-08T18:10:16.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a79532d0 con 0x5638a7860100 2024-05-08T18:10:16.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbc57606640 1 -- 172.21.15.114:0/1596466019 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0b6970 con 0x5638a7860100 2024-05-08T18:10:16.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbc57606640 1 -- 172.21.15.114:0/1596466019 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd5c0b0050 con 0x5638a7860100 2024-05-08T18:10:16.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.636+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a7955f60 con 0x5638a7860100 2024-05-08T18:10:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbc57606640 1 -- 172.21.15.114:0/1596466019 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbd5c0c8070 con 0x5638a7860100 2024-05-08T18:10:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbc57606640 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc500383f0 0x7fbc5003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbc57606640 1 -- 172.21.15.114:0/1596466019 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbd5c0bc070 con 0x5638a7860100 2024-05-08T18:10:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc500383f0 0x7fbc5003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a7860a20 0x5638a7959bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a795a130 con 0x5638a7860a20 2024-05-08T18:10:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a7860a20 0x5638a7959bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc500383f0 0x7fbc5003a8b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd60004180 tx=0x7fbd60001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a7860a20 0x5638a7959bb0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/1596466019 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd6400a4d0 con 0x5638a7860a20 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a795a980 con 0x5638a7860a20 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/1596466019 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd6400a4d0 con 0x5638a7860a20 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a795bd30 con 0x5638a7860a20 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/1596466019 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd6400a4d0 con 0x5638a7860a20 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a795b1d0 con 0x5638a7860a20 2024-05-08T18:10:16.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/1596466019 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd6400a4d0 con 0x5638a7860a20 2024-05-08T18:10:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a795b5f0 con 0x5638a7860a20 2024-05-08T18:10:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/1596466019 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd6400a4d0 con 0x5638a7860a20 2024-05-08T18:10:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 Processor -- start 2024-05-08T18:10:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.640+0000 7fbd6d1d9980 1 -- start start 2024-05-08T18:10:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6d1d9980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 0x5638a796aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6d1d9980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5638a7765fc0 con 0x5638a796a880 2024-05-08T18:10:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6a4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 0x5638a796aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6a4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 0x5638a796aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43190/0 (socket says 172.21.15.114:43190) 2024-05-08T18:10:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/174896504 learned_addr learned my addr 172.21.15.114:0/174896504 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/174896504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a796b1e0 con 0x5638a796a880 2024-05-08T18:10:16.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 0x5638a796aca0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d660 tx=0x7fbd6000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbc54e01640 1 -- 172.21.15.114:0/174896504 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6000c6b0 con 0x5638a796a880 2024-05-08T18:10:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbc54e01640 1 -- 172.21.15.114:0/174896504 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6000c850 con 0x5638a796a880 2024-05-08T18:10:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a796bc80 con 0x5638a796a880 2024-05-08T18:10:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbc54e01640 1 -- 172.21.15.114:0/174896504 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6000cb30 con 0x5638a796a880 2024-05-08T18:10:16.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a796c150 con 0x5638a796a880 2024-05-08T18:10:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbc54e01640 1 -- 172.21.15.114:0/174896504 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbd60023020 con 0x5638a796a880 2024-05-08T18:10:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbc54e01640 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc440383f0 0x7fbc4403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbc54e01640 1 -- 172.21.15.114:0/174896504 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbd60021020 con 0x5638a796a880 2024-05-08T18:10:16.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.644+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc440383f0 0x7fbc4403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 Processor -- start 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- start start 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc440383f0 0x7fbc4403a8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5638a795b570 tx=0x7fbd64005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a7977ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5638a794beb0 con 0x5638a7977b10 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a7977ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a7977ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43206/0 (socket says 172.21.15.114:43206) 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/3188012049 learned_addr learned my addr 172.21.15.114:0/3188012049 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/3188012049 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a79784c0 con 0x5638a7977b10 2024-05-08T18:10:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/3188012049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a7977ef0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd6004f2f0 tx=0x7fbd600193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7d806feb3df76 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbc4e7fc640 1 -- 172.21.15.114:0/3188012049 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6001bcc0 con 0x5638a7977b10 2024-05-08T18:10:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbc4e7fc640 1 -- 172.21.15.114:0/3188012049 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6003e0d0 con 0x5638a7977b10 2024-05-08T18:10:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbc4e7fc640 1 -- 172.21.15.114:0/3188012049 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6001be60 con 0x5638a7977b10 2024-05-08T18:10:16.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3188012049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 msgr2=0x5638a7977ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/3188012049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a7977ef0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbd6004f2f0 tx=0x7fbd600193e0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3188012049 shutdown_connections 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/3188012049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a7977ef0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3188012049 >> 172.21.15.114:0/3188012049 conn(0x5638a7973e50 msgr2=0x5638a7971eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3188012049 shutdown_connections 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/3188012049 wait complete. 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 Processor -- start 2024-05-08T18:10:16.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- start start 2024-05-08T18:10:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a797f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6d1d9980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5638a7978c80 con 0x5638a7977b10 2024-05-08T18:10:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a797f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a797f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43216/0 (socket says 172.21.15.114:43216) 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 learned_addr learned my addr 172.21.15.114:0/862108352 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.648+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a797f5a0 con 0x5638a7977b10 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a797f060 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd600238a0 tx=0x7fbd6004f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbc4cff9640 1 -- 172.21.15.114:0/862108352 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd60032020 con 0x5638a7977b10 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbc4cff9640 1 -- 172.21.15.114:0/862108352 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd6001b760 con 0x5638a7977b10 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638a797f830 con 0x5638a7977b10 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbc4cff9640 1 -- 172.21.15.114:0/862108352 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd6003f870 con 0x5638a7977b10 2024-05-08T18:10:16.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a797f830 con 0x5638a7977b10 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbc4cff9640 1 -- 172.21.15.114:0/862108352 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbd60035020 con 0x5638a7977b10 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbc4cff9640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc340383f0 0x7fbc3403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbc4cff9640 1 -- 172.21.15.114:0/862108352 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbd60005030 con 0x5638a7977b10 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc340383f0 0x7fbc3403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a798a320 0x5638a798c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798cf30 con 0x5638a798a320 2024-05-08T18:10:16.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6aced640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a798a320 0x5638a798c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc340383f0 0x7fbc3403a8b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5638a795a800 tx=0x7fbd6401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6aced640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a798a320 0x5638a798c7e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 realm 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798d340 con 0x5638a798a320 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798dc10 con 0x5638a798a320 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.652+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798dfb0 con 0x5638a798a320 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798e800 con 0x5638a798a320 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 20 searching for the correct realm 2024-05-08T18:10:16.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5638a7990230 0x5638a79926f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5638a7990230 0x5638a79926f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5638a7990230 0x5638a79926f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6a4ec640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbd6005a040 0x7fbd600367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbd6005a040 0x7fbd600367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6b4ee640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbd6005a040 0x7fbd600367d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbd5c0ca060 0x7fbd5c0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.656+0000 7fbd6aced640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbd5c0ca060 0x7fbd5c0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbd5c0ca060 0x7fbd5c0b4370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x7fbd5c0ca060 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x7fbd5c0ca060 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.660+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x7fbd5c0ca060 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0c7030 con 0x7fbd5c0ca060 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd5c0c7030 con 0x5638a798a320 2024-05-08T18:10:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.664+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a7990230 2024-05-08T18:10:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x5638a798a320 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5638a7992dc0 con 0x7fbd6005a040 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:16.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798e450 con 0x5638a798a320 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798f1a0 con 0x5638a798a320 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a798f680 con 0x5638a798a320 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 zone default found 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 4 Realm: () 2024-05-08T18:10:16.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 zonegroup default 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.668+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7993280 con 0x7fbd5c0ca060 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79950a0 con 0x5638a7990230 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7995440 con 0x5638a7990230 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.674 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 started sync module instance, tier type = 2024-05-08T18:10:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:16.675 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7994540 con 0x7fbd6005a040 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94801329998048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7994d00 con 0x7fbd6005a040 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7996340 con 0x5638a798a320 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.672+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94801329998048] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94801330002032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7996340 con 0x5638a798a320 2024-05-08T18:10:16.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7996d00 con 0x5638a7990230 2024-05-08T18:10:16.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94801330002032] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94801330006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79970a0 con 0x5638a7990230 2024-05-08T18:10:16.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.676+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7997a60 con 0x7fbd6005a040 2024-05-08T18:10:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94801330009824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7998300 con 0x7fbd6005a040 2024-05-08T18:10:16.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7998d20 con 0x5638a798a320 2024-05-08T18:10:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94801330006096] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94801330009824] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94801330014224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7997e50 con 0x5638a798a320 2024-05-08T18:10:16.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.680+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79995c0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94801330014224] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94801330003600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7997e50 con 0x7fbd5c0ca060 2024-05-08T18:10:16.683 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7999ad0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94801330003600] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94801330017696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7999a90 con 0x7fbd5c0ca060 2024-05-08T18:10:16.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.684+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a799a490 con 0x7fbd5c0ca060 2024-05-08T18:10:16.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94801330017696] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94801330016048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a799a450 con 0x7fbd5c0ca060 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=0 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=1 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=2 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=3 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=4 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=5 2024-05-08T18:10:16.689 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=6 2024-05-08T18:10:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94801330016048] v32'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 20 add_watcher() i=7 2024-05-08T18:10:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:16.690 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a799d8b0 con 0x5638a798a320 2024-05-08T18:10:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.691 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.688+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94801330020720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a799ad70 con 0x5638a798a320 2024-05-08T18:10:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94801330020720] v32'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbc217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbd6d1d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbd6d1d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:16.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a799d680 con 0x5638a798a320 2024-05-08T18:10:16.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.692+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6960 con 0x7fbd5c0ca060 2024-05-08T18:10:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.696+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.696+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6960 con 0x5638a7990230 2024-05-08T18:10:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.696+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.696+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6f50 con 0x5638a798a320 2024-05-08T18:10:16.699 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.700+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.700+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6e80 con 0x7fbd6005a040 2024-05-08T18:10:16.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.700+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'74 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.700+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a7450 con 0x5638a7990230 2024-05-08T18:10:16.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.700+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.700+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a7900 con 0x5638a798a320 2024-05-08T18:10:16.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.704+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.704+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a7900 con 0x7fbd5c0ca060 2024-05-08T18:10:16.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.704+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.704+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a7900 con 0x7fbd6005a040 2024-05-08T18:10:16.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.708+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.708+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6000 con 0x5638a7990230 2024-05-08T18:10:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.708+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.708+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6000 con 0x7fbd6005a040 2024-05-08T18:10:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.712+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'75 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.712+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6000 con 0x7fbd5c0ca060 2024-05-08T18:10:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.712+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.712+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a6000 con 0x7fbd6005a040 2024-05-08T18:10:16.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.712+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.712+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a8460 con 0x7fbd5c0ca060 2024-05-08T18:10:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.716+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.716+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a8460 con 0x5638a798a320 2024-05-08T18:10:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.716+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.716+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a8460 con 0x5638a7990230 2024-05-08T18:10:16.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.720+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'66 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.720+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a8460 con 0x7fbd6005a040 2024-05-08T18:10:16.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.720+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.722 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.720+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a84f0 con 0x5638a7990230 2024-05-08T18:10:16.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.724+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.724+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a84f0 con 0x5638a798a320 2024-05-08T18:10:16.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.724+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.724+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a84f0 con 0x5638a798a320 2024-05-08T18:10:16.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.724+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.724+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a84f0 con 0x5638a7990230 2024-05-08T18:10:16.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.728+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'67 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.728+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a84f0 con 0x7fbd6005a040 2024-05-08T18:10:16.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.728+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.728+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a89a0 con 0x5638a7990230 2024-05-08T18:10:16.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.732+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.732+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a58d0 con 0x5638a7990230 2024-05-08T18:10:16.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.732+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.732+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a58d0 con 0x5638a7990230 2024-05-08T18:10:16.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.732+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.732+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a58d0 con 0x5638a7990230 2024-05-08T18:10:16.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.736+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.736+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a58d0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.736+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.736+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a5aa0 con 0x5638a7990230 2024-05-08T18:10:16.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.740+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.740+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a5aa0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.740+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.740+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a5aa0 con 0x5638a7990230 2024-05-08T18:10:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.744+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'68 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.744+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a8a50 con 0x7fbd5c0ca060 2024-05-08T18:10:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.744+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.744+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79a8a50 con 0x7fbd6005a040 2024-05-08T18:10:16.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbb9bfff640 20 reqs_thread_entry: start 2024-05-08T18:10:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 20 Filter name: none 2024-05-08T18:10:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbb99ffb640 20 reqs_thread_entry: start 2024-05-08T18:10:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T18:10:16.749 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79c3a80 con 0x7fbd5c0ca060 2024-05-08T18:10:16.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T18:10:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T18:10:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T18:10:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:16.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.748+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79c64f0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 : miss 2024-05-08T18:10:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:96 8.11 8:8be2b6a1:root::.bucket.meta.myfoo7%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79c63a0 con 0x5638a7990230 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=382 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 info.flags=0x17 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 to cache LRU end 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:97 4.1b 4:dab03c06:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a438a0 con 0x7fbd6005a040 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(97 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:98 4.17 4:ea48bf35:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a438e0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(98 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 4.d 4:b037ff88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a438e0 con 0x5638a7990230 2024-05-08T18:10:16.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(99 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.752+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 4.3a 4:5c288fa2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x5638a7990230 2024-05-08T18:10:16.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(100 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 4.15 4:aa285e77:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x5638a7990230 2024-05-08T18:10:16.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(101 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:102 4.4 4:210bd706:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x7fbd5c0ca060 2024-05-08T18:10:16.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(102 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 [call out=377b] v0'0 uv6 ondisk = 0) ==== 195+0+377 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 10 cls_bucket_list_unordered: got fourteen 2024-05-08T18:10:16.756 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:103 4.e 4:709bad7f:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x7fbd6005a040 2024-05-08T18:10:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(103 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:104 4.6 4:61f1e78e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x5638a7990230 2024-05-08T18:10:16.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(104 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 4.9 4:92a72c6a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x5638a798a320 2024-05-08T18:10:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(105 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.756+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:106 4.37 4:ef1fe05c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x7fbd5c0ca060 2024-05-08T18:10:16.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(106 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:107 4.21 4:84c9620c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43e40 con 0x7fbd5c0ca060 2024-05-08T18:10:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(107 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10 [call out=85b] v0'0 uv10 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 20 get_obj_state: octx=0x7fbd6400a220 obj=myfoo7:fourteen state=0x5638a7a41ad8 s->prefetch_data=0 2024-05-08T18:10:16.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:108 3.1fs0 3:f812c725:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a42900 con 0x5638a798a320 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(108 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10_fourteen [getxattrs out=856b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+872 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 10 manifest: total_size = 8 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.9676558595766666373 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 20 get_obj_state: octx=0x7fbd6400a220 obj=myfoo7:fourteen state=0x5638a7a41ad8 s->prefetch_data=0 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 20 prepare_atomic_modification: state is not atomic. state=0x5638a7a41ad8 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 2024-05-08T18:10:16.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.760+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:109 4.4 4:210bd706:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a43230 con 0x7fbd5c0ca060 2024-05-08T18:10:16.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(109 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:110 3.1fs0 3:f812c725:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a7a42ce0 con 0x5638a798a320 2024-05-08T18:10:16.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(110 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10_fourteen [call] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 4.4 4:210bd706:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cb150 con 0x7fbd5c0ca060 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 20 list_objects_ordered: starting attempt 1 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:112 4.1b 4:dab03c06:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cb150 con 0x7fbd6005a040 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:113 4.17 4:ea48bf35:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf410 con 0x7fbd5c0ca060 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:114 4.d 4:b037ff88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79d1d70 con 0x5638a7990230 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:115 4.3a 4:5c288fa2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cb150 con 0x5638a7990230 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:116 4.15 4:aa285e77:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79d6ba0 con 0x5638a7990230 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:117 4.4 4:210bd706:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79d9670 con 0x7fbd5c0ca060 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:118 4.e 4:709bad7f:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dbf80 con 0x7fbd6005a040 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:119 4.6 4:61f1e78e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79de8c0 con 0x5638a7990230 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:120 4.9 4:92a72c6a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e1570 con 0x5638a798a320 2024-05-08T18:10:16.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:121 4.37 4:ef1fe05c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e3f60 con 0x7fbd5c0ca060 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:122 4.21 4:84c9620c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e6db0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(112 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(115 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(118 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(119 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(114 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(113 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(116 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.764+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(120 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(121 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(122 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10 [call out=85b] v0'0 uv10 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(111 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 [stat,call,call] v32'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbc4dffb640 20 handle_completion(): completion ok for obj=fourteen 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(117 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 [call out=124b] v0'0 uv8 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:10:16.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10])"; uploads.size()=0; is_truncated=0 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:123 4.1b 4:dab03c06:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e3f60 con 0x7fbd6005a040 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:124 4.17 4:ea48bf35:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cb040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:125 4.d 4:b037ff88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dd400 con 0x5638a7990230 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:126 4.3a 4:5c288fa2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79d80a0 con 0x5638a7990230 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:127 4.15 4:aa285e77:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e5460 con 0x5638a7990230 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:128 4.4 4:210bd706:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e3f60 con 0x7fbd5c0ca060 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:129 4.e 4:709bad7f:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cb040 con 0x7fbd6005a040 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:130 4.6 4:61f1e78e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cef60 con 0x5638a7990230 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:131 4.9 4:92a72c6a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dd400 con 0x5638a798a320 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:132 4.37 4:ef1fe05c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e3f60 con 0x7fbd5c0ca060 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:133 4.21 4:84c9620c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79e5460 con 0x7fbd5c0ca060 2024-05-08T18:10:16.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(123 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(129 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(125 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(131 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(126 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(130 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7 [call out=85b] v0'0 uv9 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(124 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(128 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 [call out=124b] v0'0 uv8 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(127 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(132 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(133 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10 [call out=85b] v0'0 uv10 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.768+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x7fbd6005a040 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 20 rados_obj.operate() r=0 bl.length=168 2024-05-08T18:10:16.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-08T18:10:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-08T18:10:16.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.772+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(136 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94801330219920 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== watch-notify(notify (1) cookie 94801330009824 notify 137438953515 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5638a79a61d0 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbc4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953515 cookie 94801330009824 notifier 4758 bl.length()=150 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(137 notify.3 [notify cookie 94801330219920 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbc4dffb640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbba00032d0 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== watch-notify(notify_complete (2) cookie 94801330219920 notify 137438953515 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a79a6ed0 con 0x7fbd6005a040 2024-05-08T18:10:16.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:139 8.11 8:8be2b6a1:root::.bucket.meta.myfoo7%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x5638a7990230 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(139 .bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 [call,call,delete] v32'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 from cache 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10, ofs0, ns] 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94801330201360 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x5638a7990230 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== watch-notify(notify (1) cookie 94801330006096 notify 137438953480 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5638a79c58d0 con 0x5638a7990230 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbc4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94801330006096 notifier 4758 bl.length()=208 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbc4dffb640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbba0003330 con 0x5638a7990230 2024-05-08T18:10:16.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(140 notify.2 [notify cookie 94801330201360 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== watch-notify(notify_complete (2) cookie 94801330201360 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a79784c0 con 0x5638a7990230 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:142 4.1b 4:dab03c06:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x7fbd6005a040 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:143 4.17 4:ea48bf35:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dc3f0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:144 4.d 4:b037ff88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dcc40 con 0x5638a7990230 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:145 4.3a 4:5c288fa2:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dd060 con 0x5638a7990230 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:146 4.15 4:aa285e77:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x5638a7990230 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:147 4.4 4:210bd706:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dc3f0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:148 4.e 4:709bad7f:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dcc40 con 0x7fbd6005a040 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.776+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:149 4.6 4:61f1e78e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dd060 con 0x5638a7990230 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:150 4.9 4:92a72c6a:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dc3f0 con 0x5638a798a320 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:151 4.37 4:ef1fe05c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3d0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:152 4.21 4:84c9620c:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79dcc40 con 0x7fbd5c0ca060 2024-05-08T18:10:16.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(144 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.2 [delete] v32'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(145 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.3 [delete] v32'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(148 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.6 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(143 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.1 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(147 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.5 [delete] v32'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(146 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.4 [delete] v32'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.780+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(142 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.0 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(149 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.7 [delete] v32'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(150 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.8 [delete] v32'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.783 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(151 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.9 [delete] v32'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== osd_op_reply(152 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10.10 [delete] v32'12 uv12 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 : miss 2024-05-08T18:10:16.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 20 rados->read ofs=0 len=0 2024-05-08T18:10:16.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:153 6.1f 6:ff34989c:::pubsub..bucket.myfoo7%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(153 pubsub..bucket.myfoo7/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:16.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 info.flags=0x0 2024-05-08T18:10:16.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 10 adding default.rgw.log++pubsub..bucket.myfoo7/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 to cache LRU end 2024-05-08T18:10:16.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:154 6.1f 6:ff34989c:::pubsub..bucket.myfoo7%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.784+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(154 pubsub..bucket.myfoo7/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.10 [delete] v32'30 uv23 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.788+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.788+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== osd_op_reply(155 fud.buckets [call] v32'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.788+0000 7fbd6d1d9980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T18:10:16.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.788+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 46 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6d1d9980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T18:10:16.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94801330201360 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x5638a7990230 2024-05-08T18:10:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== watch-notify(notify (1) cookie 94801330006096 notify 137438953481 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5638a79784c0 con 0x5638a7990230 2024-05-08T18:10:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbc4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94801330006096 notifier 4758 bl.length()=170 2024-05-08T18:10:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 49 ==== osd_op_reply(157 notify.2 [notify cookie 94801330201360 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbc4dffb640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbba0003330 con 0x5638a7990230 2024-05-08T18:10:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 50 ==== watch-notify(notify_complete (2) cookie 94801330201360 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a796c150 con 0x5638a7990230 2024-05-08T18:10:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6d1d9980 10 removing email index: 2024-05-08T18:10:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6d1d9980 10 removing user buckets index 2024-05-08T18:10:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 51 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.792+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 47 ==== osd_op_reply(159 fud.buckets [delete] v32'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6d1d9980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T18:10:16.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94801330201360 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 48 ==== watch-notify(notify (1) cookie 94801330017696 notify 137438953498 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5638a79a84f0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbc4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94801330017696 notifier 4758 bl.length()=160 2024-05-08T18:10:16.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 49 ==== osd_op_reply(160 notify.6 [notify cookie 94801330201360 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbc4e7fc640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbc30003d70 con 0x7fbd5c0ca060 2024-05-08T18:10:16.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 50 ==== watch-notify(notify_complete (2) cookie 94801330201360 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a799ce40 con 0x7fbd5c0ca060 2024-05-08T18:10:16.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 51 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6d1d9980 10 removing user index: fud 2024-05-08T18:10:16.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.796+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 52 ==== osd_op_reply(162 fud [call,call,delete] v32'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6d1d9980 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T18:10:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6d1d9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T18:10:16.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94801330201360 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 53 ==== watch-notify(notify (1) cookie 94801330003600 notify 137438953499 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5638a799ce40 con 0x7fbd5c0ca060 2024-05-08T18:10:16.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbc4e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94801330003600 notifier 4758 bl.length()=152 2024-05-08T18:10:16.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 54 ==== osd_op_reply(163 notify.5 [notify cookie 94801330201360 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbc4e7fc640 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbc30003d70 con 0x7fbd5c0ca060 2024-05-08T18:10:16.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 55 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.800+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 56 ==== watch-notify(notify_complete (2) cookie 94801330201360 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638a7955f60 con 0x7fbd5c0ca060 2024-05-08T18:10:16.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbc217e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:16.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94801330020720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x5638a798a320 2024-05-08T18:10:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94801330020720] v32'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94801329998048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd6005a040 2024-05-08T18:10:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94801329998048] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6d1d9980 20 remove_watcher() i=0 2024-05-08T18:10:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6d1d9980 2 removed watcher, disabling cache 2024-05-08T18:10:16.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.804+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94801330002032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x5638a798a320 2024-05-08T18:10:16.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.808+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94801330002032] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.808+0000 7fbd6d1d9980 20 remove_watcher() i=1 2024-05-08T18:10:16.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.808+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94801330006096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x5638a7990230 2024-05-08T18:10:16.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.812+0000 7fbd6a4ec640 1 -- 172.21.15.114:0/862108352 <== osd.3 v2:172.21.15.114:6808/3988457904 52 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94801330006096] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd60045070 con 0x5638a7990230 2024-05-08T18:10:16.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.812+0000 7fbd6d1d9980 20 remove_watcher() i=2 2024-05-08T18:10:16.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.812+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94801330009824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd6005a040 2024-05-08T18:10:16.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.812+0000 7fbd6b4ee640 1 -- 172.21.15.114:0/862108352 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94801330009824] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd6401f070 con 0x7fbd6005a040 2024-05-08T18:10:16.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.812+0000 7fbd6d1d9980 20 remove_watcher() i=3 2024-05-08T18:10:16.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.812+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94801330014224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x5638a798a320 2024-05-08T18:10:16.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.816+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94801330014224] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x5638a798a320 2024-05-08T18:10:16.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.816+0000 7fbd6d1d9980 20 remove_watcher() i=4 2024-05-08T18:10:16.816 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.816+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94801330003600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.816+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 57 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94801330003600] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.816+0000 7fbd6d1d9980 20 remove_watcher() i=5 2024-05-08T18:10:16.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.816+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94801330017696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.820+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 58 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94801330017696] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.820+0000 7fbd6d1d9980 20 remove_watcher() i=6 2024-05-08T18:10:16.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.820+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94801330016048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5638a79cf3b0 con 0x7fbd5c0ca060 2024-05-08T18:10:16.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 <== osd.0 v2:172.21.15.53:6800/803213352 59 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94801330016048] v32'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd5c0ee040 con 0x7fbd5c0ca060 2024-05-08T18:10:16.823 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 20 remove_watcher() i=7 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbd5c0ca060 msgr2=0x7fbd5c0b4370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fbd5c0ca060 0x7fbd5c0b4370 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a798a320 msgr2=0x5638a798c7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a798a320 0x5638a798c7e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbd6005a040 msgr2=0x7fbd600367d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fbd6005a040 0x7fbd600367d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5638a7990230 msgr2=0x5638a79926f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.824 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5638a7990230 0x5638a79926f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc340383f0 msgr2=0x7fbc3403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc340383f0 0x7fbc3403a8b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x5638a795a800 tx=0x7fbd6401f000 comp rx=0 tx=0).stop 2024-05-08T18:10:16.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 msgr2=0x5638a797f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.826 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/862108352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7977b10 0x5638a797f060 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbd600238a0 tx=0x7fbd6004f250 comp rx=0 tx=0).stop 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 reap_dead start 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6aced640 1 -- 172.21.15.114:0/862108352 reap_dead start 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 shutdown_connections 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 >> 172.21.15.114:0/862108352 conn(0x5638a7973e50 msgr2=0x5638a79714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 shutdown_connections 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/862108352 wait complete. 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc440383f0 msgr2=0x7fbc4403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc440383f0 0x7fbc4403a8b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5638a795b570 tx=0x7fbd64005850 comp rx=0 tx=0).stop 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 msgr2=0x5638a796aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 0x5638a796aca0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbd6000d660 tx=0x7fbd6000da60 comp rx=0 tx=0).stop 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 shutdown_connections 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc440383f0 0x7fbc4403a8b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/174896504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a796a880 0x5638a796aca0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.827 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 >> 172.21.15.114:0/174896504 conn(0x5638a795f690 msgr2=0x5638a79601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 shutdown_connections 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/174896504 wait complete. 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a7860a20 msgr2=0x5638a7959bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a7860a20 0x5638a7959bb0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc500383f0 msgr2=0x7fbc5003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc500383f0 0x7fbc5003a8b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fbd60004180 tx=0x7fbd60001340 comp rx=0 tx=0).stop 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 msgr2=0x5638a7952b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a7952b00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c01bb20 tx=0x7fbd5c018020 comp rx=0 tx=0).stop 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 shutdown_connections 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5638a7860a20 0x5638a7959bb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbc500383f0 0x7fbc5003a8b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 --2- 172.21.15.114:0/1596466019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5638a7860100 0x5638a7952b00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 >> 172.21.15.114:0/1596466019 conn(0x5638a77d37e0 msgr2=0x5638a7945ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 shutdown_connections 2024-05-08T18:10:16.828 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:16.824+0000 7fbd6d1d9980 1 -- 172.21.15.114:0/1596466019 wait complete. 2024-05-08T18:10:56.839 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-08T18:10:56.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-08T18:10:56.840 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-08T18:10:56.878 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:56.879 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:56.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bfc0b980 1 Processor -- start 2024-05-08T18:10:56.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bfc0b980 1 -- start start 2024-05-08T18:10:56.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bfc0b980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55723b4542d0 0x55723b4566c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bfc0b980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55723b2fb710 con 0x55723b3c47e0 2024-05-08T18:10:56.880 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bfc0b980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55723b30ff00 con 0x55723b4542d0 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bcf1e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55723b4542d0 0x55723b4566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bd71f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55723b3c47e0 0x55723b452bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51760/0 (socket says 172.21.15.114:51760) 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bd71f640 1 -- 172.21.15.114:0/3699623109 learned_addr learned my addr 172.21.15.114:0/3699623109 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bcf1e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55723b4542d0 0x55723b4566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42374/0 (socket says 172.21.15.114:42374) 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/3699623109 >> v1:172.21.15.53:6789/0 conn(0x55723b3c47e0 legacy=0x55723b452bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/3699623109 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723b2d7ae0 con 0x55723b4542d0 2024-05-08T18:10:56.881 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.880+0000 7fe6affff640 1 -- 172.21.15.114:0/3699623109 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508624043 0 0) 0x55723b2fb710 con 0x55723b3c47e0 2024-05-08T18:10:56.883 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/3699623109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b4542d0 0x55723b4566c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400a480 tx=0x7fe6b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a4c537b28f1fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6affff640 1 -- 172.21.15.114:0/3699623109 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40b0070 con 0x55723b4542d0 2024-05-08T18:10:56.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6affff640 1 -- 172.21.15.114:0/3699623109 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b40ab540 con 0x55723b4542d0 2024-05-08T18:10:56.884 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6affff640 1 -- 172.21.15.114:0/3699623109 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40ab840 con 0x55723b4542d0 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3699623109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b4542d0 msgr2=0x55723b4566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/3699623109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b4542d0 0x55723b4566c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400a480 tx=0x7fe6b401b280 comp rx=0 tx=0).stop 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3699623109 shutdown_connections 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/3699623109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b4542d0 0x55723b4566c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3699623109 >> 172.21.15.114:0/3699623109 conn(0x55723b44a690 msgr2=0x55723b44cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3699623109 shutdown_connections 2024-05-08T18:10:56.885 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.884+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3699623109 wait complete. 2024-05-08T18:10:56.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bfc0b980 1 Processor -- start 2024-05-08T18:10:56.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bfc0b980 1 -- start start 2024-05-08T18:10:56.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bfc0b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b53ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.901 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bfc0b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723b353f80 con 0x55723b3c47e0 2024-05-08T18:10:56.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bd71f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b53ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bd71f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b53ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42380/0 (socket says 172.21.15.114:42380) 2024-05-08T18:10:56.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bd71f640 1 -- 172.21.15.114:0/4218682223 learned_addr learned my addr 172.21.15.114:0/4218682223 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:56.902 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bd71f640 1 -- 172.21.15.114:0/4218682223 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723b31bda0 con 0x55723b3c47e0 2024-05-08T18:10:56.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.900+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/4218682223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b53ae00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006fb0 tx=0x7fe6b0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283cbd8336897d70 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe5ab606640 1 -- 172.21.15.114:0/4218682223 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0003460 con 0x55723b3c47e0 2024-05-08T18:10:56.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe5ab606640 1 -- 172.21.15.114:0/4218682223 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0003600 con 0x55723b3c47e0 2024-05-08T18:10:56.903 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe5ab606640 1 -- 172.21.15.114:0/4218682223 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0003920 con 0x55723b3c47e0 2024-05-08T18:10:56.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/4218682223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 msgr2=0x55723b53ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/4218682223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b53ae00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006fb0 tx=0x7fe6b0001b10 comp rx=0 tx=0).stop 2024-05-08T18:10:56.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/4218682223 shutdown_connections 2024-05-08T18:10:56.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/4218682223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b53ae00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/4218682223 >> 172.21.15.114:0/4218682223 conn(0x55723b44a690 msgr2=0x55723b536990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:56.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/4218682223 shutdown_connections 2024-05-08T18:10:56.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/4218682223 wait complete. 2024-05-08T18:10:56.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 Processor -- start 2024-05-08T18:10:56.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- start start 2024-05-08T18:10:56.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b5421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723b4577a0 con 0x55723b3c47e0 2024-05-08T18:10:56.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bd71f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b5421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bd71f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b5421d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42396/0 (socket says 172.21.15.114:42396) 2024-05-08T18:10:56.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bd71f640 1 -- 172.21.15.114:0/2703013745 learned_addr learned my addr 172.21.15.114:0/2703013745 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:56.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bd71f640 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723b542710 con 0x55723b3c47e0 2024-05-08T18:10:56.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b5421d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00012f0 tx=0x7fe6b0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe5a9e03640 1 -- 172.21.15.114:0/2703013745 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0025070 con 0x55723b3c47e0 2024-05-08T18:10:56.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55723b5429a0 con 0x55723b3c47e0 2024-05-08T18:10:56.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe5a9e03640 1 -- 172.21.15.114:0/2703013745 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b0019040 con 0x55723b3c47e0 2024-05-08T18:10:56.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723b545630 con 0x55723b3c47e0 2024-05-08T18:10:56.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.904+0000 7fe5a9e03640 1 -- 172.21.15.114:0/2703013745 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b0013890 con 0x55723b3c47e0 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe5a9e03640 1 -- 172.21.15.114:0/2703013745 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe6b0010070 con 0x55723b3c47e0 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe5a9e03640 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5a40383f0 0x7fe5a403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe5a9e03640 1 -- 172.21.15.114:0/2703013745 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe6b004e060 con 0x55723b3c47e0 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5a40383f0 0x7fe5a403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b4542d0 0x55723b549110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b549760 con 0x55723b4542d0 2024-05-08T18:10:56.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b4542d0 0x55723b549110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5a40383f0 0x7fe5a403a8b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40ad000 tx=0x7fe6b40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b4542d0 0x55723b549110 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bdf20640 1 -- 172.21.15.114:0/2703013745 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b80083f0 con 0x55723b4542d0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b546850 con 0x55723b4542d0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bdf20640 1 -- 172.21.15.114:0/2703013745 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6b80083f0 con 0x55723b4542d0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b54b5a0 con 0x55723b4542d0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bdf20640 1 -- 172.21.15.114:0/2703013745 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6b80083f0 con 0x55723b4542d0 2024-05-08T18:10:56.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b54a7d0 con 0x55723b4542d0 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bdf20640 1 -- 172.21.15.114:0/2703013745 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6b80083f0 con 0x55723b4542d0 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.908+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b54ac20 con 0x55723b4542d0 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bdf20640 1 -- 172.21.15.114:0/2703013745 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6b80083f0 con 0x55723b4542d0 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bfc0b980 1 Processor -- start 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bfc0b980 1 -- start start 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bfc0b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 0x55723b55a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bfc0b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723b357fc0 con 0x55723b559ee0 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bcf1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 0x55723b55a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bcf1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 0x55723b55a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42398/0 (socket says 172.21.15.114:42398) 2024-05-08T18:10:56.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/905191034 learned_addr learned my addr 172.21.15.114:0/905191034 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:56.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/905191034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723b55a840 con 0x55723b559ee0 2024-05-08T18:10:56.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 0x55723b55a300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe6b401b2c0 tx=0x7fe6b4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe5a2ffd640 1 -- 172.21.15.114:0/905191034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40c6070 con 0x55723b559ee0 2024-05-08T18:10:56.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe5a2ffd640 1 -- 172.21.15.114:0/905191034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b40b7760 con 0x55723b559ee0 2024-05-08T18:10:56.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55723b55b2e0 con 0x55723b559ee0 2024-05-08T18:10:56.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe5a2ffd640 1 -- 172.21.15.114:0/905191034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40b0040 con 0x55723b559ee0 2024-05-08T18:10:56.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723b55b750 con 0x55723b559ee0 2024-05-08T18:10:56.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe5a2ffd640 1 -- 172.21.15.114:0/905191034 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe6b40c9070 con 0x55723b559ee0 2024-05-08T18:10:56.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe5a2ffd640 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5940383f0 0x7fe59403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.912+0000 7fe5a2ffd640 1 -- 172.21.15.114:0/905191034 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe6b40be030 con 0x55723b559ee0 2024-05-08T18:10:56.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5940383f0 0x7fe59403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 Processor -- start 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- start start 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5940383f0 0x7fe59403a8b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55723b54a2f0 tx=0x7fe6b8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b5673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723b53b550 con 0x55723b566fc0 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b5673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b5673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42400/0 (socket says 172.21.15.114:42400) 2024-05-08T18:10:56.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/3551949408 learned_addr learned my addr 172.21.15.114:0/3551949408 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:56.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/3551949408 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723b5679b0 con 0x55723b566fc0 2024-05-08T18:10:56.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/3551949408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b5673e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40b6fd0 tx=0x7fe6b4006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f55738d08d593ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe5a0ff9640 1 -- 172.21.15.114:0/3551949408 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40caa20 con 0x55723b566fc0 2024-05-08T18:10:56.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe5a0ff9640 1 -- 172.21.15.114:0/3551949408 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b40ca3b0 con 0x55723b566fc0 2024-05-08T18:10:56.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe5a0ff9640 1 -- 172.21.15.114:0/3551949408 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b4006390 con 0x55723b566fc0 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3551949408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 msgr2=0x55723b5673e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/3551949408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b5673e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40b6fd0 tx=0x7fe6b4006ae0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3551949408 shutdown_connections 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/3551949408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b5673e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3551949408 >> 172.21.15.114:0/3551949408 conn(0x55723b563350 msgr2=0x55723b5613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3551949408 shutdown_connections 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/3551949408 wait complete. 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 Processor -- start 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- start start 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b56e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bfc0b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55723b568100 con 0x55723b566fc0 2024-05-08T18:10:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b56e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b56e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42408/0 (socket says 172.21.15.114:42408) 2024-05-08T18:10:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.916+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 learned_addr learned my addr 172.21.15.114:0/1161013394 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723b56eab0 con 0x55723b566fc0 2024-05-08T18:10:56.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b56e570 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40b6cf0 tx=0x7fe6b40e9160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe592ffd640 1 -- 172.21.15.114:0/1161013394 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40cac50 con 0x55723b566fc0 2024-05-08T18:10:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55723b56ed40 con 0x55723b566fc0 2024-05-08T18:10:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe592ffd640 1 -- 172.21.15.114:0/1161013394 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6b40ef020 con 0x55723b566fc0 2024-05-08T18:10:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723b571a20 con 0x55723b566fc0 2024-05-08T18:10:56.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe592ffd640 1 -- 172.21.15.114:0/1161013394 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6b40b4e30 con 0x55723b566fc0 2024-05-08T18:10:56.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe592ffd640 1 -- 172.21.15.114:0/1161013394 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe6b40f2030 con 0x55723b566fc0 2024-05-08T18:10:56.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe592ffd640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe588038350 0x7fe58803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe592ffd640 1 -- 172.21.15.114:0/1161013394 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe6b40f0070 con 0x55723b566fc0 2024-05-08T18:10:56.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe588038350 0x7fe58803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b579990 0x55723b57be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57c5a0 con 0x55723b579990 2024-05-08T18:10:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b579990 0x55723b57be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe588038350 0x7fe58803a810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800f010 tx=0x7fe6b801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.920+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b579990 0x55723b57be50 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 realm 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57c9b0 con 0x55723b579990 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.927 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57d280 con 0x55723b579990 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57d620 con 0x55723b579990 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57de70 con 0x55723b579990 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 20 searching for the correct realm 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55723b57fbe0 0x55723b581fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723b582510 con 0x55723b57fbe0 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55723b57fbe0 0x55723b581fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55723b57fbe0 0x55723b581fd0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bcf1e640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe6b40cb060 0x7fe6b40f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723b582510 con 0x7fe6b40cb060 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe6b40cb060 0x7fe6b40f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bdf20640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe6b40cb060 0x7fe6b40f4410 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723b582510 con 0x7fe6b40cb060 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723b582510 con 0x55723b579990 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.924+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723b582510 con 0x55723b579990 2024-05-08T18:10:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe6b0045910 0x7fe6b00451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55723b582510 con 0x7fe6b0045910 2024-05-08T18:10:56.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe6b0045910 0x7fe6b00451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe6b0045910 0x7fe6b00451b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b0045910 2024-05-08T18:10:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b40cb060 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b579990 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b40cb060 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b579990 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.928+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b40cb060 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b0045910 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b579990 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b579990 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b0045910 2024-05-08T18:10:56.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b40cb060 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.932+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b579990 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b0045910 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b0045910 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b40cb060 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b57fbe0 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b0045910 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x55723b579990 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fe6b003d040 con 0x7fe6b40cb060 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.936+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57e6c0 con 0x55723b579990 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57ea60 con 0x55723b579990 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57ea60 con 0x55723b579990 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 zone default found 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 4 Realm: () 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 zonegroup default 2024-05-08T18:10:56.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57e2d0 con 0x7fe6b0045910 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b57e300 con 0x55723b57fbe0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b584450 con 0x55723b57fbe0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 started sync module instance, tier type = 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5837c0 con 0x7fe6b40cb060 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93949110270896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b583420 con 0x7fe6b40cb060 2024-05-08T18:10:56.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.940+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b585380 con 0x55723b579990 2024-05-08T18:10:56.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.944+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93949110270896] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.944+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.944+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93949110274224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b585380 con 0x55723b579990 2024-05-08T18:10:56.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.944+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b585d40 con 0x55723b57fbe0 2024-05-08T18:10:56.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93949110278288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b586590 con 0x55723b57fbe0 2024-05-08T18:10:56.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b586f50 con 0x7fe6b40cb060 2024-05-08T18:10:56.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93949110274224] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93949110275792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b586f50 con 0x7fe6b40cb060 2024-05-08T18:10:56.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b587960 con 0x55723b579990 2024-05-08T18:10:56.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93949110278288] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.948+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93949110275792] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93949110285488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b586f50 con 0x55723b579990 2024-05-08T18:10:56.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5878d0 con 0x7fe6b0045910 2024-05-08T18:10:56.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93949110285488] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93949110283184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b587d80 con 0x7fe6b0045910 2024-05-08T18:10:56.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.952+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b588740 con 0x7fe6b0045910 2024-05-08T18:10:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93949110289040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b588ba0 con 0x7fe6b0045910 2024-05-08T18:10:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b589680 con 0x7fe6b0045910 2024-05-08T18:10:56.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93949110283184] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93949110289040] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93949110286544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b589190 con 0x7fe6b0045910 2024-05-08T18:10:56.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=0 2024-05-08T18:10:56.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=1 2024-05-08T18:10:56.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=2 2024-05-08T18:10:56.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=3 2024-05-08T18:10:56.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=4 2024-05-08T18:10:56.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=5 2024-05-08T18:10:56.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.956+0000 7fe6bfc0b980 20 add_watcher() i=6 2024-05-08T18:10:56.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93949110286544] v32'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bfc0b980 20 add_watcher() i=7 2024-05-08T18:10:56.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bfc0b980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:56.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b58c670 con 0x55723b579990 2024-05-08T18:10:56.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93949110292880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b589a90 con 0x55723b579990 2024-05-08T18:10:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93949110292880] v32'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.960+0000 7fe573fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:56.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 5 note: GC not initialized 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe572fe5640 20 reqs_thread_entry: start 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 20 Filter name: none 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe570fe1640 20 reqs_thread_entry: start 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 20 rados->read ofs=0 len=0 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55723b5b0010 con 0x55723b579990 2024-05-08T18:10:56.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:10:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:10:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:56.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.964+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b0045910 2024-05-08T18:10:56.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.968+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call] v32'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.968+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b0045910 2024-05-08T18:10:56.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.968+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(64 usage.10 [call] v32'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe573fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:56.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93949110292880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x55723b579990 2024-05-08T18:10:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93949110292880] v32'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93949110270896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b40cb060 2024-05-08T18:10:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93949110270896] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bfc0b980 20 remove_watcher() i=0 2024-05-08T18:10:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bfc0b980 2 removed watcher, disabling cache 2024-05-08T18:10:56.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.972+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93949110274224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x55723b579990 2024-05-08T18:10:56.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.976+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93949110274224] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.976+0000 7fe6bfc0b980 20 remove_watcher() i=1 2024-05-08T18:10:56.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.976+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93949110278288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x55723b57fbe0 2024-05-08T18:10:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bcf1e640 1 -- 172.21.15.114:0/1161013394 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93949110278288] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b40c8030 con 0x55723b57fbe0 2024-05-08T18:10:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bfc0b980 20 remove_watcher() i=2 2024-05-08T18:10:56.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93949110275792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b40cb060 2024-05-08T18:10:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bdf20640 1 -- 172.21.15.114:0/1161013394 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93949110275792] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b802f040 con 0x7fe6b40cb060 2024-05-08T18:10:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bfc0b980 20 remove_watcher() i=3 2024-05-08T18:10:56.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93949110285488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x55723b579990 2024-05-08T18:10:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93949110285488] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x55723b579990 2024-05-08T18:10:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bfc0b980 20 remove_watcher() i=4 2024-05-08T18:10:56.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.980+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93949110283184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b0045910 2024-05-08T18:10:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.984+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93949110283184] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.984+0000 7fe6bfc0b980 20 remove_watcher() i=5 2024-05-08T18:10:56.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.984+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93949110289040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b0045910 2024-05-08T18:10:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93949110289040] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 20 remove_watcher() i=6 2024-05-08T18:10:56.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93949110286544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55723b5afaf0 con 0x7fe6b0045910 2024-05-08T18:10:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93949110286544] v32'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6b000f030 con 0x7fe6b0045910 2024-05-08T18:10:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 20 remove_watcher() i=7 2024-05-08T18:10:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe6b0045910 msgr2=0x7fe6b00451b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.990 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe6b0045910 0x7fe6b00451b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b579990 msgr2=0x55723b57be50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b579990 0x55723b57be50 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe6b40cb060 msgr2=0x7fe6b40f4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe6b40cb060 0x7fe6b40f4410 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55723b57fbe0 msgr2=0x55723b581fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55723b57fbe0 0x55723b581fd0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe588038350 msgr2=0x7fe58803a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe588038350 0x7fe58803a810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800f010 tx=0x7fe6b801b070 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 msgr2=0x55723b56e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bd71f640 1 -- 172.21.15.114:0/1161013394 reap_dead start 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b56e570 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40b6cf0 tx=0x7fe6b40e9160 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 shutdown_connections 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/1161013394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b566fc0 0x55723b56e570 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 >> 172.21.15.114:0/1161013394 conn(0x55723b563350 msgr2=0x55723b568820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:56.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 shutdown_connections 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/1161013394 wait complete. 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5940383f0 msgr2=0x7fe59403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5940383f0 0x7fe59403a8b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55723b54a2f0 tx=0x7fe6b8003070 comp rx=0 tx=0).stop 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 msgr2=0x55723b55a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 0x55723b55a300 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe6b401b2c0 tx=0x7fe6b4018020 comp rx=0 tx=0).stop 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 shutdown_connections 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5940383f0 0x7fe59403a8b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/905191034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b559ee0 0x55723b55a300 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 >> 172.21.15.114:0/905191034 conn(0x55723b54ecf0 msgr2=0x55723b54f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 shutdown_connections 2024-05-08T18:10:56.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.988+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/905191034 wait complete. 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b4542d0 msgr2=0x55723b549110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b4542d0 0x55723b549110 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5a40383f0 msgr2=0x7fe5a403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5a40383f0 0x7fe5a403a8b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40ad000 tx=0x7fe6b40a5040 comp rx=0 tx=0).stop 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 msgr2=0x55723b5421d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b5421d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00012f0 tx=0x7fe6b0001260 comp rx=0 tx=0).stop 2024-05-08T18:10:56.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 shutdown_connections 2024-05-08T18:10:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55723b4542d0 0x55723b549110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe5a40383f0 0x7fe5a403a8b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 --2- 172.21.15.114:0/2703013745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723b3c47e0 0x55723b5421d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 >> 172.21.15.114:0/2703013745 conn(0x55723b44a690 msgr2=0x55723b5354a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 shutdown_connections 2024-05-08T18:10:56.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:56.992+0000 7fe6bfc0b980 1 -- 172.21.15.114:0/2703013745 wait complete. 2024-05-08T18:10:57.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T18:10:57.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T18:10:57.002 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T18:10:57.078 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:57.078 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:57.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb6714f6980 1 Processor -- start 2024-05-08T18:10:57.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb6714f6980 1 -- start start 2024-05-08T18:10:57.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb6714f6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55dfe06173c0 0x55dfe06197b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb6714f6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dfe04be710 con 0x55dfe0612f00 2024-05-08T18:10:57.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb6714f6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55dfe04d2f00 con 0x55dfe06173c0 2024-05-08T18:10:57.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66f00a640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55dfe0612f00 0x55dfe06132e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51768/0 (socket says 172.21.15.114:51768) 2024-05-08T18:10:57.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66f00a640 1 -- 172.21.15.114:0/1994687938 learned_addr learned my addr 172.21.15.114:0/1994687938 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:57.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66e809640 1 --2- 172.21.15.114:0/1994687938 >> v2:172.21.15.53:3300/0 conn(0x55dfe06173c0 0x55dfe06197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66e008640 1 -- 172.21.15.114:0/1994687938 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626642066 0 0) 0x55dfe04be710 con 0x55dfe0612f00 2024-05-08T18:10:57.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66e008640 1 -- 172.21.15.114:0/1994687938 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb658001e20 con 0x55dfe0612f00 2024-05-08T18:10:57.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66e809640 1 -- 172.21.15.114:0/1994687938 >> v1:172.21.15.53:6789/0 conn(0x55dfe0612f00 legacy=0x55dfe06132e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.080+0000 7fb66e809640 1 -- 172.21.15.114:0/1994687938 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe049aae0 con 0x55dfe06173c0 2024-05-08T18:10:57.082 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb66e809640 1 --2- 172.21.15.114:0/1994687938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe06173c0 0x55dfe06197b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb66400a480 tx=0x7fb66401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985e97b1f2fa574a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb66e008640 1 -- 172.21.15.114:0/1994687938 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640b0070 con 0x55dfe06173c0 2024-05-08T18:10:57.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb66e008640 1 -- 172.21.15.114:0/1994687938 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640ab540 con 0x55dfe06173c0 2024-05-08T18:10:57.083 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb66e008640 1 -- 172.21.15.114:0/1994687938 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640ab840 con 0x55dfe06173c0 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 -- 172.21.15.114:0/1994687938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe06173c0 msgr2=0x55dfe06197b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1994687938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe06173c0 0x55dfe06197b0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb66400a480 tx=0x7fb66401b280 comp rx=0 tx=0).stop 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 -- 172.21.15.114:0/1994687938 shutdown_connections 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1994687938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe06173c0 0x55dfe06197b0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 -- 172.21.15.114:0/1994687938 >> 172.21.15.114:0/1994687938 conn(0x55dfe060e7d0 msgr2=0x55dfe0610bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 -- 172.21.15.114:0/1994687938 shutdown_connections 2024-05-08T18:10:57.084 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.084+0000 7fb6714f6980 1 -- 172.21.15.114:0/1994687938 wait complete. 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 Processor -- start 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 -- start start 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe06fdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfe0516f80 con 0x55dfe0612f00 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb66f00a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe06fdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb66f00a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe06fdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42436/0 (socket says 172.21.15.114:42436) 2024-05-08T18:10:57.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb66f00a640 1 -- 172.21.15.114:0/1630751674 learned_addr learned my addr 172.21.15.114:0/1630751674 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb66f00a640 1 -- 172.21.15.114:0/1630751674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe04deda0 con 0x55dfe0612f00 2024-05-08T18:10:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb66f00a640 1 --2- 172.21.15.114:0/1630751674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe06fdef0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb6680016a0 tx=0x7fb668001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8bad254dfba4eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb55d60a640 1 -- 172.21.15.114:0/1630751674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668004530 con 0x55dfe0612f00 2024-05-08T18:10:57.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb55d60a640 1 -- 172.21.15.114:0/1630751674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6680046d0 con 0x55dfe0612f00 2024-05-08T18:10:57.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb55d60a640 1 -- 172.21.15.114:0/1630751674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6680049f0 con 0x55dfe0612f00 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 -- 172.21.15.114:0/1630751674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 msgr2=0x55dfe06fdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1630751674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe06fdef0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb6680016a0 tx=0x7fb668001b60 comp rx=0 tx=0).stop 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 -- 172.21.15.114:0/1630751674 shutdown_connections 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1630751674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe06fdef0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.100+0000 7fb6714f6980 1 -- 172.21.15.114:0/1630751674 >> 172.21.15.114:0/1630751674 conn(0x55dfe060e7d0 msgr2=0x55dfe06f99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 -- 172.21.15.114:0/1630751674 shutdown_connections 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 -- 172.21.15.114:0/1630751674 wait complete. 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 Processor -- start 2024-05-08T18:10:57.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 -- start start 2024-05-08T18:10:57.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe0705390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfe061c7e0 con 0x55dfe0612f00 2024-05-08T18:10:57.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb66f00a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe0705390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb66f00a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe0705390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42452/0 (socket says 172.21.15.114:42452) 2024-05-08T18:10:57.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb66f00a640 1 -- 172.21.15.114:0/1018734638 learned_addr learned my addr 172.21.15.114:0/1018734638 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb66f00a640 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe07058d0 con 0x55dfe0612f00 2024-05-08T18:10:57.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb66f00a640 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe0705390 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x55dfe06fed80 tx=0x7fb668004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb55be07640 1 -- 172.21.15.114:0/1018734638 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668013760 con 0x55dfe0612f00 2024-05-08T18:10:57.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb55be07640 1 -- 172.21.15.114:0/1018734638 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668013900 con 0x55dfe0612f00 2024-05-08T18:10:57.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dfe0705b60 con 0x55dfe0612f00 2024-05-08T18:10:57.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb55be07640 1 -- 172.21.15.114:0/1018734638 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb668013c00 con 0x55dfe0612f00 2024-05-08T18:10:57.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe07087f0 con 0x55dfe0612f00 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.104+0000 7fb55be07640 1 -- 172.21.15.114:0/1018734638 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb668010070 con 0x55dfe0612f00 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb55be07640 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5540383f0 0x7fb55403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb55be07640 1 -- 172.21.15.114:0/1018734638 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb668018070 con 0x55dfe0612f00 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66e809640 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5540383f0 0x7fb55403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe070a2c0 0x55dfe070c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe070cd20 con 0x55dfe070a2c0 2024-05-08T18:10:57.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe070a2c0 0x55dfe070c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66e809640 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5540383f0 0x7fb55403a8b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ad000 tx=0x7fb6640a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe070a2c0 0x55dfe070c6b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 -- 172.21.15.114:0/1018734638 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6600083f0 con 0x55dfe070a2c0 2024-05-08T18:10:57.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0709a10 con 0x55dfe070a2c0 2024-05-08T18:10:57.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 -- 172.21.15.114:0/1018734638 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6600083f0 con 0x55dfe070a2c0 2024-05-08T18:10:57.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe070ebb0 con 0x55dfe070a2c0 2024-05-08T18:10:57.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 -- 172.21.15.114:0/1018734638 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6600083f0 con 0x55dfe070a2c0 2024-05-08T18:10:57.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe070dd20 con 0x55dfe070a2c0 2024-05-08T18:10:57.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 -- 172.21.15.114:0/1018734638 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6600083f0 con 0x55dfe070a2c0 2024-05-08T18:10:57.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe070e170 con 0x55dfe070a2c0 2024-05-08T18:10:57.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66f80b640 1 -- 172.21.15.114:0/1018734638 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6600083f0 con 0x55dfe070a2c0 2024-05-08T18:10:57.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 Processor -- start 2024-05-08T18:10:57.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- start start 2024-05-08T18:10:57.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 0x55dfe071d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb6714f6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfe051afc0 con 0x55dfe071d4e0 2024-05-08T18:10:57.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66e809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 0x55dfe071d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66e809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 0x55dfe071d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42464/0 (socket says 172.21.15.114:42464) 2024-05-08T18:10:57.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.108+0000 7fb66e809640 1 -- 172.21.15.114:0/1238631302 learned_addr learned my addr 172.21.15.114:0/1238631302 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb66e809640 1 -- 172.21.15.114:0/1238631302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe071de40 con 0x55dfe071d4e0 2024-05-08T18:10:57.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb66e809640 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 0x55dfe071d900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb66400a480 tx=0x7fb664018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb559602640 1 -- 172.21.15.114:0/1238631302 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640c8070 con 0x55dfe071d4e0 2024-05-08T18:10:57.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb559602640 1 -- 172.21.15.114:0/1238631302 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640b1040 con 0x55dfe071d4e0 2024-05-08T18:10:57.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb559602640 1 -- 172.21.15.114:0/1238631302 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640b0050 con 0x55dfe071d4e0 2024-05-08T18:10:57.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dfe071e8e0 con 0x55dfe071d4e0 2024-05-08T18:10:57.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe071ed50 con 0x55dfe071d4e0 2024-05-08T18:10:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb559602640 1 -- 172.21.15.114:0/1238631302 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb6640cb070 con 0x55dfe071d4e0 2024-05-08T18:10:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb559602640 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb548038440 0x7fb54803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb559602640 1 -- 172.21.15.114:0/1238631302 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb6640c0070 con 0x55dfe071d4e0 2024-05-08T18:10:57.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb66f80b640 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb548038440 0x7fb54803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb6714f6980 1 Processor -- start 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb6714f6980 1 -- start start 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb66f80b640 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb548038440 0x7fb54803a900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb66000e3f0 tx=0x7fb660003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb6714f6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe05898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.112+0000 7fb6714f6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfe06fe640 con 0x55dfe0589490 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe05898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe05898b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42466/0 (socket says 172.21.15.114:42466) 2024-05-08T18:10:57.115 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 -- 172.21.15.114:0/966558766 learned_addr learned my addr 172.21.15.114:0/966558766 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 -- 172.21.15.114:0/966558766 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe0587ce0 con 0x55dfe0589490 2024-05-08T18:10:57.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 --2- 172.21.15.114:0/966558766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe05898b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb664005af0 tx=0x7fb6640b5ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606590c2d6710ad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb552ffd640 1 -- 172.21.15.114:0/966558766 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640df070 con 0x55dfe0589490 2024-05-08T18:10:57.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb552ffd640 1 -- 172.21.15.114:0/966558766 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640ea040 con 0x55dfe0589490 2024-05-08T18:10:57.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb552ffd640 1 -- 172.21.15.114:0/966558766 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640b5380 con 0x55dfe0589490 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- 172.21.15.114:0/966558766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 msgr2=0x55dfe05898b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 --2- 172.21.15.114:0/966558766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe05898b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb664005af0 tx=0x7fb6640b5ad0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- 172.21.15.114:0/966558766 shutdown_connections 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 --2- 172.21.15.114:0/966558766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe05898b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- 172.21.15.114:0/966558766 >> 172.21.15.114:0/966558766 conn(0x55dfe07268e0 msgr2=0x55dfe0724940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- 172.21.15.114:0/966558766 shutdown_connections 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- 172.21.15.114:0/966558766 wait complete. 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 Processor -- start 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- start start 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe0733d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb6714f6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55dfe0588180 con 0x55dfe0589490 2024-05-08T18:10:57.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe0733d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe0733d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42480/0 (socket says 172.21.15.114:42480) 2024-05-08T18:10:57.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 learned_addr learned my addr 172.21.15.114:0/2106669737 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.116+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfe0734240 con 0x55dfe0589490 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66e809640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe0733d00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ab800 tx=0x7fb6640e8fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb5517fa640 1 -- 172.21.15.114:0/2106669737 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640e8020 con 0x55dfe0589490 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dfe07344d0 con 0x55dfe0589490 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb5517fa640 1 -- 172.21.15.114:0/2106669737 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6640e0040 con 0x55dfe0589490 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb5517fa640 1 -- 172.21.15.114:0/2106669737 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6640df050 con 0x55dfe0589490 2024-05-08T18:10:57.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfe07348e0 con 0x55dfe0589490 2024-05-08T18:10:57.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb5517fa640 1 -- 172.21.15.114:0/2106669737 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb6640f1060 con 0x55dfe0589490 2024-05-08T18:10:57.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb5517fa640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5380383f0 0x7fb53803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb5517fa640 1 -- 172.21.15.114:0/2106669737 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb6640a8070 con 0x55dfe0589490 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f80b640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5380383f0 0x7fb53803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe073f170 0x55dfe0741630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0741d80 con 0x55dfe073f170 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f00a640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe073f170 0x55dfe0741630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f80b640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5380383f0 0x7fb53803a8b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55dfe070d840 tx=0x7fb66001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f00a640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe073f170 0x55dfe0741630 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 realm 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0742190 con 0x55dfe073f170 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0742a60 con 0x55dfe073f170 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.120+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0742e00 con 0x55dfe073f170 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 20 searching for the correct realm 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55dfe07451d0 0x55dfe07475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0747c40 con 0x55dfe07451d0 2024-05-08T18:10:57.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66e809640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55dfe07451d0 0x55dfe07475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66e809640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55dfe07451d0 0x55dfe07475c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66e809640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb6640cd060 0x7fb6640e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0747c40 con 0x7fb6640cd060 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f80b640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb6640cd060 0x7fb6640e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f80b640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb6640cd060 0x7fb6640e5a40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0747c40 con 0x7fb6640cd060 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0747c40 con 0x55dfe073f170 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb6680283d0 0x7fb668029470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.124+0000 7fb66f00a640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb6680283d0 0x7fb668029470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb6680283d0 0x7fb668029470 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6640cd060 2024-05-08T18:10:57.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6640cd060 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6640cd060 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.128+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6640cd060 2024-05-08T18:10:57.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.132+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6640cd060 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe07451d0 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6680283d0 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x55dfe073f170 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743260 con 0x7fb6640cd060 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743b40 con 0x55dfe073f170 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743ee0 con 0x55dfe073f170 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.136+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0743ee0 con 0x55dfe073f170 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 zone default found 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 4 Realm: () 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:57.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 zonegroup default 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0744300 con 0x7fb6680283d0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0744720 con 0x55dfe07451d0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0749a80 con 0x55dfe07451d0 2024-05-08T18:10:57.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 started sync module instance, tier type = 2024-05-08T18:10:57.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0748f20 con 0x7fb6640cd060 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94420031804224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074a320 con 0x7fb6640cd060 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.140+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074ab70 con 0x55dfe073f170 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.144+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94420031804224] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.144+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.144+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94420031807088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074a780 con 0x55dfe073f170 2024-05-08T18:10:57.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.144+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074b260 con 0x55dfe07451d0 2024-05-08T18:10:57.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.144+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.144+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94420031810928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074bb30 con 0x55dfe07451d0 2024-05-08T18:10:57.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074c550 con 0x7fb6640cd060 2024-05-08T18:10:57.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94420031807088] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94420031815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074c970 con 0x7fb6640cd060 2024-05-08T18:10:57.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074d330 con 0x55dfe073f170 2024-05-08T18:10:57.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94420031810928] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94420031815744] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.148+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.152+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94420031808144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074ce80 con 0x55dfe073f170 2024-05-08T18:10:57.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.152+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074d710 con 0x7fb6680283d0 2024-05-08T18:10:57.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.152+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94420031808144] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.152+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.152+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94420031813248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074d330 con 0x7fb6680283d0 2024-05-08T18:10:57.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.152+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074e150 con 0x7fb6680283d0 2024-05-08T18:10:57.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94420031823008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074e570 con 0x7fb6680283d0 2024-05-08T18:10:57.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074efc0 con 0x7fb6680283d0 2024-05-08T18:10:57.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94420031813248] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94420031823008] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94420031826608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074e0c0 con 0x7fb6680283d0 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=0 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=1 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=2 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=3 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=4 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=5 2024-05-08T18:10:57.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.156+0000 7fb6714f6980 20 add_watcher() i=6 2024-05-08T18:10:57.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94420031826608] v32'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 20 add_watcher() i=7 2024-05-08T18:10:57.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:57.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe07520c0 con 0x55dfe073f170 2024-05-08T18:10:57.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94420031819392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074f540 con 0x55dfe073f170 2024-05-08T18:10:57.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94420031819392] v32'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 5 note: GC not initialized 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb524fe1640 20 reqs_thread_entry: start 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.160+0000 7fb6714f6980 20 Filter name: none 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb49e7fc640 20 reqs_thread_entry: start 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb6714f6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe07753d0 con 0x55dfe073f170 2024-05-08T18:10:57.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb6714f6980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:57.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0776920 con 0x7fb6680283d0 2024-05-08T18:10:57.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb525fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:57.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94420031819392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0774df0 con 0x55dfe073f170 2024-05-08T18:10:57.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94420031819392] v32'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.164+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94420031804224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074ce80 con 0x7fb6640cd060 2024-05-08T18:10:57.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94420031804224] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb6714f6980 20 remove_watcher() i=0 2024-05-08T18:10:57.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb6714f6980 2 removed watcher, disabling cache 2024-05-08T18:10:57.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94420031807088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074ce80 con 0x55dfe073f170 2024-05-08T18:10:57.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94420031807088] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb6714f6980 20 remove_watcher() i=1 2024-05-08T18:10:57.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.168+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94420031810928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074ce80 con 0x55dfe07451d0 2024-05-08T18:10:57.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.172+0000 7fb66e809640 1 -- 172.21.15.114:0/2106669737 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94420031810928] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6640e2070 con 0x55dfe07451d0 2024-05-08T18:10:57.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.172+0000 7fb6714f6980 20 remove_watcher() i=2 2024-05-08T18:10:57.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.172+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94420031815744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0749e70 con 0x7fb6640cd060 2024-05-08T18:10:57.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.172+0000 7fb66f80b640 1 -- 172.21.15.114:0/2106669737 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94420031815744] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66002f040 con 0x7fb6640cd060 2024-05-08T18:10:57.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.172+0000 7fb6714f6980 20 remove_watcher() i=3 2024-05-08T18:10:57.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.172+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94420031808144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe0749e70 con 0x55dfe073f170 2024-05-08T18:10:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.176+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94420031808144] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x55dfe073f170 2024-05-08T18:10:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.176+0000 7fb6714f6980 20 remove_watcher() i=4 2024-05-08T18:10:57.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.176+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94420031813248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074c040 con 0x7fb6680283d0 2024-05-08T18:10:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.176+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94420031813248] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.176+0000 7fb6714f6980 20 remove_watcher() i=5 2024-05-08T18:10:57.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.176+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94420031823008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074c040 con 0x7fb6680283d0 2024-05-08T18:10:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94420031823008] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 20 remove_watcher() i=6 2024-05-08T18:10:57.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94420031826608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dfe074c040 con 0x7fb6680283d0 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94420031826608] v32'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb66801b030 con 0x7fb6680283d0 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 20 remove_watcher() i=7 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb6680283d0 msgr2=0x7fb668029470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fb6680283d0 0x7fb668029470 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe073f170 msgr2=0x55dfe0741630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe073f170 0x55dfe0741630 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb6640cd060 msgr2=0x7fb6640e5a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fb6640cd060 0x7fb6640e5a40 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55dfe07451d0 msgr2=0x55dfe07475c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55dfe07451d0 0x55dfe07475c0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5380383f0 msgr2=0x7fb53803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5380383f0 0x7fb53803a8b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55dfe070d840 tx=0x7fb66001b070 comp rx=0 tx=0).stop 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 msgr2=0x55dfe0733d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb66f00a640 1 -- 172.21.15.114:0/2106669737 reap_dead start 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe0733d00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ab800 tx=0x7fb6640e8fd0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 shutdown_connections 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 --2- 172.21.15.114:0/2106669737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0589490 0x55dfe0733d00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 >> 172.21.15.114:0/2106669737 conn(0x55dfe07268e0 msgr2=0x55dfe0723f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 shutdown_connections 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.180+0000 7fb6714f6980 1 -- 172.21.15.114:0/2106669737 wait complete. 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb548038440 msgr2=0x7fb54803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb548038440 0x7fb54803a900 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb66000e3f0 tx=0x7fb660003070 comp rx=0 tx=0).stop 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 msgr2=0x55dfe071d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 0x55dfe071d900 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb66400a480 tx=0x7fb664018020 comp rx=0 tx=0).stop 2024-05-08T18:10:57.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 shutdown_connections 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb548038440 0x7fb54803a900 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1238631302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe071d4e0 0x55dfe071d900 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 >> 172.21.15.114:0/1238631302 conn(0x55dfe07122f0 msgr2=0x55dfe0712e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 shutdown_connections 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1238631302 wait complete. 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe070a2c0 msgr2=0x55dfe070c6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe070a2c0 0x55dfe070c6b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5540383f0 msgr2=0x7fb55403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5540383f0 0x7fb55403a8b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb6640ad000 tx=0x7fb6640a5040 comp rx=0 tx=0).stop 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 msgr2=0x55dfe0705390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe0705390 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x55dfe06fed80 tx=0x7fb668004470 comp rx=0 tx=0).stop 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 shutdown_connections 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55dfe070a2c0 0x55dfe070c6b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb5540383f0 0x7fb55403a8b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 --2- 172.21.15.114:0/1018734638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dfe0612f00 0x55dfe0705390 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 >> 172.21.15.114:0/1018734638 conn(0x55dfe060e7d0 msgr2=0x55dfe06f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 shutdown_connections 2024-05-08T18:10:57.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.184+0000 7fb6714f6980 1 -- 172.21.15.114:0/1018734638 wait complete. 2024-05-08T18:10:57.194 INFO:teuthology.orchestra.run.smithi114.stdout:{"entries":[],"summary":[]} 2024-05-08T18:10:57.195 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T18:10:57.195 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T18:10:57.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T18:10:57.195 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-08T18:10:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:57.278 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f9fa8980 1 Processor -- start 2024-05-08T18:10:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f9fa8980 1 -- start start 2024-05-08T18:10:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f9fa8980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564fdb151100 0x564fdb1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f9fa8980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564fdaffa710 con 0x564fdb151a20 2024-05-08T18:10:57.279 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f9fa8980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x564fdb00ef00 con 0x564fdb151100 2024-05-08T18:10:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f7abc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564fdb151100 0x564fdb1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f72bb640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564fdb151a20 0x564fdb152390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51782/0 (socket says 172.21.15.114:51782) 2024-05-08T18:10:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f7abc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564fdb151100 0x564fdb1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42496/0 (socket says 172.21.15.114:42496) 2024-05-08T18:10:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f72bb640 1 -- 172.21.15.114:0/1303062840 learned_addr learned my addr 172.21.15.114:0/1303062840 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f7abc640 1 -- 172.21.15.114:0/1303062840 >> v1:172.21.15.53:6789/0 conn(0x564fdb151a20 legacy=0x564fdb152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.280 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.280+0000 7fc3f7abc640 1 -- 172.21.15.114:0/1303062840 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fdafd6ae0 con 0x564fdb151100 2024-05-08T18:10:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/1303062840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb1514e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000a420 tx=0x7fc3f001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1eaebd484cdf32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f6aba640 1 -- 172.21.15.114:0/1303062840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f00af070 con 0x564fdb151100 2024-05-08T18:10:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f6aba640 1 -- 172.21.15.114:0/1303062840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f00aa530 con 0x564fdb151100 2024-05-08T18:10:57.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f6aba640 1 -- 172.21.15.114:0/1303062840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f00aa850 con 0x564fdb151100 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/1303062840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 msgr2=0x564fdb1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/1303062840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb1514e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000a420 tx=0x7fc3f001afd0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/1303062840 shutdown_connections 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/1303062840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb1514e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/1303062840 >> 172.21.15.114:0/1303062840 conn(0x564fdb0c47e0 msgr2=0x564fdb0c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/1303062840 shutdown_connections 2024-05-08T18:10:57.284 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.284+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/1303062840 wait complete. 2024-05-08T18:10:57.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 Processor -- start 2024-05-08T18:10:57.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- start start 2024-05-08T18:10:57.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb23c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fdb052f80 con 0x564fdb151100 2024-05-08T18:10:57.300 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f7abc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb23c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f7abc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb23c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42498/0 (socket says 172.21.15.114:42498) 2024-05-08T18:10:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f7abc640 1 -- 172.21.15.114:0/3322939732 learned_addr learned my addr 172.21.15.114:0/3322939732 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f7abc640 1 -- 172.21.15.114:0/3322939732 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fdb01ada0 con 0x564fdb151100 2024-05-08T18:10:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/3322939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb23c8e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00ad040 tx=0x7fc3f00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47ae8e810b8d161 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.301 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc2e5e0b640 1 -- 172.21.15.114:0/3322939732 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f00af050 con 0x564fdb151100 2024-05-08T18:10:57.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc2e5e0b640 1 -- 172.21.15.114:0/3322939732 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f00b0040 con 0x564fdb151100 2024-05-08T18:10:57.302 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc2e5e0b640 1 -- 172.21.15.114:0/3322939732 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f00aaca0 con 0x564fdb151100 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3322939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 msgr2=0x564fdb23c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3322939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb23c8e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00ad040 tx=0x7fc3f00033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3322939732 shutdown_connections 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3322939732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb23c8e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3322939732 >> 172.21.15.114:0/3322939732 conn(0x564fdb0c47e0 msgr2=0x564fdb238470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3322939732 shutdown_connections 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.300+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3322939732 wait complete. 2024-05-08T18:10:57.303 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f9fa8980 1 Processor -- start 2024-05-08T18:10:57.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f9fa8980 1 -- start start 2024-05-08T18:10:57.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f9fa8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb243cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.304 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f9fa8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fdb15b100 con 0x564fdb151100 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f7abc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb243cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f7abc640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb243cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42504/0 (socket says 172.21.15.114:42504) 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f7abc640 1 -- 172.21.15.114:0/3742746625 learned_addr learned my addr 172.21.15.114:0/3742746625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f7abc640 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fdb244200 con 0x564fdb151100 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb243cc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00b8040 tx=0x7fc3f0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc2dffff640 1 -- 172.21.15.114:0/3742746625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f00c5070 con 0x564fdb151100 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fdb244490 con 0x564fdb151100 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc2dffff640 1 -- 172.21.15.114:0/3742746625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f00b6d40 con 0x564fdb151100 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc2dffff640 1 -- 172.21.15.114:0/3742746625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f00c15f0 con 0x564fdb151100 2024-05-08T18:10:57.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fdb247120 con 0x564fdb151100 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc2dffff640 1 -- 172.21.15.114:0/3742746625 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc3f00c8070 con 0x564fdb151100 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc2dffff640 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2e0038440 0x7fc2e003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.304+0000 7fc2dffff640 1 -- 172.21.15.114:0/3742746625 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc3f00bb070 con 0x564fdb151100 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2e0038440 0x7fc2e003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb151a20 0x564fdb24ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb24b220 con 0x564fdb151a20 2024-05-08T18:10:57.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb151a20 0x564fdb24ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2e0038440 0x7fc2e003a900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0001d80 tx=0x7fc3e00012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb151a20 0x564fdb24ac00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 -- 172.21.15.114:0/3742746625 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3e80083f0 con 0x564fdb151a20 2024-05-08T18:10:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb24bb30 con 0x564fdb151a20 2024-05-08T18:10:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 -- 172.21.15.114:0/3742746625 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3e80083f0 con 0x564fdb151a20 2024-05-08T18:10:57.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb24cee0 con 0x564fdb151a20 2024-05-08T18:10:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 -- 172.21.15.114:0/3742746625 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc3e80083f0 con 0x564fdb151a20 2024-05-08T18:10:57.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb24c380 con 0x564fdb151a20 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 -- 172.21.15.114:0/3742746625 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3e80083f0 con 0x564fdb151a20 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb24c7a0 con 0x564fdb151a20 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f82bd640 1 -- 172.21.15.114:0/3742746625 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc3e80083f0 con 0x564fdb151a20 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 Processor -- start 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- start start 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 0x564fdb25be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f9fa8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fdb056fc0 con 0x564fdb25ba30 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f72bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 0x564fdb25be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f72bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 0x564fdb25be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42512/0 (socket says 172.21.15.114:42512) 2024-05-08T18:10:57.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f72bb640 1 -- 172.21.15.114:0/396922188 learned_addr learned my addr 172.21.15.114:0/396922188 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.308+0000 7fc3f72bb640 1 -- 172.21.15.114:0/396922188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fdb25c390 con 0x564fdb25ba30 2024-05-08T18:10:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 0x564fdb25be50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000d660 tx=0x7fc3e000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc2dd7fa640 1 -- 172.21.15.114:0/396922188 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e000c6b0 con 0x564fdb25ba30 2024-05-08T18:10:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc2dd7fa640 1 -- 172.21.15.114:0/396922188 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e000c850 con 0x564fdb25ba30 2024-05-08T18:10:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc2dd7fa640 1 -- 172.21.15.114:0/396922188 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e000cb30 con 0x564fdb25ba30 2024-05-08T18:10:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fdb25ce30 con 0x564fdb25ba30 2024-05-08T18:10:57.312 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fdb25d300 con 0x564fdb25ba30 2024-05-08T18:10:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc2dd7fa640 1 -- 172.21.15.114:0/396922188 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc3e0023020 con 0x564fdb25ba30 2024-05-08T18:10:57.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc2dd7fa640 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2d0038440 0x7fc2d003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc2dd7fa640 1 -- 172.21.15.114:0/396922188 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc3e0021020 con 0x564fdb25ba30 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2d0038440 0x7fc2d003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f9fa8980 1 Processor -- start 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f9fa8980 1 -- start start 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2d0038440 0x7fc2d003a900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x564fdb24c720 tx=0x7fc3e8003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f9fa8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb269090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f9fa8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fdb23cf70 con 0x564fdb268c70 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f72bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb269090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f72bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb269090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42528/0 (socket says 172.21.15.114:42528) 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f72bb640 1 -- 172.21.15.114:0/2612340034 learned_addr learned my addr 172.21.15.114:0/2612340034 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.312+0000 7fc3f72bb640 1 -- 172.21.15.114:0/2612340034 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fdb269660 con 0x564fdb268c70 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/2612340034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb269090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc3e004f230 tx=0x7fc3e00193e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc99d0763a25b467 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2612340034 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e0043020 con 0x564fdb268c70 2024-05-08T18:10:57.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2612340034 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e000ccd0 con 0x564fdb268c70 2024-05-08T18:10:57.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/2612340034 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e001bcc0 con 0x564fdb268c70 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/2612340034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 msgr2=0x564fdb269090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/2612340034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb269090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc3e004f230 tx=0x7fc3e00193e0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/2612340034 shutdown_connections 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/2612340034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb269090 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/2612340034 >> 172.21.15.114:0/2612340034 conn(0x564fdb265000 msgr2=0x564fdb263060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/2612340034 shutdown_connections 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/2612340034 wait complete. 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 Processor -- start 2024-05-08T18:10:57.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- start start 2024-05-08T18:10:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb2701d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564fdb269db0 con 0x564fdb268c70 2024-05-08T18:10:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f72bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb2701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f72bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb2701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42532/0 (socket says 172.21.15.114:42532) 2024-05-08T18:10:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 learned_addr learned my addr 172.21.15.114:0/13508087 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fdb270710 con 0x564fdb268c70 2024-05-08T18:10:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb2701d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0023850 tx=0x7fc3e004f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc2d57fa640 1 -- 172.21.15.114:0/13508087 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e0032020 con 0x564fdb268c70 2024-05-08T18:10:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564fdb2709a0 con 0x564fdb268c70 2024-05-08T18:10:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fdb2709a0 con 0x564fdb268c70 2024-05-08T18:10:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc2d57fa640 1 -- 172.21.15.114:0/13508087 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e004f400 con 0x564fdb268c70 2024-05-08T18:10:57.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.316+0000 7fc2d57fa640 1 -- 172.21.15.114:0/13508087 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3e001b420 con 0x564fdb268c70 2024-05-08T18:10:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc2d57fa640 1 -- 172.21.15.114:0/13508087 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc3e0035020 con 0x564fdb268c70 2024-05-08T18:10:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc2d57fa640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2c00383a0 0x7fc2c003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc2d57fa640 1 -- 172.21.15.114:0/13508087 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc3e0005030 con 0x564fdb268c70 2024-05-08T18:10:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2c00383a0 0x7fc2c003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb27b4e0 0x564fdb27d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb27e0f0 con 0x564fdb27b4e0 2024-05-08T18:10:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb27b4e0 0x564fdb27d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2c00383a0 0x7fc2c003a860 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800f010 tx=0x7fc3e801b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb27b4e0 0x564fdb27d9a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 realm 2024-05-08T18:10:57.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb27e500 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb27eda0 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb27f140 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb27f990 con 0x564fdb27b4e0 2024-05-08T18:10:57.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 20 searching for the correct realm 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564fdb281700 0x564fdb283af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564fdb281700 0x564fdb283af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.320+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564fdb281700 0x564fdb283af0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f72bb640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc3e0037020 0x7fc3e00499b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc3e0037020 0x7fc3e00499b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f82bd640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc3e0037020 0x7fc3e00499b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc3f00ca070 0x7fc3f00c0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc3f00ca070 0x7fc3f00c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc3f00ca070 0x7fc3f00c0950 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x7fc3f00ca070 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x7fc3f00ca070 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.324+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x7fc3f00ca070 2024-05-08T18:10:57.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.328+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00d1070 con 0x7fc3f00ca070 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc3f00d1070 con 0x564fdb27b4e0 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.332+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb281700 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3f00ca070 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x564fdb27b4e0 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284030 con 0x7fc3e0037020 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:57.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2802e0 con 0x564fdb27b4e0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb280b30 con 0x564fdb27b4e0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb280b30 con 0x564fdb27b4e0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 zone default found 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 4 Realm: () 2024-05-08T18:10:57.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 zonegroup default 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb284460 con 0x7fc3f00ca070 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb285e40 con 0x564fdb281700 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2862a0 con 0x564fdb281700 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 started sync module instance, tier type = 2024-05-08T18:10:57.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:57.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.336+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2852e0 con 0x7fc3e0037020 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94900979259088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb286bb0 con 0x7fc3e0037020 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb287400 con 0x564fdb27b4e0 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94900979259088] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94900979263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb286fd0 con 0x564fdb27b4e0 2024-05-08T18:10:57.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.340+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb287af0 con 0x564fdb281700 2024-05-08T18:10:57.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94900979263232] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94900979264288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb286f40 con 0x564fdb281700 2024-05-08T18:10:57.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb288860 con 0x7fc3e0037020 2024-05-08T18:10:57.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94900979270544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb289100 con 0x7fc3e0037020 2024-05-08T18:10:57.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb289b00 con 0x564fdb27b4e0 2024-05-08T18:10:57.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.344+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94900979264288] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94900979270544] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94900979269344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb288c50 con 0x564fdb27b4e0 2024-05-08T18:10:57.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28a3a0 con 0x7fc3f00ca070 2024-05-08T18:10:57.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94900979269344] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94900979275280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb288c50 con 0x7fc3f00ca070 2024-05-08T18:10:57.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.348+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28a8f0 con 0x7fc3f00ca070 2024-05-08T18:10:57.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.352+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.352+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94900979278784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28ad60 con 0x7fc3f00ca070 2024-05-08T18:10:57.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.352+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28b820 con 0x7fc3f00ca070 2024-05-08T18:10:57.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.352+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94900979275280] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.352+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94900979278784] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94900979282672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28a8b0 con 0x7fc3f00ca070 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=0 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=1 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=2 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=3 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=4 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=5 2024-05-08T18:10:57.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=6 2024-05-08T18:10:57.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94900979282672] v32'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 20 add_watcher() i=7 2024-05-08T18:10:57.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:57.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28e920 con 0x564fdb27b4e0 2024-05-08T18:10:57.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94900979277040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb28bda0 con 0x564fdb27b4e0 2024-05-08T18:10:57.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94900979277040] v32'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.356+0000 7fc2ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:57.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.360+0000 7fc3f9fa8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:57.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.360+0000 7fc3f9fa8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:57.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.360+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb297140 con 0x564fdb27b4e0 2024-05-08T18:10:57.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.360+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.360+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb297810 con 0x7fc3f00ca070 2024-05-08T18:10:57.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.364+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.364+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2972d0 con 0x564fdb281700 2024-05-08T18:10:57.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.364+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.364+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb297bf0 con 0x564fdb27b4e0 2024-05-08T18:10:57.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.364+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'233 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.364+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb297c40 con 0x7fc3e0037020 2024-05-08T18:10:57.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.368+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'77 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.368+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2982c0 con 0x564fdb281700 2024-05-08T18:10:57.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.368+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.368+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2983c0 con 0x564fdb27b4e0 2024-05-08T18:10:57.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.368+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.368+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298870 con 0x7fc3f00ca070 2024-05-08T18:10:57.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.372+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.372+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298870 con 0x7fc3e0037020 2024-05-08T18:10:57.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.376+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.376+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298d20 con 0x564fdb281700 2024-05-08T18:10:57.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.376+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.376+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298d20 con 0x7fc3e0037020 2024-05-08T18:10:57.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.376+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'78 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.376+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298db0 con 0x7fc3f00ca070 2024-05-08T18:10:57.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.380+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.380+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298db0 con 0x7fc3e0037020 2024-05-08T18:10:57.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.380+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.381 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.380+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298e40 con 0x7fc3f00ca070 2024-05-08T18:10:57.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.384+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.384+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298e40 con 0x564fdb27b4e0 2024-05-08T18:10:57.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.384+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'234 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.384+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298e40 con 0x564fdb281700 2024-05-08T18:10:57.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.388+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'69 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.388+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298ed0 con 0x7fc3e0037020 2024-05-08T18:10:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.388+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.388+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x564fdb281700 2024-05-08T18:10:57.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.392+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.392+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x564fdb27b4e0 2024-05-08T18:10:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.392+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.392+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x564fdb27b4e0 2024-05-08T18:10:57.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.392+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'235 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.392+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f90 con 0x564fdb281700 2024-05-08T18:10:57.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.396+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'70 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.396+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f90 con 0x7fc3e0037020 2024-05-08T18:10:57.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.396+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.396+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298ff0 con 0x564fdb281700 2024-05-08T18:10:57.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.400+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.400 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.400+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298ff0 con 0x564fdb281700 2024-05-08T18:10:57.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.400+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.400+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298ff0 con 0x564fdb281700 2024-05-08T18:10:57.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.400+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.402 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.400+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x564fdb281700 2024-05-08T18:10:57.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.404+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.404 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.404+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x7fc3f00ca070 2024-05-08T18:10:57.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.404+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.408+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x564fdb281700 2024-05-08T18:10:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.408+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.408+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x7fc3f00ca070 2024-05-08T18:10:57.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.408+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.410 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.408+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x564fdb281700 2024-05-08T18:10:57.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.412+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'71 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.412+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x7fc3f00ca070 2024-05-08T18:10:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb298f60 con 0x7fc3e0037020 2024-05-08T18:10:57.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc2ad7e2640 20 reqs_thread_entry: start 2024-05-08T18:10:57.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f9fa8980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:57.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f9fa8980 20 Filter name: none 2024-05-08T18:10:57.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc2a67fc640 20 reqs_thread_entry: start 2024-05-08T18:10:57.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f9fa8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T18:10:57.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.419 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.416+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b4830 con 0x564fdb27b4e0 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b6d00 con 0x7fc3e0037020 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 : miss 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:96 8.10 8:0cc5c656:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b70f0 con 0x564fdb281700 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(96 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 info.flags=0x17 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 to cache LRU end 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 2024-05-08T18:10:57.421 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:97 4.37 4:ec6b564d:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb334440 con 0x7fc3f00ca070 2024-05-08T18:10:57.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(97 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 4.16 4:6892e278:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb334440 con 0x564fdb281700 2024-05-08T18:10:57.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(98 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:99 4.34 4:2e3a9bbb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb334480 con 0x7fc3e0037020 2024-05-08T18:10:57.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(99 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 4.0 4:01b26cfd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb334480 con 0x564fdb281700 2024-05-08T18:10:57.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(100 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.420+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:101 4.22 4:44157a4e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb334480 con 0x564fdb27b4e0 2024-05-08T18:10:57.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(101 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 [call out=425b] v0'0 uv3 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T18:10:57.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 4.16 4:6960ca11:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3344b0 con 0x564fdb281700 2024-05-08T18:10:57.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(102 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.424 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:103 4.4 4:22375e88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3344b0 con 0x7fc3f00ca070 2024-05-08T18:10:57.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(103 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:104 4.14 4:2b4adbf5:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3344b0 con 0x564fdb281700 2024-05-08T18:10:57.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(104 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:105 4.1c 4:382c76b8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3344b0 con 0x7fc3f00ca070 2024-05-08T18:10:57.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(105 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:106 4.b 4:d0c3e424:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3344b0 con 0x7fc3e0037020 2024-05-08T18:10:57.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(106 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:107 4.16 4:684f5bf1:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3344b0 con 0x564fdb281700 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(107 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 20 get_obj_state: octx=0x564fdb295890 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564fdb3324c8 s->prefetch_data=0 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.424+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:108 3.2es0 3:775a1b56:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb3332f0 con 0x7fc3e0037020 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(108 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 10 manifest: total_size = 6 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 20 get_obj_state: setting s->obj_tag to e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.2867537664634885949 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 20 get_obj_state: octx=0x564fdb295890 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564fdb3324c8 s->prefetch_data=0 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 20 prepare_atomic_modification: state is not atomic. state=0x564fdb3324c8 2024-05-08T18:10:57.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 20 bucket index object: :.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 2024-05-08T18:10:57.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:109 4.22 4:44157a4e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb333cd0 con 0x564fdb27b4e0 2024-05-08T18:10:57.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(109 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 [stat,call,call] v32'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.428+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:110 3.2es0 3:775a1b56:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb333cd0 con 0x7fc3e0037020 2024-05-08T18:10:57.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(110 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:111 4.22 4:44157a4e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2bbb30 con 0x564fdb27b4e0 2024-05-08T18:10:57.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 20 list_objects_ordered: starting attempt 1 2024-05-08T18:10:57.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T18:10:57.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:112 4.37 4:ec6b564d:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2bbb30 con 0x7fc3f00ca070 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:113 4.16 4:6892e278:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2c0e40 con 0x564fdb281700 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:114 4.34 4:2e3a9bbb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2c3720 con 0x7fc3e0037020 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:115 4.0 4:01b26cfd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2bbb30 con 0x564fdb281700 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:116 4.22 4:44157a4e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2c0e40 con 0x564fdb27b4e0 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:117 4.16 4:6960ca11:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x564fdb281700 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:118 4.4 4:22375e88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cdb30 con 0x7fc3f00ca070 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:119 4.14 4:2b4adbf5:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d0630 con 0x564fdb281700 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:120 4.1c 4:382c76b8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3320 con 0x7fc3f00ca070 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:121 4.b 4:d0c3e424:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d61a0 con 0x7fc3e0037020 2024-05-08T18:10:57.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:122 4.16 4:684f5bf1:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d8fd0 con 0x564fdb281700 2024-05-08T18:10:57.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(113 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(115 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(119 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(117 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(112 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(122 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(114 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(121 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(118 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(120 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(111 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 [stat,call,call] v32'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc2d6ffd640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(116 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7])"; uploads.size()=0; is_truncated=0 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:123 4.37 4:ec6b564d:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3f00ca070 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:124 4.16 4:6892e278:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d8f50 con 0x564fdb281700 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:125 4.34 4:2e3a9bbb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3e0037020 2024-05-08T18:10:57.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:126 4.0 4:01b26cfd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cdb30 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:127 4.22 4:44157a4e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d5a10 con 0x564fdb27b4e0 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:128 4.16 4:6960ca11:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:129 4.4 4:22375e88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d8f50 con 0x7fc3f00ca070 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:130 4.14 4:2b4adbf5:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cdb30 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:131 4.1c 4:382c76b8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3f00ca070 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:132 4.b 4:d0c3e424:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d8f50 con 0x7fc3e0037020 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:133 4.16 4:684f5bf1:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cd6c0 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(127 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(124 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(125 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(130 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(126 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== osd_op_reply(128 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== osd_op_reply(132 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(123 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(133 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.432+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(131 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(129 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3e0037020 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3e0037020 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T18:10:57.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.436+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3e0037020 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(136 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f9fa8980 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f9fa8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94900979601104 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2cad00 con 0x7fc3f00ca070 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== watch-notify(notify (1) cookie 94900979278784 notify 137438953500 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564fdb296cc0 con 0x7fc3f00ca070 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(137 notify.6 [notify cookie 94900979601104 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc2d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94900979278784 notifier 4779 bl.length()=149 2024-05-08T18:10:57.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2bc003d70 con 0x7fc3f00ca070 2024-05-08T18:10:57.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== watch-notify(notify_complete (2) cookie 94900979601104 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fdb295910 con 0x7fc3f00ca070 2024-05-08T18:10:57.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.440+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:139 8.10 8:0cc5c656:root::.bucket.meta.myfoo%3ae99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d7030 con 0x564fdb281700 2024-05-08T18:10:57.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(139 .bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 [call,call,delete] v32'2 uv2 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 from cache 2024-05-08T18:10:57.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7, ofs0, ns] 2024-05-08T18:10:57.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94900979575856 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d6020 con 0x7fc3e0037020 2024-05-08T18:10:57.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== watch-notify(notify (1) cookie 94900979259088 notify 137438953516 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564fdb297c90 con 0x7fc3e0037020 2024-05-08T18:10:57.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc2d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953516 cookie 94900979259088 notifier 4779 bl.length()=206 2024-05-08T18:10:57.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(140 notify.0 [notify cookie 94900979575856 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2bc003d70 con 0x7fc3e0037020 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== watch-notify(notify_complete (2) cookie 94900979575856 notify 137438953516 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fdb298490 con 0x7fc3e0037020 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:142 4.37 4:ec6b564d:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d30e0 con 0x7fc3f00ca070 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:143 4.16 4:6892e278:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3cf0 con 0x564fdb281700 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:144 4.34 4:2e3a9bbb:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b5050 con 0x7fc3e0037020 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:145 4.0 4:01b26cfd:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b5920 con 0x564fdb281700 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:146 4.22 4:44157a4e:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d64d0 con 0x564fdb27b4e0 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:147 4.16 4:6960ca11:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d6df0 con 0x564fdb281700 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:148 4.4 4:22375e88:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3cf0 con 0x7fc3f00ca070 2024-05-08T18:10:57.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:149 4.14 4:2b4adbf5:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b5920 con 0x564fdb281700 2024-05-08T18:10:57.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:150 4.1c 4:382c76b8:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b5050 con 0x7fc3f00ca070 2024-05-08T18:10:57.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:151 4.b 4:d0c3e424:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d64d0 con 0x7fc3e0037020 2024-05-08T18:10:57.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:152 4.16 4:684f5bf1:::.dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b5050 con 0x564fdb281700 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 36 ==== osd_op_reply(144 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.2 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(146 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.4 [delete] v32'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.444+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(148 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.6 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== osd_op_reply(145 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.3 [delete] v32'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(143 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.1 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(142 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.0 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.447 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(150 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.8 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(147 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.5 [delete] v32'11 uv11 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(149 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.7 [delete] v32'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(152 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.10 [delete] v32'12 uv12 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 37 ==== osd_op_reply(151 .dir.e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7.9 [delete] v32'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 : miss 2024-05-08T18:10:57.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:153 6.1f 6:febf29eb:::pubsub..bucket.myfoo%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b5920 con 0x7fc3f00ca070 2024-05-08T18:10:57.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(153 pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 info.flags=0x0 2024-05-08T18:10:57.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 10 adding default.rgw.log++pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 to cache LRU end 2024-05-08T18:10:57.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.448+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:154 6.1f 6:febf29eb:::pubsub..bucket.myfoo%2fe99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3cf0 con 0x7fc3f00ca070 2024-05-08T18:10:57.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.452+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(154 pubsub..bucket.myfoo/e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.7 [delete] v32'32 uv23 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.452+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d64d0 con 0x7fc3e0037020 2024-05-08T18:10:57.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.452+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 38 ==== osd_op_reply(155 foo.buckets [call] v32'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.452+0000 7fc3f9fa8980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-08T18:10:57.453 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.452+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3840 con 0x7fc3f00ca070 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f9fa8980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94900979451952 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d64d0 con 0x7fc3e0037020 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 39 ==== watch-notify(notify (1) cookie 94900979270544 notify 137438953517 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564fdb298490 con 0x7fc3e0037020 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 40 ==== osd_op_reply(157 notify.3 [notify cookie 94900979451952 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc2d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953517 cookie 94900979270544 notifier 4779 bl.length()=170 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc2d67fc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2200032d0 con 0x7fc3e0037020 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 41 ==== watch-notify(notify_complete (2) cookie 94900979451952 notify 137438953517 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fdb297810 con 0x7fc3e0037020 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 42 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f9fa8980 10 removing email index: foo@foo.com 2024-05-08T18:10:57.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3840 con 0x564fdb27b4e0 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(159 foo@foo.com [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f9fa8980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94900979451952 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d64d0 con 0x7fc3e0037020 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 43 ==== watch-notify(notify (1) cookie 94900979270544 notify 137438953518 ret 0) ==== 204+0+0 (crc 0 0 0) 0x564fdb297810 con 0x7fc3e0037020 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc2d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953518 cookie 94900979270544 notifier 4779 bl.length()=162 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 44 ==== osd_op_reply(160 notify.3 [notify cookie 94900979451952 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.456+0000 7fc2d67fc640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2200032d0 con 0x7fc3e0037020 2024-05-08T18:10:57.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 45 ==== watch-notify(notify_complete (2) cookie 94900979451952 notify 137438953518 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fdb297fe0 con 0x7fc3e0037020 2024-05-08T18:10:57.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 46 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f9fa8980 10 removing user buckets index 2024-05-08T18:10:57.459 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d3840 con 0x7fc3e0037020 2024-05-08T18:10:57.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 47 ==== osd_op_reply(162 foo.buckets [delete] v32'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f9fa8980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-08T18:10:57.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94900979451952 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d64d0 con 0x7fc3f00ca070 2024-05-08T18:10:57.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== watch-notify(notify (1) cookie 94900979275280 notify 137438953501 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564fdb295910 con 0x7fc3f00ca070 2024-05-08T18:10:57.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== osd_op_reply(163 notify.5 [notify cookie 94900979451952 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc2d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94900979275280 notifier 4779 bl.length()=160 2024-05-08T18:10:57.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2bc003d70 con 0x7fc3f00ca070 2024-05-08T18:10:57.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== watch-notify(notify_complete (2) cookie 94900979451952 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fdb247120 con 0x7fc3f00ca070 2024-05-08T18:10:57.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f9fa8980 10 removing user index: foo 2024-05-08T18:10:57.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.460+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2d7030 con 0x564fdb27b4e0 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(165 foo [call,call,delete] v32'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f9fa8980 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f9fa8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94900979451952 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2b54b0 con 0x564fdb27b4e0 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== watch-notify(notify (1) cookie 94900979269344 notify 137438953490 ret 0) ==== 194+0+0 (crc 0 0 0) 0x564fdb247120 con 0x564fdb27b4e0 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc2d6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94900979269344 notifier 4779 bl.length()=152 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc2d6ffd640 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2bc003d70 con 0x564fdb27b4e0 2024-05-08T18:10:57.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(166 notify.4 [notify cookie 94900979451952 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 40 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 41 ==== watch-notify(notify_complete (2) cookie 94900979451952 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564fdb244490 con 0x564fdb27b4e0 2024-05-08T18:10:57.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc2ae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:57.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.464+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94900979277040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2950e0 con 0x564fdb27b4e0 2024-05-08T18:10:57.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 42 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94900979277040] v32'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94900979259088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2950e0 con 0x7fc3e0037020 2024-05-08T18:10:57.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 48 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94900979259088] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f9fa8980 20 remove_watcher() i=0 2024-05-08T18:10:57.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f9fa8980 2 removed watcher, disabling cache 2024-05-08T18:10:57.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94900979263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2950e0 con 0x564fdb27b4e0 2024-05-08T18:10:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 43 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94900979263232] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f9fa8980 20 remove_watcher() i=1 2024-05-08T18:10:57.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.468+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94900979264288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb286700 con 0x564fdb281700 2024-05-08T18:10:57.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.472+0000 7fc3f72bb640 1 -- 172.21.15.114:0/13508087 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94900979264288] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e0059040 con 0x564fdb281700 2024-05-08T18:10:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.472+0000 7fc3f9fa8980 20 remove_watcher() i=2 2024-05-08T18:10:57.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.472+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94900979270544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb2950e0 con 0x7fc3e0037020 2024-05-08T18:10:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.472+0000 7fc3f82bd640 1 -- 172.21.15.114:0/13508087 <== osd.2 v2:172.21.15.114:6810/2279342404 49 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94900979270544] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3e802f040 con 0x7fc3e0037020 2024-05-08T18:10:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.472+0000 7fc3f9fa8980 20 remove_watcher() i=3 2024-05-08T18:10:57.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.472+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94900979269344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb288390 con 0x564fdb27b4e0 2024-05-08T18:10:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.476+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.1 v2:172.21.15.114:6800/1559856467 44 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94900979269344] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x564fdb27b4e0 2024-05-08T18:10:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.476+0000 7fc3f9fa8980 20 remove_watcher() i=4 2024-05-08T18:10:57.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.476+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94900979275280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb287ee0 con 0x7fc3f00ca070 2024-05-08T18:10:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.476+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94900979275280] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.476+0000 7fc3f9fa8980 20 remove_watcher() i=5 2024-05-08T18:10:57.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.476+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94900979278784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb288390 con 0x7fc3f00ca070 2024-05-08T18:10:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 46 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94900979278784] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 20 remove_watcher() i=6 2024-05-08T18:10:57.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94900979282672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564fdb289610 con 0x7fc3f00ca070 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 <== osd.0 v2:172.21.15.53:6800/803213352 47 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94900979282672] v32'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f00f9040 con 0x7fc3f00ca070 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 20 remove_watcher() i=7 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc3f00ca070 msgr2=0x7fc3f00c0950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc3f00ca070 0x7fc3f00c0950 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb27b4e0 msgr2=0x564fdb27d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb27b4e0 0x564fdb27d9a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc3e0037020 msgr2=0x7fc3e00499b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc3e0037020 0x7fc3e00499b0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564fdb281700 msgr2=0x564fdb283af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564fdb281700 0x564fdb283af0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2c00383a0 msgr2=0x7fc2c003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2c00383a0 0x7fc2c003a860 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800f010 tx=0x7fc3e801b070 comp rx=0 tx=0).stop 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 msgr2=0x564fdb2701d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/13508087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb268c70 0x564fdb2701d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0023850 tx=0x7fc3e004f190 comp rx=0 tx=0).stop 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f7abc640 1 -- 172.21.15.114:0/13508087 reap_dead start 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 shutdown_connections 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.480+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 >> 172.21.15.114:0/13508087 conn(0x564fdb265000 msgr2=0x564fdb26a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 shutdown_connections 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/13508087 wait complete. 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2d0038440 msgr2=0x7fc2d003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2d0038440 0x7fc2d003a900 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x564fdb24c720 tx=0x7fc3e8003070 comp rx=0 tx=0).stop 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 msgr2=0x564fdb25be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 0x564fdb25be50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000d660 tx=0x7fc3e000da60 comp rx=0 tx=0).stop 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 shutdown_connections 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2d0038440 0x7fc2d003a900 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/396922188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb25ba30 0x564fdb25be50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 >> 172.21.15.114:0/396922188 conn(0x564fdb250840 msgr2=0x564fdb251350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 shutdown_connections 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/396922188 wait complete. 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb151a20 msgr2=0x564fdb24ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb151a20 0x564fdb24ac00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2e0038440 msgr2=0x7fc2e003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2e0038440 0x7fc2e003a900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0001d80 tx=0x7fc3e00012e0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 msgr2=0x564fdb243cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb243cc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00b8040 tx=0x7fc3f0019810 comp rx=0 tx=0).stop 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 shutdown_connections 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564fdb151a20 0x564fdb24ac00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc2e0038440 0x7fc2e003a900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 --2- 172.21.15.114:0/3742746625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564fdb151100 0x564fdb243cc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 >> 172.21.15.114:0/3742746625 conn(0x564fdb0c47e0 msgr2=0x564fdb236f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 shutdown_connections 2024-05-08T18:10:57.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.484+0000 7fc3f9fa8980 1 -- 172.21.15.114:0/3742746625 wait complete. 2024-05-08T18:10:57.495 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T18:10:57.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T18:10:57.495 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T18:10:57.575 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:57.575 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:57.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0196a0980 1 Processor -- start 2024-05-08T18:10:57.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0196a0980 1 -- start start 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0196a0980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c8ce4f92d0 0x55c8ce4fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0196a0980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c8ce3a1710 con 0x55c8ce4f4d70 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0196a0980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55c8ce3b5f00 con 0x55c8ce4f92d0 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0169b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c8ce4f92d0 0x55c8ce4fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0169b3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55c8ce4f92d0 0x55c8ce4fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42536/0 (socket says 172.21.15.114:42536) 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0169b3640 1 -- 172.21.15.114:0/2172841084 learned_addr learned my addr 172.21.15.114:0/2172841084 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0169b3640 1 -- 172.21.15.114:0/2172841084 >> v1:172.21.15.53:6789/0 conn(0x55c8ce4f4d70 legacy=0x55c8ce4f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.576+0000 7fe0169b3640 1 -- 172.21.15.114:0/2172841084 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ce37dae0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0169b3640 1 --2- 172.21.15.114:0/2172841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f92d0 0x55c8ce4fb6c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00a5c0 tx=0x7fe00c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389e6d886fd94055 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0161b2640 1 -- 172.21.15.114:0/2172841084 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0a6070 con 0x55c8ce4f92d0 2024-05-08T18:10:57.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0161b2640 1 -- 172.21.15.114:0/2172841084 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0af070 con 0x55c8ce4f92d0 2024-05-08T18:10:57.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0161b2640 1 -- 172.21.15.114:0/2172841084 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0aa5c0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 -- 172.21.15.114:0/2172841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f92d0 msgr2=0x55c8ce4fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2172841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f92d0 0x55c8ce4fb6c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00a5c0 tx=0x7fe00c01b340 comp rx=0 tx=0).stop 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 -- 172.21.15.114:0/2172841084 shutdown_connections 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2172841084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f92d0 0x55c8ce4fb6c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 -- 172.21.15.114:0/2172841084 >> 172.21.15.114:0/2172841084 conn(0x55c8ce4f0640 msgr2=0x55c8ce4f2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 -- 172.21.15.114:0/2172841084 shutdown_connections 2024-05-08T18:10:57.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.580+0000 7fe0196a0980 1 -- 172.21.15.114:0/2172841084 wait complete. 2024-05-08T18:10:57.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0196a0980 1 Processor -- start 2024-05-08T18:10:57.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0196a0980 1 -- start start 2024-05-08T18:10:57.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0196a0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0196a0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c8ce3f9f80 con 0x55c8ce4f4d70 2024-05-08T18:10:57.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0171b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0171b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42548/0 (socket says 172.21.15.114:42548) 2024-05-08T18:10:57.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0171b4640 1 -- 172.21.15.114:0/1810789594 learned_addr learned my addr 172.21.15.114:0/1810789594 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0171b4640 1 -- 172.21.15.114:0/1810789594 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ce3c1da0 con 0x55c8ce4f4d70 2024-05-08T18:10:57.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fe0171b4640 1 --2- 172.21.15.114:0/1810789594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e0f50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe00800b220 tx=0x7fe00800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8aa3c115df50bc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fdf0560a640 1 -- 172.21.15.114:0/1810789594 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00800a040 con 0x55c8ce4f4d70 2024-05-08T18:10:57.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fdf0560a640 1 -- 172.21.15.114:0/1810789594 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00800f750 con 0x55c8ce4f4d70 2024-05-08T18:10:57.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.596+0000 7fdf0560a640 1 -- 172.21.15.114:0/1810789594 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00800fa70 con 0x55c8ce4f4d70 2024-05-08T18:10:57.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/1810789594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 msgr2=0x55c8ce5e0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 --2- 172.21.15.114:0/1810789594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e0f50 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe00800b220 tx=0x7fe00800b6e0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/1810789594 shutdown_connections 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 --2- 172.21.15.114:0/1810789594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e0f50 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/1810789594 >> 172.21.15.114:0/1810789594 conn(0x55c8ce4f0640 msgr2=0x55c8ce5dcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/1810789594 shutdown_connections 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/1810789594 wait complete. 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 Processor -- start 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- start start 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c8ce4fc6e0 con 0x55c8ce4f4d70 2024-05-08T18:10:57.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0171b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0171b4640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42554/0 (socket says 172.21.15.114:42554) 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0171b4640 1 -- 172.21.15.114:0/2866820757 learned_addr learned my addr 172.21.15.114:0/2866820757 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0171b4640 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ce5e89a0 con 0x55c8ce4f4d70 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0171b4640 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e8460 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe00800b720 tx=0x7fe008000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fdf03e07640 1 -- 172.21.15.114:0/2866820757 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe008001560 con 0x55c8ce4f4d70 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fdf03e07640 1 -- 172.21.15.114:0/2866820757 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00801c9c0 con 0x55c8ce4f4d70 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fdf03e07640 1 -- 172.21.15.114:0/2866820757 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00801cd00 con 0x55c8ce4f4d70 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8ce5e8c30 con 0x55c8ce4f4d70 2024-05-08T18:10:57.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.600+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ce5eb870 con 0x55c8ce4f4d70 2024-05-08T18:10:57.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fdf03e07640 1 -- 172.21.15.114:0/2866820757 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe008017050 con 0x55c8ce4f4d70 2024-05-08T18:10:57.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fdf03e07640 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdefc0383f0 0x7fdefc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fdf03e07640 1 -- 172.21.15.114:0/2866820757 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe008015020 con 0x55c8ce4f4d70 2024-05-08T18:10:57.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0169b3640 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdefc0383f0 0x7fdefc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce4f92d0 0x55c8ce5ef4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce5efa40 con 0x55c8ce4f92d0 2024-05-08T18:10:57.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce4f92d0 0x55c8ce5ef4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0169b3640 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdefc0383f0 0x7fdefc03a8b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ae000 tx=0x7fe00c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce4f92d0 0x55c8ce5ef4c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 -- 172.21.15.114:0/2866820757 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe01000a4d0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce5eca90 con 0x55c8ce4f92d0 2024-05-08T18:10:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 -- 172.21.15.114:0/2866820757 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe01000a4d0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce5f1890 con 0x55c8ce4f92d0 2024-05-08T18:10:57.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 -- 172.21.15.114:0/2866820757 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe01000a4d0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce5f0a00 con 0x55c8ce4f92d0 2024-05-08T18:10:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 -- 172.21.15.114:0/2866820757 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe01000a4d0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce5f0e50 con 0x55c8ce4f92d0 2024-05-08T18:10:57.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0179b5640 1 -- 172.21.15.114:0/2866820757 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe01000a4d0 con 0x55c8ce4f92d0 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 Processor -- start 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- start start 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 0x55c8ce6005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.604+0000 7fe0196a0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c8ce3fdfc0 con 0x55c8ce6001c0 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0169b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 0x55c8ce6005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0169b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 0x55c8ce6005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42574/0 (socket says 172.21.15.114:42574) 2024-05-08T18:10:57.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0169b3640 1 -- 172.21.15.114:0/980832060 learned_addr learned my addr 172.21.15.114:0/980832060 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0169b3640 1 -- 172.21.15.114:0/980832060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ce600b20 con 0x55c8ce6001c0 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0169b3640 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 0x55c8ce6005e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0199f0 tx=0x7fe00c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fdf01602640 1 -- 172.21.15.114:0/980832060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0b3b90 con 0x55c8ce6001c0 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8ce6015c0 con 0x55c8ce6001c0 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fdf01602640 1 -- 172.21.15.114:0/980832060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0b3d30 con 0x55c8ce6001c0 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fdf01602640 1 -- 172.21.15.114:0/980832060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0c8560 con 0x55c8ce6001c0 2024-05-08T18:10:57.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ce601a30 con 0x55c8ce6001c0 2024-05-08T18:10:57.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fdf01602640 1 -- 172.21.15.114:0/980832060 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe00c0d1440 con 0x55c8ce6001c0 2024-05-08T18:10:57.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fdf01602640 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef00383f0 0x7fdef003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fdf01602640 1 -- 172.21.15.114:0/980832060 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe00c0ec0e0 con 0x55c8ce6001c0 2024-05-08T18:10:57.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0179b5640 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef00383f0 0x7fdef003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0196a0980 1 Processor -- start 2024-05-08T18:10:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0196a0980 1 -- start start 2024-05-08T18:10:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0196a0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce60d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0196a0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c8ce5e16a0 con 0x55c8ce60d2a0 2024-05-08T18:10:57.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.608+0000 7fe0179b5640 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef00383f0 0x7fdef003a8b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c8ce5f0520 tx=0x7fe010005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce60d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce60d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42576/0 (socket says 172.21.15.114:42576) 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 -- 172.21.15.114:0/4064432727 learned_addr learned my addr 172.21.15.114:0/4064432727 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 -- 172.21.15.114:0/4064432727 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ce60dc50 con 0x55c8ce60d2a0 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 --2- 172.21.15.114:0/4064432727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce60d680 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0befd0 tx=0x7fe00c0d1a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788d6cbd37882b2e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fdefaffd640 1 -- 172.21.15.114:0/4064432727 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0bd390 con 0x55c8ce60d2a0 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fdefaffd640 1 -- 172.21.15.114:0/4064432727 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0bd530 con 0x55c8ce60d2a0 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fdefaffd640 1 -- 172.21.15.114:0/4064432727 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0be410 con 0x55c8ce60d2a0 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- 172.21.15.114:0/4064432727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 msgr2=0x55c8ce60d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4064432727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce60d680 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0befd0 tx=0x7fe00c0d1a80 comp rx=0 tx=0).stop 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- 172.21.15.114:0/4064432727 shutdown_connections 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4064432727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce60d680 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- 172.21.15.114:0/4064432727 >> 172.21.15.114:0/4064432727 conn(0x55c8ce6095e0 msgr2=0x55c8ce607640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- 172.21.15.114:0/4064432727 shutdown_connections 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- 172.21.15.114:0/4064432727 wait complete. 2024-05-08T18:10:57.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 Processor -- start 2024-05-08T18:10:57.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- start start 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce6147c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55c8ce60e410 con 0x55c8ce60d2a0 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce6147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce6147c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42584/0 (socket says 172.21.15.114:42584) 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 learned_addr learned my addr 172.21.15.114:0/4156745100 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ce614d00 con 0x55c8ce60d2a0 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0169b3640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce6147c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0c8750 tx=0x7fe00c0ea3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fdef97fa640 1 -- 172.21.15.114:0/4156745100 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0bd390 con 0x55c8ce60d2a0 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c8ce614f90 con 0x55c8ce60d2a0 2024-05-08T18:10:57.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fdef97fa640 1 -- 172.21.15.114:0/4156745100 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0e0070 con 0x55c8ce60d2a0 2024-05-08T18:10:57.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.612+0000 7fdef97fa640 1 -- 172.21.15.114:0/4156745100 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0be710 con 0x55c8ce60d2a0 2024-05-08T18:10:57.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ce617c70 con 0x55c8ce60d2a0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fdef97fa640 1 -- 172.21.15.114:0/4156745100 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe00c0f3060 con 0x55c8ce60d2a0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fdef97fa640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdee00383f0 0x7fdee003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fdef97fa640 1 -- 172.21.15.114:0/4156745100 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe00c0edd90 con 0x55c8ce60d2a0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0179b5640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdee00383f0 0x7fdee003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce61fc70 0x55c8ce6220e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce622830 con 0x55c8ce61fc70 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce61fc70 0x55c8ce6220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0179b5640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdee00383f0 0x7fdee003a8b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c8ce5ec9e0 tx=0x7fe01001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce61fc70 0x55c8ce6220e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 realm 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce622c40 con 0x55c8ce61fc70 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce623510 con 0x55c8ce61fc70 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce6238b0 con 0x55c8ce61fc70 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce623d10 con 0x55c8ce61fc70 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.616+0000 7fe0196a0980 20 searching for the correct realm 2024-05-08T18:10:57.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c8ce625c80 0x55c8ce628070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0169b3640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c8ce625c80 0x55c8ce628070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0169b3640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c8ce625c80 0x55c8ce628070 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0169b3640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe00c0f5070 0x7fe00c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0179b5640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe00c0f5070 0x7fe00c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0179b5640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe00c0f5070 0x7fe00c0caa20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe00801a480 0x7fe008046150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe00801a480 0x7fe008046150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.620+0000 7fe0171b4640 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe00801a480 0x7fe008046150 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.624+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.628+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce625c80 2024-05-08T18:10:57.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00801a480 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x55c8ce61fc70 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce628720 con 0x7fe00c0f5070 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:57.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce624720 con 0x55c8ce61fc70 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce624360 con 0x55c8ce61fc70 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce624ff0 con 0x55c8ce61fc70 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 zone default found 2024-05-08T18:10:57.637 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 4 Realm: () 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 zonegroup default 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.632+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce624ff0 con 0x7fe00801a480 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62a580 con 0x55c8ce625c80 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62a920 con 0x55c8ce625c80 2024-05-08T18:10:57.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 started sync module instance, tier type = 2024-05-08T18:10:57.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:57.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce629a20 con 0x7fe00c0f5070 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94320944389696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62b170 con 0x7fe00c0f5070 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62b9c0 con 0x55c8ce61fc70 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.636+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94320944389696] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94320944393408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62b5d0 con 0x55c8ce61fc70 2024-05-08T18:10:57.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62c0f0 con 0x55c8ce625c80 2024-05-08T18:10:57.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94320944393408] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94320944397248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62c4e0 con 0x55c8ce625c80 2024-05-08T18:10:57.642 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.640+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62cea0 con 0x7fe00c0f5070 2024-05-08T18:10:57.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94320944401184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62d740 con 0x7fe00c0f5070 2024-05-08T18:10:57.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62e160 con 0x55c8ce61fc70 2024-05-08T18:10:57.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94320944397248] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.644 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94320944401184] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94320944405584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62d290 con 0x55c8ce61fc70 2024-05-08T18:10:57.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.644+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62ea00 con 0x7fe00801a480 2024-05-08T18:10:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94320944405584] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94320944394464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62d290 con 0x7fe00801a480 2024-05-08T18:10:57.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62eef0 con 0x7fe00801a480 2024-05-08T18:10:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94320944394464] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94320944407424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62eef0 con 0x7fe00801a480 2024-05-08T18:10:57.650 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.648+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62f8f0 con 0x7fe00801a480 2024-05-08T18:10:57.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94320944407424] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94320944409040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62f8b0 con 0x7fe00801a480 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=0 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=1 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=2 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=3 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=4 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=5 2024-05-08T18:10:57.652 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=6 2024-05-08T18:10:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94320944409040] v32'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 20 add_watcher() i=7 2024-05-08T18:10:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce632ce0 con 0x55c8ce61fc70 2024-05-08T18:10:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.652+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94320944412112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce6301a0 con 0x55c8ce61fc70 2024-05-08T18:10:57.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94320944412112] v32'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fdecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:57.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:57.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:57.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 5 note: GC not initialized 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fdeccfe1640 20 reqs_thread_entry: start 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 20 Filter name: none 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fde467fc640 20 reqs_thread_entry: start 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 20 rados->read ofs=0 len=0 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce656210 con 0x55c8ce61fc70 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:57.657 INFO:teuthology.orchestra.run.smithi114.stderr:could not fetch user info: no user info saved 2024-05-08T18:10:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fdecdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:57.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.656+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94320944412112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce6561d0 con 0x55c8ce61fc70 2024-05-08T18:10:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94320944412112] v32'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.659 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94320944389696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce6561d0 con 0x7fe00c0f5070 2024-05-08T18:10:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94320944389696] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0196a0980 20 remove_watcher() i=0 2024-05-08T18:10:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0196a0980 2 removed watcher, disabling cache 2024-05-08T18:10:57.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94320944393408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce6561d0 con 0x55c8ce61fc70 2024-05-08T18:10:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94320944393408] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0196a0980 20 remove_watcher() i=1 2024-05-08T18:10:57.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.660+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94320944397248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce6561d0 con 0x55c8ce625c80 2024-05-08T18:10:57.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.664+0000 7fe0169b3640 1 -- 172.21.15.114:0/4156745100 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94320944397248] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00c0ce020 con 0x55c8ce625c80 2024-05-08T18:10:57.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.664+0000 7fe0196a0980 20 remove_watcher() i=2 2024-05-08T18:10:57.664 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.664+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94320944401184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62bbc0 con 0x7fe00c0f5070 2024-05-08T18:10:57.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.664+0000 7fe0179b5640 1 -- 172.21.15.114:0/4156745100 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94320944401184] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe01001f070 con 0x7fe00c0f5070 2024-05-08T18:10:57.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.664+0000 7fe0196a0980 20 remove_watcher() i=3 2024-05-08T18:10:57.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.664+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94320944405584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62bbc0 con 0x55c8ce61fc70 2024-05-08T18:10:57.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.668+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94320944405584] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x55c8ce61fc70 2024-05-08T18:10:57.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.668+0000 7fe0196a0980 20 remove_watcher() i=4 2024-05-08T18:10:57.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.668+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94320944394464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62dc50 con 0x7fe00801a480 2024-05-08T18:10:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.668+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94320944394464] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.668+0000 7fe0196a0980 20 remove_watcher() i=5 2024-05-08T18:10:57.670 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.668+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94320944407424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62dc50 con 0x7fe00801a480 2024-05-08T18:10:57.672 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.672+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94320944407424] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.672+0000 7fe0196a0980 20 remove_watcher() i=6 2024-05-08T18:10:57.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.672+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94320944409040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c8ce62dc50 con 0x7fe00801a480 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94320944409040] v32'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe00802e070 con 0x7fe00801a480 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 20 remove_watcher() i=7 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe00801a480 msgr2=0x7fe008046150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fe00801a480 0x7fe008046150 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce61fc70 msgr2=0x55c8ce6220e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce61fc70 0x55c8ce6220e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe00c0f5070 msgr2=0x7fe00c0caa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fe00c0f5070 0x7fe00c0caa20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c8ce625c80 msgr2=0x55c8ce628070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55c8ce625c80 0x55c8ce628070 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdee00383f0 msgr2=0x7fdee003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdee00383f0 0x7fdee003a8b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c8ce5ec9e0 tx=0x7fe01001f000 comp rx=0 tx=0).stop 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 msgr2=0x55c8ce6147c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce6147c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0c8750 tx=0x7fe00c0ea3b0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0171b4640 1 -- 172.21.15.114:0/4156745100 reap_dead start 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 shutdown_connections 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/4156745100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce60d2a0 0x55c8ce6147c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 >> 172.21.15.114:0/4156745100 conn(0x55c8ce6095e0 msgr2=0x55c8ce606c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 shutdown_connections 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/4156745100 wait complete. 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef00383f0 msgr2=0x7fdef003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef00383f0 0x7fdef003a8b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c8ce5f0520 tx=0x7fe010005850 comp rx=0 tx=0).stop 2024-05-08T18:10:57.677 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 msgr2=0x55c8ce6005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 0x55c8ce6005e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0199f0 tx=0x7fe00c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 shutdown_connections 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdef00383f0 0x7fdef003a8b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/980832060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce6001c0 0x55c8ce6005e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 >> 172.21.15.114:0/980832060 conn(0x55c8ce5f4fd0 msgr2=0x55c8ce5f5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 shutdown_connections 2024-05-08T18:10:57.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/980832060 wait complete. 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce4f92d0 msgr2=0x55c8ce5ef4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce4f92d0 0x55c8ce5ef4c0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdefc0383f0 msgr2=0x7fdefc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdefc0383f0 0x7fdefc03a8b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0ae000 tx=0x7fe00c0a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 msgr2=0x55c8ce5e8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e8460 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe00800b720 tx=0x7fe008000bd0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 shutdown_connections 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55c8ce4f92d0 0x55c8ce5ef4c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdefc0383f0 0x7fdefc03a8b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.679 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 --2- 172.21.15.114:0/2866820757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c8ce4f4d70 0x55c8ce5e8460 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 >> 172.21.15.114:0/2866820757 conn(0x55c8ce4f0640 msgr2=0x55c8ce5db5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 shutdown_connections 2024-05-08T18:10:57.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.676+0000 7fe0196a0980 1 -- 172.21.15.114:0/2866820757 wait complete. 2024-05-08T18:10:57.688 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T18:10:57.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-08T18:10:57.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-08T18:10:57.688 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-08T18:10:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:57.769 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.768+0000 7f0cad087980 1 Processor -- start 2024-05-08T18:10:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0cad087980 1 -- start start 2024-05-08T18:10:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0cad087980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5558e762c0e0 0x5558e76bac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0cad087980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558e7563710 con 0x5558e76bb150 2024-05-08T18:10:57.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0cad087980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5558e7577f00 con 0x5558e762c0e0 2024-05-08T18:10:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caab9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5558e762c0e0 0x5558e76bac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caab9b640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5558e762c0e0 0x5558e76bac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42598/0 (socket says 172.21.15.114:42598) 2024-05-08T18:10:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caab9b640 1 -- 172.21.15.114:0/260773665 learned_addr learned my addr 172.21.15.114:0/260773665 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caa39a640 1 --1- 172.21.15.114:0/260773665 >> v1:172.21.15.53:6789/0 conn(0x5558e76bb150 0x5558e76bd540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51800/0 (socket says 172.21.15.114:51800) 2024-05-08T18:10:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caab9b640 1 -- 172.21.15.114:0/260773665 >> v1:172.21.15.53:6789/0 conn(0x5558e76bb150 legacy=0x5558e76bd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caab9b640 1 -- 172.21.15.114:0/260773665 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558e753fae0 con 0x5558e762c0e0 2024-05-08T18:10:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0caab9b640 1 --2- 172.21.15.114:0/260773665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76bac10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400a4e0 tx=0x7f0ca401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c3bcb55426797a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.772+0000 7f0ca9b99640 1 -- 172.21.15.114:0/260773665 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40aa540 con 0x5558e762c0e0 2024-05-08T18:10:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0ca9b99640 1 -- 172.21.15.114:0/260773665 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca40aa6e0 con 0x5558e762c0e0 2024-05-08T18:10:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0ca9b99640 1 -- 172.21.15.114:0/260773665 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40aaa40 con 0x5558e762c0e0 2024-05-08T18:10:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 -- 172.21.15.114:0/260773665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 msgr2=0x5558e76bac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 --2- 172.21.15.114:0/260773665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76bac10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400a4e0 tx=0x7f0ca401b090 comp rx=0 tx=0).stop 2024-05-08T18:10:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 -- 172.21.15.114:0/260773665 shutdown_connections 2024-05-08T18:10:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 --2- 172.21.15.114:0/260773665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76bac10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 -- 172.21.15.114:0/260773665 >> 172.21.15.114:0/260773665 conn(0x5558e76b2730 msgr2=0x5558e76b4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 -- 172.21.15.114:0/260773665 shutdown_connections 2024-05-08T18:10:57.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.776+0000 7f0cad087980 1 -- 172.21.15.114:0/260773665 wait complete. 2024-05-08T18:10:57.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 Processor -- start 2024-05-08T18:10:57.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- start start 2024-05-08T18:10:57.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e77a3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558e75bbf80 con 0x5558e762c0e0 2024-05-08T18:10:57.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0caab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e77a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0caab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e77a3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42610/0 (socket says 172.21.15.114:42610) 2024-05-08T18:10:57.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0caab9b640 1 -- 172.21.15.114:0/1350064406 learned_addr learned my addr 172.21.15.114:0/1350064406 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0caab9b640 1 -- 172.21.15.114:0/1350064406 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558e7583da0 con 0x5558e762c0e0 2024-05-08T18:10:57.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0caab9b640 1 --2- 172.21.15.114:0/1350064406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e77a3020 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4017ca0 tx=0x7f0ca40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e704f8ae560227 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0b98e09640 1 -- 172.21.15.114:0/1350064406 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40b9030 con 0x5558e762c0e0 2024-05-08T18:10:57.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0b98e09640 1 -- 172.21.15.114:0/1350064406 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca40aaac0 con 0x5558e762c0e0 2024-05-08T18:10:57.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0b98e09640 1 -- 172.21.15.114:0/1350064406 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40aada0 con 0x5558e762c0e0 2024-05-08T18:10:57.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- 172.21.15.114:0/1350064406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 msgr2=0x5558e77a3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 --2- 172.21.15.114:0/1350064406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e77a3020 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4017ca0 tx=0x7f0ca40033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- 172.21.15.114:0/1350064406 shutdown_connections 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 --2- 172.21.15.114:0/1350064406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e77a3020 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- 172.21.15.114:0/1350064406 >> 172.21.15.114:0/1350064406 conn(0x5558e76b2730 msgr2=0x5558e779ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- 172.21.15.114:0/1350064406 shutdown_connections 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- 172.21.15.114:0/1350064406 wait complete. 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 Processor -- start 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.792+0000 7f0cad087980 1 -- start start 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76b8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558e76bf770 con 0x5558e762c0e0 2024-05-08T18:10:57.796 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42618/0 (socket says 172.21.15.114:42618) 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 -- 172.21.15.114:0/408964415 learned_addr learned my addr 172.21.15.114:0/408964415 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 -- 172.21.15.114:0/408964415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558e76b6c30 con 0x5558e762c0e0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76b8510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0ca401b0d0 tx=0x7f0ca4017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0b97606640 1 -- 172.21.15.114:0/408964415 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40b9030 con 0x5558e762c0e0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558e76b6ec0 con 0x5558e762c0e0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0b97606640 1 -- 172.21.15.114:0/408964415 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca40c3070 con 0x5558e762c0e0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0b97606640 1 -- 172.21.15.114:0/408964415 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40bf750 con 0x5558e762c0e0 2024-05-08T18:10:57.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558e76b73b0 con 0x5558e762c0e0 2024-05-08T18:10:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 Processor -- start 2024-05-08T18:10:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 -- start start 2024-05-08T18:10:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77b9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cad087980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558e75bffc0 con 0x5558e77b99e0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0b97606640 1 -- 172.21.15.114:0/408964415 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0ca40c5030 con 0x5558e762c0e0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cab39c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77b9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cab39c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77b9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42622/0 (socket says 172.21.15.114:42622) 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cab39c640 1 -- 172.21.15.114:0/2782198896 learned_addr learned my addr 172.21.15.114:0/2782198896 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0b97606640 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b900383f0 0x7f0b9003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0b97606640 1 -- 172.21.15.114:0/408964415 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0ca40ba070 con 0x5558e762c0e0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b900383f0 0x7f0b9003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0cab39c640 1 -- 172.21.15.114:0/2782198896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558e77ba340 con 0x5558e77b99e0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.796+0000 7f0caab9b640 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b900383f0 0x7f0b9003a8b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4005cc0 tx=0x7f0ca40be410 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cab39c640 1 --2- 172.21.15.114:0/2782198896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77b9e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00a440 tx=0x7f0c9c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2507dfe73bda970e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0b95602640 1 -- 172.21.15.114:0/2782198896 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9c008850 con 0x5558e77b99e0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0b95602640 1 -- 172.21.15.114:0/2782198896 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c008a10 con 0x5558e77b99e0 2024-05-08T18:10:57.801 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0b95602640 1 -- 172.21.15.114:0/2782198896 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9c008d30 con 0x5558e77b99e0 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/2782198896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 msgr2=0x5558e77b9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 --2- 172.21.15.114:0/2782198896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77b9e00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00a440 tx=0x7f0c9c00a900 comp rx=0 tx=0).stop 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/2782198896 shutdown_connections 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 --2- 172.21.15.114:0/2782198896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77b9e00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/2782198896 >> 172.21.15.114:0/2782198896 conn(0x5558e76bb150 msgr2=0x5558e77b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/2782198896 shutdown_connections 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/2782198896 wait complete. 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 Processor -- start 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- start start 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558e77bad00 con 0x5558e77b99e0 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cab39c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cab39c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77c0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42634/0 (socket says 172.21.15.114:42634) 2024-05-08T18:10:57.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cab39c640 1 -- 172.21.15.114:0/1908395508 learned_addr learned my addr 172.21.15.114:0/1908395508 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cab39c640 1 -- 172.21.15.114:0/1908395508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558e77c11b0 con 0x5558e77b99e0 2024-05-08T18:10:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cab39c640 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77c0c70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5558e77ba7c0 tx=0x7f0c9c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.804 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0b8f7fe640 1 -- 172.21.15.114:0/1908395508 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9c013a70 con 0x5558e77b99e0 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558e77c1440 con 0x5558e77b99e0 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0b8f7fe640 1 -- 172.21.15.114:0/1908395508 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c023070 con 0x5558e77b99e0 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0b8f7fe640 1 -- 172.21.15.114:0/1908395508 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c9c013d40 con 0x5558e77b99e0 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.800+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558e77c4120 con 0x5558e77b99e0 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0b8f7fe640 1 -- 172.21.15.114:0/1908395508 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0c9c028460 con 0x5558e77b99e0 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 1 Processor -- start 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 1 -- start start 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0b8f7fe640 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b840383f0 0x7f0b8403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.805 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0b8f7fe640 1 -- 172.21.15.114:0/1908395508 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0c9c04eb30 con 0x5558e77b99e0 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cab39c640 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b840383f0 0x7f0b8403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 0x5558e77daff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558e77a36b0 con 0x5558e77dabd0 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0caab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 0x5558e77daff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cab39c640 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b840383f0 0x7f0b8403a8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c04eee0 tx=0x7f0c9c027f50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0caab9b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 0x5558e77daff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42644/0 (socket says 172.21.15.114:42644) 2024-05-08T18:10:57.806 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0caab9b640 1 -- 172.21.15.114:0/2548383341 learned_addr learned my addr 172.21.15.114:0/2548383341 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0caab9b640 1 -- 172.21.15.114:0/2548383341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558e77db530 con 0x5558e77dabd0 2024-05-08T18:10:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0caab9b640 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 0x5558e77daff0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40d0a60 tx=0x7f0ca40e85c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0b6affd640 1 -- 172.21.15.114:0/2548383341 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40be9a0 con 0x5558e77dabd0 2024-05-08T18:10:57.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0b6affd640 1 -- 172.21.15.114:0/2548383341 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca40d0ae0 con 0x5558e77dabd0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558e77dc070 con 0x5558e77dabd0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0b6affd640 1 -- 172.21.15.114:0/2548383341 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca40d0c90 con 0x5558e77dabd0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.804+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558e77dc540 con 0x5558e77dabd0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0b6affd640 1 -- 172.21.15.114:0/2548383341 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0ca40b3040 con 0x5558e77dabd0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0b6affd640 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0ae40383f0 0x7f0ae403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0b6affd640 1 -- 172.21.15.114:0/2548383341 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0ca40d7030 con 0x5558e77dabd0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0caa39a640 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0ae40383f0 0x7f0ae403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0b68ff9640 20 reqs_thread_entry: start 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558e77e0850 0x5558e77e2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558e77e32f0 con 0x5558e77e0850 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cab39c640 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558e77e0850 0x5558e77e2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0caa39a640 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0ae40383f0 0x7f0ae403a8b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5558e77b5a90 tx=0x7f0ca0001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cab39c640 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558e77e0850 0x5558e77e2c40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cab39c640 1 -- 172.21.15.114:0/408964415 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0c9c012910 con 0x5558e77e0850 2024-05-08T18:10:57.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558e77e4bb0 con 0x5558e77e0850 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cab39c640 1 -- 172.21.15.114:0/408964415 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0c9c012910 con 0x5558e77e0850 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b840383f0 msgr2=0x7f0b8403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b840383f0 0x7f0b8403a8b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c04eee0 tx=0x7f0c9c027f50 comp rx=0 tx=0).stop 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 msgr2=0x5558e77c0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77c0c70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x5558e77ba7c0 tx=0x7f0c9c003000 comp rx=0 tx=0).stop 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 shutdown_connections 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b840383f0 0x7f0b8403a8b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/1908395508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77b99e0 0x5558e77c0c70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 >> 172.21.15.114:0/1908395508 conn(0x5558e76bb150 msgr2=0x5558e77b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 shutdown_connections 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/1908395508 wait complete. 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0ae40383f0 msgr2=0x7f0ae403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0ae40383f0 0x7f0ae403a8b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x5558e77b5a90 tx=0x7f0ca0001370 comp rx=0 tx=0).stop 2024-05-08T18:10:57.812 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 msgr2=0x5558e77daff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 0x5558e77daff0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40d0a60 tx=0x7f0ca40e85c0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 shutdown_connections 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0ae40383f0 0x7f0ae403a8b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 --2- 172.21.15.114:0/2548383341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e77dabd0 0x5558e77daff0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 >> 172.21.15.114:0/2548383341 conn(0x5558e77cf7c0 msgr2=0x5558e77d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 shutdown_connections 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.808+0000 7f0cad087980 1 -- 172.21.15.114:0/2548383341 wait complete. 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558e77e0850 msgr2=0x5558e77e2c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558e77e0850 0x5558e77e2c40 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b900383f0 msgr2=0x7f0b9003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b900383f0 0x7f0b9003a8b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4005cc0 tx=0x7f0ca40be410 comp rx=0 tx=0).stop 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 msgr2=0x5558e76b8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76b8510 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0ca401b0d0 tx=0x7f0ca4017e30 comp rx=0 tx=0).stop 2024-05-08T18:10:57.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 shutdown_connections 2024-05-08T18:10:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558e77e0850 0x5558e77e2c40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0b900383f0 0x7f0b9003a8b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 --2- 172.21.15.114:0/408964415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558e762c0e0 0x5558e76b8510 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 >> 172.21.15.114:0/408964415 conn(0x5558e76b2730 msgr2=0x5558e779d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 shutdown_connections 2024-05-08T18:10:57.814 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.812+0000 7f0cad087980 1 -- 172.21.15.114:0/408964415 wait complete. 2024-05-08T18:10:57.822 INFO:teuthology.orchestra.run.smithi114.stdout:{"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:10:57.822 DEBUG:tasks.util.rgw: json result: {'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:10:57.822 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-08T18:10:57.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-08T18:10:57.823 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-08T18:10:57.892 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:57.892 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:57.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9ee1e980 1 Processor -- start 2024-05-08T18:10:57.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9ee1e980 1 -- start start 2024-05-08T18:10:57.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9ee1e980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5606b6810810 0x5606b689eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9ee1e980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5606b6747710 con 0x5606b689f0a0 2024-05-08T18:10:57.893 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9ee1e980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5606b675bf00 con 0x5606b6810810 2024-05-08T18:10:57.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9c932640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5606b6810810 0x5606b689eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9c131640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5606b689f0a0 0x5606b68a1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51806/0 (socket says 172.21.15.114:51806) 2024-05-08T18:10:57.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9c131640 1 -- 172.21.15.114:0/2962513261 learned_addr learned my addr 172.21.15.114:0/2962513261 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:57.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9c932640 1 -- 172.21.15.114:0/2962513261 >> v1:172.21.15.53:6789/0 conn(0x5606b689f0a0 legacy=0x5606b68a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.894 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.892+0000 7f5d9c932640 1 -- 172.21.15.114:0/2962513261 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b6723ae0 con 0x5606b6810810 2024-05-08T18:10:57.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9c932640 1 --2- 172.21.15.114:0/2962513261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b689eb60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400a480 tx=0x7f5d8401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf5c7dd5a5590a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9b930640 1 -- 172.21.15.114:0/2962513261 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840b0070 con 0x5606b6810810 2024-05-08T18:10:57.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9b930640 1 -- 172.21.15.114:0/2962513261 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840ab540 con 0x5606b6810810 2024-05-08T18:10:57.897 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9b930640 1 -- 172.21.15.114:0/2962513261 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840ab840 con 0x5606b6810810 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/2962513261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 msgr2=0x5606b689eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/2962513261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b689eb60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400a480 tx=0x7f5d8401b280 comp rx=0 tx=0).stop 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/2962513261 shutdown_connections 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/2962513261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b689eb60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/2962513261 >> 172.21.15.114:0/2962513261 conn(0x5606b6896680 msgr2=0x5606b6898aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/2962513261 shutdown_connections 2024-05-08T18:10:57.898 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.896+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/2962513261 wait complete. 2024-05-08T18:10:57.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9ee1e980 1 Processor -- start 2024-05-08T18:10:57.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9ee1e980 1 -- start start 2024-05-08T18:10:57.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9ee1e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b6987000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9ee1e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606b679ff80 con 0x5606b6810810 2024-05-08T18:10:57.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9c932640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b6987000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9c932640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b6987000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42668/0 (socket says 172.21.15.114:42668) 2024-05-08T18:10:57.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9c932640 1 -- 172.21.15.114:0/1708809246 learned_addr learned my addr 172.21.15.114:0/1708809246 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.914 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9c932640 1 -- 172.21.15.114:0/1708809246 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b6767da0 con 0x5606b6810810 2024-05-08T18:10:57.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.912+0000 7f5d9c932640 1 --2- 172.21.15.114:0/1708809246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b6987000 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ae040 tx=0x7f5d84003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b39529333d6474 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5c8ae0d640 1 -- 172.21.15.114:0/1708809246 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840b0040 con 0x5606b6810810 2024-05-08T18:10:57.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5c8ae0d640 1 -- 172.21.15.114:0/1708809246 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840ab9d0 con 0x5606b6810810 2024-05-08T18:10:57.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5c8ae0d640 1 -- 172.21.15.114:0/1708809246 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840abcf0 con 0x5606b6810810 2024-05-08T18:10:57.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1708809246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 msgr2=0x5606b6987000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/1708809246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b6987000 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ae040 tx=0x7f5d84003030 comp rx=0 tx=0).stop 2024-05-08T18:10:57.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1708809246 shutdown_connections 2024-05-08T18:10:57.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/1708809246 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b6810810 0x5606b6987000 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1708809246 >> 172.21.15.114:0/1708809246 conn(0x5606b6896680 msgr2=0x5606b6982b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1708809246 shutdown_connections 2024-05-08T18:10:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1708809246 wait complete. 2024-05-08T18:10:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 Processor -- start 2024-05-08T18:10:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- start start 2024-05-08T18:10:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 0x5606b698e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606b68a36c0 con 0x5606b689f0a0 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9c932640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 0x5606b698e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9c932640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 0x5606b698e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42684/0 (socket says 172.21.15.114:42684) 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 learned_addr learned my addr 172.21.15.114:0/3397369060 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b698ea40 con 0x5606b689f0a0 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9c932640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 0x5606b698e500 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5d84018eb0 tx=0x7f5d84018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5c8960a640 1 -- 172.21.15.114:0/3397369060 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840c5070 con 0x5606b689f0a0 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5c8960a640 1 -- 172.21.15.114:0/3397369060 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840b67b0 con 0x5606b689f0a0 2024-05-08T18:10:57.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5c8960a640 1 -- 172.21.15.114:0/3397369060 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840b0050 con 0x5606b689f0a0 2024-05-08T18:10:57.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606b698ecd0 con 0x5606b689f0a0 2024-05-08T18:10:57.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.916+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606b6991910 con 0x5606b689f0a0 2024-05-08T18:10:57.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 Processor -- start 2024-05-08T18:10:57.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- start start 2024-05-08T18:10:57.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b689c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606b67a3fc0 con 0x5606b689bd90 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b689c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b689c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42692/0 (socket says 172.21.15.114:42692) 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 -- 172.21.15.114:0/3619640657 learned_addr learned my addr 172.21.15.114:0/3619640657 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5c8960a640 1 -- 172.21.15.114:0/3397369060 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5d840c8070 con 0x5606b689f0a0 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5c8960a640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c84038440 0x7f5c8403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 -- 172.21.15.114:0/3619640657 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b689c6f0 con 0x5606b689bd90 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5c8960a640 1 -- 172.21.15.114:0/3397369060 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5d840bc070 con 0x5606b689f0a0 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9c932640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c84038440 0x7f5c8403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 --2- 172.21.15.114:0/3619640657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b689c1b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400a440 tx=0x7f5d9400a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc97cd0771f95a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9c932640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c84038440 0x7f5c8403a900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b7590 tx=0x7f5d840b7520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5c82ffd640 1 -- 172.21.15.114:0/3619640657 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94008850 con 0x5606b689bd90 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5c82ffd640 1 -- 172.21.15.114:0/3619640657 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94008a10 con 0x5606b689bd90 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5c82ffd640 1 -- 172.21.15.114:0/3619640657 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94008d30 con 0x5606b689bd90 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3619640657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 msgr2=0x5606b689c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3619640657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b689c1b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400a440 tx=0x7f5d9400a900 comp rx=0 tx=0).stop 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3619640657 shutdown_connections 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3619640657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b689c1b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3619640657 >> 172.21.15.114:0/3619640657 conn(0x5606b6996d70 msgr2=0x5606b6997c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3619640657 shutdown_connections 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3619640657 wait complete. 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 Processor -- start 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- start start 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b69a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9ee1e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606b689c980 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b69a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b69a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42696/0 (socket says 172.21.15.114:42696) 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.920+0000 7f5d9d133640 1 -- 172.21.15.114:0/1279708671 learned_addr learned my addr 172.21.15.114:0/1279708671 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9d133640 1 -- 172.21.15.114:0/1279708671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b69a56d0 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9d133640 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b69a5190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5606b69988a0 tx=0x7f5d94003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5c817fa640 1 -- 172.21.15.114:0/1279708671 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94013a70 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606b69a5960 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5c817fa640 1 -- 172.21.15.114:0/1279708671 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d94023070 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5c817fa640 1 -- 172.21.15.114:0/1279708671 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d94013d40 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606b69a8640 con 0x5606b689bd90 2024-05-08T18:10:57.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:57.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:57.926 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5c817fa640 1 -- 172.21.15.114:0/1279708671 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5d94028460 con 0x5606b689bd90 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 1 Processor -- start 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5c817fa640 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 1 -- start start 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5c817fa640 1 -- 172.21.15.114:0/1279708671 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5d9404ebf0 con 0x5606b689bd90 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9d133640 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 0x5606b69bf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9ee1e980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5606b6987690 con 0x5606b69bf080 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9d133640 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d940058b0 tx=0x7f5d94013f60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9c932640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 0x5606b69bf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9c932640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 0x5606b69bf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42698/0 (socket says 172.21.15.114:42698) 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.924+0000 7f5d9c932640 1 -- 172.21.15.114:0/858814814 learned_addr learned my addr 172.21.15.114:0/858814814 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:57.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9c932640 1 -- 172.21.15.114:0/858814814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606b69bf9e0 con 0x5606b69bf080 2024-05-08T18:10:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9c932640 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 0x5606b69bf4a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b9040 tx=0x7f5d840e68a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5c617e2640 1 -- 172.21.15.114:0/858814814 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840d2030 con 0x5606b69bf080 2024-05-08T18:10:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5c617e2640 1 -- 172.21.15.114:0/858814814 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d840d4050 con 0x5606b69bf080 2024-05-08T18:10:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5606b69c0480 con 0x5606b69bf080 2024-05-08T18:10:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5c617e2640 1 -- 172.21.15.114:0/858814814 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d840e61f0 con 0x5606b69bf080 2024-05-08T18:10:57.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606b69c0950 con 0x5606b69bf080 2024-05-08T18:10:57.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5c617e2640 1 -- 172.21.15.114:0/858814814 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f5d840e6390 con 0x5606b69bf080 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5c617e2640 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5bd80383f0 0x7f5bd803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5c617e2640 1 -- 172.21.15.114:0/858814814 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f5d840d3070 con 0x5606b69bf080 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9c131640 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5bd80383f0 0x7f5bd803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5be2ffd640 20 reqs_thread_entry: start 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5606b69c4c60 0x5606b69c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606b69c76f0 con 0x5606b69c4c60 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9c131640 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5bd80383f0 0x7f5bd803a8b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5606b69979d0 tx=0x7f5d8c0066a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9d133640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5606b69c4c60 0x5606b69c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9d133640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5606b69c4c60 0x5606b69c7070 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606b69c7fa0 con 0x5606b69c4c60 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.928+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606b69c9350 con 0x5606b69c4c60 2024-05-08T18:10:57.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cfd40 con 0x5606b69c4c60 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:NOTICE: set zone's realm_id= 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5606b69d3da0 0x5606b69d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c932640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5606b69d3da0 0x5606b69d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c932640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5606b69d3da0 0x5606b69d01c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c932640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d840f2040 0x7f5d840d7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c131640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d840f2040 0x7f5d840d7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c131640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d840f2040 0x7f5d840d7a00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94041040 0x7f5d940273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.932+0000 7f5d9d133640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94041040 0x7f5d940273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94041040 0x7f5d940273c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x7f5d94041040 2024-05-08T18:10:57.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x7f5d94041040 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.936+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x7f5d94041040 2024-05-08T18:10:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=137b] v23'2 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x7f5d94041040 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d9403e040 con 0x5606b69c4c60 2024-05-08T18:10:57.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.940+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d9403e040 con 0x7f5d94041040 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94062040 con 0x7f5d94041040 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69d3da0 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d840c7030 con 0x5606b69d3da0 2024-05-08T18:10:57.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c932640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d94041040 2024-05-08T18:10:57.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d94062040 con 0x7f5d94041040 2024-05-08T18:10:57.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x5606b69c4c60 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d94062040 con 0x5606b69c4c60 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5606b69cf5d0 con 0x7f5d840f2040 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9c131640 1 -- 172.21.15.114:0/3397369060 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d8c00f070 con 0x7f5d840f2040 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606b69d1370 con 0x5606b69c4c60 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d94062040 con 0x5606b69c4c60 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5606b69d1bf0 con 0x5606b69c4c60 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d94062040 con 0x5606b69c4c60 2024-05-08T18:10:57.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.944+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606b69d1ff0 con 0x5606b69c4c60 2024-05-08T18:10:57.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.948+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [create,call,writefull 0~1155] v32'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f5d94062040 con 0x5606b69c4c60 2024-05-08T18:10:57.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.948+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606b69d1bf0 con 0x5606b69c4c60 2024-05-08T18:10:57.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f5d94062040 con 0x5606b69c4c60 2024-05-08T18:10:57.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5606b69d1bf0 con 0x5606b69c4c60 2024-05-08T18:10:57.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'3 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f5d94062040 con 0x5606b69c4c60 2024-05-08T18:10:57.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 msgr2=0x7f5c7403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d940058b0 tx=0x7f5d94013f60 comp rx=0 tx=0).stop 2024-05-08T18:10:57.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 msgr2=0x5606b69a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b69a5190 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x5606b69988a0 tx=0x7f5d94003000 comp rx=0 tx=0).stop 2024-05-08T18:10:57.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 shutdown_connections 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c740383f0 0x7f5c7403a8b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/1279708671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689bd90 0x5606b69a5190 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 >> 172.21.15.114:0/1279708671 conn(0x5606b6996d70 msgr2=0x5606b6997c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 shutdown_connections 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/1279708671 wait complete. 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5bd80383f0 msgr2=0x7f5bd803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5bd80383f0 0x7f5bd803a8b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5606b69979d0 tx=0x7f5d8c0066a0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 msgr2=0x5606b69bf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 0x5606b69bf4a0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b9040 tx=0x7f5d840e68a0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 shutdown_connections 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5bd80383f0 0x7f5bd803a8b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/858814814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b69bf080 0x5606b69bf4a0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 >> 172.21.15.114:0/858814814 conn(0x5606b69b3c60 msgr2=0x5606b69b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 shutdown_connections 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/858814814 wait complete. 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94041040 msgr2=0x7f5d940273c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f5d94041040 0x7f5d940273c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5606b69c4c60 msgr2=0x5606b69c7070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5606b69c4c60 0x5606b69c7070 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d840f2040 msgr2=0x7f5d840d7a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f5d840f2040 0x7f5d840d7a00 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5606b69d3da0 msgr2=0x5606b69d01c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5606b69d3da0 0x5606b69d01c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c84038440 msgr2=0x7f5c8403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.952+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f5c84038440 0x7f5c8403a900 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5d840b7590 tx=0x7f5d840b7520 comp rx=0 tx=0).stop 2024-05-08T18:10:57.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 msgr2=0x5606b698e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 0x5606b698e500 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f5d84018eb0 tx=0x7f5d84018020 comp rx=0 tx=0).stop 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9d133640 1 -- 172.21.15.114:0/3397369060 reap_dead start 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 shutdown_connections 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 --2- 172.21.15.114:0/3397369060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5606b689f0a0 0x5606b698e500 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 >> 172.21.15.114:0/3397369060 conn(0x5606b6896680 msgr2=0x5606b69816a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 shutdown_connections 2024-05-08T18:10:57.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:57.956+0000 7f5d9ee1e980 1 -- 172.21.15.114:0/3397369060 wait complete. 2024-05-08T18:10:57.965 INFO:teuthology.orchestra.run.smithi114.stdout:{"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T18:10:57.965 DEBUG:tasks.util.rgw: json result: {'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T18:10:57.965 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-08T18:10:57.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-08T18:10:57.966 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-08T18:10:58.037 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:58.037 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:58.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.036+0000 7f20b82e4980 1 Processor -- start 2024-05-08T18:10:58.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.036+0000 7f20b82e4980 1 -- start start 2024-05-08T18:10:58.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.036+0000 7f20b82e4980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5559c7585310 0x5559c7587700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.036+0000 7f20b82e4980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559c742d710 con 0x5559c7580db0 2024-05-08T18:10:58.038 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.036+0000 7f20b82e4980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5559c7441f00 con 0x5559c7585310 2024-05-08T18:10:58.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b55f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5559c7585310 0x5559c7587700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b55f7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5559c7585310 0x5559c7587700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42706/0 (socket says 172.21.15.114:42706) 2024-05-08T18:10:58.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b5df8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5559c7580db0 0x5559c7581190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51812/0 (socket says 172.21.15.114:51812) 2024-05-08T18:10:58.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b55f7640 1 -- 172.21.15.114:0/3327602686 learned_addr learned my addr 172.21.15.114:0/3327602686 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.039 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b55f7640 1 -- 172.21.15.114:0/3327602686 >> v1:172.21.15.53:6789/0 conn(0x5559c7580db0 legacy=0x5559c7581190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b55f7640 1 -- 172.21.15.114:0/3327602686 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c7409ae0 con 0x5559c7585310 2024-05-08T18:10:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b55f7640 1 --2- 172.21.15.114:0/3327602686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7585310 0x5559c7587700 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f20a800a5c0 tx=0x7f20a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b05af58d88b40c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b4df6640 1 -- 172.21.15.114:0/3327602686 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80a6070 con 0x5559c7585310 2024-05-08T18:10:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b4df6640 1 -- 172.21.15.114:0/3327602686 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a80af070 con 0x5559c7585310 2024-05-08T18:10:58.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b4df6640 1 -- 172.21.15.114:0/3327602686 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a80aa5c0 con 0x5559c7585310 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b82e4980 1 -- 172.21.15.114:0/3327602686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7585310 msgr2=0x5559c7587700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b82e4980 1 --2- 172.21.15.114:0/3327602686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7585310 0x5559c7587700 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f20a800a5c0 tx=0x7f20a801b340 comp rx=0 tx=0).stop 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b82e4980 1 -- 172.21.15.114:0/3327602686 shutdown_connections 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b82e4980 1 --2- 172.21.15.114:0/3327602686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7585310 0x5559c7587700 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.040+0000 7f20b82e4980 1 -- 172.21.15.114:0/3327602686 >> 172.21.15.114:0/3327602686 conn(0x5559c757c680 msgr2=0x5559c757eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.044+0000 7f20b82e4980 1 -- 172.21.15.114:0/3327602686 shutdown_connections 2024-05-08T18:10:58.043 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.044+0000 7f20b82e4980 1 -- 172.21.15.114:0/3327602686 wait complete. 2024-05-08T18:10:58.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.056+0000 7f20b82e4980 1 Processor -- start 2024-05-08T18:10:58.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.056+0000 7f20b82e4980 1 -- start start 2024-05-08T18:10:58.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.056+0000 7f20b82e4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c766beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.058 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.056+0000 7f20b82e4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559c7485f80 con 0x5559c7580db0 2024-05-08T18:10:58.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.056+0000 7f20b5df8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c766beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c766beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42712/0 (socket says 172.21.15.114:42712) 2024-05-08T18:10:58.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 -- 172.21.15.114:0/2350345781 learned_addr learned my addr 172.21.15.114:0/2350345781 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 -- 172.21.15.114:0/2350345781 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c744dda0 con 0x5559c7580db0 2024-05-08T18:10:58.059 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 --2- 172.21.15.114:0/2350345781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c766beb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f20a0001ec0 tx=0x7f20a000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4c8e69a502cef1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f1fa2e15640 1 -- 172.21.15.114:0/2350345781 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a000e5d0 con 0x5559c7580db0 2024-05-08T18:10:58.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f1fa2e15640 1 -- 172.21.15.114:0/2350345781 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a000e770 con 0x5559c7580db0 2024-05-08T18:10:58.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f1fa2e15640 1 -- 172.21.15.114:0/2350345781 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a000ea70 con 0x5559c7580db0 2024-05-08T18:10:58.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- 172.21.15.114:0/2350345781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 msgr2=0x5559c766beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 --2- 172.21.15.114:0/2350345781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c766beb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f20a0001ec0 tx=0x7f20a000b6d0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- 172.21.15.114:0/2350345781 shutdown_connections 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 --2- 172.21.15.114:0/2350345781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c766beb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- 172.21.15.114:0/2350345781 >> 172.21.15.114:0/2350345781 conn(0x5559c757c680 msgr2=0x5559c7667a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- 172.21.15.114:0/2350345781 shutdown_connections 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- 172.21.15.114:0/2350345781 wait complete. 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 Processor -- start 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- start start 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c76721d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b82e4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559c758a730 con 0x5559c7580db0 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c76721d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c76721d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42718/0 (socket says 172.21.15.114:42718) 2024-05-08T18:10:58.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 -- 172.21.15.114:0/1215881153 learned_addr learned my addr 172.21.15.114:0/1215881153 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 -- 172.21.15.114:0/1215881153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c7672710 con 0x5559c7580db0 2024-05-08T18:10:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.060+0000 7f20b5df8640 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c76721d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x5559c766cd40 tx=0x7f20a0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1fa1612640 1 -- 172.21.15.114:0/1215881153 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a000f8a0 con 0x5559c7580db0 2024-05-08T18:10:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559c76729a0 con 0x5559c7580db0 2024-05-08T18:10:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1fa1612640 1 -- 172.21.15.114:0/1215881153 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a000fa40 con 0x5559c7580db0 2024-05-08T18:10:58.064 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1fa1612640 1 -- 172.21.15.114:0/1215881153 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a000fd20 con 0x5559c7580db0 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c7675630 con 0x5559c7580db0 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 Processor -- start 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- start start 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c767fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559c7489fc0 con 0x5559c767f660 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b65f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c767fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b65f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c767fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42722/0 (socket says 172.21.15.114:42722) 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b65f9640 1 -- 172.21.15.114:0/1305301063 learned_addr learned my addr 172.21.15.114:0/1305301063 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1fa1612640 1 -- 172.21.15.114:0/1215881153 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f20a0017070 con 0x5559c7580db0 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1fa1612640 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f9c03a600 0x7f1f9c03cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1fa1612640 1 -- 172.21.15.114:0/1215881153 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f20a0015020 con 0x5559c7580db0 2024-05-08T18:10:58.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b5df8640 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f9c03a600 0x7f1f9c03cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b65f9640 1 -- 172.21.15.114:0/1305301063 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c767ffc0 con 0x5559c767f660 2024-05-08T18:10:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b5df8640 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f9c03a600 0x7f1f9c03cac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f20a00016d0 tx=0x7f20a000ff40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b65f9640 1 --2- 172.21.15.114:0/1305301063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c767fa80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a430 tx=0x7f20b000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e337204ce70f3e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1f9affd640 1 -- 172.21.15.114:0/1305301063 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b000f6e0 con 0x5559c767f660 2024-05-08T18:10:58.067 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1f9affd640 1 -- 172.21.15.114:0/1305301063 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0015070 con 0x5559c767f660 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f1f9affd640 1 -- 172.21.15.114:0/1305301063 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b000fa10 con 0x5559c767f660 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1305301063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 msgr2=0x5559c767fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1305301063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c767fa80 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a430 tx=0x7f20b000a8f0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1305301063 shutdown_connections 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1305301063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c767fa80 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1305301063 >> 172.21.15.114:0/1305301063 conn(0x5559c7585310 msgr2=0x5559c767aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1305301063 shutdown_connections 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- 172.21.15.114:0/1305301063 wait complete. 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 Processor -- start 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- start start 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c76869e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.064+0000 7f20b82e4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559c7680980 con 0x5559c767f660 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c76869e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c76869e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42728/0 (socket says 172.21.15.114:42728) 2024-05-08T18:10:58.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 -- 172.21.15.114:0/1532403840 learned_addr learned my addr 172.21.15.114:0/1532403840 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 -- 172.21.15.114:0/1532403840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c7686f20 con 0x5559c767f660 2024-05-08T18:10:58.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c76869e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a930 tx=0x7f20b0003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f1f997fa640 1 -- 172.21.15.114:0/1532403840 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0005a50 con 0x5559c767f660 2024-05-08T18:10:58.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f1f997fa640 1 -- 172.21.15.114:0/1532403840 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b00109a0 con 0x5559c767f660 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f1f997fa640 1 -- 172.21.15.114:0/1532403840 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b0010cc0 con 0x5559c767f660 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559c76871b0 con 0x5559c767f660 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c7689e90 con 0x5559c767f660 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f1f997fa640 1 -- 172.21.15.114:0/1532403840 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f20b001a480 con 0x5559c767f660 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b82e4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b82e4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f1f997fa640 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f8c038440 0x7f1f8c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f1f997fa640 1 -- 172.21.15.114:0/1532403840 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f20b004eea0 con 0x5559c767f660 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f8c038440 0x7f1f8c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b82e4980 1 Processor -- start 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b82e4980 1 -- start start 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.068+0000 7f20b65f9640 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f8c038440 0x7f1f8c03a900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f20b0000f90 tx=0x7f20b004f190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b82e4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 0x5559c76a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b82e4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5559c766c5d0 con 0x5559c76a0910 2024-05-08T18:10:58.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b5df8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 0x5559c76a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b5df8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 0x5559c76a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42732/0 (socket says 172.21.15.114:42732) 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b5df8640 1 -- 172.21.15.114:0/871321916 learned_addr learned my addr 172.21.15.114:0/871321916 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b5df8640 1 -- 172.21.15.114:0/871321916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c76a1270 con 0x5559c76a0910 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b5df8640 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 0x5559c76a0d30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f20a001d620 tx=0x7f20a004f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1f797e2640 1 -- 172.21.15.114:0/871321916 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a0017720 con 0x5559c76a0910 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559c76a1d10 con 0x5559c76a0910 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1f797e2640 1 -- 172.21.15.114:0/871321916 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a00178c0 con 0x5559c76a0910 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1f797e2640 1 -- 172.21.15.114:0/871321916 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a00165d0 con 0x5559c76a0910 2024-05-08T18:10:58.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c76a21e0 con 0x5559c76a0910 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1f797e2640 1 -- 172.21.15.114:0/871321916 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f20a0016a10 con 0x5559c76a0910 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1f797e2640 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ef00383a0 0x7f1ef003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1f797e2640 1 -- 172.21.15.114:0/871321916 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f20a0043070 con 0x5559c76a0910 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b55f7640 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ef00383a0 0x7f1ef003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f1efaffd640 20 reqs_thread_entry: start 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5559c76a6310 0x5559c76a8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559c76a8dc0 con 0x5559c76a6310 2024-05-08T18:10:58.074 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b65f9640 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5559c76a6310 0x5559c76a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b55f7640 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ef00383a0 0x7f1ef003a860 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20a80ae000 tx=0x7f20a80a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.072+0000 7f20b65f9640 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5559c76a6310 0x5559c76a8740 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b65f9640 1 -- 172.21.15.114:0/1215881153 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20b000e070 con 0x5559c76a6310 2024-05-08T18:10:58.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559c76a92f0 con 0x5559c76a6310 2024-05-08T18:10:58.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b65f9640 1 -- 172.21.15.114:0/1215881153 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b000e070 con 0x5559c76a6310 2024-05-08T18:10:58.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5559c76aabf0 con 0x5559c76a6310 2024-05-08T18:10:58.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b65f9640 1 -- 172.21.15.114:0/1215881153 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f20b000e070 con 0x5559c76a6310 2024-05-08T18:10:58.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f8c038440 msgr2=0x7f1f8c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.077 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f8c038440 0x7f1f8c03a900 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f20b0000f90 tx=0x7f20b004f190 comp rx=0 tx=0).stop 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 msgr2=0x5559c76869e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c76869e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f20b000a930 tx=0x7f20b0003380 comp rx=0 tx=0).stop 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 shutdown_connections 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f8c038440 0x7f1f8c03a900 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1532403840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c767f660 0x5559c76869e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 >> 172.21.15.114:0/1532403840 conn(0x5559c7585310 msgr2=0x5559c76798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 shutdown_connections 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1532403840 wait complete. 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ef00383a0 msgr2=0x7f1ef003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ef00383a0 0x7f1ef003a860 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f20a80ae000 tx=0x7f20a80a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 msgr2=0x5559c76a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 0x5559c76a0d30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f20a001d620 tx=0x7f20a004f420 comp rx=0 tx=0).stop 2024-05-08T18:10:58.078 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 shutdown_connections 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1ef00383a0 0x7f1ef003a860 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/871321916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c76a0910 0x5559c76a0d30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 >> 172.21.15.114:0/871321916 conn(0x5559c76954f0 msgr2=0x5559c7695f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 shutdown_connections 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/871321916 wait complete. 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5559c76a6310 msgr2=0x5559c76a8740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5559c76a6310 0x5559c76a8740 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f9c03a600 msgr2=0x7f1f9c03cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f9c03a600 0x7f1f9c03cac0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f20a00016d0 tx=0x7f20a000ff40 comp rx=0 tx=0).stop 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 msgr2=0x5559c76721d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c76721d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x5559c766cd40 tx=0x7f20a0000bd0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 shutdown_connections 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5559c76a6310 0x5559c76a8740 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1f9c03a600 0x7f1f9c03cac0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 --2- 172.21.15.114:0/1215881153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5559c7580db0 0x5559c76721d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 >> 172.21.15.114:0/1215881153 conn(0x5559c757c680 msgr2=0x5559c7666550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 shutdown_connections 2024-05-08T18:10:58.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.076+0000 7f20b82e4980 1 -- 172.21.15.114:0/1215881153 wait complete. 2024-05-08T18:10:58.090 INFO:teuthology.orchestra.run.smithi114.stdout:{"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T18:10:58.090 DEBUG:tasks.util.rgw: json result: {'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T18:10:58.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:10:58.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T18:10:58.091 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T18:10:58.176 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:58.177 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:58.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa3230d7980 1 Processor -- start 2024-05-08T18:10:58.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa3230d7980 1 -- start start 2024-05-08T18:10:58.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa3230d7980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fd60420880 0x55fd604b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa3230d7980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fd60357710 con 0x55fd604b1530 2024-05-08T18:10:58.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa3230d7980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55fd6036bf00 con 0x55fd60420880 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa320beb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fd60420880 0x55fd604b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa320beb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55fd60420880 0x55fd604b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42746/0 (socket says 172.21.15.114:42746) 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa3203ea640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55fd604b1530 0x55fd604b3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51820/0 (socket says 172.21.15.114:51820) 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.176+0000 7fa320beb640 1 -- 172.21.15.114:0/717215795 learned_addr learned my addr 172.21.15.114:0/717215795 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa320beb640 1 -- 172.21.15.114:0/717215795 >> v1:172.21.15.53:6789/0 conn(0x55fd604b1530 legacy=0x55fd604b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa320beb640 1 -- 172.21.15.114:0/717215795 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd60333ae0 con 0x55fd60420880 2024-05-08T18:10:58.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa31fbe9640 1 -- 172.21.15.114:0/717215795 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658596226 0 0) 0x55fd60357710 con 0x55fd604b1530 2024-05-08T18:10:58.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa320beb640 1 --2- 172.21.15.114:0/717215795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd604b0ff0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa31800a4e0 tx=0x7fa31801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7662efe6d992e17 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa31fbe9640 1 -- 172.21.15.114:0/717215795 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180aa540 con 0x55fd60420880 2024-05-08T18:10:58.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa31fbe9640 1 -- 172.21.15.114:0/717215795 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180aa6e0 con 0x55fd60420880 2024-05-08T18:10:58.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa31fbe9640 1 -- 172.21.15.114:0/717215795 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180aaa00 con 0x55fd60420880 2024-05-08T18:10:58.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa3230d7980 1 -- 172.21.15.114:0/717215795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 msgr2=0x55fd604b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa3230d7980 1 --2- 172.21.15.114:0/717215795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd604b0ff0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa31800a4e0 tx=0x7fa31801b090 comp rx=0 tx=0).stop 2024-05-08T18:10:58.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa3230d7980 1 -- 172.21.15.114:0/717215795 shutdown_connections 2024-05-08T18:10:58.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa3230d7980 1 --2- 172.21.15.114:0/717215795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd604b0ff0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa3230d7980 1 -- 172.21.15.114:0/717215795 >> 172.21.15.114:0/717215795 conn(0x55fd604a66d0 msgr2=0x55fd604a8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.180+0000 7fa3230d7980 1 -- 172.21.15.114:0/717215795 shutdown_connections 2024-05-08T18:10:58.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.184+0000 7fa3230d7980 1 -- 172.21.15.114:0/717215795 wait complete. 2024-05-08T18:10:58.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa3230d7980 1 Processor -- start 2024-05-08T18:10:58.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa3230d7980 1 -- start start 2024-05-08T18:10:58.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa3230d7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd60599160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa3230d7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd603aff80 con 0x55fd60420880 2024-05-08T18:10:58.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa320beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd60599160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa320beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd60599160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42758/0 (socket says 172.21.15.114:42758) 2024-05-08T18:10:58.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa320beb640 1 -- 172.21.15.114:0/2236545622 learned_addr learned my addr 172.21.15.114:0/2236545622 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.196+0000 7fa320beb640 1 -- 172.21.15.114:0/2236545622 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd60377da0 con 0x55fd60420880 2024-05-08T18:10:58.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa320beb640 1 --2- 172.21.15.114:0/2236545622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd60599160 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa318017ca0 tx=0x7fa3180033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96b362f75bd128 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa20ee0d640 1 -- 172.21.15.114:0/2236545622 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180b9070 con 0x55fd60420880 2024-05-08T18:10:58.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa20ee0d640 1 -- 172.21.15.114:0/2236545622 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180aaa80 con 0x55fd60420880 2024-05-08T18:10:58.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa20ee0d640 1 -- 172.21.15.114:0/2236545622 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180aad60 con 0x55fd60420880 2024-05-08T18:10:58.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/2236545622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 msgr2=0x55fd60599160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 --2- 172.21.15.114:0/2236545622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd60599160 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa318017ca0 tx=0x7fa3180033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/2236545622 shutdown_connections 2024-05-08T18:10:58.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 --2- 172.21.15.114:0/2236545622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd60599160 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/2236545622 >> 172.21.15.114:0/2236545622 conn(0x55fd604a66d0 msgr2=0x55fd60594cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/2236545622 shutdown_connections 2024-05-08T18:10:58.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/2236545622 wait complete. 2024-05-08T18:10:58.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 Processor -- start 2024-05-08T18:10:58.201 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- start start 2024-05-08T18:10:58.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd605a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd604b7b60 con 0x55fd60420880 2024-05-08T18:10:58.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa320beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd605a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa320beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd605a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42760/0 (socket says 172.21.15.114:42760) 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa320beb640 1 -- 172.21.15.114:0/3824496513 learned_addr learned my addr 172.21.15.114:0/3824496513 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa320beb640 1 -- 172.21.15.114:0/3824496513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd605a0a70 con 0x55fd60420880 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa320beb640 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd605a0530 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa318017ca0 tx=0x7fa318017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa20d60a640 1 -- 172.21.15.114:0/3824496513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180b9070 con 0x55fd60420880 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa20d60a640 1 -- 172.21.15.114:0/3824496513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180b5e10 con 0x55fd60420880 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd605a0d00 con 0x55fd60420880 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa20d60a640 1 -- 172.21.15.114:0/3824496513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180bd780 con 0x55fd60420880 2024-05-08T18:10:58.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.200+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd605a3990 con 0x55fd60420880 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 Processor -- start 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- start start 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605ade30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd603b3fc0 con 0x55fd605ada10 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa20d60a640 1 -- 172.21.15.114:0/3824496513 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa3180b3040 con 0x55fd60420880 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42772/0 (socket says 172.21.15.114:42772) 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 -- 172.21.15.114:0/870835015 learned_addr learned my addr 172.21.15.114:0/870835015 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa20d60a640 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa208038440 0x7fa20803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa20d60a640 1 -- 172.21.15.114:0/3824496513 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa3180c4070 con 0x55fd60420880 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa320beb640 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa208038440 0x7fa20803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 -- 172.21.15.114:0/870835015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd605ae370 con 0x55fd605ada10 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa320beb640 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa208038440 0x7fa20803a900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b4010 tx=0x7fa3180a4000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 --2- 172.21.15.114:0/870835015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605ade30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa31000a440 tx=0x7fa31000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4969c82a5a2bb3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa206ffd640 1 -- 172.21.15.114:0/870835015 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa310008850 con 0x55fd605ada10 2024-05-08T18:10:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa206ffd640 1 -- 172.21.15.114:0/870835015 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa310008a10 con 0x55fd605ada10 2024-05-08T18:10:58.206 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa206ffd640 1 -- 172.21.15.114:0/870835015 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa310008d30 con 0x55fd605ada10 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- 172.21.15.114:0/870835015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 msgr2=0x55fd605ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 --2- 172.21.15.114:0/870835015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605ade30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa31000a440 tx=0x7fa31000a900 comp rx=0 tx=0).stop 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- 172.21.15.114:0/870835015 shutdown_connections 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 --2- 172.21.15.114:0/870835015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605ade30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- 172.21.15.114:0/870835015 >> 172.21.15.114:0/870835015 conn(0x55fd604b1530 msgr2=0x55fd605a8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- 172.21.15.114:0/870835015 shutdown_connections 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- 172.21.15.114:0/870835015 wait complete. 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 Processor -- start 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- start start 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3230d7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd605aed30 con 0x55fd605ada10 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42778/0 (socket says 172.21.15.114:42778) 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.204+0000 7fa3213ec640 1 -- 172.21.15.114:0/617065888 learned_addr learned my addr 172.21.15.114:0/617065888 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3213ec640 1 -- 172.21.15.114:0/617065888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd605b51e0 con 0x55fd605ada10 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3213ec640 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605b4ca0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55fd605ae7f0 tx=0x7fa310003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa2057fa640 1 -- 172.21.15.114:0/617065888 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa310013a70 con 0x55fd605ada10 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa2057fa640 1 -- 172.21.15.114:0/617065888 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa310023070 con 0x55fd605ada10 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd605b5470 con 0x55fd605ada10 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd605b8150 con 0x55fd605ada10 2024-05-08T18:10:58.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa2057fa640 1 -- 172.21.15.114:0/617065888 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa310013d40 con 0x55fd605ada10 2024-05-08T18:10:58.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:58.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:58.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa2057fa640 1 -- 172.21.15.114:0/617065888 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa310028460 con 0x55fd605ada10 2024-05-08T18:10:58.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 1 Processor -- start 2024-05-08T18:10:58.211 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 1 -- start start 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa2057fa640 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1f80383f0 0x7fa1f803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa2057fa640 1 -- 172.21.15.114:0/617065888 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa31004ebe0 con 0x55fd605ada10 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3213ec640 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1f80383f0 0x7fa1f803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 0x55fd605cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3230d7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55fd605997f0 con 0x55fd605cec00 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa3213ec640 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1f80383f0 0x7fa1f803a8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa310002fd0 tx=0x7fa310027ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa320beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 0x55fd605cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa320beb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 0x55fd605cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42792/0 (socket says 172.21.15.114:42792) 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa320beb640 1 -- 172.21.15.114:0/3838006046 learned_addr learned my addr 172.21.15.114:0/3838006046 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.208+0000 7fa320beb640 1 -- 172.21.15.114:0/3838006046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd605cf560 con 0x55fd605cec00 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa320beb640 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 0x55fd605cf020 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b3f10 tx=0x7fa3180e7670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa1e57e2640 1 -- 172.21.15.114:0/3838006046 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180bc7a0 con 0x55fd605cec00 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa1e57e2640 1 -- 172.21.15.114:0/3838006046 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3180bc940 con 0x55fd605cec00 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa1e57e2640 1 -- 172.21.15.114:0/3838006046 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3180e7020 con 0x55fd605cec00 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd605cf7f0 con 0x55fd605cec00 2024-05-08T18:10:58.212 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd605d0340 con 0x55fd605cec00 2024-05-08T18:10:58.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa1e57e2640 1 -- 172.21.15.114:0/3838006046 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa3180f0060 con 0x55fd605cec00 2024-05-08T18:10:58.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa1e57e2640 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa15c0383f0 0x7fa15c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa1e57e2640 1 -- 172.21.15.114:0/3838006046 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa3180e3070 con 0x55fd605cec00 2024-05-08T18:10:58.214 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3203ea640 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa15c0383f0 0x7fa15c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa166ffd640 20 reqs_thread_entry: start 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd605d4710 0x55fd605d6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd605d7280 con 0x55fd605d4710 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3203ea640 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa15c0383f0 0x7fa15c03a8b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa308000c10 tx=0x7fa308001340 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3213ec640 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd605d4710 0x55fd605d6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3213ec640 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd605d4710 0x55fd605d6bd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3213ec640 1 -- 172.21.15.114:0/3824496513 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa310011390 con 0x55fd605d4710 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fd605d8b40 con 0x55fd605d4710 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3213ec640 1 -- 172.21.15.114:0/3824496513 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fa310011390 con 0x55fd605d4710 2024-05-08T18:10:58.215 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.212+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fd605dd690 con 0x55fd605d4710 2024-05-08T18:10:58.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3213ec640 1 -- 172.21.15.114:0/3824496513 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [stat,call,call,writefull 0~993] v32'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fa310011390 con 0x55fd605d4710 2024-05-08T18:10:58.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1f80383f0 msgr2=0x7fa1f803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1f80383f0 0x7fa1f803a8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa310002fd0 tx=0x7fa310027ec0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 msgr2=0x55fd605b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605b4ca0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x55fd605ae7f0 tx=0x7fa310003000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 shutdown_connections 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa1f80383f0 0x7fa1f803a8b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/617065888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605ada10 0x55fd605b4ca0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 >> 172.21.15.114:0/617065888 conn(0x55fd604b1530 msgr2=0x55fd605a7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 shutdown_connections 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/617065888 wait complete. 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa15c0383f0 msgr2=0x7fa15c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa15c0383f0 0x7fa15c03a8b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa308000c10 tx=0x7fa308001340 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 msgr2=0x55fd605cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 0x55fd605cf020 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b3f10 tx=0x7fa3180e7670 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 shutdown_connections 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa15c0383f0 0x7fa15c03a8b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3838006046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd605cec00 0x55fd605cf020 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 >> 172.21.15.114:0/3838006046 conn(0x55fd605c37f0 msgr2=0x55fd605c4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 shutdown_connections 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.216+0000 7fa3230d7980 1 -- 172.21.15.114:0/3838006046 wait complete. 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd605d4710 msgr2=0x55fd605d6bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd605d4710 0x55fd605d6bd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa208038440 msgr2=0x7fa20803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa208038440 0x7fa20803a900 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b4010 tx=0x7fa3180a4000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 msgr2=0x55fd605a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd605a0530 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa318017ca0 tx=0x7fa318017e30 comp rx=0 tx=0).stop 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 shutdown_connections 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55fd605d4710 0x55fd605d6bd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa208038440 0x7fa20803a900 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 --2- 172.21.15.114:0/3824496513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd60420880 0x55fd605a0530 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 >> 172.21.15.114:0/3824496513 conn(0x55fd604a66d0 msgr2=0x55fd60593800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 shutdown_connections 2024-05-08T18:10:58.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.220+0000 7fa3230d7980 1 -- 172.21.15.114:0/3824496513 wait complete. 2024-05-08T18:10:58.229 INFO:teuthology.orchestra.run.smithi114.stdout:{"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T18:10:58.229 DEBUG:tasks.util.rgw: json result: {'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T18:10:58.229 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-08T18:10:58.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-08T18:10:58.230 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-08T18:10:58.304 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:58.304 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7db000b980 1 Processor -- start 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7db000b980 1 -- start start 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7db000b980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f20826c310 0x55f20826e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7db000b980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f208114710 con 0x55f208267db0 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7db000b980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f208128f00 con 0x55f20826c310 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7dad31e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f20826c310 0x55f20826e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7dad31e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f20826c310 0x55f20826e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42808/0 (socket says 172.21.15.114:42808) 2024-05-08T18:10:58.305 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7dad31e640 1 -- 172.21.15.114:0/3136881970 learned_addr learned my addr 172.21.15.114:0/3136881970 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7dadb1f640 1 --1- 172.21.15.114:0/3136881970 >> v1:172.21.15.53:6789/0 conn(0x55f208267db0 0x55f208268190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51826/0 (socket says 172.21.15.114:51826) 2024-05-08T18:10:58.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7dad31e640 1 -- 172.21.15.114:0/3136881970 >> v1:172.21.15.53:6789/0 conn(0x55f208267db0 legacy=0x55f208268190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.304+0000 7f7dad31e640 1 -- 172.21.15.114:0/3136881970 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2080f0ae0 con 0x55f20826c310 2024-05-08T18:10:58.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7dad31e640 1 --2- 172.21.15.114:0/3136881970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20826e700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800a5c0 tx=0x7f7d9801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12244a2b50720756 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7dacb1d640 1 -- 172.21.15.114:0/3136881970 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d980a6070 con 0x55f20826c310 2024-05-08T18:10:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7dacb1d640 1 -- 172.21.15.114:0/3136881970 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d980af070 con 0x55f20826c310 2024-05-08T18:10:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7dacb1d640 1 -- 172.21.15.114:0/3136881970 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d980aa5c0 con 0x55f20826c310 2024-05-08T18:10:58.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 -- 172.21.15.114:0/3136881970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 msgr2=0x55f20826e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 --2- 172.21.15.114:0/3136881970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20826e700 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800a5c0 tx=0x7f7d9801b340 comp rx=0 tx=0).stop 2024-05-08T18:10:58.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 -- 172.21.15.114:0/3136881970 shutdown_connections 2024-05-08T18:10:58.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 --2- 172.21.15.114:0/3136881970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20826e700 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 -- 172.21.15.114:0/3136881970 >> 172.21.15.114:0/3136881970 conn(0x55f208263680 msgr2=0x55f208265aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 -- 172.21.15.114:0/3136881970 shutdown_connections 2024-05-08T18:10:58.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.308+0000 7f7db000b980 1 -- 172.21.15.114:0/3136881970 wait complete. 2024-05-08T18:10:58.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7db000b980 1 Processor -- start 2024-05-08T18:10:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7db000b980 1 -- start start 2024-05-08T18:10:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7db000b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 0x55f208351da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7db000b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f20816cf80 con 0x55f208267db0 2024-05-08T18:10:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7dadb1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 0x55f208351da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7dadb1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 0x55f208351da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42814/0 (socket says 172.21.15.114:42814) 2024-05-08T18:10:58.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7dadb1f640 1 -- 172.21.15.114:0/1207694742 learned_addr learned my addr 172.21.15.114:0/1207694742 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7dadb1f640 1 -- 172.21.15.114:0/1207694742 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f208134da0 con 0x55f208267db0 2024-05-08T18:10:58.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.324+0000 7f7dadb1f640 1 --2- 172.21.15.114:0/1207694742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 0x55f208351da0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7da000b270 tx=0x7f7da000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3979471bae6ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7c9be07640 1 -- 172.21.15.114:0/1207694742 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da000e5d0 con 0x55f208267db0 2024-05-08T18:10:58.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7c9be07640 1 -- 172.21.15.114:0/1207694742 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da000e770 con 0x55f208267db0 2024-05-08T18:10:58.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7c9be07640 1 -- 172.21.15.114:0/1207694742 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da000ea70 con 0x55f208267db0 2024-05-08T18:10:58.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/1207694742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 msgr2=0x55f208351da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 --2- 172.21.15.114:0/1207694742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 0x55f208351da0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7da000b270 tx=0x7f7da000b670 comp rx=0 tx=0).stop 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/1207694742 shutdown_connections 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 --2- 172.21.15.114:0/1207694742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f208267db0 0x55f208351da0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/1207694742 >> 172.21.15.114:0/1207694742 conn(0x55f208263680 msgr2=0x55f20834d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/1207694742 shutdown_connections 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/1207694742 wait complete. 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 Processor -- start 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- start start 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20835d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2081dce30 con 0x55f20826c310 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7dadb1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20835d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7dadb1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20835d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42822/0 (socket says 172.21.15.114:42822) 2024-05-08T18:10:58.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7dadb1f640 1 -- 172.21.15.114:0/2428689950 learned_addr learned my addr 172.21.15.114:0/2428689950 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7dadb1f640 1 -- 172.21.15.114:0/2428689950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20835dcf0 con 0x55f20826c310 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7dadb1f640 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20835d7b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7da000b6b0 tx=0x7f7da0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7c9a604640 1 -- 172.21.15.114:0/2428689950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da000be70 con 0x55f20826c310 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7c9a604640 1 -- 172.21.15.114:0/2428689950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da000f9a0 con 0x55f20826c310 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20835df80 con 0x55f20826c310 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7c9a604640 1 -- 172.21.15.114:0/2428689950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da000fce0 con 0x55f20826c310 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.328+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f208360c60 con 0x55f20826c310 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 Processor -- start 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- start start 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f20836b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f208170fc0 con 0x55f20836b4c0 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7c9a604640 1 -- 172.21.15.114:0/2428689950 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7da0017070 con 0x55f20826c310 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f20836b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f20836b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42824/0 (socket says 172.21.15.114:42824) 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 -- 172.21.15.114:0/3442662459 learned_addr learned my addr 172.21.15.114:0/3442662459 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7c9a604640 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c940383f0 0x7f7c9403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7c9a604640 1 -- 172.21.15.114:0/2428689950 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f7da0015020 con 0x55f20826c310 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dadb1f640 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c940383f0 0x7f7c9403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 -- 172.21.15.114:0/3442662459 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20836be20 con 0x55f20836b4c0 2024-05-08T18:10:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dadb1f640 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c940383f0 0x7f7c9403a8b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7da000ff60 tx=0x7f7da000ef40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 --2- 172.21.15.114:0/3442662459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f20836b8e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a430 tx=0x7f7da800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6445e4abc0398b2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7c93fff640 1 -- 172.21.15.114:0/3442662459 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da800f6e0 con 0x55f20836b4c0 2024-05-08T18:10:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7c93fff640 1 -- 172.21.15.114:0/3442662459 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8015070 con 0x55f20836b4c0 2024-05-08T18:10:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7c93fff640 1 -- 172.21.15.114:0/3442662459 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da800fa10 con 0x55f20836b4c0 2024-05-08T18:10:58.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- 172.21.15.114:0/3442662459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 msgr2=0x55f20836b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 --2- 172.21.15.114:0/3442662459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f20836b8e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a430 tx=0x7f7da800a8f0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- 172.21.15.114:0/3442662459 shutdown_connections 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 --2- 172.21.15.114:0/3442662459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f20836b8e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- 172.21.15.114:0/3442662459 >> 172.21.15.114:0/3442662459 conn(0x55f2083660e0 msgr2=0x55f208366fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- 172.21.15.114:0/3442662459 shutdown_connections 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- 172.21.15.114:0/3442662459 wait complete. 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 Processor -- start 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- start start 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f208372430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7db000b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f20836c360 con 0x55f20836b4c0 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f208372430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f208372430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42832/0 (socket says 172.21.15.114:42832) 2024-05-08T18:10:58.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.332+0000 7f7dae320640 1 -- 172.21.15.114:0/2640936361 learned_addr learned my addr 172.21.15.114:0/2640936361 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dae320640 1 -- 172.21.15.114:0/2640936361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f208372970 con 0x55f20836b4c0 2024-05-08T18:10:58.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dae320640 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f208372430 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a930 tx=0x7f7da8003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7c927fc640 1 -- 172.21.15.114:0/2640936361 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da8005a50 con 0x55f20836b4c0 2024-05-08T18:10:58.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7c927fc640 1 -- 172.21.15.114:0/2640936361 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da80109a0 con 0x55f20836b4c0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f208372c00 con 0x55f20836b4c0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7c927fc640 1 -- 172.21.15.114:0/2640936361 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da8010cc0 con 0x55f20836b4c0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2083758e0 con 0x55f20836b4c0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7c927fc640 1 -- 172.21.15.114:0/2640936361 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7da801a480 con 0x55f20836b4c0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 1 Processor -- start 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 1 -- start start 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7c927fc640 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c88038440 0x7f7c8803a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7c927fc640 1 -- 172.21.15.114:0/2640936361 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f7da804eea0 con 0x55f20836b4c0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 0x55f20838c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7db000b980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f2083524f0 con 0x55f20838c360 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dae320640 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c88038440 0x7f7c8803a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dadb1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 0x55f20838c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dadb1f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 0x55f20838c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42836/0 (socket says 172.21.15.114:42836) 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dadb1f640 1 -- 172.21.15.114:0/3041592023 learned_addr learned my addr 172.21.15.114:0/3041592023 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dae320640 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c88038440 0x7f7c8803a900 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f90 tx=0x7f7da8019ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.336+0000 7f7dadb1f640 1 -- 172.21.15.114:0/3041592023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f20838ccc0 con 0x55f20838c360 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dadb1f640 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 0x55f20838c780 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7da0017ab0 tx=0x7f7da001df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7c727e4640 1 -- 172.21.15.114:0/3041592023 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da001bcd0 con 0x55f20838c360 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f20838d760 con 0x55f20838c360 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7c727e4640 1 -- 172.21.15.114:0/3041592023 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da001c450 con 0x55f20838c360 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7c727e4640 1 -- 172.21.15.114:0/3041592023 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7da0017720 con 0x55f20838c360 2024-05-08T18:10:58.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20838d760 con 0x55f20838c360 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7c727e4640 1 -- 172.21.15.114:0/3041592023 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7da004d120 con 0x55f20838c360 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7c727e4640 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7bf00383f0 0x7f7bf003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7c727e4640 1 -- 172.21.15.114:0/3041592023 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f7da004bd10 con 0x55f20838c360 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dad31e640 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7bf00383f0 0x7f7bf003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7be3fff640 20 reqs_thread_entry: start 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f208391d80 0x55f208394170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f208394740 con 0x55f208391d80 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dad31e640 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7bf00383f0 0x7f7bf003a8b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ae000 tx=0x7f7d980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dae320640 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f208391d80 0x55f208394170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dae320640 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f208391d80 0x55f208394170 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dae320640 1 -- 172.21.15.114:0/2428689950 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7da800e070 con 0x55f208391d80 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f208394cf0 con 0x55f208391d80 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7dae320640 1 -- 172.21.15.114:0/2428689950 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7da800e070 con 0x55f208391d80 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.340+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2083965d0 con 0x55f208391d80 2024-05-08T18:10:58.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7dae320640 1 -- 172.21.15.114:0/2428689950 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7da800e070 con 0x55f208391d80 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c88038440 msgr2=0x7f7c8803a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c88038440 0x7f7c8803a900 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7da8000f90 tx=0x7f7da8019ef0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 msgr2=0x55f208372430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f208372430 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7da800a930 tx=0x7f7da8003380 comp rx=0 tx=0).stop 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 shutdown_connections 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c88038440 0x7f7c8803a900 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2640936361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20836b4c0 0x55f208372430 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 >> 172.21.15.114:0/2640936361 conn(0x55f2083660e0 msgr2=0x55f208366fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 shutdown_connections 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2640936361 wait complete. 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7bf00383f0 msgr2=0x7f7bf003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7bf00383f0 0x7f7bf003a8b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ae000 tx=0x7f7d980a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 msgr2=0x55f20838c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 0x55f20838c780 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7da0017ab0 tx=0x7f7da001df70 comp rx=0 tx=0).stop 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 shutdown_connections 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7bf00383f0 0x7f7bf003a8b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/3041592023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20838c360 0x55f20838c780 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 >> 172.21.15.114:0/3041592023 conn(0x55f208380eb0 msgr2=0x55f2083818d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 shutdown_connections 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/3041592023 wait complete. 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f208391d80 msgr2=0x55f208394170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f208391d80 0x55f208394170 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c940383f0 msgr2=0x7f7c9403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c940383f0 0x7f7c9403a8b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7da000ff60 tx=0x7f7da000ef40 comp rx=0 tx=0).stop 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 msgr2=0x55f20835d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20835d7b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7da000b6b0 tx=0x7f7da0000ee0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 shutdown_connections 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f208391d80 0x55f208394170 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7c940383f0 0x7f7c9403a8b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 --2- 172.21.15.114:0/2428689950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20826c310 0x55f20835d7b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 >> 172.21.15.114:0/2428689950 conn(0x55f208263680 msgr2=0x55f20834c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 shutdown_connections 2024-05-08T18:10:58.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.344+0000 7f7db000b980 1 -- 172.21.15.114:0/2428689950 wait complete. 2024-05-08T18:10:58.358 INFO:teuthology.orchestra.run.smithi114.stdout:{"id":"50b0c397-f53b-4292-89b3-02a592fb10e2","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","zones":[{"id":"e99f9810-9b3d-4ce9-95f6-943c8fddbc84","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-08T18:10:58.358 DEBUG:tasks.util.rgw: json result: {'id': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'zones': [{'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-08T18:10:58.360 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-08T18:10:58.378 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T18:10:58.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T18:10:58.378 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-08T18:10:58.439 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:58.439 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:58.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcd782980 1 Processor -- start 2024-05-08T18:10:58.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcd782980 1 -- start start 2024-05-08T18:10:58.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcd782980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562245abb780 0x562245b4bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcd782980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5622459f2710 con 0x562245b4c490 2024-05-08T18:10:58.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcd782980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x562245a06f00 con 0x562245abb780 2024-05-08T18:10:58.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcb296640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562245abb780 0x562245b4bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcb296640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x562245abb780 0x562245b4bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42844/0 (socket says 172.21.15.114:42844) 2024-05-08T18:10:58.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcaa95640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x562245b4c490 0x562245b4e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51830/0 (socket says 172.21.15.114:51830) 2024-05-08T18:10:58.441 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcb296640 1 -- 172.21.15.114:0/3247377677 learned_addr learned my addr 172.21.15.114:0/3247377677 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcb296640 1 -- 172.21.15.114:0/3247377677 >> v1:172.21.15.53:6789/0 conn(0x562245b4c490 legacy=0x562245b4e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.440+0000 7fddcb296640 1 -- 172.21.15.114:0/3247377677 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622459ceae0 con 0x562245abb780 2024-05-08T18:10:58.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcb296640 1 --2- 172.21.15.114:0/3247377677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245b4bf50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00a5c0 tx=0x7fddbc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e34401777ec0ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddca294640 1 -- 172.21.15.114:0/3247377677 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc0a6070 con 0x562245abb780 2024-05-08T18:10:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddca294640 1 -- 172.21.15.114:0/3247377677 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc0af070 con 0x562245abb780 2024-05-08T18:10:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddca294640 1 -- 172.21.15.114:0/3247377677 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc0aa5c0 con 0x562245abb780 2024-05-08T18:10:58.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 -- 172.21.15.114:0/3247377677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 msgr2=0x562245b4bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 --2- 172.21.15.114:0/3247377677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245b4bf50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00a5c0 tx=0x7fddbc01b340 comp rx=0 tx=0).stop 2024-05-08T18:10:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 -- 172.21.15.114:0/3247377677 shutdown_connections 2024-05-08T18:10:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 --2- 172.21.15.114:0/3247377677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245b4bf50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 -- 172.21.15.114:0/3247377677 >> 172.21.15.114:0/3247377677 conn(0x562245b41630 msgr2=0x562245b43a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 -- 172.21.15.114:0/3247377677 shutdown_connections 2024-05-08T18:10:58.446 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.444+0000 7fddcd782980 1 -- 172.21.15.114:0/3247377677 wait complete. 2024-05-08T18:10:58.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 Processor -- start 2024-05-08T18:10:58.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- start start 2024-05-08T18:10:58.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c34200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562245a4af80 con 0x562245abb780 2024-05-08T18:10:58.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcb296640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c34200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcb296640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c34200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42860/0 (socket says 172.21.15.114:42860) 2024-05-08T18:10:58.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcb296640 1 -- 172.21.15.114:0/809216165 learned_addr learned my addr 172.21.15.114:0/809216165 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcb296640 1 -- 172.21.15.114:0/809216165 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245a12da0 con 0x562245abb780 2024-05-08T18:10:58.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcb296640 1 --2- 172.21.15.114:0/809216165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c34200 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0199f0 tx=0x7fddbc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956d81a5bb01d0ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.461 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fdcb960a640 1 -- 172.21.15.114:0/809216165 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc0aaa00 con 0x562245abb780 2024-05-08T18:10:58.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fdcb960a640 1 -- 172.21.15.114:0/809216165 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc0aaba0 con 0x562245abb780 2024-05-08T18:10:58.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fdcb960a640 1 -- 172.21.15.114:0/809216165 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc0bd3f0 con 0x562245abb780 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- 172.21.15.114:0/809216165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 msgr2=0x562245c34200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 --2- 172.21.15.114:0/809216165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c34200 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fddbc0199f0 tx=0x7fddbc003030 comp rx=0 tx=0).stop 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- 172.21.15.114:0/809216165 shutdown_connections 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 --2- 172.21.15.114:0/809216165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c34200 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- 172.21.15.114:0/809216165 >> 172.21.15.114:0/809216165 conn(0x562245b41630 msgr2=0x562245c2fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- 172.21.15.114:0/809216165 shutdown_connections 2024-05-08T18:10:58.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.460+0000 7fddcd782980 1 -- 172.21.15.114:0/809216165 wait complete. 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 Processor -- start 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 -- start start 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c3b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562245b52a00 con 0x562245abb780 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcb296640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c3b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcb296640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c3b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42864/0 (socket says 172.21.15.114:42864) 2024-05-08T18:10:58.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcb296640 1 -- 172.21.15.114:0/697178094 learned_addr learned my addr 172.21.15.114:0/697178094 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcb296640 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245c3bac0 con 0x562245abb780 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcb296640 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c3b580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fddbc01b170 tx=0x7fddbc0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fdcb7e07640 1 -- 172.21.15.114:0/697178094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc0bd7c0 con 0x562245abb780 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562245c3bd50 con 0x562245abb780 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fdcb7e07640 1 -- 172.21.15.114:0/697178094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddbc0bd960 con 0x562245abb780 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fdcb7e07640 1 -- 172.21.15.114:0/697178094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddbc0bdc40 con 0x562245abb780 2024-05-08T18:10:58.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562245c3e9e0 con 0x562245abb780 2024-05-08T18:10:58.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fdcb7e07640 1 -- 172.21.15.114:0/697178094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fddbc0ce020 con 0x562245abb780 2024-05-08T18:10:58.466 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fdcb7e07640 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcb00383f0 0x7fdcb003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fdcb7e07640 1 -- 172.21.15.114:0/697178094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fddbc0cc020 con 0x562245abb780 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcaa95640 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcb00383f0 0x7fdcb003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245b4c490 0x562245c424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c42ae0 con 0x562245b4c490 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcba97640 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245b4c490 0x562245c424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.464+0000 7fddcaa95640 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcb00383f0 0x7fdcb003a8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fddc0001e40 tx=0x7fddc00013a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.467 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcba97640 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245b4c490 0x562245c424c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcba97640 1 -- 172.21.15.114:0/697178094 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddc400a4d0 con 0x562245b4c490 2024-05-08T18:10:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c43410 con 0x562245b4c490 2024-05-08T18:10:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcba97640 1 -- 172.21.15.114:0/697178094 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddc400a4d0 con 0x562245b4c490 2024-05-08T18:10:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c447c0 con 0x562245b4c490 2024-05-08T18:10:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcba97640 1 -- 172.21.15.114:0/697178094 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fddc400a4d0 con 0x562245b4c490 2024-05-08T18:10:58.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c43c60 con 0x562245b4c490 2024-05-08T18:10:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcba97640 1 -- 172.21.15.114:0/697178094 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fddc400a4d0 con 0x562245b4c490 2024-05-08T18:10:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c44080 con 0x562245b4c490 2024-05-08T18:10:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcba97640 1 -- 172.21.15.114:0/697178094 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fddc400a4d0 con 0x562245b4c490 2024-05-08T18:10:58.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 Processor -- start 2024-05-08T18:10:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 -- start start 2024-05-08T18:10:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 0x562245c53730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcd782980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562245a4efc0 con 0x562245c53310 2024-05-08T18:10:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcaa95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 0x562245c53730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcaa95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 0x562245c53730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42870/0 (socket says 172.21.15.114:42870) 2024-05-08T18:10:58.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcaa95640 1 -- 172.21.15.114:0/3936291402 learned_addr learned my addr 172.21.15.114:0/3936291402 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.468+0000 7fddcaa95640 1 -- 172.21.15.114:0/3936291402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245c53c70 con 0x562245c53310 2024-05-08T18:10:58.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcaa95640 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 0x562245c53730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fddc000e670 tx=0x7fddc000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fdcb5602640 1 -- 172.21.15.114:0/3936291402 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0022070 con 0x562245c53310 2024-05-08T18:10:58.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fdcb5602640 1 -- 172.21.15.114:0/3936291402 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc000d660 con 0x562245c53310 2024-05-08T18:10:58.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fdcb5602640 1 -- 172.21.15.114:0/3936291402 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0006070 con 0x562245c53310 2024-05-08T18:10:58.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562245c54710 con 0x562245c53310 2024-05-08T18:10:58.472 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562245c54be0 con 0x562245c53310 2024-05-08T18:10:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fdcb5602640 1 -- 172.21.15.114:0/3936291402 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fddc0025070 con 0x562245c53310 2024-05-08T18:10:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fdcb5602640 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdca4038440 0x7fdca403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fdcb5602640 1 -- 172.21.15.114:0/3936291402 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fddc0050090 con 0x562245c53310 2024-05-08T18:10:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcba97640 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdca4038440 0x7fdca403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcd782980 1 Processor -- start 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcd782980 1 -- start start 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcba97640 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdca4038440 0x7fdca403a900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x562245c44000 tx=0x7fddc4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcd782980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcd782980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562245c34890 con 0x562245c60490 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcaa95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcaa95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c608b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42886/0 (socket says 172.21.15.114:42886) 2024-05-08T18:10:58.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcaa95640 1 -- 172.21.15.114:0/1610807121 learned_addr learned my addr 172.21.15.114:0/1610807121 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcaa95640 1 -- 172.21.15.114:0/1610807121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245c60e80 con 0x562245c60490 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.472+0000 7fddcaa95640 1 --2- 172.21.15.114:0/1610807121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c608b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fddc000ef50 tx=0x7fddc0026780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a109da9417b59d28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcaeffd640 1 -- 172.21.15.114:0/1610807121 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc00242c0 con 0x562245c60490 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcaeffd640 1 -- 172.21.15.114:0/1610807121 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc0024460 con 0x562245c60490 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcaeffd640 1 -- 172.21.15.114:0/1610807121 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0024740 con 0x562245c60490 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/1610807121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 msgr2=0x562245c608b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 --2- 172.21.15.114:0/1610807121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c608b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fddc000ef50 tx=0x7fddc0026780 comp rx=0 tx=0).stop 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/1610807121 shutdown_connections 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 --2- 172.21.15.114:0/1610807121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c608b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/1610807121 >> 172.21.15.114:0/1610807121 conn(0x562245c5c820 msgr2=0x562245c5a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/1610807121 shutdown_connections 2024-05-08T18:10:58.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/1610807121 wait complete. 2024-05-08T18:10:58.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 Processor -- start 2024-05-08T18:10:58.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- start start 2024-05-08T18:10:58.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c67a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x562245c615d0 con 0x562245c60490 2024-05-08T18:10:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcaa95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c67a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcaa95640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c67a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42898/0 (socket says 172.21.15.114:42898) 2024-05-08T18:10:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 learned_addr learned my addr 172.21.15.114:0/265486842 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562245c67fa0 con 0x562245c60490 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcaa95640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c67a60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fddc001b6c0 tx=0x7fddc004e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcad7fa640 1 -- 172.21.15.114:0/265486842 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc00242c0 con 0x562245c60490 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcad7fa640 1 -- 172.21.15.114:0/265486842 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc001a7e0 con 0x562245c60490 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562245c68230 con 0x562245c60490 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcad7fa640 1 -- 172.21.15.114:0/265486842 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddc0024d90 con 0x562245c60490 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562245c68230 con 0x562245c60490 2024-05-08T18:10:58.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.476+0000 7fdcad7fa640 1 -- 172.21.15.114:0/265486842 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fddc003e9f0 con 0x562245c60490 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fdcad7fa640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdc94038440 0x7fdc9403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fdcad7fa640 1 -- 172.21.15.114:0/265486842 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fddc0046030 con 0x562245c60490 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcba97640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdc94038440 0x7fdc9403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245c72ce0 0x562245c751a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c758f0 con 0x562245c72ce0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245c72ce0 0x562245c751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcba97640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdc94038440 0x7fdc9403a900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x562245c43290 tx=0x7fddc401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245c72ce0 0x562245c751a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 realm 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c75d00 con 0x562245c72ce0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c765d0 con 0x562245c72ce0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c76970 con 0x562245c72ce0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.485 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c771c0 con 0x562245c72ce0 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 20 searching for the correct realm 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562245c78f30 0x562245c7b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcaa95640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562245c78f30 0x562245c7b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcaa95640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562245c78f30 0x562245c7b320 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcaa95640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fddc0027060 0x7fddc003da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcba97640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fddc0027060 0x7fddc003da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.480+0000 7fddcba97640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fddc0027060 0x7fddc003da20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fddbc009040 0x7fddbc0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.487 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fddbc009040 0x7fddbc0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fddbc009040 0x7fddbc0cfa30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x7fddbc009040 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x7fddbc009040 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.484+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x7fddbc009040 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.493 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0c5d00 con 0x7fddbc009040 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.488+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fddbc0c5d00 con 0x562245c72ce0 2024-05-08T18:10:58.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c78f30 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddbc009040 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.492+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x562245c72ce0 2024-05-08T18:10:58.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562245c7b860 con 0x7fddc0027060 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c77b40 con 0x562245c72ce0 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c78390 con 0x562245c72ce0 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c77780 con 0x562245c72ce0 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 zone default found 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 4 Realm: () 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 zonegroup default 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c7bc90 con 0x7fddbc009040 2024-05-08T18:10:58.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c7d6a0 con 0x562245c78f30 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c7dba0 con 0x562245c78f30 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 started sync module instance, tier type = 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7cb10 con 0x7fddc0027060 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94705199599360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7c770 con 0x7fddc0027060 2024-05-08T18:10:58.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.496+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7ead0 con 0x562245c72ce0 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.500+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94705199599360] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.500+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.500+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94705199603712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7ead0 con 0x562245c72ce0 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.500+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7f490 con 0x562245c78f30 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94705199603712] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94705199605280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7ea40 con 0x562245c78f30 2024-05-08T18:10:58.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c801d0 con 0x7fddc0027060 2024-05-08T18:10:58.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94705199611104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c80a70 con 0x7fddc0027060 2024-05-08T18:10:58.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c814b0 con 0x562245c72ce0 2024-05-08T18:10:58.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94705199605280] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.504+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94705199611104] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94705199615872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c805c0 con 0x562245c72ce0 2024-05-08T18:10:58.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c81d50 con 0x7fddbc009040 2024-05-08T18:10:58.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94705199617808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c81fe0 con 0x7fddbc009040 2024-05-08T18:10:58.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c82830 con 0x7fddbc009040 2024-05-08T18:10:58.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.508+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94705199615872] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94705199620064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c828b0 con 0x7fddbc009040 2024-05-08T18:10:58.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c83180 con 0x7fddbc009040 2024-05-08T18:10:58.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94705199617808] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94705199620064] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94705199618864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c828b0 con 0x7fddbc009040 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=0 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=1 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=2 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=3 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=4 2024-05-08T18:10:58.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=5 2024-05-08T18:10:58.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.512+0000 7fddcd782980 20 add_watcher() i=6 2024-05-08T18:10:58.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94705199618864] v32'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 20 add_watcher() i=7 2024-05-08T18:10:58.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:58.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245c86280 con 0x562245c72ce0 2024-05-08T18:10:58.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.517 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94705199621120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c83700 con 0x562245c72ce0 2024-05-08T18:10:58.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94705199621120] v32'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fdc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 5 note: GC not initialized 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fdc80fe1640 20 reqs_thread_entry: start 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fddcd782980 20 Filter name: none 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.516+0000 7fdbfa7fc640 20 reqs_thread_entry: start 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245ca9b50 con 0x7fddbc009040 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245ca8190 con 0x562245c72ce0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:10:58.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T18:10:58.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T18:10:58.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245ca8a30 con 0x7fddbc009040 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v32'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.520+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94705199777152 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245cad5f0 con 0x562245c72ce0 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== watch-notify(notify (1) cookie 94705199615872 notify 137438953491 ret 0) ==== 691+0+0 (crc 0 0 0) 0x562245ca9700 con 0x562245c72ce0 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94705199615872 notifier 4828 bl.length()=649 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcaeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify cookie 94705199777152 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcaeffd640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdc90003eb0 con 0x562245c72ce0 2024-05-08T18:10:58.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94705199777152 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fddbc0e5040 con 0x562245c72ce0 2024-05-08T18:10:58.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245ca8530 con 0x562245c72ce0 2024-05-08T18:10:58.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v32'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcd782980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T18:10:58.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcd782980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:10:58.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcd782980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-08T18:10:58.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94705199777072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562245cad5f0 con 0x562245c78f30 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== watch-notify(notify (1) cookie 94705199605280 notify 137438953482 ret 0) ==== 219+0+0 (crc 0 0 0) 0x562245c67fa0 con 0x562245c78f30 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(68 notify.2 [notify cookie 94705199777072 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94705199605280 notifier 4828 bl.length()=177 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdcae7fc640 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fdc00003410 con 0x562245c78f30 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== watch-notify(notify_complete (2) cookie 94705199777072 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fddc006c040 con 0x562245c78f30 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.526 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:10:58.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fdc81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:58.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.524+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94705199621120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245ca77f0 con 0x562245c72ce0 2024-05-08T18:10:58.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.528+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94705199621120] v32'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.528+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94705199599360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245ca77f0 con 0x7fddc0027060 2024-05-08T18:10:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.528+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94705199599360] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.528+0000 7fddcd782980 20 remove_watcher() i=0 2024-05-08T18:10:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.528+0000 7fddcd782980 2 removed watcher, disabling cache 2024-05-08T18:10:58.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.528+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94705199603712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245ca77f0 con 0x562245c72ce0 2024-05-08T18:10:58.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.532+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94705199603712] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.532+0000 7fddcd782980 20 remove_watcher() i=1 2024-05-08T18:10:58.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.532+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94705199605280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245ca77f0 con 0x562245c78f30 2024-05-08T18:10:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.532+0000 7fddcaa95640 1 -- 172.21.15.114:0/265486842 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94705199605280] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc0024030 con 0x562245c78f30 2024-05-08T18:10:58.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.532+0000 7fddcd782980 20 remove_watcher() i=2 2024-05-08T18:10:58.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.532+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94705199611104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7cf00 con 0x7fddc0027060 2024-05-08T18:10:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.536+0000 7fddcba97640 1 -- 172.21.15.114:0/265486842 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94705199611104] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddc401f070 con 0x7fddc0027060 2024-05-08T18:10:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.536+0000 7fddcd782980 20 remove_watcher() i=3 2024-05-08T18:10:58.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.536+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94705199615872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7e620 con 0x562245c72ce0 2024-05-08T18:10:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.536+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94705199615872] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x562245c72ce0 2024-05-08T18:10:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.536+0000 7fddcd782980 20 remove_watcher() i=4 2024-05-08T18:10:58.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.536+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94705199617808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7cf00 con 0x7fddbc009040 2024-05-08T18:10:58.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.540+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94705199617808] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.540+0000 7fddcd782980 20 remove_watcher() i=5 2024-05-08T18:10:58.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.540+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94705199620064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c80f80 con 0x7fddbc009040 2024-05-08T18:10:58.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.540+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94705199620064] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.540+0000 7fddcd782980 20 remove_watcher() i=6 2024-05-08T18:10:58.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.540+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94705199618864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562245c7e620 con 0x7fddbc009040 2024-05-08T18:10:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94705199618864] v32'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fddbc0f7040 con 0x7fddbc009040 2024-05-08T18:10:58.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 20 remove_watcher() i=7 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fddbc009040 msgr2=0x7fddbc0cfa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fddbc009040 0x7fddbc0cfa30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245c72ce0 msgr2=0x562245c751a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245c72ce0 0x562245c751a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fddc0027060 msgr2=0x7fddc003da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fddc0027060 0x7fddc003da20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562245c78f30 msgr2=0x562245c7b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x562245c78f30 0x562245c7b320 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdc94038440 msgr2=0x7fdc9403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdc94038440 0x7fdc9403a900 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x562245c43290 tx=0x7fddc401f000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 msgr2=0x562245c67a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/265486842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c60490 0x562245c67a60 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fddc001b6c0 tx=0x7fddc004e2a0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 reap_dead start 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcb296640 1 -- 172.21.15.114:0/265486842 reap_dead start 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 shutdown_connections 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 >> 172.21.15.114:0/265486842 conn(0x562245c5c820 msgr2=0x562245c61cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 shutdown_connections 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/265486842 wait complete. 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdca4038440 msgr2=0x7fdca403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdca4038440 0x7fdca403a900 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x562245c44000 tx=0x7fddc4005850 comp rx=0 tx=0).stop 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 msgr2=0x562245c53730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 0x562245c53730 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fddc000e670 tx=0x7fddc000ea70 comp rx=0 tx=0).stop 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 shutdown_connections 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdca4038440 0x7fdca403a900 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/3936291402 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245c53310 0x562245c53730 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 >> 172.21.15.114:0/3936291402 conn(0x562245c48120 msgr2=0x562245c48c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 shutdown_connections 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/3936291402 wait complete. 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245b4c490 msgr2=0x562245c424c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245b4c490 0x562245c424c0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcb00383f0 msgr2=0x7fdcb003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcb00383f0 0x7fdcb003a8b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fddc0001e40 tx=0x7fddc00013a0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 msgr2=0x562245c3b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c3b580 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fddbc01b170 tx=0x7fddbc0180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 shutdown_connections 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x562245b4c490 0x562245c424c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fdcb00383f0 0x7fdcb003a8b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 --2- 172.21.15.114:0/697178094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562245abb780 0x562245c3b580 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 >> 172.21.15.114:0/697178094 conn(0x562245b41630 msgr2=0x562245c2e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 shutdown_connections 2024-05-08T18:10:58.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.544+0000 7fddcd782980 1 -- 172.21.15.114:0/697178094 wait complete. 2024-05-08T18:10:58.557 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:58.557 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:58.557 ERROR:root:0 2024-05-08T18:10:58.558 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:10:58.564 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000000b22a81bf40b392a-00663bc032-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:10:58.565 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-08T18:10:58.578 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:10:58.579 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-08T18:10:58.597 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-08T18:10:58.597 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-08T18:10:58.621 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T18:10:58.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T18:10:58.633 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-08T18:10:58.633 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:10:58.636 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:10:58.637 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-08T18:10:58.641 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:10:58.642 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:10:58.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:10:58.642 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-08T18:10:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:58.679 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0eb5a4980 1 Processor -- start 2024-05-08T18:10:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0eb5a4980 1 -- start start 2024-05-08T18:10:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0eb5a4980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5623b4ab05c0 0x5623b4ab29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0eb5a4980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5623b4955710 con 0x5623b4aac100 2024-05-08T18:10:58.680 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0eb5a4980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5623b4969f00 con 0x5623b4ab05c0 2024-05-08T18:10:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0e88b7640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5623b4ab05c0 0x5623b4ab29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0e90b8640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5623b4aac100 0x5623b4aac4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51846/0 (socket says 172.21.15.114:51846) 2024-05-08T18:10:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0e90b8640 1 -- 172.21.15.114:0/1028564028 learned_addr learned my addr 172.21.15.114:0/1028564028 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/1028564028 >> v2:172.21.15.53:3300/0 conn(0x5623b4ab05c0 0x5623b4ab29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42910/0 (socket says 172.21.15.114:42910) 2024-05-08T18:10:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0e88b7640 1 -- 172.21.15.114:0/1028564028 >> v1:172.21.15.53:6789/0 conn(0x5623b4aac100 legacy=0x5623b4aac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.680+0000 7fd0e88b7640 1 -- 172.21.15.114:0/1028564028 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4931ae0 con 0x5623b4ab05c0 2024-05-08T18:10:58.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/1028564028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4ab05c0 0x5623b4ab29b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400a480 tx=0x7fd0d401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a97b1a7cff90d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0e3fff640 1 -- 172.21.15.114:0/1028564028 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b0070 con 0x5623b4ab05c0 2024-05-08T18:10:58.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0e3fff640 1 -- 172.21.15.114:0/1028564028 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40ab540 con 0x5623b4ab05c0 2024-05-08T18:10:58.684 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0e3fff640 1 -- 172.21.15.114:0/1028564028 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40ab840 con 0x5623b4ab05c0 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/1028564028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4ab05c0 msgr2=0x5623b4ab29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/1028564028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4ab05c0 0x5623b4ab29b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd0d400a480 tx=0x7fd0d401b280 comp rx=0 tx=0).stop 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/1028564028 shutdown_connections 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/1028564028 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4ab05c0 0x5623b4ab29b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/1028564028 >> 172.21.15.114:0/1028564028 conn(0x5623b4a1f7e0 msgr2=0x5623b4a1fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/1028564028 shutdown_connections 2024-05-08T18:10:58.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.684+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/1028564028 wait complete. 2024-05-08T18:10:58.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0eb5a4980 1 Processor -- start 2024-05-08T18:10:58.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0eb5a4980 1 -- start start 2024-05-08T18:10:58.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0eb5a4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b971d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0eb5a4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b49adf80 con 0x5623b4aac100 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0e90b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0e90b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42928/0 (socket says 172.21.15.114:42928) 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0e90b8640 1 -- 172.21.15.114:0/2093180836 learned_addr learned my addr 172.21.15.114:0/2093180836 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0e90b8640 1 -- 172.21.15.114:0/2093180836 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4975da0 con 0x5623b4aac100 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/2093180836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b971d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc001e00 tx=0x7fd0dc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c378adffc1ef6359 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fcfd7606640 1 -- 172.21.15.114:0/2093180836 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc012020 con 0x5623b4aac100 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fcfd7606640 1 -- 172.21.15.114:0/2093180836 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc00e690 con 0x5623b4aac100 2024-05-08T18:10:58.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.700+0000 7fcfd7606640 1 -- 172.21.15.114:0/2093180836 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc00ea10 con 0x5623b4aac100 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/2093180836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 msgr2=0x5623b4b971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/2093180836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b971d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc001e00 tx=0x7fd0dc00b6d0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/2093180836 shutdown_connections 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/2093180836 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b971d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/2093180836 >> 172.21.15.114:0/2093180836 conn(0x5623b4a1f7e0 msgr2=0x5623b4b92d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/2093180836 shutdown_connections 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/2093180836 wait complete. 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 Processor -- start 2024-05-08T18:10:58.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- start start 2024-05-08T18:10:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b9e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b4ab59e0 con 0x5623b4aac100 2024-05-08T18:10:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0e90b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b9e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0e90b8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b9e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42938/0 (socket says 172.21.15.114:42938) 2024-05-08T18:10:58.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0e90b8640 1 -- 172.21.15.114:0/3621925442 learned_addr learned my addr 172.21.15.114:0/3621925442 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0e90b8640 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4b9ebf0 con 0x5623b4aac100 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b9e6b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x5623b4b98060 tx=0x7fd0dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fcfd5e03640 1 -- 172.21.15.114:0/3621925442 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc012030 con 0x5623b4aac100 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623b4b9ee80 con 0x5623b4aac100 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fcfd5e03640 1 -- 172.21.15.114:0/3621925442 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0dc01a7a0 con 0x5623b4aac100 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fcfd5e03640 1 -- 172.21.15.114:0/3621925442 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0dc01aaa0 con 0x5623b4aac100 2024-05-08T18:10:58.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.704+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b4ba1b60 con 0x5623b4aac100 2024-05-08T18:10:58.707 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fcfd5e03640 1 -- 172.21.15.114:0/3621925442 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd0dc015020 con 0x5623b4aac100 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fcfd5e03640 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfd00383f0 0x7fcfd003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fcfd5e03640 1 -- 172.21.15.114:0/3621925442 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd0dc020030 con 0x5623b4aac100 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfd00383f0 0x7fcfd003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4ab05c0 0x5623b4ba5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4ba5cb0 con 0x5623b4ab05c0 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4ab05c0 0x5623b4ba5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfd00383f0 0x7fcfd003a8b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ad000 tx=0x7fd0d40a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.708 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4ab05c0 0x5623b4ba5640 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 -- 172.21.15.114:0/3621925442 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0e400a4d0 con 0x5623b4ab05c0 2024-05-08T18:10:58.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4ba2d80 con 0x5623b4ab05c0 2024-05-08T18:10:58.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 -- 172.21.15.114:0/3621925442 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0e400a4d0 con 0x5623b4ab05c0 2024-05-08T18:10:58.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4ba7ad0 con 0x5623b4ab05c0 2024-05-08T18:10:58.709 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 -- 172.21.15.114:0/3621925442 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd0e400a4d0 con 0x5623b4ab05c0 2024-05-08T18:10:58.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4ba6d00 con 0x5623b4ab05c0 2024-05-08T18:10:58.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 -- 172.21.15.114:0/3621925442 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0e400a4d0 con 0x5623b4ab05c0 2024-05-08T18:10:58.710 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4ba7120 con 0x5623b4ab05c0 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0e98b9640 1 -- 172.21.15.114:0/3621925442 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd0e400a4d0 con 0x5623b4ab05c0 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 Processor -- start 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- start start 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 0x5623b4bb6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.708+0000 7fd0eb5a4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b49b1fc0 con 0x5623b4bb63e0 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 0x5623b4bb6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 0x5623b4bb6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42950/0 (socket says 172.21.15.114:42950) 2024-05-08T18:10:58.711 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e88b7640 1 -- 172.21.15.114:0/600352420 learned_addr learned my addr 172.21.15.114:0/600352420 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e88b7640 1 -- 172.21.15.114:0/600352420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4bb6d40 con 0x5623b4bb63e0 2024-05-08T18:10:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 0x5623b4bb6800 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ab510 tx=0x7fd0d4018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fcfceffd640 1 -- 172.21.15.114:0/600352420 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40c6070 con 0x5623b4bb63e0 2024-05-08T18:10:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fcfceffd640 1 -- 172.21.15.114:0/600352420 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40b7740 con 0x5623b4bb63e0 2024-05-08T18:10:58.712 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623b4bb77e0 con 0x5623b4bb63e0 2024-05-08T18:10:58.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fcfceffd640 1 -- 172.21.15.114:0/600352420 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b0040 con 0x5623b4bb63e0 2024-05-08T18:10:58.713 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b4bb7c50 con 0x5623b4bb63e0 2024-05-08T18:10:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fcfceffd640 1 -- 172.21.15.114:0/600352420 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd0d40c9070 con 0x5623b4bb63e0 2024-05-08T18:10:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fcfceffd640 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfc00383f0 0x7fcfc003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fcfceffd640 1 -- 172.21.15.114:0/600352420 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd0d40be030 con 0x5623b4bb63e0 2024-05-08T18:10:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfc00383f0 0x7fcfc003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0eb5a4980 1 Processor -- start 2024-05-08T18:10:58.714 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0eb5a4980 1 -- start start 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfc00383f0 0x7fcfc003a8b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5623b4ba70a0 tx=0x7fd0e4005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0eb5a4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bc3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.712+0000 7fd0eb5a4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b4b97920 con 0x5623b4bc3500 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bc3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bc3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42958/0 (socket says 172.21.15.114:42958) 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 -- 172.21.15.114:0/405046967 learned_addr learned my addr 172.21.15.114:0/405046967 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.715 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 -- 172.21.15.114:0/405046967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4bc3ed0 con 0x5623b4bc3500 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/405046967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bc3900 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4007000 tx=0x7fd0d4006760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba54c244bbec4344 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fcfccff9640 1 -- 172.21.15.114:0/405046967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40dd070 con 0x5623b4bc3500 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fcfccff9640 1 -- 172.21.15.114:0/405046967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40b7a20 con 0x5623b4bc3500 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fcfccff9640 1 -- 172.21.15.114:0/405046967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b7d20 con 0x5623b4bc3500 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/405046967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 msgr2=0x5623b4bc3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/405046967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bc3900 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4007000 tx=0x7fd0d4006760 comp rx=0 tx=0).stop 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/405046967 shutdown_connections 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/405046967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bc3900 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/405046967 >> 172.21.15.114:0/405046967 conn(0x5623b4bbf840 msgr2=0x5623b4bbd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/405046967 shutdown_connections 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/405046967 wait complete. 2024-05-08T18:10:58.718 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 Processor -- start 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- start start 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bcaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0eb5a4980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5623b4bc4610 con 0x5623b4bc3500 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bcaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bcaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42964/0 (socket says 172.21.15.114:42964) 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 learned_addr learned my addr 172.21.15.114:0/437459806 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b4bcaf40 con 0x5623b4bc3500 2024-05-08T18:10:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.716+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bcaa00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40aaa60 tx=0x7fd0d40e91d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fcfbeffd640 1 -- 172.21.15.114:0/437459806 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40dd050 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fcfbeffd640 1 -- 172.21.15.114:0/437459806 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0d40de040 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623b4bcb1d0 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fcfbeffd640 1 -- 172.21.15.114:0/437459806 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0d40b4a10 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b4bcdeb0 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fcfbeffd640 1 -- 172.21.15.114:0/437459806 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fd0d40b4c80 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fcfbeffd640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfb40383f0 0x7fcfb403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fcfbeffd640 1 -- 172.21.15.114:0/437459806 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fd0d40ee030 con 0x5623b4bc3500 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfb40383f0 0x7fcfb403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4bd5ef0 0x5623b4bd83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bd8b00 con 0x5623b4bd5ef0 2024-05-08T18:10:58.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4bd5ef0 0x5623b4bd83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfb40383f0 0x7fcfb403a8b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5623b4ba6820 tx=0x7fd0e401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4bd5ef0 0x5623b4bd83b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 realm 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bd8f10 con 0x5623b4bd5ef0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bd97e0 con 0x5623b4bd5ef0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.726 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bd9b80 con 0x5623b4bd5ef0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bda3d0 con 0x5623b4bd5ef0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.720+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0eb5a4980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0eb5a4980 20 searching for the correct realm 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5623b4bdc140 0x5623b4bde530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5623b4bdc140 0x5623b4bde530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5623b4bdc140 0x5623b4bde530 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e88b7640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd0d40f2020 0x7fd0d40d7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd0d40f2020 0x7fd0d40d7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e98b9640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd0d40f2020 0x7fd0d40d7a30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd0dc017050 0x7fd0dc02c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.729 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd0dc017050 0x7fd0dc02c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.724+0000 7fd0e90b8640 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd0dc017050 0x7fd0dc02c7c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.732 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.728+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.732+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bdc140 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0dc017050 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x5623b4bd5ef0 2024-05-08T18:10:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdea70 con 0x7fd0d40f2020 2024-05-08T18:10:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:58.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdace0 con 0x5623b4bd5ef0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdb530 con 0x5623b4bd5ef0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdb530 con 0x5623b4bd5ef0 2024-05-08T18:10:58.742 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 zone default found 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 4 Realm: () 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 zonegroup default 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.736+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdeea0 con 0x7fd0dc017050 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be0910 con 0x5623b4bdc140 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be0da0 con 0x5623b4bdc140 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 started sync module instance, tier type = 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4bdfd20 con 0x7fd0d40f2020 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94711356195088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be0530 con 0x7fd0d40f2020 2024-05-08T18:10:58.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.740+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be1be0 con 0x5623b4bd5ef0 2024-05-08T18:10:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94711356195088] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94711356199424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be1fd0 con 0x5623b4bd5ef0 2024-05-08T18:10:58.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be2990 con 0x5623b4bdc140 2024-05-08T18:10:58.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94711356199424] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94711356204256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be31e0 con 0x5623b4bdc140 2024-05-08T18:10:58.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.744+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be1640 con 0x7fd0d40f2020 2024-05-08T18:10:58.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94711356208880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be3fc0 con 0x7fd0d40f2020 2024-05-08T18:10:58.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be4980 con 0x5623b4bd5ef0 2024-05-08T18:10:58.748 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94711356204256] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94711356206384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be4980 con 0x5623b4bd5ef0 2024-05-08T18:10:58.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.748+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be5390 con 0x7fd0dc017050 2024-05-08T18:10:58.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94711356206384] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94711356208880] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94711356212432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be48f0 con 0x7fd0dc017050 2024-05-08T18:10:58.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be5840 con 0x7fd0dc017050 2024-05-08T18:10:58.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94711356212432] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.752+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94711356215008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be57b0 con 0x7fd0dc017050 2024-05-08T18:10:58.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be6170 con 0x7fd0dc017050 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94711356215008] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94711356216336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be6170 con 0x7fd0dc017050 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=0 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=1 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=2 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=3 2024-05-08T18:10:58.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=4 2024-05-08T18:10:58.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=5 2024-05-08T18:10:58.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.756+0000 7fd0eb5a4980 20 add_watcher() i=6 2024-05-08T18:10:58.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94711356216336] v32'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 20 add_watcher() i=7 2024-05-08T18:10:58.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:58.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be9460 con 0x5623b4bd5ef0 2024-05-08T18:10:58.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94711356218928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be6700 con 0x5623b4bd5ef0 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94711356218928] v32'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0dc008030 con 0x5623b4bd5ef0 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fcf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 5 note: GC not initialized 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fcf9e7e4640 20 reqs_thread_entry: start 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 20 Filter name: none 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fcf0ffff640 20 reqs_thread_entry: start 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.760+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c0cf50 con 0x7fd0dc017050 2024-05-08T18:10:58.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fd0dc008030 con 0x7fd0dc017050 2024-05-08T18:10:58.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T18:10:58.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:10:58.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:58.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:58.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c13870 con 0x7fd0dc017050 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x7fd0dc017050 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94711356404448 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c0ef60 con 0x5623b4bd5ef0 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94711356206384 notify 137438953493 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5623b4ba1b60 con 0x5623b4bd5ef0 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fcfccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94711356206384 notifier 4835 bl.length()=636 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fcfccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94711356404448 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd0dc06b040 con 0x5623b4bd5ef0 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fcfccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fcfccff9640 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcfac003eb0 con 0x5623b4bd5ef0 2024-05-08T18:10:58.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x5623b4bd5ef0 2024-05-08T18:10:58.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.764+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94711356404448 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5623b4b9ee80 con 0x5623b4bd5ef0 2024-05-08T18:10:58.768 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:10:58.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fcf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:58.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94711356218928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c0ac50 con 0x5623b4bd5ef0 2024-05-08T18:10:58.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94711356218928] v32'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x5623b4bd5ef0 2024-05-08T18:10:58.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94711356195088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c0ac50 con 0x7fd0d40f2020 2024-05-08T18:10:58.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94711356195088] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0eb5a4980 20 remove_watcher() i=0 2024-05-08T18:10:58.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0eb5a4980 2 removed watcher, disabling cache 2024-05-08T18:10:58.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.768+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94711356199424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c0ac50 con 0x5623b4bd5ef0 2024-05-08T18:10:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.772+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94711356199424] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x5623b4bd5ef0 2024-05-08T18:10:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.772+0000 7fd0eb5a4980 20 remove_watcher() i=1 2024-05-08T18:10:58.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.772+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94711356204256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4c0ac50 con 0x5623b4bdc140 2024-05-08T18:10:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.772+0000 7fd0e88b7640 1 -- 172.21.15.114:0/437459806 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94711356204256] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0d40e8020 con 0x5623b4bdc140 2024-05-08T18:10:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.772+0000 7fd0eb5a4980 20 remove_watcher() i=2 2024-05-08T18:10:58.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.772+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94711356208880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be0110 con 0x7fd0d40f2020 2024-05-08T18:10:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.776+0000 7fd0e98b9640 1 -- 172.21.15.114:0/437459806 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94711356208880] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0e401f070 con 0x7fd0d40f2020 2024-05-08T18:10:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.776+0000 7fd0eb5a4980 20 remove_watcher() i=3 2024-05-08T18:10:58.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.776+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94711356206384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be1200 con 0x5623b4bd5ef0 2024-05-08T18:10:58.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.776+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94711356206384] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x5623b4bd5ef0 2024-05-08T18:10:58.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.776+0000 7fd0eb5a4980 20 remove_watcher() i=4 2024-05-08T18:10:58.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.776+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94711356212432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be36f0 con 0x7fd0dc017050 2024-05-08T18:10:58.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.780+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94711356212432] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x7fd0dc017050 2024-05-08T18:10:58.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.780+0000 7fd0eb5a4980 20 remove_watcher() i=5 2024-05-08T18:10:58.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.780+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94711356215008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be0110 con 0x7fd0dc017050 2024-05-08T18:10:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.780+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94711356215008] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x7fd0dc017050 2024-05-08T18:10:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.780+0000 7fd0eb5a4980 20 remove_watcher() i=6 2024-05-08T18:10:58.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.780+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94711356216336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5623b4be1200 con 0x7fd0dc017050 2024-05-08T18:10:58.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94711356216336] v32'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd0dc06b040 con 0x7fd0dc017050 2024-05-08T18:10:58.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 20 remove_watcher() i=7 2024-05-08T18:10:58.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd0dc017050 msgr2=0x7fd0dc02c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fd0dc017050 0x7fd0dc02c7c0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4bd5ef0 msgr2=0x5623b4bd83b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4bd5ef0 0x5623b4bd83b0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd0d40f2020 msgr2=0x7fd0d40d7a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fd0d40f2020 0x7fd0d40d7a30 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5623b4bdc140 msgr2=0x5623b4bde530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5623b4bdc140 0x5623b4bde530 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfb40383f0 msgr2=0x7fcfb403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfb40383f0 0x7fcfb403a8b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x5623b4ba6820 tx=0x7fd0e401f000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 msgr2=0x5623b4bcaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bcaa00 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40aaa60 tx=0x7fd0d40e91d0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0e90b8640 1 -- 172.21.15.114:0/437459806 reap_dead start 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 shutdown_connections 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/437459806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bc3500 0x5623b4bcaa00 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 >> 172.21.15.114:0/437459806 conn(0x5623b4bbf840 msgr2=0x5623b4bbcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 shutdown_connections 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/437459806 wait complete. 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfc00383f0 msgr2=0x7fcfc003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfc00383f0 0x7fcfc003a8b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5623b4ba70a0 tx=0x7fd0e4005850 comp rx=0 tx=0).stop 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 msgr2=0x5623b4bb6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 0x5623b4bb6800 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ab510 tx=0x7fd0d4018020 comp rx=0 tx=0).stop 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 shutdown_connections 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfc00383f0 0x7fcfc003a8b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/600352420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4bb63e0 0x5623b4bb6800 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 >> 172.21.15.114:0/600352420 conn(0x5623b4bab1f0 msgr2=0x5623b4babd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 shutdown_connections 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/600352420 wait complete. 2024-05-08T18:10:58.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4ab05c0 msgr2=0x5623b4ba5640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4ab05c0 0x5623b4ba5640 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfd00383f0 msgr2=0x7fcfd003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfd00383f0 0x7fcfd003a8b0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40ad000 tx=0x7fd0d40a5040 comp rx=0 tx=0).stop 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 msgr2=0x5623b4b9e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b9e6b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x5623b4b98060 tx=0x7fd0dc000bd0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 shutdown_connections 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5623b4ab05c0 0x5623b4ba5640 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fcfd00383f0 0x7fcfd003a8b0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 --2- 172.21.15.114:0/3621925442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623b4aac100 0x5623b4b9e6b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 >> 172.21.15.114:0/3621925442 conn(0x5623b4a1f7e0 msgr2=0x5623b4b91870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 shutdown_connections 2024-05-08T18:10:58.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.784+0000 7fd0eb5a4980 1 -- 172.21.15.114:0/3621925442 wait complete. 2024-05-08T18:10:58.797 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:58.797 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:58.797 ERROR:root:0 2024-05-08T18:10:58.797 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T18:10:58.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T18:10:58.797 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-08T18:10:58.886 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:58.886 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:58.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f317a113980 1 Processor -- start 2024-05-08T18:10:58.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f317a113980 1 -- start start 2024-05-08T18:10:58.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f317a113980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5616a9c4f4f0 0x5616a9ce2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f317a113980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616a9b85710 con 0x5616a9c507e0 2024-05-08T18:10:58.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f317a113980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5616a9b99f00 con 0x5616a9c4f4f0 2024-05-08T18:10:58.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f3177426640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5616a9c4f4f0 0x5616a9ce2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f3177c27640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5616a9c507e0 0x5616a9c4ede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51854/0 (socket says 172.21.15.114:51854) 2024-05-08T18:10:58.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f3177c27640 1 -- 172.21.15.114:0/519300056 learned_addr learned my addr 172.21.15.114:0/519300056 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:10:58.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f3177426640 1 -- 172.21.15.114:0/519300056 >> v1:172.21.15.53:6789/0 conn(0x5616a9c507e0 legacy=0x5616a9c4ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.888+0000 7f3177426640 1 -- 172.21.15.114:0/519300056 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9b61ae0 con 0x5616a9c4f4f0 2024-05-08T18:10:58.890 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f3177426640 1 --2- 172.21.15.114:0/519300056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9ce2eb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f316c00a480 tx=0x7f316c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d8896400e5fe719 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f3176c25640 1 -- 172.21.15.114:0/519300056 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0b0070 con 0x5616a9c4f4f0 2024-05-08T18:10:58.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f3176c25640 1 -- 172.21.15.114:0/519300056 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c0ab540 con 0x5616a9c4f4f0 2024-05-08T18:10:58.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f3176c25640 1 -- 172.21.15.114:0/519300056 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0ab840 con 0x5616a9c4f4f0 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 -- 172.21.15.114:0/519300056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 msgr2=0x5616a9ce2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 --2- 172.21.15.114:0/519300056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9ce2eb0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f316c00a480 tx=0x7f316c01b280 comp rx=0 tx=0).stop 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 -- 172.21.15.114:0/519300056 shutdown_connections 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 --2- 172.21.15.114:0/519300056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9ce2eb0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 -- 172.21.15.114:0/519300056 >> 172.21.15.114:0/519300056 conn(0x5616a9cd5770 msgr2=0x5616a9cd7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 -- 172.21.15.114:0/519300056 shutdown_connections 2024-05-08T18:10:58.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.892+0000 7f317a113980 1 -- 172.21.15.114:0/519300056 wait complete. 2024-05-08T18:10:58.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 Processor -- start 2024-05-08T18:10:58.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- start start 2024-05-08T18:10:58.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dc7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5616a9bddf80 con 0x5616a9c4f4f0 2024-05-08T18:10:58.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dc7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dc7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42980/0 (socket says 172.21.15.114:42980) 2024-05-08T18:10:58.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 -- 172.21.15.114:0/3475848649 learned_addr learned my addr 172.21.15.114:0/3475848649 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 -- 172.21.15.114:0/3475848649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9ba5da0 con 0x5616a9c4f4f0 2024-05-08T18:10:58.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 --2- 172.21.15.114:0/3475848649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dc7660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3170001e00 tx=0x7f317000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859075b608007d28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3065e0b640 1 -- 172.21.15.114:0/3475848649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3170012020 con 0x5616a9c4f4f0 2024-05-08T18:10:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3065e0b640 1 -- 172.21.15.114:0/3475848649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317000e690 con 0x5616a9c4f4f0 2024-05-08T18:10:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3065e0b640 1 -- 172.21.15.114:0/3475848649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317000ea10 con 0x5616a9c4f4f0 2024-05-08T18:10:58.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- 172.21.15.114:0/3475848649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 msgr2=0x5616a9dc7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 --2- 172.21.15.114:0/3475848649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dc7660 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3170001e00 tx=0x7f317000b6d0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- 172.21.15.114:0/3475848649 shutdown_connections 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 --2- 172.21.15.114:0/3475848649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dc7660 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- 172.21.15.114:0/3475848649 >> 172.21.15.114:0/3475848649 conn(0x5616a9cd5770 msgr2=0x5616a9dc31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- 172.21.15.114:0/3475848649 shutdown_connections 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- 172.21.15.114:0/3475848649 wait complete. 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 Processor -- start 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- start start 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dceb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f317a113980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5616a9ce5e50 con 0x5616a9c4f4f0 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42984/0 (socket says 172.21.15.114:42984) 2024-05-08T18:10:58.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.908+0000 7f3177c27640 1 -- 172.21.15.114:0/2757311839 learned_addr learned my addr 172.21.15.114:0/2757311839 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3177c27640 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9dcf070 con 0x5616a9c4f4f0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3177c27640 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dceb30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x5616a9dc84f0 tx=0x7f3170000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f305ffff640 1 -- 172.21.15.114:0/2757311839 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3170012030 con 0x5616a9c4f4f0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a9dcf300 con 0x5616a9c4f4f0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f305ffff640 1 -- 172.21.15.114:0/2757311839 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317001a750 con 0x5616a9c4f4f0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f305ffff640 1 -- 172.21.15.114:0/2757311839 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317001aa50 con 0x5616a9c4f4f0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a9dd1f40 con 0x5616a9c4f4f0 2024-05-08T18:10:58.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f305ffff640 1 -- 172.21.15.114:0/2757311839 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3170015020 con 0x5616a9c4f4f0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f305ffff640 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30600383f0 0x7f306003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f305ffff640 1 -- 172.21.15.114:0/2757311839 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f3170020030 con 0x5616a9c4f4f0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3177426640 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30600383f0 0x7f306003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9c507e0 0x5616a9dd5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9dd60d0 con 0x5616a9c507e0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3178428640 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9c507e0 0x5616a9dd5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3177426640 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30600383f0 0x7f306003a8b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f316c0ad000 tx=0x7f316c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3178428640 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9c507e0 0x5616a9dd5a60 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f3178428640 1 -- 172.21.15.114:0/2757311839 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f316800a4d0 con 0x5616a9c507e0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.912+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9dd3160 con 0x5616a9c507e0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3178428640 1 -- 172.21.15.114:0/2757311839 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f316800a4d0 con 0x5616a9c507e0 2024-05-08T18:10:58.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9dd7f10 con 0x5616a9c507e0 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3178428640 1 -- 172.21.15.114:0/2757311839 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f316800a4d0 con 0x5616a9c507e0 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9dd7140 con 0x5616a9c507e0 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3178428640 1 -- 172.21.15.114:0/2757311839 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f316800a4d0 con 0x5616a9c507e0 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9dd7590 con 0x5616a9c507e0 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3178428640 1 -- 172.21.15.114:0/2757311839 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f316800a4d0 con 0x5616a9c507e0 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 Processor -- start 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- start start 2024-05-08T18:10:58.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 0x5616a9de6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5616a9be1fc0 con 0x5616a9de6850 2024-05-08T18:10:58.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3177426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 0x5616a9de6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3177426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 0x5616a9de6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:42986/0 (socket says 172.21.15.114:42986) 2024-05-08T18:10:58.918 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3177426640 1 -- 172.21.15.114:0/500274828 learned_addr learned my addr 172.21.15.114:0/500274828 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3177426640 1 -- 172.21.15.114:0/500274828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9de71b0 con 0x5616a9de6850 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f3177426640 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 0x5616a9de6c70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f316c0ae040 tx=0x7f316c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f305d7fa640 1 -- 172.21.15.114:0/500274828 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0c6070 con 0x5616a9de6850 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f305d7fa640 1 -- 172.21.15.114:0/500274828 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c0c1540 con 0x5616a9de6850 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a9de7c50 con 0x5616a9de6850 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f305d7fa640 1 -- 172.21.15.114:0/500274828 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0b0040 con 0x5616a9de6850 2024-05-08T18:10:58.919 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.916+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a9de80c0 con 0x5616a9de6850 2024-05-08T18:10:58.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f305d7fa640 1 -- 172.21.15.114:0/500274828 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f316c0c9070 con 0x5616a9de6850 2024-05-08T18:10:58.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f305d7fa640 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30500383f0 0x7f305003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f305d7fa640 1 -- 172.21.15.114:0/500274828 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f316c0be030 con 0x5616a9de6850 2024-05-08T18:10:58.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3178428640 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30500383f0 0x7f305003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f317a113980 1 Processor -- start 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f317a113980 1 -- start start 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3178428640 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30500383f0 0x7f305003a8b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5616a9dd6c60 tx=0x7f3168005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f317a113980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9df3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f317a113980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5616a9dc7db0 con 0x5616a9df3920 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3177426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9df3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3177426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9df3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43000/0 (socket says 172.21.15.114:43000) 2024-05-08T18:10:58.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3177426640 1 -- 172.21.15.114:0/2283575917 learned_addr learned my addr 172.21.15.114:0/2283575917 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3177426640 1 -- 172.21.15.114:0/2283575917 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9df4310 con 0x5616a9df3920 2024-05-08T18:10:58.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3177426640 1 --2- 172.21.15.114:0/2283575917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9df3d40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f316c0e8fe0 tx=0x7f316c006910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce79b4a5f8657 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3056ffd640 1 -- 172.21.15.114:0/2283575917 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0ca4e0 con 0x5616a9df3920 2024-05-08T18:10:58.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3056ffd640 1 -- 172.21.15.114:0/2283575917 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c0c9c60 con 0x5616a9df3920 2024-05-08T18:10:58.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.920+0000 7f3056ffd640 1 -- 172.21.15.114:0/2283575917 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0b53d0 con 0x5616a9df3920 2024-05-08T18:10:58.924 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2283575917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 msgr2=0x5616a9df3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 --2- 172.21.15.114:0/2283575917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9df3d40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f316c0e8fe0 tx=0x7f316c006910 comp rx=0 tx=0).stop 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2283575917 shutdown_connections 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 --2- 172.21.15.114:0/2283575917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9df3d40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2283575917 >> 172.21.15.114:0/2283575917 conn(0x5616a9defcb0 msgr2=0x5616a9dedd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2283575917 shutdown_connections 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2283575917 wait complete. 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 Processor -- start 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- start start 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9dfae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5616a9df4a60 con 0x5616a9df3920 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f3177426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9dfae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f3177426640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9dfae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43004/0 (socket says 172.21.15.114:43004) 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 learned_addr learned my addr 172.21.15.114:0/2073503349 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:58.925 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a9dfb3d0 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f3177426640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9dfae90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f316c0066e0 tx=0x7f316c0e8f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f30557fa640 1 -- 172.21.15.114:0/2073503349 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0cb7a0 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616a9dfb660 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f30557fa640 1 -- 172.21.15.114:0/2073503349 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316c0cb940 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f30557fa640 1 -- 172.21.15.114:0/2073503349 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f316c0c19b0 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a9dfe340 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f30557fa640 1 -- 172.21.15.114:0/2073503349 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f316c0c1b50 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f30557fa640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30400383f0 0x7f304003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.924+0000 7f30557fa640 1 -- 172.21.15.114:0/2073503349 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f316c0a8070 con 0x5616a9df3920 2024-05-08T18:10:58.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3178428640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30400383f0 0x7f304003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9e062f0 0x5616a9e08790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e08ee0 con 0x5616a9e062f0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9e062f0 0x5616a9e08790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3178428640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30400383f0 0x7f304003a8b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5616a9dd3080 tx=0x7f316801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9e062f0 0x5616a9e08790 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 realm 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e092f0 con 0x5616a9e062f0 2024-05-08T18:10:58.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e09b90 con 0x5616a9e062f0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e09f30 con 0x5616a9e062f0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0a780 con 0x5616a9e062f0 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 20 searching for the correct realm 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5616a9e0c4f0 0x5616a9e0e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177426640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5616a9e0c4f0 0x5616a9e0e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177426640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5616a9e0c4f0 0x5616a9e0e8e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177426640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f316c0cb060 0x7f316c0e7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3178428640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f316c0cb060 0x7f316c0e7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3178428640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f316c0cb060 0x7f316c0e7390 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.928+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3170017050 0x7f317000c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3170017050 0x7f317000c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3170017050 0x7f317000c760 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.932+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.940 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.936+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e0c4f0 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f3170017050 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x5616a9e062f0 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.940+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ee20 con 0x7f316c0cb060 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0b0d0 con 0x5616a9e062f0 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0b920 con 0x5616a9e062f0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0ad10 con 0x5616a9e062f0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 zone default found 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 4 Realm: () 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:58.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 zonegroup default 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0f250 con 0x7f3170017050 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e10c30 con 0x5616a9e0c4f0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e110b0 con 0x5616a9e0c4f0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 started sync module instance, tier type = 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e100d0 con 0x7f316c0cb060 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94655339365568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e0fd30 con 0x7f316c0cb060 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.944+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e11fe0 con 0x5616a9e062f0 2024-05-08T18:10:58.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.948+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94655339365568] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.948+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.948+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94655339369744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e11fe0 con 0x5616a9e062f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.948+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e129a0 con 0x5616a9e0c4f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94655339369744] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94655339371312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e11f50 con 0x5616a9e0c4f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e136e0 con 0x7f316c0cb060 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94655339377136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e13f80 con 0x7f316c0cb060 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e149a0 con 0x5616a9e062f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94655339371312] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94655339377136] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94655339381904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e13ad0 con 0x5616a9e062f0 2024-05-08T18:10:58.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.952+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e14e10 con 0x7f3170017050 2024-05-08T18:10:58.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.956+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.956+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94655339383136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e14d80 con 0x7f3170017050 2024-05-08T18:10:58.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.956+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e15d10 con 0x7f3170017050 2024-05-08T18:10:58.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.956+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94655339381904] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94655339383136] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94655339385344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e15820 con 0x7f3170017050 2024-05-08T18:10:58.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e161e0 con 0x7f3170017050 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94655339388208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e16600 con 0x7f3170017050 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=0 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=1 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=2 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=3 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=4 2024-05-08T18:10:58.961 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=5 2024-05-08T18:10:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94655339385344] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.960+0000 7f317a113980 20 add_watcher() i=6 2024-05-08T18:10:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94655339388208] v32'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 add_watcher() i=7 2024-05-08T18:10:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e16600 con 0x5616a9e062f0 2024-05-08T18:10:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94655339389264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e16570 con 0x5616a9e062f0 2024-05-08T18:10:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94655339389264] v32'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f302dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:58.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 5 note: GC not initialized 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f302cfe1640 20 reqs_thread_entry: start 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 Filter name: none 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f2fa67fc640 20 reqs_thread_entry: start 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3d010 con 0x7f3170017050 2024-05-08T18:10:58.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 rados->read ofs=0 len=0 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3b650 con 0x5616a9e0c4f0 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T18:10:58.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.964+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3c170 con 0x7f3170017050 2024-05-08T18:10:58.969 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f317a113980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f317a113980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f317a113980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94655339543392 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e40cc0 con 0x7f316c0cb060 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== watch-notify(notify (1) cookie 94655339365568 notify 137438953521 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f3168039040 con 0x7f316c0cb060 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(65 notify.0 [notify cookie 94655339543392 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953521 cookie 94655339365568 notifier 4842 bl.length()=533 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3056ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3056ffd640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f303c003eb0 con 0x7f316c0cb060 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== watch-notify(notify_complete (2) cookie 94655339543392 notify 137438953521 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3168024680 con 0x7f316c0cb060 2024-05-08T18:10:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.968+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e40c80 con 0x5616a9e0c4f0 2024-05-08T18:10:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f317a113980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f317a113980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f317a113980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94655339543392 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e410d0 con 0x5616a9e062f0 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94655339369744 notify 137438953494 ret 0) ==== 218+0+0 (crc 0 0 0) 0x5616a9e40600 con 0x5616a9e062f0 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3056ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94655339369744 notifier 4842 bl.length()=176 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3056ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3056ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(68 notify.1 [notify cookie 94655339543392 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3056ffd640 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f303c003eb0 con 0x5616a9e062f0 2024-05-08T18:10:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify_complete (2) cookie 94655339543392 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5616a9e3cd20 con 0x5616a9e062f0 2024-05-08T18:10:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.973 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-08T18:10:58.969245Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.969230Z","tags":[],"group_ids":[]} 2024-05-08T18:10:58.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f302dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:58.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94655339389264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x5616a9e062f0 2024-05-08T18:10:58.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94655339389264] v32'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.972+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94655339365568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x7f316c0cb060 2024-05-08T18:10:58.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94655339365568] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f317a113980 20 remove_watcher() i=0 2024-05-08T18:10:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f317a113980 2 removed watcher, disabling cache 2024-05-08T18:10:58.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94655339369744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x5616a9e062f0 2024-05-08T18:10:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94655339369744] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f317a113980 20 remove_watcher() i=1 2024-05-08T18:10:58.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.976+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94655339371312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x5616a9e0c4f0 2024-05-08T18:10:58.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.980+0000 7f3177426640 1 -- 172.21.15.114:0/2073503349 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94655339371312] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316c0c8030 con 0x5616a9e0c4f0 2024-05-08T18:10:58.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.980+0000 7f317a113980 20 remove_watcher() i=2 2024-05-08T18:10:58.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.980+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94655339377136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x7f316c0cb060 2024-05-08T18:10:58.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.980+0000 7f3178428640 1 -- 172.21.15.114:0/2073503349 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94655339377136] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f316801f070 con 0x7f316c0cb060 2024-05-08T18:10:58.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.980+0000 7f317a113980 20 remove_watcher() i=3 2024-05-08T18:10:58.981 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.980+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94655339381904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x5616a9e062f0 2024-05-08T18:10:58.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.984+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94655339381904] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x5616a9e062f0 2024-05-08T18:10:58.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.984+0000 7f317a113980 20 remove_watcher() i=4 2024-05-08T18:10:58.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.984+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94655339383136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x7f3170017050 2024-05-08T18:10:58.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.984+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94655339383136] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.984+0000 7f317a113980 20 remove_watcher() i=5 2024-05-08T18:10:58.986 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.984+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94655339385344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x7f3170017050 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94655339385344] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 20 remove_watcher() i=6 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94655339388208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5616a9e3ad10 con 0x7f3170017050 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94655339388208] v32'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3170008030 con 0x7f3170017050 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 20 remove_watcher() i=7 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3170017050 msgr2=0x7f317000c760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3170017050 0x7f317000c760 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9e062f0 msgr2=0x5616a9e08790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9e062f0 0x5616a9e08790 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f316c0cb060 msgr2=0x7f316c0e7390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f316c0cb060 0x7f316c0e7390 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5616a9e0c4f0 msgr2=0x5616a9e0e8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.988+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5616a9e0c4f0 0x5616a9e0e8e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30400383f0 msgr2=0x7f304003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30400383f0 0x7f304003a8b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5616a9dd3080 tx=0x7f316801f000 comp rx=0 tx=0).stop 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 msgr2=0x5616a9dfae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f3177c27640 1 -- 172.21.15.114:0/2073503349 reap_dead start 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9dfae90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f316c0066e0 tx=0x7f316c0e8f40 comp rx=0 tx=0).stop 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 shutdown_connections 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2073503349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9df3920 0x5616a9dfae90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 >> 172.21.15.114:0/2073503349 conn(0x5616a9defcb0 msgr2=0x5616a9df5180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 shutdown_connections 2024-05-08T18:10:58.994 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2073503349 wait complete. 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30500383f0 msgr2=0x7f305003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30500383f0 0x7f305003a8b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5616a9dd6c60 tx=0x7f3168005850 comp rx=0 tx=0).stop 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 msgr2=0x5616a9de6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 0x5616a9de6c70 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f316c0ae040 tx=0x7f316c018020 comp rx=0 tx=0).stop 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 shutdown_connections 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30500383f0 0x7f305003a8b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/500274828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9de6850 0x5616a9de6c70 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 >> 172.21.15.114:0/500274828 conn(0x5616a9ddb660 msgr2=0x5616a9ddc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 shutdown_connections 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/500274828 wait complete. 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9c507e0 msgr2=0x5616a9dd5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9c507e0 0x5616a9dd5a60 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30600383f0 msgr2=0x7f306003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30600383f0 0x7f306003a8b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f316c0ad000 tx=0x7f316c0a5040 comp rx=0 tx=0).stop 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 msgr2=0x5616a9dceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dceb30 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x5616a9dc84f0 tx=0x7f3170000bd0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 shutdown_connections 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5616a9c507e0 0x5616a9dd5a60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f30600383f0 0x7f306003a8b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 --2- 172.21.15.114:0/2757311839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5616a9c4f4f0 0x5616a9dceb30 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 >> 172.21.15.114:0/2757311839 conn(0x5616a9cd5770 msgr2=0x5616a9dc1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 shutdown_connections 2024-05-08T18:10:58.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:58.992+0000 7f317a113980 1 -- 172.21.15.114:0/2757311839 wait complete. 2024-05-08T18:10:59.003 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T18:10:58.969245Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.969230Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:59.003 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T18:10:58.969245Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.969230Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:59.003 ERROR:root:0 2024-05-08T18:10:59.003 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:10:59.008 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:10:59.008 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-08T18:10:59.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-08T18:10:59.009 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-08T18:10:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:59.039 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb824f980 1 Processor -- start 2024-05-08T18:10:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb824f980 1 -- start start 2024-05-08T18:10:59.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb824f980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d50c281390 0x55d50c283780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb824f980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d50c128710 con 0x55d50c27ced0 2024-05-08T18:10:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb824f980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d50c13cf00 con 0x55d50c281390 2024-05-08T18:10:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb5562640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d50c281390 0x55d50c283780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.041 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb5562640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d50c281390 0x55d50c283780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43014/0 (socket says 172.21.15.114:43014) 2024-05-08T18:10:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb5d63640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55d50c27ced0 0x55d50c27d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:51870/0 (socket says 172.21.15.114:51870) 2024-05-08T18:10:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb5562640 1 -- 172.21.15.114:0/637956804 learned_addr learned my addr 172.21.15.114:0/637956804 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb5562640 1 -- 172.21.15.114:0/637956804 >> v1:172.21.15.53:6789/0 conn(0x55d50c27ced0 legacy=0x55d50c27d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.042 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.040+0000 7fabb5562640 1 -- 172.21.15.114:0/637956804 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50c104ae0 con 0x55d50c281390 2024-05-08T18:10:59.044 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb5562640 1 --2- 172.21.15.114:0/637956804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c281390 0x55d50c283780 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fabac00a5c0 tx=0x7fabac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f014ae5dfb52301 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb4d61640 1 -- 172.21.15.114:0/637956804 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0a6070 con 0x55d50c281390 2024-05-08T18:10:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb4d61640 1 -- 172.21.15.114:0/637956804 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac0af070 con 0x55d50c281390 2024-05-08T18:10:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb4d61640 1 -- 172.21.15.114:0/637956804 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0aa5c0 con 0x55d50c281390 2024-05-08T18:10:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 -- 172.21.15.114:0/637956804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c281390 msgr2=0x55d50c283780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 --2- 172.21.15.114:0/637956804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c281390 0x55d50c283780 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fabac00a5c0 tx=0x7fabac01b340 comp rx=0 tx=0).stop 2024-05-08T18:10:59.045 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 -- 172.21.15.114:0/637956804 shutdown_connections 2024-05-08T18:10:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 --2- 172.21.15.114:0/637956804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c281390 0x55d50c283780 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 -- 172.21.15.114:0/637956804 >> 172.21.15.114:0/637956804 conn(0x55d50c2787a0 msgr2=0x55d50c27abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 -- 172.21.15.114:0/637956804 shutdown_connections 2024-05-08T18:10:59.046 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.044+0000 7fabb824f980 1 -- 172.21.15.114:0/637956804 wait complete. 2024-05-08T18:10:59.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 Processor -- start 2024-05-08T18:10:59.060 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- start start 2024-05-08T18:10:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d50c180f80 con 0x55d50c27ced0 2024-05-08T18:10:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb5d63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb5d63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c1f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43026/0 (socket says 172.21.15.114:43026) 2024-05-08T18:10:59.061 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb5d63640 1 -- 172.21.15.114:0/3602035193 learned_addr learned my addr 172.21.15.114:0/3602035193 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb5d63640 1 -- 172.21.15.114:0/3602035193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50c148da0 con 0x55d50c27ced0 2024-05-08T18:10:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb5d63640 1 --2- 172.21.15.114:0/3602035193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c1f2dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7faba800b270 tx=0x7faba800b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1a9f563d3ed841 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7faaa3e07640 1 -- 172.21.15.114:0/3602035193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba800e5d0 con 0x55d50c27ced0 2024-05-08T18:10:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7faaa3e07640 1 -- 172.21.15.114:0/3602035193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba800e770 con 0x55d50c27ced0 2024-05-08T18:10:59.062 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7faaa3e07640 1 -- 172.21.15.114:0/3602035193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba800ea70 con 0x55d50c27ced0 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- 172.21.15.114:0/3602035193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 msgr2=0x55d50c1f2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 --2- 172.21.15.114:0/3602035193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c1f2dd0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7faba800b270 tx=0x7faba800b670 comp rx=0 tx=0).stop 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- 172.21.15.114:0/3602035193 shutdown_connections 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 --2- 172.21.15.114:0/3602035193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c1f2dd0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- 172.21.15.114:0/3602035193 >> 172.21.15.114:0/3602035193 conn(0x55d50c2787a0 msgr2=0x55d50c363ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- 172.21.15.114:0/3602035193 shutdown_connections 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.060+0000 7fabb824f980 1 -- 172.21.15.114:0/3602035193 wait complete. 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb824f980 1 Processor -- start 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb824f980 1 -- start start 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb824f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c3715c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.065 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb824f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d50c2867b0 con 0x55d50c27ced0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb5d63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c3715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb5d63640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c3715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43036/0 (socket says 172.21.15.114:43036) 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb5d63640 1 -- 172.21.15.114:0/1068050625 learned_addr learned my addr 172.21.15.114:0/1068050625 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb5d63640 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50c371b00 con 0x55d50c27ced0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb5d63640 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c3715c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7faba800b6b0 tx=0x7faba8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7faaa2604640 1 -- 172.21.15.114:0/1068050625 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba800be70 con 0x55d50c27ced0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7faaa2604640 1 -- 172.21.15.114:0/1068050625 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba800fa40 con 0x55d50c27ced0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d50c371d90 con 0x55d50c27ced0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7faaa2604640 1 -- 172.21.15.114:0/1068050625 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faba800fd80 con 0x55d50c27ced0 2024-05-08T18:10:59.066 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50c374a70 con 0x55d50c27ced0 2024-05-08T18:10:59.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7faaa2604640 1 -- 172.21.15.114:0/1068050625 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7faba8017070 con 0x55d50c27ced0 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7faaa2604640 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa9c0383f0 0x7faa9c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7faaa2604640 1 -- 172.21.15.114:0/1068050625 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7faba8015020 con 0x55d50c27ced0 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.064+0000 7fabb5562640 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa9c0383f0 0x7faa9c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c281390 0x55d50c3786c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c378c40 con 0x55d50c281390 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c281390 0x55d50c3786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb5562640 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa9c0383f0 0x7faa9c03a8b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fabac0ae000 tx=0x7fabac0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c281390 0x55d50c3786c0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 -- 172.21.15.114:0/1068050625 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fabb000a4d0 con 0x55d50c281390 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c375c90 con 0x55d50c281390 2024-05-08T18:10:59.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 -- 172.21.15.114:0/1068050625 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fabb000a4d0 con 0x55d50c281390 2024-05-08T18:10:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c37aa40 con 0x55d50c281390 2024-05-08T18:10:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 -- 172.21.15.114:0/1068050625 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fabb000a4d0 con 0x55d50c281390 2024-05-08T18:10:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c379bb0 con 0x55d50c281390 2024-05-08T18:10:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 -- 172.21.15.114:0/1068050625 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fabb000a4d0 con 0x55d50c281390 2024-05-08T18:10:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c37a000 con 0x55d50c281390 2024-05-08T18:10:59.070 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb6564640 1 -- 172.21.15.114:0/1068050625 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fabb000a4d0 con 0x55d50c281390 2024-05-08T18:10:59.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 Processor -- start 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- start start 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 0x55d50c389790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb824f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d50c184fc0 con 0x55d50c389370 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb5562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 0x55d50c389790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb5562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 0x55d50c389790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43040/0 (socket says 172.21.15.114:43040) 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.068+0000 7fabb5562640 1 -- 172.21.15.114:0/766470513 learned_addr learned my addr 172.21.15.114:0/766470513 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb5562640 1 -- 172.21.15.114:0/766470513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50c389cd0 con 0x55d50c389370 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb5562640 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 0x55d50c389790 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabac0ac040 tx=0x7fabac0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7faa9b7fe640 1 -- 172.21.15.114:0/766470513 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0b3b90 con 0x55d50c389370 2024-05-08T18:10:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7faa9b7fe640 1 -- 172.21.15.114:0/766470513 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac0b3d30 con 0x55d50c389370 2024-05-08T18:10:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7faa9b7fe640 1 -- 172.21.15.114:0/766470513 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0c8560 con 0x55d50c389370 2024-05-08T18:10:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d50c38a770 con 0x55d50c389370 2024-05-08T18:10:59.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50c38abe0 con 0x55d50c389370 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7faa9b7fe640 1 -- 172.21.15.114:0/766470513 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fabac0d1440 con 0x55d50c389370 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7faa9b7fe640 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa90038440 0x7faa9003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7faa9b7fe640 1 -- 172.21.15.114:0/766470513 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fabac0ec050 con 0x55d50c389370 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb6564640 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa90038440 0x7faa9003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb824f980 1 Processor -- start 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb824f980 1 -- start start 2024-05-08T18:10:59.075 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb824f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c396830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb6564640 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa90038440 0x7faa9003a900 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55d50c3796d0 tx=0x7fabb0005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb824f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d50c1f1500 con 0x55d50c396450 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb5562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c396830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb5562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c396830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43050/0 (socket says 172.21.15.114:43050) 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.072+0000 7fabb5562640 1 -- 172.21.15.114:0/225618825 learned_addr learned my addr 172.21.15.114:0/225618825 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 -- 172.21.15.114:0/225618825 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50c396e00 con 0x55d50c396450 2024-05-08T18:10:59.076 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 --2- 172.21.15.114:0/225618825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c396830 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fabac0befd0 tx=0x7fabac0bdd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ef407673266e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7faa997fa640 1 -- 172.21.15.114:0/225618825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0d1940 con 0x55d50c396450 2024-05-08T18:10:59.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7faa997fa640 1 -- 172.21.15.114:0/225618825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac0bd390 con 0x55d50c396450 2024-05-08T18:10:59.079 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7faa997fa640 1 -- 172.21.15.114:0/225618825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0bd670 con 0x55d50c396450 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/225618825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 msgr2=0x55d50c396830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 --2- 172.21.15.114:0/225618825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c396830 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fabac0befd0 tx=0x7fabac0bdd50 comp rx=0 tx=0).stop 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/225618825 shutdown_connections 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 --2- 172.21.15.114:0/225618825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c396830 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/225618825 >> 172.21.15.114:0/225618825 conn(0x55d50c392790 msgr2=0x55d50c3907f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/225618825 shutdown_connections 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/225618825 wait complete. 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 Processor -- start 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- start start 2024-05-08T18:10:59.080 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c39d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d50c3975c0 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c39d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c39d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:43058/0 (socket says 172.21.15.114:43058) 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 learned_addr learned my addr 172.21.15.114:0/3009347437 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d50c39df10 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb5562640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c39d9d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fabac0bcfd0 tx=0x7fabac0ea320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7faa877fe640 1 -- 172.21.15.114:0/3009347437 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0be540 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d50c39e1a0 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7faa877fe640 1 -- 172.21.15.114:0/3009347437 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabac0be6e0 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7faa877fe640 1 -- 172.21.15.114:0/3009347437 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabac0c7c10 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.076+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d50c39e5b0 con 0x55d50c396450 2024-05-08T18:10:59.081 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7faa877fe640 1 -- 172.21.15.114:0/3009347437 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fabac0f5060 con 0x55d50c396450 2024-05-08T18:10:59.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7faa877fe640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa800383f0 0x7faa8003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7faa877fe640 1 -- 172.21.15.114:0/3009347437 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fabac0e1070 con 0x55d50c396450 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb6564640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa800383f0 0x7faa8003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c3a8ef0 0x55d50c3ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3abae0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c3a8ef0 0x55d50c3ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb6564640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa800383f0 0x7faa8003a8b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55d50c375be0 tx=0x7fabb001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c3a8ef0 0x55d50c3ab390 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 realm 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3abef0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3ac7c0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3acb60 con 0x55d50c3a8ef0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3ad3b0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:59.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 20 searching for the correct realm 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d50c3af120 0x55d50c3b1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.080+0000 7fabb5562640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d50c3af120 0x55d50c3b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5562640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d50c3af120 0x55d50c3b1510 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5562640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fabac0f7070 0x7fabac0eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb6564640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fabac0f7070 0x7fabac0eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb6564640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fabac0f7070 0x7fabac0eda50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7faba804da80 0x7faba804c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7faba804da80 0x7faba804c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7faba804da80 0x7faba804c150 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.084+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.092 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.100 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.088+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3af120 2024-05-08T18:10:59.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.092+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7faba804da80 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x55d50c3a8ef0 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1a50 con 0x7fabac0f7070 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3add30 con 0x55d50c3a8ef0 2024-05-08T18:10:59.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3ae580 con 0x55d50c3a8ef0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1e80 con 0x55d50c3a8ef0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 zone default found 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 4 Realm: () 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:59.104 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 zonegroup default 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b1f10 con 0x7faba804da80 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b3d30 con 0x55d50c3af120 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b4180 con 0x55d50c3af120 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 started sync module instance, tier type = 2024-05-08T18:10:59.105 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.096+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b31d0 con 0x7fabac0f7070 2024-05-08T18:10:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94373521601984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b2e30 con 0x7fabac0f7070 2024-05-08T18:10:59.106 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b50b0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94373521601984] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94373521606112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b50b0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.100+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b5a70 con 0x55d50c3af120 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94373521606112] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94373521607680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b5020 con 0x55d50c3af120 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b6770 con 0x7fabac0f7070 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94373521613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b7010 con 0x7fabac0f7070 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b7a30 con 0x55d50c3a8ef0 2024-05-08T18:10:59.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94373521607680] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.104+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94373521613808] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94373521618208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b6b60 con 0x55d50c3a8ef0 2024-05-08T18:10:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b82d0 con 0x7faba804da80 2024-05-08T18:10:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94373521618208] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94373521612304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b6b60 con 0x7faba804da80 2024-05-08T18:10:59.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.108+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b87f0 con 0x7faba804da80 2024-05-08T18:10:59.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94373521612304] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94373521621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b87b0 con 0x7faba804da80 2024-05-08T18:10:59.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b91b0 con 0x7faba804da80 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94373521621696] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94373521620000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b9170 con 0x7faba804da80 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=0 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=1 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=2 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=3 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=4 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=5 2024-05-08T18:10:59.114 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.112+0000 7fabb824f980 20 add_watcher() i=6 2024-05-08T18:10:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94373521620000] v32'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 20 add_watcher() i=7 2024-05-08T18:10:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3bc600 con 0x55d50c3a8ef0 2024-05-08T18:10:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.116 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94373521624720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b9b20 con 0x55d50c3a8ef0 2024-05-08T18:10:59.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94373521624720] v32'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7faa677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:59.117 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:59.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.116+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c5030 con 0x55d50c3a8ef0 2024-05-08T18:10:59.119 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.120+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.120 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.120+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c5680 con 0x7faba804da80 2024-05-08T18:10:59.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.120+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.120+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c5680 con 0x55d50c3af120 2024-05-08T18:10:59.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c5ed0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'246 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c4820 con 0x7fabac0f7070 2024-05-08T18:10:59.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'80 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c4820 con 0x55d50c3af120 2024-05-08T18:10:59.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.124+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c6550 con 0x55d50c3a8ef0 2024-05-08T18:10:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.128+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.128+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c6550 con 0x7faba804da80 2024-05-08T18:10:59.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.128+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.128+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c6550 con 0x7fabac0f7070 2024-05-08T18:10:59.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.132+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.132+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c6ac0 con 0x55d50c3af120 2024-05-08T18:10:59.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.132+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.132+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c6e60 con 0x7fabac0f7070 2024-05-08T18:10:59.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.132+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'81 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.132+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c7310 con 0x7faba804da80 2024-05-08T18:10:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.136+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.136+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c7310 con 0x7fabac0f7070 2024-05-08T18:10:59.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.136+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.136+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c73a0 con 0x7faba804da80 2024-05-08T18:10:59.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.140+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.140+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c73a0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.140+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'247 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.140+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c73a0 con 0x55d50c3af120 2024-05-08T18:10:59.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.140+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'72 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.140+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c7430 con 0x7fabac0f7070 2024-05-08T18:10:59.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.144+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.144+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.144+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.144+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.144+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.144+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.148+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'248 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.148+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.148+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'73 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.148+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x7fabac0f7070 2024-05-08T18:10:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.148+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.148+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.152+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.152+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.152+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.152+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.152+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.154 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.152+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.156+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.156+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x7faba804da80 2024-05-08T18:10:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.156+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.156+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c74c0 con 0x55d50c3af120 2024-05-08T18:10:59.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.160+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.160+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c60a0 con 0x7faba804da80 2024-05-08T18:10:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.160+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.160+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c60a0 con 0x55d50c3af120 2024-05-08T18:10:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.164+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'74 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.164+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c60a0 con 0x7faba804da80 2024-05-08T18:10:59.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.164+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.164+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3c60a0 con 0x7fabac0f7070 2024-05-08T18:10:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7faa667fc640 20 reqs_thread_entry: start 2024-05-08T18:10:59.167 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 20 Filter name: none 2024-05-08T18:10:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fa9d7fff640 20 reqs_thread_entry: start 2024-05-08T18:10:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T18:10:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.168 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e2ac0 con 0x7faba804da80 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 20 rados_obj.operate() r=0 bl.length=349 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e4f90 con 0x7faba804da80 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 10 removing key index: system_akey 2024-05-08T18:10:59.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e2f70 con 0x55d50c3af120 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(96 system_akey [delete] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94373521799888 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e5860 con 0x55d50c3a8ef0 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== watch-notify(notify (1) cookie 94373521606112 notify 137438953495 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55d50c3c64d0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7faa997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94373521606112 notifier 4849 bl.length()=161 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(97 notify.1 [notify cookie 94373521799888 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.168+0000 7faa997fa640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faa78003d70 con 0x55d50c3a8ef0 2024-05-08T18:10:59.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== watch-notify(notify_complete (2) cookie 94373521799888 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d50c374a70 con 0x55d50c3a8ef0 2024-05-08T18:10:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb824f980 10 removing email index: 2024-05-08T18:10:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb824f980 10 removing user buckets index 2024-05-08T18:10:59.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e2f70 con 0x7faba804da80 2024-05-08T18:10:59.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(99 system_user.buckets [delete] v32'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb824f980 10 removing user index: system_user 2024-05-08T18:10:59.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.172+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e4ae0 con 0x7faba804da80 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(100 system_user [call,call,delete] v32'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb824f980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb824f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94373521795776 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3e43a0 con 0x7fabac0f7070 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== watch-notify(notify (1) cookie 94373521601984 notify 137438953522 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55d50c3c6720 con 0x7fabac0f7070 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7faa98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953522 cookie 94373521601984 notifier 4849 bl.length()=160 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(101 notify.0 [notify cookie 94373521795776 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7faa98ff9640 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa9e00032d0 con 0x7fabac0f7070 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== watch-notify(notify_complete (2) cookie 94373521795776 notify 137438953522 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d50c3c5a20 con 0x7fabac0f7070 2024-05-08T18:10:59.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7faa677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.177 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94373521624720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3bfad0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94373521624720] v32'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.176+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94373521601984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b8e60 con 0x7fabac0f7070 2024-05-08T18:10:59.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94373521601984] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb824f980 20 remove_watcher() i=0 2024-05-08T18:10:59.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb824f980 2 removed watcher, disabling cache 2024-05-08T18:10:59.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94373521606112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b35c0 con 0x55d50c3a8ef0 2024-05-08T18:10:59.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94373521606112] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb824f980 20 remove_watcher() i=1 2024-05-08T18:10:59.181 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.180+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94373521607680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b45e0 con 0x55d50c3af120 2024-05-08T18:10:59.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb5562640 1 -- 172.21.15.114:0/3009347437 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94373521607680] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabac0f7d70 con 0x55d50c3af120 2024-05-08T18:10:59.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb824f980 20 remove_watcher() i=2 2024-05-08T18:10:59.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94373521613808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b4c00 con 0x7fabac0f7070 2024-05-08T18:10:59.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb6564640 1 -- 172.21.15.114:0/3009347437 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94373521613808] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fabb001f070 con 0x7fabac0f7070 2024-05-08T18:10:59.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb824f980 20 remove_watcher() i=3 2024-05-08T18:10:59.184 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94373521618208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b4c00 con 0x55d50c3a8ef0 2024-05-08T18:10:59.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94373521618208] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x55d50c3a8ef0 2024-05-08T18:10:59.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb824f980 20 remove_watcher() i=4 2024-05-08T18:10:59.186 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.184+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94373521612304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b4c00 con 0x7faba804da80 2024-05-08T18:10:59.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.188+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94373521612304] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.188+0000 7fabb824f980 20 remove_watcher() i=5 2024-05-08T18:10:59.188 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.188+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94373521621696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b4c00 con 0x7faba804da80 2024-05-08T18:10:59.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.188+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94373521621696] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.188+0000 7fabb824f980 20 remove_watcher() i=6 2024-05-08T18:10:59.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.188+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94373521620000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d50c3b4c00 con 0x7faba804da80 2024-05-08T18:10:59.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94373521620000] v32'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba802e070 con 0x7faba804da80 2024-05-08T18:10:59.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 20 remove_watcher() i=7 2024-05-08T18:10:59.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7faba804da80 msgr2=0x7faba804c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7faba804da80 0x7faba804c150 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c3a8ef0 msgr2=0x55d50c3ab390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c3a8ef0 0x55d50c3ab390 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fabac0f7070 msgr2=0x7fabac0eda50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fabac0f7070 0x7fabac0eda50 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d50c3af120 msgr2=0x55d50c3b1510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d50c3af120 0x55d50c3b1510 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa800383f0 msgr2=0x7faa8003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa800383f0 0x7faa8003a8b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x55d50c375be0 tx=0x7fabb001f000 comp rx=0 tx=0).stop 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 msgr2=0x55d50c39d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c39d9d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fabac0bcfd0 tx=0x7fabac0ea320 comp rx=0 tx=0).stop 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb5d63640 1 -- 172.21.15.114:0/3009347437 reap_dead start 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 shutdown_connections 2024-05-08T18:10:59.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/3009347437 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c396450 0x55d50c39d9d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 >> 172.21.15.114:0/3009347437 conn(0x55d50c392790 msgr2=0x55d50c38fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 shutdown_connections 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/3009347437 wait complete. 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa90038440 msgr2=0x7faa9003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa90038440 0x7faa9003a900 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55d50c3796d0 tx=0x7fabb0005850 comp rx=0 tx=0).stop 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 msgr2=0x55d50c389790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 0x55d50c389790 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabac0ac040 tx=0x7fabac0180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 shutdown_connections 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa90038440 0x7faa9003a900 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/766470513 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c389370 0x55d50c389790 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 >> 172.21.15.114:0/766470513 conn(0x55d50c37e180 msgr2=0x55d50c37ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 shutdown_connections 2024-05-08T18:10:59.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/766470513 wait complete. 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c281390 msgr2=0x55d50c3786c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c281390 0x55d50c3786c0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa9c0383f0 msgr2=0x7faa9c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa9c0383f0 0x7faa9c03a8b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fabac0ae000 tx=0x7fabac0a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 msgr2=0x55d50c3715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c3715c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7faba800b6b0 tx=0x7faba8000ee0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 shutdown_connections 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d50c281390 0x55d50c3786c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7faa9c0383f0 0x7faa9c03a8b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 --2- 172.21.15.114:0/1068050625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d50c27ced0 0x55d50c3715c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 >> 172.21.15.114:0/1068050625 conn(0x55d50c2787a0 msgr2=0x55d50c1f1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 shutdown_connections 2024-05-08T18:10:59.199 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.192+0000 7fabb824f980 1 -- 172.21.15.114:0/1068050625 wait complete. 2024-05-08T18:10:59.202 ERROR:root:None 2024-05-08T18:10:59.202 ERROR:root:0 2024-05-08T18:10:59.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T18:10:59.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T18:10:59.203 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-08T18:10:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:59.293 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.292+0000 7f2f477b6980 1 Processor -- start 2024-05-08T18:10:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.292+0000 7f2f477b6980 1 -- start start 2024-05-08T18:10:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.292+0000 7f2f477b6980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555c75db0550 0x555c75db2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.292+0000 7f2f477b6980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c75c55710 con 0x555c75dac090 2024-05-08T18:10:59.294 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.292+0000 7f2f477b6980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x555c75c69f00 con 0x555c75db0550 2024-05-08T18:10:59.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f44ac9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555c75db0550 0x555c75db2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f44ac9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x555c75db0550 0x555c75db2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37908/0 (socket says 172.21.15.114:37908) 2024-05-08T18:10:59.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f452ca640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x555c75dac090 0x555c75dac470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43490/0 (socket says 172.21.15.114:43490) 2024-05-08T18:10:59.295 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f44ac9640 1 -- 172.21.15.114:0/1797992273 learned_addr learned my addr 172.21.15.114:0/1797992273 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f44ac9640 1 -- 172.21.15.114:0/1797992273 >> v1:172.21.15.53:6789/0 conn(0x555c75dac090 legacy=0x555c75dac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.296 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f44ac9640 1 -- 172.21.15.114:0/1797992273 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c75c31ae0 con 0x555c75db0550 2024-05-08T18:10:59.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/1797992273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75db0550 0x555c75db2940 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00a5c0 tx=0x7f2f3c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf644c31a635d21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f37fff640 1 -- 172.21.15.114:0/1797992273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0a6070 con 0x555c75db0550 2024-05-08T18:10:59.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f37fff640 1 -- 172.21.15.114:0/1797992273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0af070 con 0x555c75db0550 2024-05-08T18:10:59.298 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.296+0000 7f2f37fff640 1 -- 172.21.15.114:0/1797992273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0aa5c0 con 0x555c75db0550 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 -- 172.21.15.114:0/1797992273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75db0550 msgr2=0x555c75db2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1797992273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75db0550 0x555c75db2940 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00a5c0 tx=0x7f2f3c01b340 comp rx=0 tx=0).stop 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 -- 172.21.15.114:0/1797992273 shutdown_connections 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1797992273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75db0550 0x555c75db2940 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 -- 172.21.15.114:0/1797992273 >> 172.21.15.114:0/1797992273 conn(0x555c75d1f770 msgr2=0x555c75d1fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 -- 172.21.15.114:0/1797992273 shutdown_connections 2024-05-08T18:10:59.299 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.300+0000 7f2f477b6980 1 -- 172.21.15.114:0/1797992273 wait complete. 2024-05-08T18:10:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f477b6980 1 Processor -- start 2024-05-08T18:10:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f477b6980 1 -- start start 2024-05-08T18:10:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f477b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e97160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f477b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c75cadf80 con 0x555c75dac090 2024-05-08T18:10:59.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f452ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e97160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f452ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e97160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37922/0 (socket says 172.21.15.114:37922) 2024-05-08T18:10:59.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f452ca640 1 -- 172.21.15.114:0/2648136170 learned_addr learned my addr 172.21.15.114:0/2648136170 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f452ca640 1 -- 172.21.15.114:0/2648136170 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c75c75da0 con 0x555c75dac090 2024-05-08T18:10:59.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2f452ca640 1 --2- 172.21.15.114:0/2648136170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e97160 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001ec0 tx=0x7f2f4000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c84fcca6bce6998 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2e33606640 1 -- 172.21.15.114:0/2648136170 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4000e5d0 con 0x555c75dac090 2024-05-08T18:10:59.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2e33606640 1 -- 172.21.15.114:0/2648136170 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4000e770 con 0x555c75dac090 2024-05-08T18:10:59.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.312+0000 7f2e33606640 1 -- 172.21.15.114:0/2648136170 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4000ea70 con 0x555c75dac090 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/2648136170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 msgr2=0x555c75e97160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 --2- 172.21.15.114:0/2648136170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e97160 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001ec0 tx=0x7f2f4000b6d0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/2648136170 shutdown_connections 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 --2- 172.21.15.114:0/2648136170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e97160 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/2648136170 >> 172.21.15.114:0/2648136170 conn(0x555c75d1f770 msgr2=0x555c75e92cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/2648136170 shutdown_connections 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/2648136170 wait complete. 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 Processor -- start 2024-05-08T18:10:59.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- start start 2024-05-08T18:10:59.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e9e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c75db5970 con 0x555c75dac090 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f452ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e9e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f452ca640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e9e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37936/0 (socket says 172.21.15.114:37936) 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f452ca640 1 -- 172.21.15.114:0/1465346891 learned_addr learned my addr 172.21.15.114:0/1465346891 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f452ca640 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c75e9eb70 con 0x555c75dac090 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f452ca640 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e9e630 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x555c75e97ff0 tx=0x7f2f40000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2e31e03640 1 -- 172.21.15.114:0/1465346891 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4000f8a0 con 0x555c75dac090 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2e31e03640 1 -- 172.21.15.114:0/1465346891 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f4000fa40 con 0x555c75dac090 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2e31e03640 1 -- 172.21.15.114:0/1465346891 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f4000fd20 con 0x555c75dac090 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c75e9ee00 con 0x555c75dac090 2024-05-08T18:10:59.318 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.316+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c75ea1a40 con 0x555c75dac090 2024-05-08T18:10:59.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2e31e03640 1 -- 172.21.15.114:0/1465346891 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2f40017070 con 0x555c75dac090 2024-05-08T18:10:59.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2e31e03640 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e2c0383f0 0x7f2e2c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2e31e03640 1 -- 172.21.15.114:0/1465346891 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f2f40015020 con 0x555c75dac090 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e2c0383f0 0x7f2e2c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75db0550 0x555c75ea5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ea5ba0 con 0x555c75db0550 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75db0550 0x555c75ea5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e2c0383f0 0x7f2e2c03a8b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ae000 tx=0x7f2f3c0a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75db0550 0x555c75ea5560 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 -- 172.21.15.114:0/1465346891 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f3800a4d0 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ea2c60 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 -- 172.21.15.114:0/1465346891 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f3800a4d0 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ea79e0 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 -- 172.21.15.114:0/1465346891 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f3800a4d0 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ea6c10 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 -- 172.21.15.114:0/1465346891 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f3800a4d0 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ea7030 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f45acb640 1 -- 172.21.15.114:0/1465346891 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2f3800a4d0 con 0x555c75db0550 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 Processor -- start 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- start start 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 0x555c75eb6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f477b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c75cb1fc0 con 0x555c75eb6360 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f44ac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 0x555c75eb6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f44ac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 0x555c75eb6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37950/0 (socket says 172.21.15.114:37950) 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.320+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3032908303 learned_addr learned my addr 172.21.15.114:0/3032908303 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3032908303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c75eb6cc0 con 0x555c75eb6360 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 0x555c75eb6780 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0199f0 tx=0x7f2f3c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2e2affd640 1 -- 172.21.15.114:0/3032908303 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0b3b90 con 0x555c75eb6360 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c75eb7760 con 0x555c75eb6360 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2e2affd640 1 -- 172.21.15.114:0/3032908303 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0b3d30 con 0x555c75eb6360 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2e2affd640 1 -- 172.21.15.114:0/3032908303 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0c8560 con 0x555c75eb6360 2024-05-08T18:10:59.324 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c75eb7bd0 con 0x555c75eb6360 2024-05-08T18:10:59.325 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2e2affd640 1 -- 172.21.15.114:0/3032908303 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2f3c0d1440 con 0x555c75eb6360 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2e2affd640 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e200383f0 0x7f2e2003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2e2affd640 1 -- 172.21.15.114:0/3032908303 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f2f3c0ec0e0 con 0x555c75eb6360 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f45acb640 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e200383f0 0x7f2e2003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f477b6980 1 Processor -- start 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f477b6980 1 -- start start 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f45acb640 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e200383f0 0x7f2e2003a8b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x555c75ea6fb0 tx=0x7f2f38005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f477b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75ec37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f477b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c75e978b0 con 0x555c75ec33d0 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f44ac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75ec37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f44ac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75ec37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37962/0 (socket says 172.21.15.114:37962) 2024-05-08T18:10:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.324+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3025895935 learned_addr learned my addr 172.21.15.114:0/3025895935 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3025895935 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c75ec3dc0 con 0x555c75ec33d0 2024-05-08T18:10:59.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/3025895935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75ec37f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ea450 tx=0x7f2f3c0d1c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d1aceb1c1a8ea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2e28ff9640 1 -- 172.21.15.114:0/3025895935 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0e7030 con 0x555c75ec33d0 2024-05-08T18:10:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2e28ff9640 1 -- 172.21.15.114:0/3025895935 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0bd390 con 0x555c75ec33d0 2024-05-08T18:10:59.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2e28ff9640 1 -- 172.21.15.114:0/3025895935 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0be410 con 0x555c75ec33d0 2024-05-08T18:10:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3025895935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 msgr2=0x555c75ec37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3025895935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75ec37f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ea450 tx=0x7f2f3c0d1c50 comp rx=0 tx=0).stop 2024-05-08T18:10:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3025895935 shutdown_connections 2024-05-08T18:10:59.329 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3025895935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75ec37f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3025895935 >> 172.21.15.114:0/3025895935 conn(0x555c75ebf760 msgr2=0x555c75ebd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3025895935 shutdown_connections 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3025895935 wait complete. 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 Processor -- start 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- start start 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75eca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x555c75ec4510 con 0x555c75ec33d0 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75eca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75eca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37978/0 (socket says 172.21.15.114:37978) 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 learned_addr learned my addr 172.21.15.114:0/3446881058 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c75ecae80 con 0x555c75ec33d0 2024-05-08T18:10:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75eca940 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0bcfd0 tx=0x7f2f3c0ea3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2e16ffd640 1 -- 172.21.15.114:0/3446881058 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0f1070 con 0x555c75ec33d0 2024-05-08T18:10:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c75ecb110 con 0x555c75ec33d0 2024-05-08T18:10:59.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2e16ffd640 1 -- 172.21.15.114:0/3446881058 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0c7e20 con 0x555c75ec33d0 2024-05-08T18:10:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c75ecddf0 con 0x555c75ec33d0 2024-05-08T18:10:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.328+0000 7f2e16ffd640 1 -- 172.21.15.114:0/3446881058 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c0fb060 con 0x555c75ec33d0 2024-05-08T18:10:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2e16ffd640 1 -- 172.21.15.114:0/3446881058 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2f3c0f4070 con 0x555c75ec33d0 2024-05-08T18:10:59.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2e16ffd640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e100383a0 0x7f2e1003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2e16ffd640 1 -- 172.21.15.114:0/3446881058 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f2f3c0b4050 con 0x555c75ec33d0 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f45acb640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e100383a0 0x7f2e1003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75ed5c50 0x555c75ed80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ed8810 con 0x555c75ed5c50 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75ed5c50 0x555c75ed80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f45acb640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e100383a0 0x7f2e1003a860 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x555c75ea6730 tx=0x7f2f3801f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75ed5c50 0x555c75ed80c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 realm 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ed8c20 con 0x555c75ed5c50 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ed94f0 con 0x555c75ed5c50 2024-05-08T18:10:59.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ed9890 con 0x555c75ed5c50 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75eda0e0 con 0x555c75ed5c50 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 20 searching for the correct realm 2024-05-08T18:10:59.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555c75edbe50 0x555c75ede240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c75ede780 con 0x555c75edbe50 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555c75edbe50 0x555c75ede240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555c75edbe50 0x555c75ede240 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f44ac9640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2f3c0f6060 0x7f2f3c0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.332+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2f3c0f6060 0x7f2f3c0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2f3c0f6060 0x7f2f3c0b64f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.339 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2f4004daa0 0x7f2f4004c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2f4004daa0 0x7f2f4004c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2f4004daa0 0x7f2f4004c150 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.336+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.340+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75edbe50 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.344+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f4004daa0 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x555c75ed5c50 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2f3c102040 con 0x7f2f3c0f6060 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:59.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75edaa60 con 0x555c75ed5c50 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75edb2b0 con 0x555c75ed5c50 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75eda6a0 con 0x555c75ed5c50 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.354 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 zone default found 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 4 Realm: () 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 zonegroup default 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75edec40 con 0x7f2f4004daa0 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee0a60 con 0x555c75edbe50 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee0e30 con 0x555c75edbe50 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 started sync module instance, tier type = 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75edff00 con 0x7f2f3c0f6060 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93855603884784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee1720 con 0x7f2f3c0f6060 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.348+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee1f70 con 0x555c75ed5c50 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.352+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93855603884784] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.352+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.352+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93855603888752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee1b40 con 0x555c75ed5c50 2024-05-08T18:10:59.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.352+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee25f0 con 0x555c75edbe50 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93855603888752] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93855603889808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee1ab0 con 0x555c75edbe50 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee33c0 con 0x7f2f3c0f6060 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93855603895952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee3c60 con 0x7f2f3c0f6060 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee4680 con 0x555c75ed5c50 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93855603889808] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93855603895952] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93855603900784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee37b0 con 0x555c75ed5c50 2024-05-08T18:10:59.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.356+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee4f50 con 0x7f2f4004daa0 2024-05-08T18:10:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93855603900784] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93855603894752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee37b0 con 0x7f2f4004daa0 2024-05-08T18:10:59.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee5430 con 0x7f2f4004daa0 2024-05-08T18:10:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 93855603894752] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93855603904256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee53f0 con 0x7f2f4004daa0 2024-05-08T18:10:59.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.360+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee5df0 con 0x7f2f4004daa0 2024-05-08T18:10:59.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93855603904256] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93855603902608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee5db0 con 0x7f2f4004daa0 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=0 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=1 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=2 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=3 2024-05-08T18:10:59.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=4 2024-05-08T18:10:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=5 2024-05-08T18:10:59.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.364+0000 7f2f477b6980 20 add_watcher() i=6 2024-05-08T18:10:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93855603902608] v32'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 add_watcher() i=7 2024-05-08T18:10:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee9240 con 0x555c75ed5c50 2024-05-08T18:10:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93855603907280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75ee6700 con 0x555c75ed5c50 2024-05-08T18:10:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93855603907280] v32'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2dfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:59.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 5 note: GC not initialized 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2dfa7e4640 20 reqs_thread_entry: start 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 Filter name: none 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2d6bfff640 20 reqs_thread_entry: start 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0cc70 con 0x555c75edbe50 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0b760 con 0x555c75edbe50 2024-05-08T18:10:59.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-08T18:10:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:10:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T18:10:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T18:10:59.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.368+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f10260 con 0x555c75edbe50 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v32'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93855604063344 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75f10950 con 0x555c75edbe50 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== watch-notify(notify (1) cookie 93855603889808 notify 137438953483 ret 0) ==== 584+0+0 (crc 0 0 0) 0x555c75f0b520 con 0x555c75edbe50 2024-05-08T18:10:59.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e28ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 93855603889808 notifier 4856 bl.length()=542 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e28ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e28ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(65 notify.2 [notify cookie 93855604063344 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e28ff9640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2e08003eb0 con 0x555c75edbe50 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== watch-notify(notify_complete (2) cookie 93855604063344 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c75ec3dc0 con 0x555c75edbe50 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0bc70 con 0x555c75edbe50 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v32'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93855604063344 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c75f10d80 con 0x7f2f4004daa0 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== watch-notify(notify (1) cookie 93855603894752 notify 137438953502 ret 0) ==== 217+0+0 (crc 0 0 0) 0x555c75ea1a40 con 0x7f2f4004daa0 2024-05-08T18:10:59.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 93855603894752 notifier 4856 bl.length()=175 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e17fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2e17fff640 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f2d78003410 con 0x7f2f4004daa0 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(68 notify.5 [notify cookie 93855604063344 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.372+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== watch-notify(notify_complete (2) cookie 93855604063344 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555c75e9ee00 con 0x7f2f4004daa0 2024-05-08T18:10:59.376 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-08T18:10:59.372822Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:59.372807Z","tags":[],"group_ids":[]} 2024-05-08T18:10:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2dfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93855603907280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x555c75ed5c50 2024-05-08T18:10:59.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93855603907280] v32'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93855603884784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x7f2f3c0f6060 2024-05-08T18:10:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93855603884784] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f477b6980 20 remove_watcher() i=0 2024-05-08T18:10:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f477b6980 2 removed watcher, disabling cache 2024-05-08T18:10:59.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.376+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93855603888752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x555c75ed5c50 2024-05-08T18:10:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.380+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93855603888752] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.380+0000 7f2f477b6980 20 remove_watcher() i=1 2024-05-08T18:10:59.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.380+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93855603889808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x555c75edbe50 2024-05-08T18:10:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.380+0000 7f2f44ac9640 1 -- 172.21.15.114:0/3446881058 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93855603889808] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3c0f3030 con 0x555c75edbe50 2024-05-08T18:10:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.380+0000 7f2f477b6980 20 remove_watcher() i=2 2024-05-08T18:10:59.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.380+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93855603895952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x7f2f3c0f6060 2024-05-08T18:10:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.384+0000 7f2f45acb640 1 -- 172.21.15.114:0/3446881058 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93855603895952] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f3801f070 con 0x7f2f3c0f6060 2024-05-08T18:10:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.384+0000 7f2f477b6980 20 remove_watcher() i=3 2024-05-08T18:10:59.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.384+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93855603900784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x555c75ed5c50 2024-05-08T18:10:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.384+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93855603900784] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x555c75ed5c50 2024-05-08T18:10:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.384+0000 7f2f477b6980 20 remove_watcher() i=4 2024-05-08T18:10:59.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.384+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93855603894752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x7f2f4004daa0 2024-05-08T18:10:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.388+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93855603894752] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.388+0000 7f2f477b6980 20 remove_watcher() i=5 2024-05-08T18:10:59.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.388+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93855603904256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x7f2f4004daa0 2024-05-08T18:10:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.388+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93855603904256] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.388+0000 7f2f477b6980 20 remove_watcher() i=6 2024-05-08T18:10:59.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.388+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93855603902608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c75f0a970 con 0x7f2f4004daa0 2024-05-08T18:10:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93855603902608] v32'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2f4002e070 con 0x7f2f4004daa0 2024-05-08T18:10:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 20 remove_watcher() i=7 2024-05-08T18:10:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2f4004daa0 msgr2=0x7f2f4004c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f2f4004daa0 0x7f2f4004c150 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75ed5c50 msgr2=0x555c75ed80c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75ed5c50 0x555c75ed80c0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2f3c0f6060 msgr2=0x7f2f3c0b64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f2f3c0f6060 0x7f2f3c0b64f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555c75edbe50 msgr2=0x555c75ede240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x555c75edbe50 0x555c75ede240 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e100383a0 msgr2=0x7f2e1003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e100383a0 0x7f2e1003a860 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x555c75ea6730 tx=0x7f2f3801f000 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f452ca640 1 -- 172.21.15.114:0/3446881058 reap_dead start 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 msgr2=0x555c75eca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75eca940 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0bcfd0 tx=0x7f2f3c0ea3b0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 shutdown_connections 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3446881058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75ec33d0 0x555c75eca940 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 >> 172.21.15.114:0/3446881058 conn(0x555c75ebf760 msgr2=0x555c75ec4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 shutdown_connections 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3446881058 wait complete. 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e200383f0 msgr2=0x7f2e2003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e200383f0 0x7f2e2003a8b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x555c75ea6fb0 tx=0x7f2f38005850 comp rx=0 tx=0).stop 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 msgr2=0x555c75eb6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 0x555c75eb6780 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0199f0 tx=0x7f2f3c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 shutdown_connections 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e200383f0 0x7f2e2003a8b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/3032908303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75eb6360 0x555c75eb6780 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 >> 172.21.15.114:0/3032908303 conn(0x555c75eab170 msgr2=0x555c75eabc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 shutdown_connections 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/3032908303 wait complete. 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75db0550 msgr2=0x555c75ea5560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75db0550 0x555c75ea5560 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e2c0383f0 msgr2=0x7f2e2c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e2c0383f0 0x7f2e2c03a8b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ae000 tx=0x7f2f3c0a6000 comp rx=0 tx=0).stop 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 msgr2=0x555c75e9e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e9e630 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x555c75e97ff0 tx=0x7f2f40000bd0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 shutdown_connections 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x555c75db0550 0x555c75ea5560 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2e2c0383f0 0x7f2e2c03a8b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 --2- 172.21.15.114:0/1465346891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c75dac090 0x555c75e9e630 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 >> 172.21.15.114:0/1465346891 conn(0x555c75d1f770 msgr2=0x555c75e91800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 shutdown_connections 2024-05-08T18:10:59.398 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.392+0000 7f2f477b6980 1 -- 172.21.15.114:0/1465346891 wait complete. 2024-05-08T18:10:59.402 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T18:10:59.372822Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:59.372807Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:59.402 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T18:10:59.372822Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:59.372807Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:59.402 ERROR:root:0 2024-05-08T18:10:59.403 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:10:59.407 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:10:59.408 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-08T18:10:59.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-08T18:10:59.408 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-08T18:10:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:59.475 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59e695980 1 Processor -- start 2024-05-08T18:10:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59e695980 1 -- start start 2024-05-08T18:10:59.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59e695980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55587c4ebf50 0x55587c57ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59e695980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55587c423710 con 0x55587c57b0a0 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59e695980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55587c437f00 con 0x55587c4ebf50 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59c1a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55587c4ebf50 0x55587c57ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59c1a9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55587c4ebf50 0x55587c57ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:37990/0 (socket says 172.21.15.114:37990) 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3506732488 learned_addr learned my addr 172.21.15.114:0/3506732488 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3506732488 >> v1:172.21.15.53:6789/0 conn(0x55587c57b0a0 legacy=0x55587c57d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.476+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3506732488 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587c3ffae0 con 0x55587c4ebf50 2024-05-08T18:10:59.479 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/3506732488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c4ebf50 0x55587c57ab60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00a5c0 tx=0x7fc58c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5293df878c778f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59b9a8640 1 -- 172.21.15.114:0/3506732488 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0a6070 con 0x55587c4ebf50 2024-05-08T18:10:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59b9a8640 1 -- 172.21.15.114:0/3506732488 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58c0af070 con 0x55587c4ebf50 2024-05-08T18:10:59.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59b9a8640 1 -- 172.21.15.114:0/3506732488 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0aa5c0 con 0x55587c4ebf50 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 -- 172.21.15.114:0/3506732488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c4ebf50 msgr2=0x55587c57ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 --2- 172.21.15.114:0/3506732488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c4ebf50 0x55587c57ab60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00a5c0 tx=0x7fc58c01b340 comp rx=0 tx=0).stop 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 -- 172.21.15.114:0/3506732488 shutdown_connections 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 --2- 172.21.15.114:0/3506732488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c4ebf50 0x55587c57ab60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 -- 172.21.15.114:0/3506732488 >> 172.21.15.114:0/3506732488 conn(0x55587c572640 msgr2=0x55587c574a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 -- 172.21.15.114:0/3506732488 shutdown_connections 2024-05-08T18:10:59.481 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.480+0000 7fc59e695980 1 -- 172.21.15.114:0/3506732488 wait complete. 2024-05-08T18:10:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59e695980 1 Processor -- start 2024-05-08T18:10:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59e695980 1 -- start start 2024-05-08T18:10:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59e695980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 0x55587c663060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59e695980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55587c47bf80 con 0x55587c57b0a0 2024-05-08T18:10:59.494 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59c1a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 0x55587c663060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59c1a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 0x55587c663060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38004/0 (socket says 172.21.15.114:38004) 2024-05-08T18:10:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.492+0000 7fc59c1a9640 1 -- 172.21.15.114:0/863691967 learned_addr learned my addr 172.21.15.114:0/863691967 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 -- 172.21.15.114:0/863691967 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587c443da0 con 0x55587c57b0a0 2024-05-08T18:10:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/863691967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 0x55587c663060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc58c01b380 tx=0x7fc58c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4465dac5e49c398 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc48a60c640 1 -- 172.21.15.114:0/863691967 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0aa8f0 con 0x55587c57b0a0 2024-05-08T18:10:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc48a60c640 1 -- 172.21.15.114:0/863691967 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58c0aaab0 con 0x55587c57b0a0 2024-05-08T18:10:59.496 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc48a60c640 1 -- 172.21.15.114:0/863691967 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0aadd0 con 0x55587c57b0a0 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/863691967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 msgr2=0x55587c663060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 --2- 172.21.15.114:0/863691967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 0x55587c663060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc58c01b380 tx=0x7fc58c003030 comp rx=0 tx=0).stop 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/863691967 shutdown_connections 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 --2- 172.21.15.114:0/863691967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c57b0a0 0x55587c663060 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/863691967 >> 172.21.15.114:0/863691967 conn(0x55587c572640 msgr2=0x55587c65eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/863691967 shutdown_connections 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/863691967 wait complete. 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 Processor -- start 2024-05-08T18:10:59.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- start start 2024-05-08T18:10:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 0x55587c66a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55587c57f6c0 con 0x55587c66a5b0 2024-05-08T18:10:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 0x55587c66a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 0x55587c66a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38016/0 (socket says 172.21.15.114:38016) 2024-05-08T18:10:59.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 -- 172.21.15.114:0/1054599933 learned_addr learned my addr 172.21.15.114:0/1054599933 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587c66af10 con 0x55587c66a5b0 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 0x55587c66a9d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0199f0 tx=0x7fc58c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc488e09640 1 -- 172.21.15.114:0/1054599933 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0cb020 con 0x55587c66a5b0 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55587c66b1a0 con 0x55587c66a5b0 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc488e09640 1 -- 172.21.15.114:0/1054599933 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58c0c6780 con 0x55587c66a5b0 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc488e09640 1 -- 172.21.15.114:0/1054599933 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58c0c6a60 con 0x55587c66a5b0 2024-05-08T18:10:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.496+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587c66dc30 con 0x55587c66a5b0 2024-05-08T18:10:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc488e09640 1 -- 172.21.15.114:0/1054599933 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc58c0ce020 con 0x55587c66a5b0 2024-05-08T18:10:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc488e09640 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4840383f0 0x7fc48403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc488e09640 1 -- 172.21.15.114:0/1054599933 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc58c0ea060 con 0x55587c66a5b0 2024-05-08T18:10:59.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc5939a8640 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4840383f0 0x7fc48403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c66f920 0x55587c671d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c672380 con 0x55587c66f920 2024-05-08T18:10:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c66f920 0x55587c671d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc5939a8640 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4840383f0 0x7fc48403a8b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc584001ec0 tx=0x7fc584001440 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.501 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c66f920 0x55587c671d10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 -- 172.21.15.114:0/1054599933 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc59400a4d0 con 0x55587c66f920 2024-05-08T18:10:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c672c60 con 0x55587c66f920 2024-05-08T18:10:59.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 -- 172.21.15.114:0/1054599933 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc59400a4d0 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c674010 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 -- 172.21.15.114:0/1054599933 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc59400a4d0 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6734b0 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 -- 172.21.15.114:0/1054599933 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc59400a4d0 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6738d0 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.500+0000 7fc59c9aa640 1 -- 172.21.15.114:0/1054599933 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc59400a4d0 con 0x55587c66f920 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59e695980 1 Processor -- start 2024-05-08T18:10:59.503 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59e695980 1 -- start start 2024-05-08T18:10:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59e695980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 0x55587c682f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59e695980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55587c47ffc0 con 0x55587c682b40 2024-05-08T18:10:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc5939a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 0x55587c682f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc5939a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 0x55587c682f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38024/0 (socket says 172.21.15.114:38024) 2024-05-08T18:10:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc5939a8640 1 -- 172.21.15.114:0/1920944499 learned_addr learned my addr 172.21.15.114:0/1920944499 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc5939a8640 1 -- 172.21.15.114:0/1920944499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587c6834a0 con 0x55587c682b40 2024-05-08T18:10:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc5939a8640 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 0x55587c682f60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc584010fd0 tx=0x7fc58400f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc481ffb640 1 -- 172.21.15.114:0/1920944499 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58400a040 con 0x55587c682b40 2024-05-08T18:10:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc481ffb640 1 -- 172.21.15.114:0/1920944499 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc584017050 con 0x55587c682b40 2024-05-08T18:10:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55587c683f40 con 0x55587c682b40 2024-05-08T18:10:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc481ffb640 1 -- 172.21.15.114:0/1920944499 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58400e6b0 con 0x55587c682b40 2024-05-08T18:10:59.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587c684410 con 0x55587c682b40 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc481ffb640 1 -- 172.21.15.114:0/1920944499 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc58400e8e0 con 0x55587c682b40 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc481ffb640 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4740383f0 0x7fc47403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc481ffb640 1 -- 172.21.15.114:0/1920944499 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc5840506d0 con 0x55587c682b40 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.504+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4740383f0 0x7fc47403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 Processor -- start 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- start start 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4740383f0 0x7fc47403a8b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55587c673850 tx=0x7fc594005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c578510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55587c6636f0 con 0x55587c578110 2024-05-08T18:10:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c578510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c578510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38040/0 (socket says 172.21.15.114:38040) 2024-05-08T18:10:59.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 -- 172.21.15.114:0/1354405258 learned_addr learned my addr 172.21.15.114:0/1354405258 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 -- 172.21.15.114:0/1354405258 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587c576940 con 0x55587c578110 2024-05-08T18:10:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 --2- 172.21.15.114:0/1354405258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c578510 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc58404ea40 tx=0x7fc58401aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94407da5daf2a799 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc47b7fe640 1 -- 172.21.15.114:0/1354405258 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584043070 con 0x55587c578110 2024-05-08T18:10:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc47b7fe640 1 -- 172.21.15.114:0/1354405258 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58401a310 con 0x55587c578110 2024-05-08T18:10:59.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc47b7fe640 1 -- 172.21.15.114:0/1354405258 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc58401a690 con 0x55587c578110 2024-05-08T18:10:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- 172.21.15.114:0/1354405258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 msgr2=0x55587c578510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 --2- 172.21.15.114:0/1354405258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c578510 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc58404ea40 tx=0x7fc58401aee0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- 172.21.15.114:0/1354405258 shutdown_connections 2024-05-08T18:10:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 --2- 172.21.15.114:0/1354405258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c578510 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- 172.21.15.114:0/1354405258 >> 172.21.15.114:0/1354405258 conn(0x55587c68c0b0 msgr2=0x55587c68a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- 172.21.15.114:0/1354405258 shutdown_connections 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- 172.21.15.114:0/1354405258 wait complete. 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 Processor -- start 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- start start 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c6994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc59e695980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55587c576db0 con 0x55587c578110 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c6994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c6994a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38042/0 (socket says 172.21.15.114:38042) 2024-05-08T18:10:59.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.508+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 learned_addr learned my addr 172.21.15.114:0/3383665068 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587c6999e0 con 0x55587c578110 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc5939a8640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c6994a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc58400fcf0 tx=0x7fc58404e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc479ffb640 1 -- 172.21.15.114:0/3383665068 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584034070 con 0x55587c578110 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55587c699c70 con 0x55587c578110 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc479ffb640 1 -- 172.21.15.114:0/3383665068 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc58401cc30 con 0x55587c578110 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587c69c950 con 0x55587c578110 2024-05-08T18:10:59.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc479ffb640 1 -- 172.21.15.114:0/3383665068 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc584043040 con 0x55587c578110 2024-05-08T18:10:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc479ffb640 1 -- 172.21.15.114:0/3383665068 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc584037070 con 0x55587c578110 2024-05-08T18:10:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc479ffb640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc46c0383a0 0x7fc46c03a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc479ffb640 1 -- 172.21.15.114:0/3383665068 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc58403ad50 con 0x55587c578110 2024-05-08T18:10:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc46c0383a0 0x7fc46c03a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c6a49c0 0x55587c6a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a7580 con 0x55587c6a49c0 2024-05-08T18:10:59.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c6a49c0 0x55587c6a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc46c0383a0 0x7fc46c03a860 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55587c672ae0 tx=0x7fc59401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c6a49c0 0x55587c6a6e30 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 20 realm 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a7990 con 0x55587c6a49c0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.512+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a8260 con 0x55587c6a49c0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a8600 con 0x55587c6a49c0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a8e50 con 0x55587c6a49c0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 20 searching for the correct realm 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55587c6aabc0 0x55587c6acfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.519 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc5939a8640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55587c6aabc0 0x55587c6acfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc5939a8640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55587c6aabc0 0x55587c6acfb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc5939a8640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc584039060 0x7fc584048850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc584039060 0x7fc584048850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c9aa640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc584039060 0x7fc584048850 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.520 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc58c0d0020 0x7fc58c0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.516+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc58c0d0020 0x7fc58c0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc58c0d0020 0x7fc58c0cf3b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.525 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.520+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.524+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6aabc0 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x55587c6a49c0 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad4f0 con 0x7fc584039060 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:59.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a9760 con 0x55587c6a49c0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a9fb0 con 0x55587c6a49c0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6a9fb0 con 0x55587c6a49c0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 zone default found 2024-05-08T18:10:59.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 4 Realm: () 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 zonegroup default 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ad920 con 0x7fc58c0d0020 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6af360 con 0x55587c6aabc0 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6af7f0 con 0x55587c6aabc0 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 started sync module instance, tier type = 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.528+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ae7a0 con 0x7fc584039060 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93838532864912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6aefb0 con 0x7fc584039060 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b0610 con 0x55587c6a49c0 2024-05-08T18:10:59.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93838532864912] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93838532869200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b0a00 con 0x55587c6a49c0 2024-05-08T18:10:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.532+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b13c0 con 0x55587c6aabc0 2024-05-08T18:10:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93838532869200] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93838532874000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b17b0 con 0x55587c6aabc0 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b2170 con 0x7fc584039060 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93838532877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b2a10 con 0x7fc584039060 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b3440 con 0x55587c6a49c0 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93838532874000] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.536+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93838532877808] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93838532879712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b0070 con 0x55587c6a49c0 2024-05-08T18:10:59.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b38f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93838532879712] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93838532882256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b38f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.540+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b41f0 con 0x7fc58c0d0020 2024-05-08T18:10:59.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93838532885232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b41b0 con 0x7fc58c0d0020 2024-05-08T18:10:59.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b5150 con 0x7fc58c0d0020 2024-05-08T18:10:59.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93838532882256] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93838532885232] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93838532889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b4390 con 0x7fc58c0d0020 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=0 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=1 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=2 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=3 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=4 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=5 2024-05-08T18:10:59.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.544+0000 7fc59e695980 20 add_watcher() i=6 2024-05-08T18:10:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93838532889696] v32'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.547 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 20 add_watcher() i=7 2024-05-08T18:10:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b3440 con 0x55587c6a49c0 2024-05-08T18:10:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93838532883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b5830 con 0x55587c6a49c0 2024-05-08T18:10:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93838532883520] v32'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc4527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:59.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.548+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c0a70 con 0x55587c6a49c0 2024-05-08T18:10:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.552+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.552+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c10c0 con 0x7fc58c0d0020 2024-05-08T18:10:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.552+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.554 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.552+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c10c0 con 0x55587c6aabc0 2024-05-08T18:10:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c19d0 con 0x55587c6a49c0 2024-05-08T18:10:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'253 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c0260 con 0x7fc584039060 2024-05-08T18:10:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'83 uv56 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c0260 con 0x55587c6aabc0 2024-05-08T18:10:59.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.556+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c1ae0 con 0x55587c6a49c0 2024-05-08T18:10:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.560+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.560 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.560+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c1ae0 con 0x7fc58c0d0020 2024-05-08T18:10:59.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.560+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.560+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c1ae0 con 0x7fc584039060 2024-05-08T18:10:59.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.564+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.564+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c2050 con 0x55587c6aabc0 2024-05-08T18:10:59.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.564+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.564+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c2050 con 0x7fc584039060 2024-05-08T18:10:59.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.564+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'84 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.564+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c25c0 con 0x7fc58c0d0020 2024-05-08T18:10:59.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.568+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.568+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c25c0 con 0x7fc584039060 2024-05-08T18:10:59.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.568+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.568+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc58c0d0020 2024-05-08T18:10:59.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.572+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.572+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6a49c0 2024-05-08T18:10:59.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.572+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'254 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.572+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.576+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'75 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.576+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc584039060 2024-05-08T18:10:59.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.576+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.576+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.576+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.577 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.576+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6a49c0 2024-05-08T18:10:59.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.580+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.580+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6a49c0 2024-05-08T18:10:59.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.580+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'255 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.580+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.580+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'76 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.580+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc584039060 2024-05-08T18:10:59.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.584+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.584+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.584+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.584+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.584+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.584+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.588+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.588+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.588+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.588+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc58c0d0020 2024-05-08T18:10:59.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.588+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.588+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.592+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.592+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc58c0d0020 2024-05-08T18:10:59.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.592+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.592+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x55587c6aabc0 2024-05-08T18:10:59.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.596+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'77 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.596+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc58c0d0020 2024-05-08T18:10:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.596+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.596+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6c27a0 con 0x7fc584039060 2024-05-08T18:10:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc4517e2640 20 reqs_thread_entry: start 2024-05-08T18:10:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 20 Filter name: none 2024-05-08T18:10:59.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc3c2ffd640 20 reqs_thread_entry: start 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6ddd80 con 0x55587c6aabc0 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 20 rados_obj.operate() r=0 bl.length=363 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6e0660 con 0x55587c6aabc0 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fc584036030 con 0x55587c6aabc0 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 10 removing key index: true_admin_akey 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.600+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6de640 con 0x55587c6aabc0 2024-05-08T18:10:59.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(96 true_admin_akey [delete] v32'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fc58406b040 con 0x55587c6aabc0 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93838533062992 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6e0b30 con 0x7fc58c0d0020 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== watch-notify(notify (1) cookie 93838532882256 notify 137438953503 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55587c6c2050 con 0x7fc58c0d0020 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc47b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 93838532882256 notifier 4863 bl.length()=165 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(97 notify.5 [notify cookie 93838533062992 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc47b7fe640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc460003d70 con 0x7fc58c0d0020 2024-05-08T18:10:59.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== watch-notify(notify_complete (2) cookie 93838533062992 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc58c0e1040 con 0x7fc58c0d0020 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 10 removing email index: 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 10 removing user buckets index 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6e0a90 con 0x55587c6aabc0 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(99 a_user.buckets [delete] v32'5 uv4 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fc58406b040 con 0x55587c6aabc0 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 10 removing user index: a_user 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.604+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6e0610 con 0x55587c6aabc0 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(100 a_user [call,call,delete] v32'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fc58406b040 con 0x55587c6aabc0 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-08T18:10:59.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93838533058880 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55587c6dfa20 con 0x55587c6aabc0 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== watch-notify(notify (1) cookie 93838532874000 notify 137438953484 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55587c6c1ae0 con 0x55587c6aabc0 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc47b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93838532874000 notifier 4863 bl.length()=155 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc47b7fe640 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc460003d70 con 0x55587c6aabc0 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(101 notify.2 [notify cookie 93838533058880 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc58406b040 con 0x55587c6aabc0 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58406b040 con 0x55587c6aabc0 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== watch-notify(notify_complete (2) cookie 93838533058880 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55587c6999e0 con 0x55587c6aabc0 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc4527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93838532883520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6be060 con 0x55587c6a49c0 2024-05-08T18:10:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93838532883520] v32'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93838532864912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b3440 con 0x7fc584039060 2024-05-08T18:10:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93838532864912] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 20 remove_watcher() i=0 2024-05-08T18:10:59.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 2 removed watcher, disabling cache 2024-05-08T18:10:59.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.608+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93838532869200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6aeb90 con 0x55587c6a49c0 2024-05-08T18:10:59.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.612+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93838532869200] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.612+0000 7fc59e695980 20 remove_watcher() i=1 2024-05-08T18:10:59.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.612+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93838532874000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6aeb90 con 0x55587c6aabc0 2024-05-08T18:10:59.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc5939a8640 1 -- 172.21.15.114:0/3383665068 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93838532874000] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58406b040 con 0x55587c6aabc0 2024-05-08T18:10:59.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59e695980 20 remove_watcher() i=2 2024-05-08T18:10:59.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93838532877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b0f10 con 0x7fc584039060 2024-05-08T18:10:59.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59c9aa640 1 -- 172.21.15.114:0/3383665068 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93838532877808] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc59401f070 con 0x7fc584039060 2024-05-08T18:10:59.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59e695980 20 remove_watcher() i=3 2024-05-08T18:10:59.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93838532879712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6aeb90 con 0x55587c6a49c0 2024-05-08T18:10:59.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93838532879712] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x55587c6a49c0 2024-05-08T18:10:59.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59e695980 20 remove_watcher() i=4 2024-05-08T18:10:59.618 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.616+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93838532882256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b0f10 con 0x7fc58c0d0020 2024-05-08T18:10:59.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.620+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93838532882256] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.620+0000 7fc59e695980 20 remove_watcher() i=5 2024-05-08T18:10:59.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.620+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93838532885232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6aeb90 con 0x7fc58c0d0020 2024-05-08T18:10:59.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.620+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93838532885232] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.620+0000 7fc59e695980 20 remove_watcher() i=6 2024-05-08T18:10:59.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.620+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93838532889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55587c6b2f50 con 0x7fc58c0d0020 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93838532889696] v32'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc58c0d1d30 con 0x7fc58c0d0020 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 20 remove_watcher() i=7 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc58c0d0020 msgr2=0x7fc58c0cf3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc58c0d0020 0x7fc58c0cf3b0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c6a49c0 msgr2=0x55587c6a6e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c6a49c0 0x55587c6a6e30 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc584039060 msgr2=0x7fc584048850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc584039060 0x7fc584048850 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55587c6aabc0 msgr2=0x55587c6acfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55587c6aabc0 0x55587c6acfb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc46c0383a0 msgr2=0x7fc46c03a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc46c0383a0 0x7fc46c03a860 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55587c672ae0 tx=0x7fc59401f000 comp rx=0 tx=0).stop 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 msgr2=0x55587c6994a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59c1a9640 1 -- 172.21.15.114:0/3383665068 reap_dead start 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c6994a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fc58400fcf0 tx=0x7fc58404e9a0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 shutdown_connections 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/3383665068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c578110 0x55587c6994a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 >> 172.21.15.114:0/3383665068 conn(0x55587c68c0b0 msgr2=0x55587c689710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 shutdown_connections 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/3383665068 wait complete. 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4740383f0 msgr2=0x7fc47403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4740383f0 0x7fc47403a8b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55587c673850 tx=0x7fc594005850 comp rx=0 tx=0).stop 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 msgr2=0x55587c682f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 0x55587c682f60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fc584010fd0 tx=0x7fc58400f7a0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 shutdown_connections 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4740383f0 0x7fc47403a8b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1920944499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c682b40 0x55587c682f60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 >> 172.21.15.114:0/1920944499 conn(0x55587c677950 msgr2=0x55587c678460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 shutdown_connections 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1920944499 wait complete. 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c66f920 msgr2=0x55587c671d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c66f920 0x55587c671d10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4840383f0 msgr2=0x7fc48403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4840383f0 0x7fc48403a8b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc584001ec0 tx=0x7fc584001440 comp rx=0 tx=0).stop 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 msgr2=0x55587c66a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 0x55587c66a9d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0199f0 tx=0x7fc58c0180e0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 shutdown_connections 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55587c66f920 0x55587c671d10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.628 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc4840383f0 0x7fc48403a8b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 --2- 172.21.15.114:0/1054599933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55587c66a5b0 0x55587c66a9d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 >> 172.21.15.114:0/1054599933 conn(0x55587c572640 msgr2=0x55587c65d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 shutdown_connections 2024-05-08T18:10:59.629 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.624+0000 7fc59e695980 1 -- 172.21.15.114:0/1054599933 wait complete. 2024-05-08T18:10:59.635 ERROR:root:None 2024-05-08T18:10:59.635 ERROR:root:0 2024-05-08T18:10:59.635 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T18:10:59.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T18:10:59.635 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-08T18:10:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:59.715 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:59.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e3932980 1 Processor -- start 2024-05-08T18:10:59.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e3932980 1 -- start start 2024-05-08T18:10:59.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e3932980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56387fcf2100 0x56387fcf24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e3932980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56387fb9b710 con 0x56387fcf2a20 2024-05-08T18:10:59.716 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e3932980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x56387fbaff00 con 0x56387fcf2100 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e1446640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56387fcf2100 0x56387fcf24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e1446640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x56387fcf2100 0x56387fcf24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38048/0 (socket says 172.21.15.114:38048) 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e1446640 1 -- 172.21.15.114:0/2406825637 learned_addr learned my addr 172.21.15.114:0/2406825637 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e0c45640 1 --1- 172.21.15.114:0/2406825637 >> v1:172.21.15.53:6789/0 conn(0x56387fcf2a20 0x56387fcf3390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43508/0 (socket says 172.21.15.114:43508) 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e1446640 1 -- 172.21.15.114:0/2406825637 >> v1:172.21.15.53:6789/0 conn(0x56387fcf2a20 legacy=0x56387fcf3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41e1446640 1 -- 172.21.15.114:0/2406825637 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387fb77ae0 con 0x56387fcf2100 2024-05-08T18:10:59.717 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.716+0000 7f41dbfff640 1 -- 172.21.15.114:0/2406825637 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794469127 0 0) 0x56387fb9b710 con 0x56387fcf2a20 2024-05-08T18:10:59.719 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e1446640 1 --2- 172.21.15.114:0/2406825637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fcf24e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00a4e0 tx=0x7f41cc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a096e32621dccce6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41dbfff640 1 -- 172.21.15.114:0/2406825637 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0aa540 con 0x56387fcf2100 2024-05-08T18:10:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41dbfff640 1 -- 172.21.15.114:0/2406825637 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc0aa6e0 con 0x56387fcf2100 2024-05-08T18:10:59.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41dbfff640 1 -- 172.21.15.114:0/2406825637 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0aaa00 con 0x56387fcf2100 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 -- 172.21.15.114:0/2406825637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 msgr2=0x56387fcf24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 --2- 172.21.15.114:0/2406825637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fcf24e0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00a4e0 tx=0x7f41cc01b090 comp rx=0 tx=0).stop 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 -- 172.21.15.114:0/2406825637 shutdown_connections 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 --2- 172.21.15.114:0/2406825637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fcf24e0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 -- 172.21.15.114:0/2406825637 >> 172.21.15.114:0/2406825637 conn(0x56387fc657e0 msgr2=0x56387fc65bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 -- 172.21.15.114:0/2406825637 shutdown_connections 2024-05-08T18:10:59.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.720+0000 7f41e3932980 1 -- 172.21.15.114:0/2406825637 wait complete. 2024-05-08T18:10:59.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 Processor -- start 2024-05-08T18:10:59.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- start start 2024-05-08T18:10:59.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fddd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56387fbf3f80 con 0x56387fcf2100 2024-05-08T18:10:59.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fddd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fddd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38056/0 (socket says 172.21.15.114:38056) 2024-05-08T18:10:59.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 -- 172.21.15.114:0/1338771011 learned_addr learned my addr 172.21.15.114:0/1338771011 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 -- 172.21.15.114:0/1338771011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387fbbbda0 con 0x56387fcf2100 2024-05-08T18:10:59.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 --2- 172.21.15.114:0/1338771011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fddd6c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f41cc017ca0 tx=0x7f41cc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14898c3c52ae5a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f40ce614640 1 -- 172.21.15.114:0/1338771011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0b9030 con 0x56387fcf2100 2024-05-08T18:10:59.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f40ce614640 1 -- 172.21.15.114:0/1338771011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc0aaac0 con 0x56387fcf2100 2024-05-08T18:10:59.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f40ce614640 1 -- 172.21.15.114:0/1338771011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0aada0 con 0x56387fcf2100 2024-05-08T18:10:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- 172.21.15.114:0/1338771011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 msgr2=0x56387fddd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 --2- 172.21.15.114:0/1338771011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fddd6c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f41cc017ca0 tx=0x7f41cc0033b0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- 172.21.15.114:0/1338771011 shutdown_connections 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 --2- 172.21.15.114:0/1338771011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fddd6c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- 172.21.15.114:0/1338771011 >> 172.21.15.114:0/1338771011 conn(0x56387fc657e0 msgr2=0x56387fdd9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- 172.21.15.114:0/1338771011 shutdown_connections 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- 172.21.15.114:0/1338771011 wait complete. 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 Processor -- start 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- start start 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fde4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e3932980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56387fcfc100 con 0x56387fcf2100 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fde4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fde4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38060/0 (socket says 172.21.15.114:38060) 2024-05-08T18:10:59.739 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.736+0000 7f41e1446640 1 -- 172.21.15.114:0/3389574115 learned_addr learned my addr 172.21.15.114:0/3389574115 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e1446640 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387fde4f60 con 0x56387fcf2100 2024-05-08T18:10:59.740 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e1446640 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fde4a20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f41cc01b0d0 tx=0x7f41cc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f40cce11640 1 -- 172.21.15.114:0/3389574115 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0b9030 con 0x56387fcf2100 2024-05-08T18:10:59.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f40cce11640 1 -- 172.21.15.114:0/3389574115 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41cc0c3070 con 0x56387fcf2100 2024-05-08T18:10:59.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56387fde51f0 con 0x56387fcf2100 2024-05-08T18:10:59.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f40cce11640 1 -- 172.21.15.114:0/3389574115 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41cc0bf750 con 0x56387fcf2100 2024-05-08T18:10:59.741 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56387fde7e80 con 0x56387fcf2100 2024-05-08T18:10:59.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f40cce11640 1 -- 172.21.15.114:0/3389574115 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f41cc0c5030 con 0x56387fcf2100 2024-05-08T18:10:59.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f40cce11640 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40c80383f0 0x7f40c803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f40cce11640 1 -- 172.21.15.114:0/3389574115 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f41cc0ba070 con 0x56387fcf2100 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e0c45640 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40c80383f0 0x7f40c803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fcf2a20 0x56387fdeb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fdebfa0 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e1c47640 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fcf2a20 0x56387fdeb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e0c45640 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40c80383f0 0x7f40c803a8b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f41dc000c10 tx=0x7f41dc0013c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e1c47640 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fcf2a20 0x56387fdeb960 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e1c47640 1 -- 172.21.15.114:0/3389574115 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41d40083f0 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.740+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fde9080 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e1c47640 1 -- 172.21.15.114:0/3389574115 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41d40083f0 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fdedd80 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e1c47640 1 -- 172.21.15.114:0/3389574115 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f41d40083f0 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fdecfb0 con 0x56387fcf2a20 2024-05-08T18:10:59.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e1c47640 1 -- 172.21.15.114:0/3389574115 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41d40083f0 con 0x56387fcf2a20 2024-05-08T18:10:59.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fded3d0 con 0x56387fcf2a20 2024-05-08T18:10:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e1c47640 1 -- 172.21.15.114:0/3389574115 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41d40083f0 con 0x56387fcf2a20 2024-05-08T18:10:59.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 Processor -- start 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- start start 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 0x56387fdfcb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56387fbf7fc0 con 0x56387fdfc6f0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e0c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 0x56387fdfcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e0c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 0x56387fdfcb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38062/0 (socket says 172.21.15.114:38062) 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e0c45640 1 -- 172.21.15.114:0/1428210237 learned_addr learned my addr 172.21.15.114:0/1428210237 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e0c45640 1 -- 172.21.15.114:0/1428210237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387fdfd050 con 0x56387fdfc6f0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e0c45640 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 0x56387fdfcb10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e620 tx=0x7f41dc00e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f40c5ffb640 1 -- 172.21.15.114:0/1428210237 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc022070 con 0x56387fdfc6f0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56387fdfdaf0 con 0x56387fdfc6f0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f40c5ffb640 1 -- 172.21.15.114:0/1428210237 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc01b380 con 0x56387fdfc6f0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f40c5ffb640 1 -- 172.21.15.114:0/1428210237 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc01b660 con 0x56387fdfc6f0 2024-05-08T18:10:59.747 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.744+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56387fdfdfc0 con 0x56387fdfc6f0 2024-05-08T18:10:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f40c5ffb640 1 -- 172.21.15.114:0/1428210237 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f41dc025070 con 0x56387fdfc6f0 2024-05-08T18:10:59.750 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f40c5ffb640 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b80383f0 0x7f40b803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f40c5ffb640 1 -- 172.21.15.114:0/1428210237 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f41dc04fd50 con 0x56387fdfc6f0 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e1c47640 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b80383f0 0x7f40b803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 Processor -- start 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- start start 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe09d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56387fdddd50 con 0x56387fe09920 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e1c47640 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b80383f0 0x7f40b803a8b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x56387fded350 tx=0x7f41d4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e0c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe09d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e0c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe09d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38070/0 (socket says 172.21.15.114:38070) 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e0c45640 1 -- 172.21.15.114:0/1148956253 learned_addr learned my addr 172.21.15.114:0/1148956253 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e0c45640 1 -- 172.21.15.114:0/1148956253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387fe0a2d0 con 0x56387fe09920 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e0c45640 1 --2- 172.21.15.114:0/1148956253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe09d00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f41dc04e000 tx=0x7f41dc0242c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197e603489c3087a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f40bf7fe640 1 -- 172.21.15.114:0/1148956253 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc01b800 con 0x56387fe09920 2024-05-08T18:10:59.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f40bf7fe640 1 -- 172.21.15.114:0/1148956253 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc03e260 con 0x56387fe09920 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f40bf7fe640 1 -- 172.21.15.114:0/1148956253 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc0263b0 con 0x56387fe09920 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- 172.21.15.114:0/1148956253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 msgr2=0x56387fe09d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 --2- 172.21.15.114:0/1148956253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe09d00 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f41dc04e000 tx=0x7f41dc0242c0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- 172.21.15.114:0/1148956253 shutdown_connections 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 --2- 172.21.15.114:0/1148956253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe09d00 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- 172.21.15.114:0/1148956253 >> 172.21.15.114:0/1148956253 conn(0x56387fe05c60 msgr2=0x56387fe03cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- 172.21.15.114:0/1148956253 shutdown_connections 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- 172.21.15.114:0/1148956253 wait complete. 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 Processor -- start 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- start start 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe10e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.748+0000 7f41e3932980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x56387fe0aa90 con 0x56387fe09920 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e0c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe10e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e0c45640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe10e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38076/0 (socket says 172.21.15.114:38076) 2024-05-08T18:10:59.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 learned_addr learned my addr 172.21.15.114:0/386568301 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387fe11370 con 0x56387fe09920 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e0c45640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe10e30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f41dc024bb0 tx=0x7f41dc04df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f40bdffb640 1 -- 172.21.15.114:0/386568301 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc030020 con 0x56387fe09920 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f40bdffb640 1 -- 172.21.15.114:0/386568301 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc044040 con 0x56387fe09920 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56387fe11600 con 0x56387fe09920 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f40bdffb640 1 -- 172.21.15.114:0/386568301 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f41dc0264e0 con 0x56387fe09920 2024-05-08T18:10:59.757 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56387fe11600 con 0x56387fe09920 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f40bdffb640 1 -- 172.21.15.114:0/386568301 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f41dc033020 con 0x56387fe09920 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f40bdffb640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b0038350 0x7f40b003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f40bdffb640 1 -- 172.21.15.114:0/386568301 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f41dc036d10 con 0x56387fe09920 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e1c47640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b0038350 0x7f40b003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fe1c0e0 0x56387fe1e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe1ecf0 con 0x56387fe1c0e0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e1446640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fe1c0e0 0x56387fe1e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e1c47640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b0038350 0x7f40b003a810 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f41d400f010 tx=0x7f41d401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e1446640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fe1c0e0 0x56387fe1e5a0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 20 realm 2024-05-08T18:10:59.758 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe1f100 con 0x56387fe1c0e0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.752+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe1f9d0 con 0x56387fe1c0e0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe1fd70 con 0x56387fe1c0e0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe205c0 con 0x56387fe1c0e0 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 20 searching for the correct realm 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56387fe22010 0x56387fe244d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e0c45640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56387fe22010 0x56387fe244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e0c45640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56387fe22010 0x56387fe244d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e0c45640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f41dc035020 0x7f41dc01a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1c47640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f41dc035020 0x7f41dc01a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1c47640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f41dc035020 0x7f41dc01a4c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f41cc0e1c20 0x7f41cc0e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.756+0000 7f41e1446640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f41cc0e1c20 0x7f41cc0e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f41cc0e1c20 0x7f41cc0e14c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x7f41cc0e1c20 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x7f41cc0e1c20 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.760+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x7f41cc0e1c20 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x7f41cc0e1c20 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f41cc0be790 con 0x56387fe1c0e0 2024-05-08T18:10:59.769 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.773 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0be790 con 0x7f41cc0e1c20 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.764+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe22010 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x56387fe1c0e0 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56387fe24ba0 con 0x7f41dc035020 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe20210 con 0x56387fe1c0e0 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe20f30 con 0x56387fe1c0e0 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe21410 con 0x56387fe1c0e0 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.768+0000 7f41e3932980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 zone default found 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 4 Realm: () 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 zonegroup default 2024-05-08T18:10:59.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe254d0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe27120 con 0x56387fe22010 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe27590 con 0x56387fe22010 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 started sync module instance, tier type = 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe25ff0 con 0x7f41dc035020 2024-05-08T18:10:59.777 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94800663700496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe25c50 con 0x7f41dc035020 2024-05-08T18:10:59.778 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.772+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe284c0 con 0x56387fe1c0e0 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94800663700496] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94800663706096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe284c0 con 0x56387fe1c0e0 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe28e80 con 0x56387fe22010 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94800663710160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe29720 con 0x56387fe22010 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2a140 con 0x7f41dc035020 2024-05-08T18:10:59.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.776+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94800663706096] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94800663714864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2a530 con 0x7f41dc035020 2024-05-08T18:10:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2aef0 con 0x56387fe1c0e0 2024-05-08T18:10:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94800663710160] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94800663714864] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94800663707664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2aa40 con 0x56387fe1c0e0 2024-05-08T18:10:59.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.780+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2b310 con 0x7f41cc0e1c20 2024-05-08T18:10:59.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94800663707664] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94800663712368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2aef0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2bd20 con 0x7f41cc0e1c20 2024-05-08T18:10:59.785 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94800663712368] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94800663718736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2bd20 con 0x7f41cc0e1c20 2024-05-08T18:10:59.786 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.784+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2c6e0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94800663724592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2cb00 con 0x7f41cc0e1c20 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=0 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=1 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=2 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=3 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=4 2024-05-08T18:10:59.789 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=5 2024-05-08T18:10:59.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94800663718736] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.788+0000 7f41e3932980 20 add_watcher() i=6 2024-05-08T18:10:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94800663724592] v32'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 20 add_watcher() i=7 2024-05-08T18:10:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2cb00 con 0x56387fe1c0e0 2024-05-08T18:10:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94800663725648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe2ca70 con 0x56387fe1c0e0 2024-05-08T18:10:59.793 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94800663725648] v32'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f40967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 5 note: GC not initialized 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f40957e2640 20 reqs_thread_entry: start 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 20 Filter name: none 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f4006ffd640 20 reqs_thread_entry: start 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.792+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe535e0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:10:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:10:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:59.795 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe59bb0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:59.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:59.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:10:59.797 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94800663909920 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56387fe55260 con 0x56387fe1c0e0 2024-05-08T18:10:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94800663707664 notify 137438953496 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f41cc0db040 con 0x56387fe1c0e0 2024-05-08T18:10:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f40bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94800663707664 notifier 4870 bl.length()=666 2024-05-08T18:10:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f40bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f40bf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:59.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94800663909920 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f40bf7fe640 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f40a4003eb0 con 0x56387fe1c0e0 2024-05-08T18:10:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.796+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94800663909920 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56387fde7e80 con 0x56387fe1c0e0 2024-05-08T18:10:59.799 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:10:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f40967e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94800663725648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe512e0 con 0x56387fe1c0e0 2024-05-08T18:10:59.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94800663725648] v32'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94800663700496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe512e0 con 0x7f41dc035020 2024-05-08T18:10:59.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94800663700496] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e3932980 20 remove_watcher() i=0 2024-05-08T18:10:59.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e3932980 2 removed watcher, disabling cache 2024-05-08T18:10:59.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.800+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94800663706096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe512e0 con 0x56387fe1c0e0 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.804+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94800663706096] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.804+0000 7f41e3932980 20 remove_watcher() i=1 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.804+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94800663710160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe512e0 con 0x56387fe22010 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.804+0000 7f41e0c45640 1 -- 172.21.15.114:0/386568301 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94800663710160] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41dc024030 con 0x56387fe22010 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.804+0000 7f41e3932980 20 remove_watcher() i=2 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.804+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94800663714864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe279f0 con 0x7f41dc035020 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.808+0000 7f41e1c47640 1 -- 172.21.15.114:0/386568301 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94800663714864] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41d402f040 con 0x7f41dc035020 2024-05-08T18:10:59.807 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.808+0000 7f41e3932980 20 remove_watcher() i=3 2024-05-08T18:10:59.808 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.808+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94800663707664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe29c30 con 0x56387fe1c0e0 2024-05-08T18:10:59.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.808+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94800663707664] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x56387fe1c0e0 2024-05-08T18:10:59.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.808+0000 7f41e3932980 20 remove_watcher() i=4 2024-05-08T18:10:59.809 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.808+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94800663712368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe279f0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.812+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94800663712368] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.812+0000 7f41e3932980 20 remove_watcher() i=5 2024-05-08T18:10:59.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.812+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94800663718736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe29270 con 0x7f41cc0e1c20 2024-05-08T18:10:59.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.812+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94800663718736] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.812+0000 7f41e3932980 20 remove_watcher() i=6 2024-05-08T18:10:59.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.812+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94800663724592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56387fe279f0 con 0x7f41cc0e1c20 2024-05-08T18:10:59.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94800663724592] v32'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41cc0f2040 con 0x7f41cc0e1c20 2024-05-08T18:10:59.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 20 remove_watcher() i=7 2024-05-08T18:10:59.817 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f41cc0e1c20 msgr2=0x7f41cc0e14c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f41cc0e1c20 0x7f41cc0e14c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fe1c0e0 msgr2=0x56387fe1e5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fe1c0e0 0x56387fe1e5a0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f41dc035020 msgr2=0x7f41dc01a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f41dc035020 0x7f41dc01a4c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56387fe22010 msgr2=0x56387fe244d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56387fe22010 0x56387fe244d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b0038350 msgr2=0x7f40b003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b0038350 0x7f40b003a810 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f41d400f010 tx=0x7f41d401b070 comp rx=0 tx=0).stop 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 msgr2=0x56387fe10e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e1446640 1 -- 172.21.15.114:0/386568301 reap_dead start 2024-05-08T18:10:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe10e30 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f41dc024bb0 tx=0x7f41dc04df60 comp rx=0 tx=0).stop 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 shutdown_connections 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/386568301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fe09920 0x56387fe10e30 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 >> 172.21.15.114:0/386568301 conn(0x56387fe05c60 msgr2=0x56387fe0b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 shutdown_connections 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/386568301 wait complete. 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b80383f0 msgr2=0x7f40b803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b80383f0 0x7f40b803a8b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x56387fded350 tx=0x7f41d4003070 comp rx=0 tx=0).stop 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 msgr2=0x56387fdfcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 0x56387fdfcb10 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e620 tx=0x7f41dc00e650 comp rx=0 tx=0).stop 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 shutdown_connections 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40b80383f0 0x7f40b803a8b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/1428210237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fdfc6f0 0x56387fdfcb10 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.819 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 >> 172.21.15.114:0/1428210237 conn(0x56387fdf1500 msgr2=0x56387fdf2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 shutdown_connections 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/1428210237 wait complete. 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fcf2a20 msgr2=0x56387fdeb960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fcf2a20 0x56387fdeb960 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40c80383f0 msgr2=0x7f40c803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40c80383f0 0x7f40c803a8b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f41dc000c10 tx=0x7f41dc0013c0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 msgr2=0x56387fde4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fde4a20 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f41cc01b0d0 tx=0x7f41cc017e30 comp rx=0 tx=0).stop 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 shutdown_connections 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x56387fcf2a20 0x56387fdeb960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f40c80383f0 0x7f40c803a8b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.820 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 --2- 172.21.15.114:0/3389574115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56387fcf2100 0x56387fde4a20 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 >> 172.21.15.114:0/3389574115 conn(0x56387fc657e0 msgr2=0x56387fdd7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 shutdown_connections 2024-05-08T18:10:59.821 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.816+0000 7f41e3932980 1 -- 172.21.15.114:0/3389574115 wait complete. 2024-05-08T18:10:59.828 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:59.828 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:10:59.828 ERROR:root:0 2024-05-08T18:10:59.828 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:10:59.833 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:10:59.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T18:10:59.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T18:10:59.833 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-08T18:10:59.910 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:10:59.910 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:10:59.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f6a11980 1 Processor -- start 2024-05-08T18:10:59.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f6a11980 1 -- start start 2024-05-08T18:10:59.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f6a11980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ca45046100 0x55ca450464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f6a11980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ca44eef710 con 0x55ca45046a20 2024-05-08T18:10:59.911 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f6a11980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55ca44f03f00 con 0x55ca45046100 2024-05-08T18:10:59.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f4525640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ca45046100 0x55ca450464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f4525640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55ca45046100 0x55ca450464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38082/0 (socket says 172.21.15.114:38082) 2024-05-08T18:10:59.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f4525640 1 -- 172.21.15.114:0/3040435032 learned_addr learned my addr 172.21.15.114:0/3040435032 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f4525640 1 -- 172.21.15.114:0/3040435032 >> v1:172.21.15.53:6789/0 conn(0x55ca45046a20 legacy=0x55ca45047390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.912+0000 7fc7f4525640 1 -- 172.21.15.114:0/3040435032 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca44ecbae0 con 0x55ca45046100 2024-05-08T18:10:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f4525640 1 --2- 172.21.15.114:0/3040435032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca450464e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400a5c0 tx=0x7fc7e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81c4fdc151069d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f3523640 1 -- 172.21.15.114:0/3040435032 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e40a6070 con 0x55ca45046100 2024-05-08T18:10:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f3523640 1 -- 172.21.15.114:0/3040435032 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e40af070 con 0x55ca45046100 2024-05-08T18:10:59.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f3523640 1 -- 172.21.15.114:0/3040435032 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e40aa5c0 con 0x55ca45046100 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3040435032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 msgr2=0x55ca450464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/3040435032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca450464e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400a5c0 tx=0x7fc7e401b340 comp rx=0 tx=0).stop 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3040435032 shutdown_connections 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/3040435032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca450464e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3040435032 >> 172.21.15.114:0/3040435032 conn(0x55ca44fb97e0 msgr2=0x55ca44fb9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3040435032 shutdown_connections 2024-05-08T18:10:59.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.916+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3040435032 wait complete. 2024-05-08T18:10:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 Processor -- start 2024-05-08T18:10:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- start start 2024-05-08T18:10:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca451318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca44f47f80 con 0x55ca45046100 2024-05-08T18:10:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f4525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca451318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f4525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca451318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38084/0 (socket says 172.21.15.114:38084) 2024-05-08T18:10:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f4525640 1 -- 172.21.15.114:0/3555733890 learned_addr learned my addr 172.21.15.114:0/3555733890 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f4525640 1 -- 172.21.15.114:0/3555733890 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca44f0fda0 con 0x55ca45046100 2024-05-08T18:10:59.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f4525640 1 --2- 172.21.15.114:0/3555733890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca451318d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400a5c0 tx=0x7fc7e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e400eb3260a8b7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc6e260c640 1 -- 172.21.15.114:0/3555733890 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e40aa9b0 con 0x55ca45046100 2024-05-08T18:10:59.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc6e260c640 1 -- 172.21.15.114:0/3555733890 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e40aab50 con 0x55ca45046100 2024-05-08T18:10:59.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc6e260c640 1 -- 172.21.15.114:0/3555733890 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e40aae50 con 0x55ca45046100 2024-05-08T18:10:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3555733890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 msgr2=0x55ca451318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/3555733890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca451318d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400a5c0 tx=0x7fc7e4003030 comp rx=0 tx=0).stop 2024-05-08T18:10:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3555733890 shutdown_connections 2024-05-08T18:10:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/3555733890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca451318d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3555733890 >> 172.21.15.114:0/3555733890 conn(0x55ca44fb97e0 msgr2=0x55ca4512d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3555733890 shutdown_connections 2024-05-08T18:10:59.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- 172.21.15.114:0/3555733890 wait complete. 2024-05-08T18:10:59.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 Processor -- start 2024-05-08T18:10:59.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- start start 2024-05-08T18:10:59.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca45138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.935 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.932+0000 7fc7f6a11980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca45050100 con 0x55ca45046100 2024-05-08T18:10:59.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca45138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4525640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca45138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38094/0 (socket says 172.21.15.114:38094) 2024-05-08T18:10:59.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4525640 1 -- 172.21.15.114:0/2752194207 learned_addr learned my addr 172.21.15.114:0/2752194207 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4525640 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca45139150 con 0x55ca45046100 2024-05-08T18:10:59.936 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4525640 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca45138c10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400a5c0 tx=0x7fc7e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc6e0e09640 1 -- 172.21.15.114:0/2752194207 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e40c6750 con 0x55ca45046100 2024-05-08T18:10:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc6e0e09640 1 -- 172.21.15.114:0/2752194207 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e40c68f0 con 0x55ca45046100 2024-05-08T18:10:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca451393e0 con 0x55ca45046100 2024-05-08T18:10:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc6e0e09640 1 -- 172.21.15.114:0/2752194207 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7e40c6bd0 con 0x55ca45046100 2024-05-08T18:10:59.937 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca4513c070 con 0x55ca45046100 2024-05-08T18:10:59.938 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc6e0e09640 1 -- 172.21.15.114:0/2752194207 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc7e40ce020 con 0x55ca45046100 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc6e0e09640 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6dc038440 0x7fc6dc03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc6e0e09640 1 -- 172.21.15.114:0/2752194207 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc7e40cc020 con 0x55ca45046100 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6dc038440 0x7fc6dc03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45046a20 0x55ca4513fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca451401c0 con 0x55ca45046a20 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45046a20 0x55ca4513fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6dc038440 0x7fc6dc03a900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc001e60 tx=0x7fc7dc0013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.936+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45046a20 0x55ca4513fb50 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f4d26640 1 -- 172.21.15.114:0/2752194207 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7ec00a4d0 con 0x55ca45046a20 2024-05-08T18:10:59.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45140ad0 con 0x55ca45046a20 2024-05-08T18:10:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f4d26640 1 -- 172.21.15.114:0/2752194207 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7ec00a4d0 con 0x55ca45046a20 2024-05-08T18:10:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45141e80 con 0x55ca45046a20 2024-05-08T18:10:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f4d26640 1 -- 172.21.15.114:0/2752194207 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7ec00a4d0 con 0x55ca45046a20 2024-05-08T18:10:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45141320 con 0x55ca45046a20 2024-05-08T18:10:59.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f4d26640 1 -- 172.21.15.114:0/2752194207 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7ec00a4d0 con 0x55ca45046a20 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45141740 con 0x55ca45046a20 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f4d26640 1 -- 172.21.15.114:0/2752194207 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7ec00a4d0 con 0x55ca45046a20 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 Processor -- start 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- start start 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 0x55ca45150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca44f4bfc0 con 0x55ca451509b0 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f3d24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 0x55ca45150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f3d24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 0x55ca45150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38110/0 (socket says 172.21.15.114:38110) 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f3d24640 1 -- 172.21.15.114:0/2029510482 learned_addr learned my addr 172.21.15.114:0/2029510482 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f3d24640 1 -- 172.21.15.114:0/2029510482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca45151310 con 0x55ca451509b0 2024-05-08T18:10:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 0x55ca45150dd0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc010f90 tx=0x7fc7dc00f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc6d9ffb640 1 -- 172.21.15.114:0/2029510482 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc00a040 con 0x55ca451509b0 2024-05-08T18:10:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc6d9ffb640 1 -- 172.21.15.114:0/2029510482 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc017050 con 0x55ca451509b0 2024-05-08T18:10:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca45151db0 con 0x55ca451509b0 2024-05-08T18:10:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc6d9ffb640 1 -- 172.21.15.114:0/2029510482 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc00e7e0 con 0x55ca451509b0 2024-05-08T18:10:59.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.940+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca45152280 con 0x55ca451509b0 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc6d9ffb640 1 -- 172.21.15.114:0/2029510482 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc7dc00e980 con 0x55ca451509b0 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc6d9ffb640 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6cc038440 0x7fc6cc03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc6d9ffb640 1 -- 172.21.15.114:0/2029510482 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc7dc050730 con 0x55ca451509b0 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6cc038440 0x7fc6cc03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 Processor -- start 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 -- start start 2024-05-08T18:10:59.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6cc038440 0x7fc6cc03a900 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55ca451416c0 tx=0x7fc7ec005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca4515df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca45131f60 con 0x55ca4515dba0 2024-05-08T18:10:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f3d24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca4515df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f3d24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca4515df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38120/0 (socket says 172.21.15.114:38120) 2024-05-08T18:10:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f3d24640 1 -- 172.21.15.114:0/2396968106 learned_addr learned my addr 172.21.15.114:0/2396968106 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f3d24640 1 -- 172.21.15.114:0/2396968106 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4515e550 con 0x55ca4515dba0 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/2396968106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca4515df80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc01cfd0 tx=0x7fc7dc023660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2f2874e55968b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc6d37fe640 1 -- 172.21.15.114:0/2396968106 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc01a310 con 0x55ca4515dba0 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc6d37fe640 1 -- 172.21.15.114:0/2396968106 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00ec70 con 0x55ca4515dba0 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc6d37fe640 1 -- 172.21.15.114:0/2396968106 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc01a4b0 con 0x55ca4515dba0 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2396968106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 msgr2=0x55ca4515df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2396968106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca4515df80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc01cfd0 tx=0x7fc7dc023660 comp rx=0 tx=0).stop 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2396968106 shutdown_connections 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2396968106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca4515df80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2396968106 >> 172.21.15.114:0/2396968106 conn(0x55ca45159ee0 msgr2=0x55ca45157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.944+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2396968106 shutdown_connections 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2396968106 wait complete. 2024-05-08T18:10:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 Processor -- start 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 -- start start 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca45165060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55ca4515ec50 con 0x55ca4515dba0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f3d24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca45165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f3d24640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca45165060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38122/0 (socket says 172.21.15.114:38122) 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 learned_addr learned my addr 172.21.15.114:0/1007804064 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca451655a0 con 0x55ca4515dba0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca45165060 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc027030 tx=0x7fc7dc04e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc6d1ffb640 1 -- 172.21.15.114:0/1007804064 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc023530 con 0x55ca4515dba0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ca45165830 con 0x55ca4515dba0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc6d1ffb640 1 -- 172.21.15.114:0/1007804064 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc04ebb0 con 0x55ca4515dba0 2024-05-08T18:10:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc6d1ffb640 1 -- 172.21.15.114:0/1007804064 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7dc023760 con 0x55ca4515dba0 2024-05-08T18:10:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca45168510 con 0x55ca4515dba0 2024-05-08T18:10:59.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc6d1ffb640 1 -- 172.21.15.114:0/1007804064 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc7dc047040 con 0x55ca4515dba0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc6d1ffb640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6c40383f0 0x7fc6c403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc6d1ffb640 1 -- 172.21.15.114:0/1007804064 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc7dc044040 con 0x55ca4515dba0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6c40383f0 0x7fc6c403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.948+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45170550 0x55ca45172a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45173160 con 0x55ca45170550 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45170550 0x55ca45172a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6c40383f0 0x7fc6c403a8b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55ca45140950 tx=0x7fc7ec01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45170550 0x55ca45172a10 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 realm 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45173570 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45173e40 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca451741e0 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.957 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 20 searching for the correct realm 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ca451764c0 0x55ca45178980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45179050 con 0x55ca451764c0 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ca451764c0 0x55ca45178980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ca451764c0 0x55ca45178980 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f3d24640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc7dc01c030 0x7fc7dc049620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45179050 con 0x7fc7dc01c030 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc7dc01c030 0x7fc7dc049620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4d26640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc7dc01c030 0x7fc7dc049620 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.952+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45179050 con 0x7fc7dc01c030 2024-05-08T18:10:59.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45179050 con 0x55ca45170550 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc7e4009040 0x7fc7e40d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc7e4009040 0x7fc7e40d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:10:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc7e4009040 0x7fc7e40d0410 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:10:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.962 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7dc01c030 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.956+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7dc01c030 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7dc01c030 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.960+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7dc01c030 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7dc01c030 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.967 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca451764c0 2024-05-08T18:10:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.964+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7e4009040 2024-05-08T18:10:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x55ca45170550 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174a30 con 0x7fc7dc01c030 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:10:59.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174dd0 con 0x55ca45170550 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45175170 con 0x55ca45170550 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45175170 con 0x55ca45170550 2024-05-08T18:10:59.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 zone default found 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 4 Realm: () 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 zonegroup default 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174610 con 0x7fc7e4009040 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45174690 con 0x55ca451764c0 2024-05-08T18:10:59.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517b050 con 0x55ca451764c0 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 started sync module instance, tier type = 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.968+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517a350 con 0x7fc7dc01c030 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94327230932800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca45179fb0 con 0x7fc7dc01c030 2024-05-08T18:10:59.974 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517bf80 con 0x55ca45170550 2024-05-08T18:10:59.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94327230932800] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94327230936240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517bf80 con 0x55ca45170550 2024-05-08T18:10:59.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.972+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517c940 con 0x55ca451764c0 2024-05-08T18:10:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94327230936240] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94327230937808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517bef0 con 0x55ca451764c0 2024-05-08T18:10:59.976 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517d6a0 con 0x7fc7dc01c030 2024-05-08T18:10:59.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.977 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94327230943632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517df40 con 0x7fc7dc01c030 2024-05-08T18:10:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517e980 con 0x55ca45170550 2024-05-08T18:10:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.976+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94327230937808] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:10:59.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94327230943632] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:10:59.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.979 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94327230948432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517da90 con 0x55ca45170550 2024-05-08T18:10:59.980 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517f220 con 0x7fc7e4009040 2024-05-08T18:10:59.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94327230948432] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94327230942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517da90 con 0x7fc7e4009040 2024-05-08T18:10:59.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.980+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517f730 con 0x7fc7e4009040 2024-05-08T18:10:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.984+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94327230942432] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.984+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.984+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94327230951936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517f6f0 con 0x7fc7e4009040 2024-05-08T18:10:59.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.984+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca45180110 con 0x7fc7e4009040 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.984+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94327230951936] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94327230954496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca451800d0 con 0x7fc7e4009040 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=0 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=1 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=2 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=3 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=4 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=5 2024-05-08T18:10:59.987 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=6 2024-05-08T18:10:59.988 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94327230954496] v32'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 20 add_watcher() i=7 2024-05-08T18:10:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 2 all 8 watchers are set, enabling cache 2024-05-08T18:10:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca45183530 con 0x55ca45170550 2024-05-08T18:10:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.989 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94327230950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca45180a50 con 0x55ca45170550 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94327230950288] v32'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.988+0000 7fc6aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 5 note: GC not initialized 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc6a97e2640 20 reqs_thread_entry: start 2024-05-08T18:10:59.991 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 20 init_complete bucket index max shards: 11 2024-05-08T18:10:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 20 Filter name: none 2024-05-08T18:10:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc61affd640 20 reqs_thread_entry: start 2024-05-08T18:10:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:10:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 20 rados->read ofs=0 len=0 2024-05-08T18:10:59.992 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca451a6f30 con 0x7fc7e4009040 2024-05-08T18:10:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:10:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:10:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:10:59.993 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.992+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca451ad8a0 con 0x7fc7e4009040 2024-05-08T18:10:59.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:10:59.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f6a11980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:59.995 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f6a11980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f6a11980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94327231140624 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ca451a8f70 con 0x55ca45170550 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94327230948432 notify 137438953497 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55ca4513c070 con 0x55ca45170550 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc6d37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94327230948432 notifier 4877 bl.length()=666 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc6d37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc6d37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94327231140624 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc6d37fe640 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc6b8003eb0 con 0x55ca45170550 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.996 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94327231140624 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ca451393e0 con 0x55ca45170550 2024-05-08T18:10:59.997 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:10:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc6aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:10:59.997 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94327230950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca451a4c30 con 0x55ca45170550 2024-05-08T18:10:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94327230950288] v32'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:10:59.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:10:59.996+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94327230932800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca451a4c30 con 0x7fc7dc01c030 2024-05-08T18:11:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94327230932800] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:11:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f6a11980 20 remove_watcher() i=0 2024-05-08T18:11:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f6a11980 2 removed watcher, disabling cache 2024-05-08T18:11:00.000 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94327230936240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca451a4c30 con 0x55ca45170550 2024-05-08T18:11:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94327230936240] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:11:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f6a11980 20 remove_watcher() i=1 2024-05-08T18:11:00.002 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.000+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94327230937808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca451a4c30 con 0x55ca451764c0 2024-05-08T18:11:00.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.004+0000 7fc7f3d24640 1 -- 172.21.15.114:0/1007804064 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94327230937808] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7dc04d020 con 0x55ca451764c0 2024-05-08T18:11:00.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.004+0000 7fc7f6a11980 20 remove_watcher() i=2 2024-05-08T18:11:00.004 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.004+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94327230943632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517bad0 con 0x7fc7dc01c030 2024-05-08T18:11:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.004+0000 7fc7f4d26640 1 -- 172.21.15.114:0/1007804064 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94327230943632] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ec01f070 con 0x7fc7dc01c030 2024-05-08T18:11:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.004+0000 7fc7f6a11980 20 remove_watcher() i=3 2024-05-08T18:11:00.005 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.004+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94327230948432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517bad0 con 0x55ca45170550 2024-05-08T18:11:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.008+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94327230948432] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x55ca45170550 2024-05-08T18:11:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.008+0000 7fc7f6a11980 20 remove_watcher() i=4 2024-05-08T18:11:00.007 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.008+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94327230942432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517e450 con 0x7fc7e4009040 2024-05-08T18:11:00.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.008+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94327230942432] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:11:00.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.008+0000 7fc7f6a11980 20 remove_watcher() i=5 2024-05-08T18:11:00.009 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.008+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94327230951936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517bad0 con 0x7fc7e4009040 2024-05-08T18:11:00.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94327230951936] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:11:00.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 20 remove_watcher() i=6 2024-05-08T18:11:00.011 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94327230954496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ca4517e450 con 0x7fc7e4009040 2024-05-08T18:11:00.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94327230954496] v32'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7e40d0c60 con 0x7fc7e4009040 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 20 remove_watcher() i=7 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc7e4009040 msgr2=0x7fc7e40d0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc7e4009040 0x7fc7e40d0410 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45170550 msgr2=0x55ca45172a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45170550 0x55ca45172a10 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc7dc01c030 msgr2=0x7fc7dc049620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc7dc01c030 0x7fc7dc049620 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ca451764c0 msgr2=0x55ca45178980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55ca451764c0 0x55ca45178980 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6c40383f0 msgr2=0x7fc6c403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6c40383f0 0x7fc6c403a8b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55ca45140950 tx=0x7fc7ec01f000 comp rx=0 tx=0).stop 2024-05-08T18:11:00.016 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f4525640 1 -- 172.21.15.114:0/1007804064 reap_dead start 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 msgr2=0x55ca45165060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca45165060 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc027030 tx=0x7fc7dc04e940 comp rx=0 tx=0).stop 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 shutdown_connections 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/1007804064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca4515dba0 0x55ca45165060 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 >> 172.21.15.114:0/1007804064 conn(0x55ca45159ee0 msgr2=0x55ca45157540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 shutdown_connections 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/1007804064 wait complete. 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6cc038440 msgr2=0x7fc6cc03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6cc038440 0x7fc6cc03a900 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x55ca451416c0 tx=0x7fc7ec005850 comp rx=0 tx=0).stop 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 msgr2=0x55ca45150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 0x55ca45150dd0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc010f90 tx=0x7fc7dc00f7a0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 shutdown_connections 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6cc038440 0x7fc6cc03a900 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.017 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2029510482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca451509b0 0x55ca45150dd0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 >> 172.21.15.114:0/2029510482 conn(0x55ca451457c0 msgr2=0x55ca451462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 shutdown_connections 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.012+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2029510482 wait complete. 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45046a20 msgr2=0x55ca4513fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45046a20 0x55ca4513fb50 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6dc038440 msgr2=0x7fc6dc03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6dc038440 0x7fc6dc03a900 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc001e60 tx=0x7fc7dc0013e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 msgr2=0x55ca45138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca45138c10 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400a5c0 tx=0x7fc7e40180e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 shutdown_connections 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55ca45046a20 0x55ca4513fb50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc6dc038440 0x7fc6dc03a900 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.018 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 --2- 172.21.15.114:0/2752194207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ca45046100 0x55ca45138c10 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 >> 172.21.15.114:0/2752194207 conn(0x55ca44fb97e0 msgr2=0x55ca4512bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 shutdown_connections 2024-05-08T18:11:00.019 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.016+0000 7fc7f6a11980 1 -- 172.21.15.114:0/2752194207 wait complete. 2024-05-08T18:11:00.026 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.026 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.026 ERROR:root:0 2024-05-08T18:11:00.026 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:00.031 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:00.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:11:00.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:11:00.031 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:11:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:11:00.106 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:11:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb46248980 1 Processor -- start 2024-05-08T18:11:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb46248980 1 -- start start 2024-05-08T18:11:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb46248980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x5558f9780560 0x5558f9813f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb46248980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5558f96b6710 con 0x5558f9781850 2024-05-08T18:11:00.107 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb46248980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5558f96caf00 con 0x5558f9780560 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb43d5c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x5558f9781850 0x5558f977fe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43524/0 (socket says 172.21.15.114:43524) 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb43d5c640 1 -- 172.21.15.114:0/3313342674 learned_addr learned my addr 172.21.15.114:0/3313342674 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb4355b640 1 --2- 172.21.15.114:0/3313342674 >> v2:172.21.15.53:3300/0 conn(0x5558f9780560 0x5558f9813f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb42d5a640 1 -- 172.21.15.114:0/3313342674 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3535537594 0 0) 0x5558f96b6710 con 0x5558f9781850 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb42d5a640 1 -- 172.21.15.114:0/3313342674 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb30001e20 con 0x5558f9781850 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb4355b640 1 -- 172.21.15.114:0/3313342674 >> v1:172.21.15.53:6789/0 conn(0x5558f9781850 legacy=0x5558f977fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.108 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.108+0000 7ffb4355b640 1 -- 172.21.15.114:0/3313342674 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f9692ae0 con 0x5558f9780560 2024-05-08T18:11:00.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb4355b640 1 --2- 172.21.15.114:0/3313342674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f9813f20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00a480 tx=0x7ffb2c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccfe37cd58270fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb42d5a640 1 -- 172.21.15.114:0/3313342674 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0b0070 con 0x5558f9780560 2024-05-08T18:11:00.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb42d5a640 1 -- 172.21.15.114:0/3313342674 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0ab540 con 0x5558f9780560 2024-05-08T18:11:00.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb42d5a640 1 -- 172.21.15.114:0/3313342674 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0ab840 con 0x5558f9780560 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 -- 172.21.15.114:0/3313342674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 msgr2=0x5558f9813f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 --2- 172.21.15.114:0/3313342674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f9813f20 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00a480 tx=0x7ffb2c01b280 comp rx=0 tx=0).stop 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 -- 172.21.15.114:0/3313342674 shutdown_connections 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 --2- 172.21.15.114:0/3313342674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f9813f20 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 -- 172.21.15.114:0/3313342674 >> 172.21.15.114:0/3313342674 conn(0x5558f98067e0 msgr2=0x5558f9808c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 -- 172.21.15.114:0/3313342674 shutdown_connections 2024-05-08T18:11:00.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.112+0000 7ffb46248980 1 -- 172.21.15.114:0/3313342674 wait complete. 2024-05-08T18:11:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.128+0000 7ffb46248980 1 Processor -- start 2024-05-08T18:11:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.128+0000 7ffb46248980 1 -- start start 2024-05-08T18:11:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.128+0000 7ffb46248980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98f8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.128+0000 7ffb46248980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558f970ef80 con 0x5558f9780560 2024-05-08T18:11:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38136/0 (socket says 172.21.15.114:38136) 2024-05-08T18:11:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 -- 172.21.15.114:0/2998409251 learned_addr learned my addr 172.21.15.114:0/2998409251 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 -- 172.21.15.114:0/2998409251 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f96d6da0 con 0x5558f9780560 2024-05-08T18:11:00.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/2998409251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98f8510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffb340016a0 tx=0x7ffb34001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1180c4cff3efa7bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffa31e0b640 1 -- 172.21.15.114:0/2998409251 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb34004530 con 0x5558f9780560 2024-05-08T18:11:00.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffa31e0b640 1 -- 172.21.15.114:0/2998409251 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb340046d0 con 0x5558f9780560 2024-05-08T18:11:00.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffa31e0b640 1 -- 172.21.15.114:0/2998409251 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb340049f0 con 0x5558f9780560 2024-05-08T18:11:00.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- 172.21.15.114:0/2998409251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 msgr2=0x5558f98f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 --2- 172.21.15.114:0/2998409251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98f8510 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7ffb340016a0 tx=0x7ffb34001b60 comp rx=0 tx=0).stop 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- 172.21.15.114:0/2998409251 shutdown_connections 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 --2- 172.21.15.114:0/2998409251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98f8510 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- 172.21.15.114:0/2998409251 >> 172.21.15.114:0/2998409251 conn(0x5558f98067e0 msgr2=0x5558f98f40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- 172.21.15.114:0/2998409251 shutdown_connections 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- 172.21.15.114:0/2998409251 wait complete. 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 Processor -- start 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- start start 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb46248980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558f9816ec0 con 0x5558f9780560 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98ff9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38150/0 (socket says 172.21.15.114:38150) 2024-05-08T18:11:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1376088885 learned_addr learned my addr 172.21.15.114:0/1376088885 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.135 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f98ffef0 con 0x5558f9780560 2024-05-08T18:11:00.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.132+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98ff9b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x5558f98f93a0 tx=0x7ffb34004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffa2bfff640 1 -- 172.21.15.114:0/1376088885 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb34013760 con 0x5558f9780560 2024-05-08T18:11:00.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffa2bfff640 1 -- 172.21.15.114:0/1376088885 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb34013900 con 0x5558f9780560 2024-05-08T18:11:00.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558f9900180 con 0x5558f9780560 2024-05-08T18:11:00.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffa2bfff640 1 -- 172.21.15.114:0/1376088885 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb34013be0 con 0x5558f9780560 2024-05-08T18:11:00.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f9902e10 con 0x5558f9780560 2024-05-08T18:11:00.138 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffa2bfff640 1 -- 172.21.15.114:0/1376088885 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ffb34010070 con 0x5558f9780560 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffa2bfff640 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa2c038440 0x7ffa2c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffa2bfff640 1 -- 172.21.15.114:0/1376088885 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7ffb34018070 con 0x5558f9780560 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa2c038440 0x7ffa2c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f9781850 0x5558f9906910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f9906f80 con 0x5558f9781850 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4455d640 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f9781850 0x5558f9906910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa2c038440 0x7ffa2c03a900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0ad000 tx=0x7ffb2c0a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4455d640 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f9781850 0x5558f9906910 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4455d640 1 -- 172.21.15.114:0/1376088885 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb3c0083f0 con 0x5558f9781850 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f9904030 con 0x5558f9781850 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4455d640 1 -- 172.21.15.114:0/1376088885 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb3c0083f0 con 0x5558f9781850 2024-05-08T18:11:00.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f9908da0 con 0x5558f9781850 2024-05-08T18:11:00.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb4455d640 1 -- 172.21.15.114:0/1376088885 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb3c0083f0 con 0x5558f9781850 2024-05-08T18:11:00.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.136+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f9907fd0 con 0x5558f9781850 2024-05-08T18:11:00.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4455d640 1 -- 172.21.15.114:0/1376088885 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb3c0083f0 con 0x5558f9781850 2024-05-08T18:11:00.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f99083f0 con 0x5558f9781850 2024-05-08T18:11:00.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4455d640 1 -- 172.21.15.114:0/1376088885 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb3c0083f0 con 0x5558f9781850 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 Processor -- start 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 -- start start 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 0x5558f9917b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558f9712fc0 con 0x5558f9917720 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4355b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 0x5558f9917b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4355b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 0x5558f9917b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38166/0 (socket says 172.21.15.114:38166) 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4355b640 1 -- 172.21.15.114:0/3358285843 learned_addr learned my addr 172.21.15.114:0/3358285843 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4355b640 1 -- 172.21.15.114:0/3358285843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f9918080 con 0x5558f9917720 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb4355b640 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 0x5558f9917b40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c01b2c0 tx=0x7ffb2c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffa297fa640 1 -- 172.21.15.114:0/3358285843 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0c6070 con 0x5558f9917720 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffa297fa640 1 -- 172.21.15.114:0/3358285843 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0c1560 con 0x5558f9917720 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558f9918b20 con 0x5558f9917720 2024-05-08T18:11:00.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffa297fa640 1 -- 172.21.15.114:0/3358285843 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0b0040 con 0x5558f9917720 2024-05-08T18:11:00.143 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.140+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f9918f90 con 0x5558f9917720 2024-05-08T18:11:00.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffa297fa640 1 -- 172.21.15.114:0/3358285843 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ffb2c0c9070 con 0x5558f9917720 2024-05-08T18:11:00.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffa297fa640 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa1c0383f0 0x7ffa1c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffa297fa640 1 -- 172.21.15.114:0/3358285843 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7ffb2c0be030 con 0x5558f9917720 2024-05-08T18:11:00.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4455d640 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa1c0383f0 0x7ffa1c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 Processor -- start 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- start start 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4455d640 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa1c0383f0 0x7ffa1c03a8b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5558f9908370 tx=0x7ffb3c003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f9924c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558f98f8c60 con 0x5558f9924840 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4355b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f9924c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4355b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f9924c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38178/0 (socket says 172.21.15.114:38178) 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4355b640 1 -- 172.21.15.114:0/1336381232 learned_addr learned my addr 172.21.15.114:0/1336381232 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4355b640 1 -- 172.21.15.114:0/1336381232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f99251f0 con 0x5558f9924840 2024-05-08T18:11:00.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1336381232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f9924c20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0e8f20 tx=0x7ffb2c006390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b29239247429b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffa22ffd640 1 -- 172.21.15.114:0/1336381232 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0ca3b0 con 0x5558f9924840 2024-05-08T18:11:00.149 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffa22ffd640 1 -- 172.21.15.114:0/1336381232 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0c9360 con 0x5558f9924840 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffa22ffd640 1 -- 172.21.15.114:0/1336381232 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0c9c80 con 0x5558f9924840 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- 172.21.15.114:0/1336381232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 msgr2=0x5558f9924c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 --2- 172.21.15.114:0/1336381232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f9924c20 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0e8f20 tx=0x7ffb2c006390 comp rx=0 tx=0).stop 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- 172.21.15.114:0/1336381232 shutdown_connections 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 --2- 172.21.15.114:0/1336381232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f9924c20 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- 172.21.15.114:0/1336381232 >> 172.21.15.114:0/1336381232 conn(0x5558f9920b80 msgr2=0x5558f991ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- 172.21.15.114:0/1336381232 shutdown_connections 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- 172.21.15.114:0/1336381232 wait complete. 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 Processor -- start 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- start start 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f992bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.144+0000 7ffb46248980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5558f99259b0 con 0x5558f9924840 2024-05-08T18:11:00.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4355b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f992bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4355b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f992bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38182/0 (socket says 172.21.15.114:38182) 2024-05-08T18:11:00.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 learned_addr learned my addr 172.21.15.114:0/1771034547 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.151 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558f992c300 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f992bdc0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0b6cf0 tx=0x7ffb2c0e8e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffa217fa640 1 -- 172.21.15.114:0/1771034547 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0c9510 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5558f992c590 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffa217fa640 1 -- 172.21.15.114:0/1771034547 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0b55e0 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffa217fa640 1 -- 172.21.15.114:0/1771034547 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb2c0c1880 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558f992c9a0 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffa217fa640 1 -- 172.21.15.114:0/1771034547 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ffb2c0c1a20 con 0x5558f9924840 2024-05-08T18:11:00.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffa217fa640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa0c0383f0 0x7ffa0c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffa217fa640 1 -- 172.21.15.114:0/1771034547 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7ffb2c0a8070 con 0x5558f9924840 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4455d640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa0c0383f0 0x7ffa0c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f99372c0 0x5558f9939780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f9939ed0 con 0x5558f99372c0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f99372c0 0x5558f9939780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb4455d640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa0c0383f0 0x7ffa0c03a8b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00f010 tx=0x7ffb3c01b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f99372c0 0x5558f9939780 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.148+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 realm 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993a2e0 con 0x5558f99372c0 2024-05-08T18:11:00.158 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993abb0 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993af50 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 20 searching for the correct realm 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5558f993d510 0x5558f993f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993fe40 con 0x5558f993d510 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5558f993d510 0x5558f993f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5558f993d510 0x5558f993f900 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4355b640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffb2c0cb060 0x7ffb2c0de3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993fe40 con 0x7ffb2c0cb060 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4455d640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffb2c0cb060 0x7ffb2c0de3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4455d640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffb2c0cb060 0x7ffb2c0de3d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993fe40 con 0x7ffb2c0cb060 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.160 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993fe40 con 0x5558f99372c0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffb340283d0 0x7ffb340123c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.152+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffb340283d0 0x7ffb340123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffb340283d0 0x7ffb340123c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.161 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.162 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.169 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.156+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.170 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.171 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.160+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f993d510 2024-05-08T18:11:00.172 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb340283d0 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x5558f99372c0 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5558f993b7a0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:11:00.173 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993bff0 con 0x5558f99372c0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993c390 con 0x5558f99372c0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.164+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993c390 con 0x5558f99372c0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 zone default found 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 4 Realm: () 2024-05-08T18:11:00.174 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 zonegroup default 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993cc60 con 0x7ffb340283d0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f993cc60 con 0x5558f993d510 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f9941d40 con 0x5558f993d510 2024-05-08T18:11:00.175 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 started sync module instance, tier type = 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99410f0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93840632714464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9940d50 con 0x7ffb2c0cb060 2024-05-08T18:11:00.176 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.168+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9942c70 con 0x5558f99372c0 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93840632714464] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93840632717728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9942c70 con 0x5558f99372c0 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9943630 con 0x5558f993d510 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 93840632717728] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93840632721792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9943e80 con 0x5558f993d510 2024-05-08T18:11:00.178 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.172+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99427c0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93840632726416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9944c60 con 0x7ffb2c0cb060 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9945620 con 0x5558f99372c0 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93840632721792] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93840632726416] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93840632729968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9944c60 con 0x5558f99372c0 2024-05-08T18:11:00.179 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.176+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9945590 con 0x7ffb340283d0 2024-05-08T18:11:00.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 93840632729968] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93840632727472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9944bd0 con 0x7ffb340283d0 2024-05-08T18:11:00.180 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9946450 con 0x7ffb340283d0 2024-05-08T18:11:00.182 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(56 notify.6 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93840632733600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9946870 con 0x7ffb340283d0 2024-05-08T18:11:00.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99472c0 con 0x7ffb340283d0 2024-05-08T18:11:00.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.180+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93840632727472] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 93840632733600] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93840632737200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99463c0 con 0x7ffb340283d0 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=0 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=1 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=2 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=3 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=4 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=5 2024-05-08T18:11:00.185 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.184+0000 7ffb46248980 20 add_watcher() i=6 2024-05-08T18:11:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 93840632737200] v32'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 add_watcher() i=7 2024-05-08T18:11:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 2 all 8 watchers are set, enabling cache 2024-05-08T18:11:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f994a3c0 con 0x5558f99372c0 2024-05-08T18:11:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.187 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93840632731952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9947840 con 0x5558f99372c0 2024-05-08T18:11:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93840632731952] v32'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ff9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:11:00.189 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 5 note: GC not initialized 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ff9f8fe1640 20 reqs_thread_entry: start 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 init_complete bucket index max shards: 11 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 Filter name: none 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ff9727fc640 20 reqs_thread_entry: start 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.190 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f996dbf0 con 0x7ffb340283d0 2024-05-08T18:11:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:11:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:11:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.188+0000 7ffb46248980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:11:00.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9974550 con 0x7ffb340283d0 2024-05-08T18:11:00.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb46248980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb46248980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb46248980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:11:00.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93840632922048 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5558f996fc00 con 0x5558f99372c0 2024-05-08T18:11:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 93840632729968 notify 137438953498 ret 0) ==== 721+0+0 (crc 0 0 0) 0x5558f9902e10 con 0x5558f99372c0 2024-05-08T18:11:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffa22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 93840632729968 notifier 4884 bl.length()=679 2024-05-08T18:11:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffa22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffa22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffa22ffd640 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ffa08003eb0 con 0x5558f99372c0 2024-05-08T18:11:00.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 93840632922048 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.192+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 93840632922048 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5558f9900180 con 0x5558f99372c0 2024-05-08T18:11:00.195 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:11:00.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ff9f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93840632731952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f996b8f0 con 0x5558f99372c0 2024-05-08T18:11:00.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93840632731952] v32'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.196 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93840632714464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f996b8f0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93840632714464] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb46248980 20 remove_watcher() i=0 2024-05-08T18:11:00.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb46248980 2 removed watcher, disabling cache 2024-05-08T18:11:00.198 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.196+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93840632717728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f996b8f0 con 0x5558f99372c0 2024-05-08T18:11:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.200+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93840632717728] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.200+0000 7ffb46248980 20 remove_watcher() i=1 2024-05-08T18:11:00.200 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.200+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93840632721792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f996b8f0 con 0x5558f993d510 2024-05-08T18:11:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.200+0000 7ffb4355b640 1 -- 172.21.15.114:0/1771034547 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93840632721792] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb2c0f0020 con 0x5558f993d510 2024-05-08T18:11:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.200+0000 7ffb46248980 20 remove_watcher() i=2 2024-05-08T18:11:00.202 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.200+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93840632726416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99414e0 con 0x7ffb2c0cb060 2024-05-08T18:11:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.204+0000 7ffb4455d640 1 -- 172.21.15.114:0/1771034547 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93840632726416] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3c02f040 con 0x7ffb2c0cb060 2024-05-08T18:11:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.204+0000 7ffb46248980 20 remove_watcher() i=3 2024-05-08T18:11:00.203 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.204+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93840632729968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99421a0 con 0x5558f99372c0 2024-05-08T18:11:00.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.204+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93840632729968] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x5558f99372c0 2024-05-08T18:11:00.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.204+0000 7ffb46248980 20 remove_watcher() i=4 2024-05-08T18:11:00.205 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.204+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93840632727472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9944390 con 0x7ffb340283d0 2024-05-08T18:11:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.208+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93840632727472] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.208+0000 7ffb46248980 20 remove_watcher() i=5 2024-05-08T18:11:00.207 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.208+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93840632733600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f99414e0 con 0x7ffb340283d0 2024-05-08T18:11:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.208+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93840632733600] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.208+0000 7ffb46248980 20 remove_watcher() i=6 2024-05-08T18:11:00.209 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.208+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93840632737200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5558f9945170 con 0x7ffb340283d0 2024-05-08T18:11:00.217 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93840632737200] v32'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb3401b030 con 0x7ffb340283d0 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 20 remove_watcher() i=7 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffb340283d0 msgr2=0x7ffb340123c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ffb340283d0 0x7ffb340123c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f99372c0 msgr2=0x5558f9939780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f99372c0 0x5558f9939780 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffb2c0cb060 msgr2=0x7ffb2c0de3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7ffb2c0cb060 0x7ffb2c0de3d0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5558f993d510 msgr2=0x5558f993f900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x5558f993d510 0x5558f993f900 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa0c0383f0 msgr2=0x7ffa0c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa0c0383f0 0x7ffa0c03a8b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00f010 tx=0x7ffb3c01b070 comp rx=0 tx=0).stop 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 msgr2=0x5558f992bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.218 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb43d5c640 1 -- 172.21.15.114:0/1771034547 reap_dead start 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f992bdc0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0b6cf0 tx=0x7ffb2c0e8e80 comp rx=0 tx=0).stop 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 shutdown_connections 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1771034547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9924840 0x5558f992bdc0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 >> 172.21.15.114:0/1771034547 conn(0x5558f9920b80 msgr2=0x5558f991e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 shutdown_connections 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1771034547 wait complete. 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa1c0383f0 msgr2=0x7ffa1c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa1c0383f0 0x7ffa1c03a8b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5558f9908370 tx=0x7ffb3c003070 comp rx=0 tx=0).stop 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 msgr2=0x5558f9917b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 0x5558f9917b40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c01b2c0 tx=0x7ffb2c018020 comp rx=0 tx=0).stop 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 shutdown_connections 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa1c0383f0 0x7ffa1c03a8b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/3358285843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9917720 0x5558f9917b40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.219 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 >> 172.21.15.114:0/3358285843 conn(0x5558f990c530 msgr2=0x5558f990d040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 shutdown_connections 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/3358285843 wait complete. 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f9781850 msgr2=0x5558f9906910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f9781850 0x5558f9906910 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa2c038440 msgr2=0x7ffa2c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa2c038440 0x7ffa2c03a900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0ad000 tx=0x7ffb2c0a5040 comp rx=0 tx=0).stop 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 msgr2=0x5558f98ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98ff9b0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x5558f98f93a0 tx=0x7ffb34004470 comp rx=0 tx=0).stop 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 shutdown_connections 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x5558f9781850 0x5558f9906910 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ffa2c038440 0x7ffa2c03a900 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 --2- 172.21.15.114:0/1376088885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558f9780560 0x5558f98ff9b0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.220 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 >> 172.21.15.114:0/1376088885 conn(0x5558f98067e0 msgr2=0x5558f98f2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 shutdown_connections 2024-05-08T18:11:00.221 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.212+0000 7ffb46248980 1 -- 172.21.15.114:0/1376088885 wait complete. 2024-05-08T18:11:00.225 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.225 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.225 ERROR:root:0 2024-05-08T18:11:00.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:00.230 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:00.230 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T18:11:00.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T18:11:00.230 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-08T18:11:00.304 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:11:00.305 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:11:00.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b7d52980 1 Processor -- start 2024-05-08T18:11:00.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b7d52980 1 -- start start 2024-05-08T18:11:00.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b7d52980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bcc88017f0 0x55bcc888fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b7d52980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bcc8738710 con 0x55bcc8890100 2024-05-08T18:11:00.306 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b7d52980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55bcc874cf00 con 0x55bcc88017f0 2024-05-08T18:11:00.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b5866640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bcc88017f0 0x55bcc888fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b5866640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55bcc88017f0 0x55bcc888fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38188/0 (socket says 172.21.15.114:38188) 2024-05-08T18:11:00.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.304+0000 7fa6b5866640 1 -- 172.21.15.114:0/1809170286 learned_addr learned my addr 172.21.15.114:0/1809170286 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b5866640 1 -- 172.21.15.114:0/1809170286 >> v1:172.21.15.53:6789/0 conn(0x55bcc8890100 legacy=0x55bcc88924f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.307 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b5866640 1 -- 172.21.15.114:0/1809170286 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc8714ae0 con 0x55bcc88017f0 2024-05-08T18:11:00.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b5866640 1 --2- 172.21.15.114:0/1809170286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc888fbc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800a4e0 tx=0x7fa6a801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b64a68eec68b75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b4864640 1 -- 172.21.15.114:0/1809170286 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a80aa540 con 0x55bcc88017f0 2024-05-08T18:11:00.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b4864640 1 -- 172.21.15.114:0/1809170286 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a80aa6e0 con 0x55bcc88017f0 2024-05-08T18:11:00.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b4864640 1 -- 172.21.15.114:0/1809170286 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a80aaa40 con 0x55bcc88017f0 2024-05-08T18:11:00.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1809170286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 msgr2=0x55bcc888fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1809170286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc888fbc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa6a800a4e0 tx=0x7fa6a801b090 comp rx=0 tx=0).stop 2024-05-08T18:11:00.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1809170286 shutdown_connections 2024-05-08T18:11:00.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1809170286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc888fbc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1809170286 >> 172.21.15.114:0/1809170286 conn(0x55bcc88876a0 msgr2=0x55bcc8889ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1809170286 shutdown_connections 2024-05-08T18:11:00.311 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.308+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1809170286 wait complete. 2024-05-08T18:11:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.324+0000 7fa6b7d52980 1 Processor -- start 2024-05-08T18:11:00.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.324+0000 7fa6b7d52980 1 -- start start 2024-05-08T18:11:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.324+0000 7fa6b7d52980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc8977fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.324+0000 7fa6b7d52980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bcc8790f80 con 0x55bcc88017f0 2024-05-08T18:11:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc8977fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc8977fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38202/0 (socket says 172.21.15.114:38202) 2024-05-08T18:11:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 -- 172.21.15.114:0/3049350510 learned_addr learned my addr 172.21.15.114:0/3049350510 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 -- 172.21.15.114:0/3049350510 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc8758da0 con 0x55bcc88017f0 2024-05-08T18:11:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 --2- 172.21.15.114:0/3049350510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc8977fa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8017ca0 tx=0x7fa6a80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338edd9102adf719 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa5a3e07640 1 -- 172.21.15.114:0/3049350510 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a80b9070 con 0x55bcc88017f0 2024-05-08T18:11:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa5a3e07640 1 -- 172.21.15.114:0/3049350510 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a80aaa80 con 0x55bcc88017f0 2024-05-08T18:11:00.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa5a3e07640 1 -- 172.21.15.114:0/3049350510 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a80aad60 con 0x55bcc88017f0 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3049350510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 msgr2=0x55bcc8977fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/3049350510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc8977fa0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8017ca0 tx=0x7fa6a80033b0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3049350510 shutdown_connections 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/3049350510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc88017f0 0x55bcc8977fa0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3049350510 >> 172.21.15.114:0/3049350510 conn(0x55bcc88876a0 msgr2=0x55bcc8973b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3049350510 shutdown_connections 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3049350510 wait complete. 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 Processor -- start 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- start start 2024-05-08T18:11:00.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 0x55bcc897f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b7d52980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bcc8894720 con 0x55bcc8890100 2024-05-08T18:11:00.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 0x55bcc897f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 0x55bcc897f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38206/0 (socket says 172.21.15.114:38206) 2024-05-08T18:11:00.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.328+0000 7fa6b5866640 1 -- 172.21.15.114:0/1083306162 learned_addr learned my addr 172.21.15.114:0/1083306162 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b5866640 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc897fa20 con 0x55bcc8890100 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b5866640 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 0x55bcc897f4e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8017ca0 tx=0x7fa6a8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa5a2604640 1 -- 172.21.15.114:0/1083306162 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a80b9050 con 0x55bcc8890100 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa5a2604640 1 -- 172.21.15.114:0/1083306162 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a80c7470 con 0x55bcc8890100 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcc897fcb0 con 0x55bcc8890100 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa5a2604640 1 -- 172.21.15.114:0/1083306162 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a80c77b0 con 0x55bcc8890100 2024-05-08T18:11:00.332 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc8982940 con 0x55bcc8890100 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa5a2604640 1 -- 172.21.15.114:0/1083306162 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa6a80b3040 con 0x55bcc8890100 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa5a2604640 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa59c0383f0 0x7fa59c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa5a2604640 1 -- 172.21.15.114:0/1083306162 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa6a80c3030 con 0x55bcc8890100 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b5065640 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa59c0383f0 0x7fa59c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc8984580 0x55bcc8986970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc8986eb0 con 0x55bcc8984580 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b6067640 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc8984580 0x55bcc8986970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b5065640 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa59c0383f0 0x7fa59c03a8b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0001e60 tx=0x7fa6a00013e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b6067640 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc8984580 0x55bcc8986970 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b6067640 1 -- 172.21.15.114:0/1083306162 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6b00083f0 con 0x55bcc8984580 2024-05-08T18:11:00.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc8987770 con 0x55bcc8984580 2024-05-08T18:11:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b6067640 1 -- 172.21.15.114:0/1083306162 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6b00083f0 con 0x55bcc8984580 2024-05-08T18:11:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.332+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc8988b20 con 0x55bcc8984580 2024-05-08T18:11:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b6067640 1 -- 172.21.15.114:0/1083306162 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa6b00083f0 con 0x55bcc8984580 2024-05-08T18:11:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc8987fc0 con 0x55bcc8984580 2024-05-08T18:11:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b6067640 1 -- 172.21.15.114:0/1083306162 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6b00083f0 con 0x55bcc8984580 2024-05-08T18:11:00.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89883e0 con 0x55bcc8984580 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b6067640 1 -- 172.21.15.114:0/1083306162 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa6b00083f0 con 0x55bcc8984580 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 Processor -- start 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 -- start start 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 0x55bcc8997ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bcc8794fc0 con 0x55bcc8997690 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b5065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 0x55bcc8997ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b5065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 0x55bcc8997ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38216/0 (socket says 172.21.15.114:38216) 2024-05-08T18:11:00.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b5065640 1 -- 172.21.15.114:0/4285089628 learned_addr learned my addr 172.21.15.114:0/4285089628 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b5065640 1 -- 172.21.15.114:0/4285089628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc8997ff0 con 0x55bcc8997690 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b5065640 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 0x55bcc8997ab0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0010f90 tx=0x7fa6a000f7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa59b7fe640 1 -- 172.21.15.114:0/4285089628 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a000a040 con 0x55bcc8997690 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa59b7fe640 1 -- 172.21.15.114:0/4285089628 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a0017050 con 0x55bcc8997690 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcc8998a90 con 0x55bcc8997690 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa59b7fe640 1 -- 172.21.15.114:0/4285089628 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a000e7e0 con 0x55bcc8997690 2024-05-08T18:11:00.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.336+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc8998f60 con 0x55bcc8997690 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa59b7fe640 1 -- 172.21.15.114:0/4285089628 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa6a000e9d0 con 0x55bcc8997690 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa59b7fe640 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5900383f0 0x7fa59003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa59b7fe640 1 -- 172.21.15.114:0/4285089628 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa6a0050790 con 0x55bcc8997690 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b6067640 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5900383f0 0x7fa59003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 Processor -- start 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- start start 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b6067640 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5900383f0 0x7fa59003a8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55bcc8988360 tx=0x7fa6b0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.340 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bcc8978630 con 0x55bcc89a48b0 2024-05-08T18:11:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b5065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b5065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38222/0 (socket says 172.21.15.114:38222) 2024-05-08T18:11:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b5065640 1 -- 172.21.15.114:0/3574750273 learned_addr learned my addr 172.21.15.114:0/3574750273 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b5065640 1 -- 172.21.15.114:0/3574750273 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc89a52a0 con 0x55bcc89a48b0 2024-05-08T18:11:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b5065640 1 --2- 172.21.15.114:0/3574750273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89a4cd0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa6a001cfd0 tx=0x7fa6a001aa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890cc1d124e05189 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa5997fa640 1 -- 172.21.15.114:0/3574750273 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a0044070 con 0x55bcc89a48b0 2024-05-08T18:11:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa5997fa640 1 -- 172.21.15.114:0/3574750273 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a001c410 con 0x55bcc89a48b0 2024-05-08T18:11:00.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa5997fa640 1 -- 172.21.15.114:0/3574750273 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a000ecc0 con 0x55bcc89a48b0 2024-05-08T18:11:00.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3574750273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 msgr2=0x55bcc89a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/3574750273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89a4cd0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fa6a001cfd0 tx=0x7fa6a001aa60 comp rx=0 tx=0).stop 2024-05-08T18:11:00.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3574750273 shutdown_connections 2024-05-08T18:11:00.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/3574750273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89a4cd0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3574750273 >> 172.21.15.114:0/3574750273 conn(0x55bcc89a0c40 msgr2=0x55bcc899eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3574750273 shutdown_connections 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- 172.21.15.114:0/3574750273 wait complete. 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 Processor -- start 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.340+0000 7fa6b7d52980 1 -- start start 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55bcc89a59b0 con 0x55bcc89a48b0 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5065640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38226/0 (socket says 172.21.15.114:38226) 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 learned_addr learned my addr 172.21.15.114:0/469168234 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcc89ac380 con 0x55bcc89a48b0 2024-05-08T18:11:00.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5065640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89abe40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000fcf0 tx=0x7fa6a004e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa5877fe640 1 -- 172.21.15.114:0/469168234 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a0032020 con 0x55bcc89a48b0 2024-05-08T18:11:00.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa5877fe640 1 -- 172.21.15.114:0/469168234 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a0045040 con 0x55bcc89a48b0 2024-05-08T18:11:00.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bcc89ac610 con 0x55bcc89a48b0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa5877fe640 1 -- 172.21.15.114:0/469168234 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a0044070 con 0x55bcc89a48b0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcc89af2f0 con 0x55bcc89a48b0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa5877fe640 1 -- 172.21.15.114:0/469168234 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fa6a0035020 con 0x55bcc89a48b0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa5877fe640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5800383f0 0x7fa58003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa5877fe640 1 -- 172.21.15.114:0/469168234 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fa6a0038d10 con 0x55bcc89a48b0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b6067640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5800383f0 0x7fa58003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc89b72a0 0x55bcc89b9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89b9eb0 con 0x55bcc89b72a0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5866640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc89b72a0 0x55bcc89b9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b6067640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5800383f0 0x7fa58003a8b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000f010 tx=0x7fa6b001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.344+0000 7fa6b5866640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc89b72a0 0x55bcc89b9760 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 realm 2024-05-08T18:11:00.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89ba2c0 con 0x55bcc89b72a0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bab90 con 0x55bcc89b72a0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89baf30 con 0x55bcc89b72a0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bb780 con 0x55bcc89b72a0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 20 searching for the correct realm 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bcc89bd4f0 0x55bcc89bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5065640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bcc89bd4f0 0x55bcc89bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5065640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bcc89bd4f0 0x55bcc89bf8e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5065640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa6a0037020 0x7fa6a003d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b6067640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa6a0037020 0x7fa6a003d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b6067640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa6a0037020 0x7fa6a003d580 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.348+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55bcc88017f0 0x7fa6a80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55bcc88017f0 0x7fa6a80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55bcc88017f0 0x7fa6a80b3330 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.352+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.357 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.359 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.356+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.360 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89bd4f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc88017f0 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.360+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x55bcc89b72a0 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bfe20 con 0x7fa6a0037020 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:11:00.366 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bc0d0 con 0x55bcc89b72a0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bc920 con 0x55bcc89b72a0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89bbd10 con 0x55bcc89b72a0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 zone default found 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 4 Realm: () 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:11:00.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 zonegroup default 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c0250 con 0x55bcc88017f0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c1c60 con 0x55bcc89bd4f0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c20f0 con 0x55bcc89bd4f0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.368 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 started sync module instance, tier type = 2024-05-08T18:11:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:11:00.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.364+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c10d0 con 0x7fa6a0037020 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94269307884736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c0d30 con 0x7fa6a0037020 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c3020 con 0x55bcc89b72a0 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94269307884736] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94269307888976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c3020 con 0x55bcc89b72a0 2024-05-08T18:11:00.370 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.368+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c39e0 con 0x55bcc89bd4f0 2024-05-08T18:11:00.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94269307888976] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94269307890544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c2f90 con 0x55bcc89bd4f0 2024-05-08T18:11:00.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c46e0 con 0x7fa6a0037020 2024-05-08T18:11:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94269307896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c4e30 con 0x7fa6a0037020 2024-05-08T18:11:00.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c5950 con 0x55bcc89b72a0 2024-05-08T18:11:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.372+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94269307890544] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94269307896640] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94269307900960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c5910 con 0x55bcc89b72a0 2024-05-08T18:11:00.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c61f0 con 0x55bcc88017f0 2024-05-08T18:11:00.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94269307900960] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94269307895168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c5910 con 0x55bcc88017f0 2024-05-08T18:11:00.378 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.376+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c67c0 con 0x55bcc88017f0 2024-05-08T18:11:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94269307895168] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94269307903216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c67c0 con 0x55bcc88017f0 2024-05-08T18:11:00.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c7180 con 0x55bcc88017f0 2024-05-08T18:11:00.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94269307903216] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94269307905264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c7180 con 0x55bcc88017f0 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=0 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=1 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=2 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=3 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=4 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=5 2024-05-08T18:11:00.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.380+0000 7fa6b7d52980 20 add_watcher() i=6 2024-05-08T18:11:00.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94269307905264] v32'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 20 add_watcher() i=7 2024-05-08T18:11:00.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 2 all 8 watchers are set, enabling cache 2024-05-08T18:11:00.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89ca4a0 con 0x55bcc89b72a0 2024-05-08T18:11:00.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94269307907648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c7710 con 0x55bcc89b72a0 2024-05-08T18:11:00.386 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94269307907648] v32'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa5677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 5 note: GC not initialized 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa5667fc640 20 reqs_thread_entry: start 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 20 init_complete bucket index max shards: 11 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.384+0000 7fa6b7d52980 20 Filter name: none 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa4d7fff640 20 reqs_thread_entry: start 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89f0180 con 0x55bcc88017f0 2024-05-08T18:11:00.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 20 rados_obj.operate() r=0 bl.length=503 2024-05-08T18:11:00.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:11:00.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:11:00.389 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89f6b00 con 0x55bcc88017f0 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94269308102000 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89f2210 con 0x55bcc89b72a0 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.388+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94269307900960 notify 137438953499 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fa6a80d9040 con 0x55bcc89b72a0 2024-05-08T18:11:00.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa5997fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94269307900960 notifier 4891 bl.length()=636 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa5997fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa5997fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94269308102000 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa5997fa640 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa578003eb0 con 0x55bcc89b72a0 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94269308102000 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bcc8982940 con 0x55bcc89b72a0 2024-05-08T18:11:00.392 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:11:00.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa5677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.393 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94269307907648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89ede70 con 0x55bcc89b72a0 2024-05-08T18:11:00.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94269307907648] v32'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.392+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94269307884736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89ede70 con 0x7fa6a0037020 2024-05-08T18:11:00.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94269307884736] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b7d52980 20 remove_watcher() i=0 2024-05-08T18:11:00.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b7d52980 2 removed watcher, disabling cache 2024-05-08T18:11:00.395 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94269307888976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89ede70 con 0x55bcc89b72a0 2024-05-08T18:11:00.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94269307888976] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b7d52980 20 remove_watcher() i=1 2024-05-08T18:11:00.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.396+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94269307890544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89ede70 con 0x55bcc89bd4f0 2024-05-08T18:11:00.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.400+0000 7fa6b5065640 1 -- 172.21.15.114:0/469168234 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94269307890544] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a000d040 con 0x55bcc89bd4f0 2024-05-08T18:11:00.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.400+0000 7fa6b7d52980 20 remove_watcher() i=2 2024-05-08T18:11:00.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.400+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94269307896640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c14c0 con 0x7fa6a0037020 2024-05-08T18:11:00.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.400+0000 7fa6b6067640 1 -- 172.21.15.114:0/469168234 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94269307896640] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6b002f040 con 0x7fa6a0037020 2024-05-08T18:11:00.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.400+0000 7fa6b7d52980 20 remove_watcher() i=3 2024-05-08T18:11:00.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.400+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94269307900960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c2b70 con 0x55bcc89b72a0 2024-05-08T18:11:00.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.404+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94269307900960] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc89b72a0 2024-05-08T18:11:00.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.404+0000 7fa6b7d52980 20 remove_watcher() i=4 2024-05-08T18:11:00.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.404+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94269307895168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c4340 con 0x55bcc88017f0 2024-05-08T18:11:00.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.404+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94269307895168] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.404+0000 7fa6b7d52980 20 remove_watcher() i=5 2024-05-08T18:11:00.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.404+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94269307903216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c14c0 con 0x55bcc88017f0 2024-05-08T18:11:00.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94269307903216] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 20 remove_watcher() i=6 2024-05-08T18:11:00.407 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94269307905264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bcc89c2b70 con 0x55bcc88017f0 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94269307905264] v32'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa6a80cd060 con 0x55bcc88017f0 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 20 remove_watcher() i=7 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55bcc88017f0 msgr2=0x7fa6a80b3330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55bcc88017f0 0x7fa6a80b3330 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc89b72a0 msgr2=0x55bcc89b9760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc89b72a0 0x55bcc89b9760 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa6a0037020 msgr2=0x7fa6a003d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fa6a0037020 0x7fa6a003d580 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bcc89bd4f0 msgr2=0x55bcc89bf8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55bcc89bd4f0 0x55bcc89bf8e0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5800383f0 msgr2=0x7fa58003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5800383f0 0x7fa58003a8b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000f010 tx=0x7fa6b001b070 comp rx=0 tx=0).stop 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 msgr2=0x55bcc89abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b5866640 1 -- 172.21.15.114:0/469168234 reap_dead start 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89abe40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000fcf0 tx=0x7fa6a004e9a0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 shutdown_connections 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/469168234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc89a48b0 0x55bcc89abe40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 >> 172.21.15.114:0/469168234 conn(0x55bcc89a0c40 msgr2=0x55bcc899e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 shutdown_connections 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/469168234 wait complete. 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5900383f0 msgr2=0x7fa59003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5900383f0 0x7fa59003a8b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55bcc8988360 tx=0x7fa6b0003070 comp rx=0 tx=0).stop 2024-05-08T18:11:00.412 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 msgr2=0x55bcc8997ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 0x55bcc8997ab0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0010f90 tx=0x7fa6a000f7a0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 shutdown_connections 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa5900383f0 0x7fa59003a8b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/4285089628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8997690 0x55bcc8997ab0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 >> 172.21.15.114:0/4285089628 conn(0x55bcc898c4a0 msgr2=0x55bcc898cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 shutdown_connections 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/4285089628 wait complete. 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc8984580 msgr2=0x55bcc8986970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.408+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc8984580 0x55bcc8986970 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa59c0383f0 msgr2=0x7fa59c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa59c0383f0 0x7fa59c03a8b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0001e60 tx=0x7fa6a00013e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 msgr2=0x55bcc897f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 0x55bcc897f4e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8017ca0 tx=0x7fa6a8017e30 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 shutdown_connections 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55bcc8984580 0x55bcc8986970 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.413 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fa59c0383f0 0x7fa59c03a8b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 --2- 172.21.15.114:0/1083306162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bcc8890100 0x55bcc897f4e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 >> 172.21.15.114:0/1083306162 conn(0x55bcc88876a0 msgr2=0x55bcc8972640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 shutdown_connections 2024-05-08T18:11:00.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.412+0000 7fa6b7d52980 1 -- 172.21.15.114:0/1083306162 wait complete. 2024-05-08T18:11:00.424 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.424 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.424 ERROR:root:0 2024-05-08T18:11:00.424 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:11:00.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:11:00.424 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-08T18:11:00.504 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:11:00.504 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:11:00.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1139485980 1 Processor -- start 2024-05-08T18:11:00.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1139485980 1 -- start start 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1139485980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561932721290 0x561932723680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1139485980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619325c8710 con 0x561932690f60 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1139485980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5619325dcf00 con 0x561932721290 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1136798640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561932721290 0x561932723680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1136798640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x561932721290 0x561932723680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38238/0 (socket says 172.21.15.114:38238) 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1136798640 1 -- 172.21.15.114:0/610463714 learned_addr learned my addr 172.21.15.114:0/610463714 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1136798640 1 -- 172.21.15.114:0/610463714 >> v1:172.21.15.53:6789/0 conn(0x561932690f60 legacy=0x56193271fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.507 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.504+0000 7f1136798640 1 -- 172.21.15.114:0/610463714 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619325a4ae0 con 0x561932721290 2024-05-08T18:11:00.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1136798640 1 --2- 172.21.15.114:0/610463714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932721290 0x561932723680 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f112000a5c0 tx=0x7f112001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3557dc076128fe0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1135f97640 1 -- 172.21.15.114:0/610463714 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200a6070 con 0x561932721290 2024-05-08T18:11:00.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1135f97640 1 -- 172.21.15.114:0/610463714 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200af070 con 0x561932721290 2024-05-08T18:11:00.509 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1135f97640 1 -- 172.21.15.114:0/610463714 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200aa5c0 con 0x561932721290 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 -- 172.21.15.114:0/610463714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932721290 msgr2=0x561932723680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 --2- 172.21.15.114:0/610463714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932721290 0x561932723680 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f112000a5c0 tx=0x7f112001b340 comp rx=0 tx=0).stop 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 -- 172.21.15.114:0/610463714 shutdown_connections 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 --2- 172.21.15.114:0/610463714 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932721290 0x561932723680 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 -- 172.21.15.114:0/610463714 >> 172.21.15.114:0/610463714 conn(0x561932717650 msgr2=0x561932719a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 -- 172.21.15.114:0/610463714 shutdown_connections 2024-05-08T18:11:00.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.508+0000 7f1139485980 1 -- 172.21.15.114:0/610463714 wait complete. 2024-05-08T18:11:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1139485980 1 Processor -- start 2024-05-08T18:11:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1139485980 1 -- start start 2024-05-08T18:11:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1139485980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x561932807f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1139485980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561932620f80 con 0x561932690f60 2024-05-08T18:11:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1136f99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x561932807f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1136f99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x561932807f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38242/0 (socket says 172.21.15.114:38242) 2024-05-08T18:11:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.524+0000 7f1136f99640 1 -- 172.21.15.114:0/1657244668 learned_addr learned my addr 172.21.15.114:0/1657244668 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 -- 172.21.15.114:0/1657244668 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619325e8da0 con 0x561932690f60 2024-05-08T18:11:00.527 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 --2- 172.21.15.114:0/1657244668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x561932807f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f112800b2d0 tx=0x7f112800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c1f77b09b93b71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1023e17640 1 -- 172.21.15.114:0/1657244668 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112800a040 con 0x561932690f60 2024-05-08T18:11:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1023e17640 1 -- 172.21.15.114:0/1657244668 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112800f750 con 0x561932690f60 2024-05-08T18:11:00.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1023e17640 1 -- 172.21.15.114:0/1657244668 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112800fa70 con 0x561932690f60 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- 172.21.15.114:0/1657244668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 msgr2=0x561932807f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 --2- 172.21.15.114:0/1657244668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x561932807f90 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f112800b2d0 tx=0x7f112800b790 comp rx=0 tx=0).stop 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- 172.21.15.114:0/1657244668 shutdown_connections 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 --2- 172.21.15.114:0/1657244668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x561932807f90 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- 172.21.15.114:0/1657244668 >> 172.21.15.114:0/1657244668 conn(0x561932717650 msgr2=0x561932803b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- 172.21.15.114:0/1657244668 shutdown_connections 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- 172.21.15.114:0/1657244668 wait complete. 2024-05-08T18:11:00.529 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 Processor -- start 2024-05-08T18:11:00.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- start start 2024-05-08T18:11:00.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x56193280f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1139485980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561932724760 con 0x561932690f60 2024-05-08T18:11:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x56193280f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x56193280f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38256/0 (socket says 172.21.15.114:38256) 2024-05-08T18:11:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 -- 172.21.15.114:0/3836498734 learned_addr learned my addr 172.21.15.114:0/3836498734 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193280f9b0 con 0x561932690f60 2024-05-08T18:11:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.528+0000 7f1136f99640 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x56193280f470 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f112800b7d0 tx=0x7f1128000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1022614640 1 -- 172.21.15.114:0/3836498734 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112801ca40 con 0x561932690f60 2024-05-08T18:11:00.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193280fc40 con 0x561932690f60 2024-05-08T18:11:00.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1022614640 1 -- 172.21.15.114:0/3836498734 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112801cc00 con 0x561932690f60 2024-05-08T18:11:00.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1022614640 1 -- 172.21.15.114:0/3836498734 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f112801a480 con 0x561932690f60 2024-05-08T18:11:00.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619328128d0 con 0x561932690f60 2024-05-08T18:11:00.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1022614640 1 -- 172.21.15.114:0/3836498734 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f1128017050 con 0x561932690f60 2024-05-08T18:11:00.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1022614640 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f101c0383f0 0x7f101c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1022614640 1 -- 172.21.15.114:0/3836498734 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f1128015020 con 0x561932690f60 2024-05-08T18:11:00.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1136798640 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f101c0383f0 0x7f101c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932721290 0x561932816520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932816aa0 con 0x561932721290 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f113779a640 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932721290 0x561932816520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1136798640 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f101c0383f0 0x7f101c03a8b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f11200ae000 tx=0x7f11200a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f113779a640 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932721290 0x561932816520 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f113779a640 1 -- 172.21.15.114:0/3836498734 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f113000a4d0 con 0x561932721290 2024-05-08T18:11:00.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932813af0 con 0x561932721290 2024-05-08T18:11:00.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f113779a640 1 -- 172.21.15.114:0/3836498734 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f113000a4d0 con 0x561932721290 2024-05-08T18:11:00.535 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619328188f0 con 0x561932721290 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f113779a640 1 -- 172.21.15.114:0/3836498734 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f113000a4d0 con 0x561932721290 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.532+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932817a60 con 0x561932721290 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f113779a640 1 -- 172.21.15.114:0/3836498734 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f113000a4d0 con 0x561932721290 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932817eb0 con 0x561932721290 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f113779a640 1 -- 172.21.15.114:0/3836498734 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f113000a4d0 con 0x561932721290 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 Processor -- start 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 -- start start 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 0x561932827640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.536 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x561932624fc0 con 0x561932827220 2024-05-08T18:11:00.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1136798640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 0x561932827640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1136798640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 0x561932827640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38268/0 (socket says 172.21.15.114:38268) 2024-05-08T18:11:00.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1136798640 1 -- 172.21.15.114:0/1585038605 learned_addr learned my addr 172.21.15.114:0/1585038605 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1136798640 1 -- 172.21.15.114:0/1585038605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561932827b80 con 0x561932827220 2024-05-08T18:11:00.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1136798640 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 0x561932827640 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f11200ac040 tx=0x7f11200180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f101b7fe640 1 -- 172.21.15.114:0/1585038605 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200b3b90 con 0x561932827220 2024-05-08T18:11:00.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f101b7fe640 1 -- 172.21.15.114:0/1585038605 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200b3d30 con 0x561932827220 2024-05-08T18:11:00.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f101b7fe640 1 -- 172.21.15.114:0/1585038605 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200c8560 con 0x561932827220 2024-05-08T18:11:00.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561932828620 con 0x561932827220 2024-05-08T18:11:00.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.536+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561932828a90 con 0x561932827220 2024-05-08T18:11:00.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f101b7fe640 1 -- 172.21.15.114:0/1585038605 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f11200d1440 con 0x561932827220 2024-05-08T18:11:00.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f101b7fe640 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1010038440 0x7f101003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f101b7fe640 1 -- 172.21.15.114:0/1585038605 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f11200ec050 con 0x561932827220 2024-05-08T18:11:00.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f113779a640 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1010038440 0x7f101003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 Processor -- start 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- start start 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f113779a640 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1010038440 0x7f101003a900 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x561932817580 tx=0x7f1130005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x5619328346b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5619328086e0 con 0x561932834290 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1136798640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x5619328346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1136798640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x5619328346b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38274/0 (socket says 172.21.15.114:38274) 2024-05-08T18:11:00.540 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1136798640 1 -- 172.21.15.114:0/1049069761 learned_addr learned my addr 172.21.15.114:0/1049069761 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1136798640 1 -- 172.21.15.114:0/1049069761 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561932834c80 con 0x561932834290 2024-05-08T18:11:00.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1136798640 1 --2- 172.21.15.114:0/1049069761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x5619328346b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f11200befd0 tx=0x7f11200bced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f03f09ddb45bf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f10197fa640 1 -- 172.21.15.114:0/1049069761 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200d1940 con 0x561932834290 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f10197fa640 1 -- 172.21.15.114:0/1049069761 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200bd390 con 0x561932834290 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f10197fa640 1 -- 172.21.15.114:0/1049069761 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200bd670 con 0x561932834290 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- 172.21.15.114:0/1049069761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 msgr2=0x5619328346b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 --2- 172.21.15.114:0/1049069761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x5619328346b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f11200befd0 tx=0x7f11200bced0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- 172.21.15.114:0/1049069761 shutdown_connections 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 --2- 172.21.15.114:0/1049069761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x5619328346b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- 172.21.15.114:0/1049069761 >> 172.21.15.114:0/1049069761 conn(0x561932830620 msgr2=0x56193282e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- 172.21.15.114:0/1049069761 shutdown_connections 2024-05-08T18:11:00.542 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- 172.21.15.114:0/1049069761 wait complete. 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 Processor -- start 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- start start 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x56193283b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1139485980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x5619328353d0 con 0x561932834290 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.540+0000 7f1136798640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x56193283b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136798640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x56193283b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38290/0 (socket says 172.21.15.114:38290) 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 learned_addr learned my addr 172.21.15.114:0/1857715397 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56193283bd40 con 0x561932834290 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136798640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x56193283b800 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f11200bdd90 tx=0x7f11200ea320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f10077fe640 1 -- 172.21.15.114:0/1857715397 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200c7ae0 con 0x561932834290 2024-05-08T18:11:00.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f10077fe640 1 -- 172.21.15.114:0/1857715397 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11200c7c80 con 0x561932834290 2024-05-08T18:11:00.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56193283bfd0 con 0x561932834290 2024-05-08T18:11:00.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f10077fe640 1 -- 172.21.15.114:0/1857715397 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11200bf970 con 0x561932834290 2024-05-08T18:11:00.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56193283ecb0 con 0x561932834290 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f10077fe640 1 -- 172.21.15.114:0/1857715397 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f11200bfb10 con 0x561932834290 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f10077fe640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f10000383f0 0x7f100003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f10077fe640 1 -- 172.21.15.114:0/1857715397 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f11200e1070 con 0x561932834290 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f113779a640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f10000383f0 0x7f100003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932846c80 0x561932849140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932849890 con 0x561932846c80 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136f99640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932846c80 0x561932849140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f113779a640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f10000383f0 0x7f100003a8b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x561932813a40 tx=0x7f113001f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136f99640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932846c80 0x561932849140 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 20 realm 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.544+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932849ca0 con 0x561932846c80 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284a570 con 0x561932846c80 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284a910 con 0x561932846c80 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284b160 con 0x561932846c80 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 20 searching for the correct realm 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56193284cbb0 0x56193284f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136798640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56193284cbb0 0x56193284f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136798640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56193284cbb0 0x56193284f070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136798640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f1120009040 0x7f11200eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f113779a640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f1120009040 0x7f11200eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f113779a640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f1120009040 0x7f11200eda10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f112801d450 0x7f112801a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.548+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f112801d450 0x7f112801a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.556 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f112801d450 0x7f112801a620 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.552+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.556+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x56193284cbb0 2024-05-08T18:11:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.562 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f112801d450 2024-05-08T18:11:00.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x561932846c80 2024-05-08T18:11:00.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56193284f740 con 0x7f1120009040 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284adb0 con 0x561932846c80 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284bad0 con 0x561932846c80 2024-05-08T18:11:00.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.560+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284bfb0 con 0x561932846c80 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 zone default found 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 4 Realm: () 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 zonegroup default 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193284fc00 con 0x7f112801d450 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.567 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932851a20 con 0x56193284cbb0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932851e40 con 0x56193284cbb0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 started sync module instance, tier type = 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932850ec0 con 0x7f1120009040 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94666221753008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932850b20 con 0x7f1120009040 2024-05-08T18:11:00.568 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.564+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932852d70 con 0x561932846c80 2024-05-08T18:11:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94666221753008] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94666221757088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932852d70 con 0x561932846c80 2024-05-08T18:11:00.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932853730 con 0x56193284cbb0 2024-05-08T18:11:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94666221757088] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94666221758656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932852ce0 con 0x56193284cbb0 2024-05-08T18:11:00.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.568+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932854430 con 0x7f1120009040 2024-05-08T18:11:00.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94666221764784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932854d00 con 0x7f1120009040 2024-05-08T18:11:00.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932855750 con 0x561932846c80 2024-05-08T18:11:00.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94666221758656] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94666221764784] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94666221769280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932854850 con 0x561932846c80 2024-05-08T18:11:00.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.572+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932855ff0 con 0x7f112801d450 2024-05-08T18:11:00.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.576+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94666221769280] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.576+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.576+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94666221763280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932854850 con 0x7f112801d450 2024-05-08T18:11:00.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.576+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619328564c0 con 0x7f112801d450 2024-05-08T18:11:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.576+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94666221763280] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94666221771184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932856480 con 0x7f112801d450 2024-05-08T18:11:00.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932856eb0 con 0x7f112801d450 2024-05-08T18:11:00.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94666221775296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619328572f0 con 0x7f112801d450 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=0 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=1 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=2 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=3 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=4 2024-05-08T18:11:00.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=5 2024-05-08T18:11:00.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94666221771184] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1139485980 20 add_watcher() i=6 2024-05-08T18:11:00.582 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.580+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94666221775296] v32'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 add_watcher() i=7 2024-05-08T18:11:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 2 all 8 watchers are set, enabling cache 2024-05-08T18:11:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561932855fd0 con 0x561932846c80 2024-05-08T18:11:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94666221772752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932857830 con 0x561932846c80 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94666221772752] v32'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f0fe77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 5 note: GC not initialized 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f0fe67fc640 20 reqs_thread_entry: start 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 init_complete bucket index max shards: 11 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 Filter name: none 2024-05-08T18:11:00.585 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f0f57fff640 20 reqs_thread_entry: start 2024-05-08T18:11:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:11:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193287dd70 con 0x7f112801d450 2024-05-08T18:11:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.586 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:11:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:11:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:11:00.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.584+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619328843a0 con 0x7f112801d450 2024-05-08T18:11:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1139485980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1139485980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1139485980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94666221960720 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56193287fa90 con 0x561932846c80 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94666221769280 notify 137438953500 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f1128051040 con 0x561932846c80 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f10197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94666221769280 notifier 4898 bl.length()=666 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94666221960720 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f10197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f10197fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f10197fa640 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0ff8003eb0 con 0x561932846c80 2024-05-08T18:11:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.588+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94666221960720 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619328128d0 con 0x561932846c80 2024-05-08T18:11:00.591 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:11:00.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f0fe77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94666221772752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193287ba70 con 0x561932846c80 2024-05-08T18:11:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94666221772752] v32'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.592 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94666221753008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193287ba70 con 0x7f1120009040 2024-05-08T18:11:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94666221753008] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f1139485980 20 remove_watcher() i=0 2024-05-08T18:11:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f1139485980 2 removed watcher, disabling cache 2024-05-08T18:11:00.593 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.592+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94666221757088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193287ba70 con 0x561932846c80 2024-05-08T18:11:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.596+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94666221757088] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.596+0000 7f1139485980 20 remove_watcher() i=1 2024-05-08T18:11:00.595 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.596+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94666221758656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56193287ba70 con 0x56193284cbb0 2024-05-08T18:11:00.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.596+0000 7f1136798640 1 -- 172.21.15.114:0/1857715397 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94666221758656] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11200f4020 con 0x56193284cbb0 2024-05-08T18:11:00.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.596+0000 7f1139485980 20 remove_watcher() i=2 2024-05-08T18:11:00.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.596+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94666221764784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619328528c0 con 0x7f1120009040 2024-05-08T18:11:00.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.600+0000 7f113779a640 1 -- 172.21.15.114:0/1857715397 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94666221764784] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f113001f070 con 0x7f1120009040 2024-05-08T18:11:00.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.600+0000 7f1139485980 20 remove_watcher() i=3 2024-05-08T18:11:00.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.600+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94666221769280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619328528c0 con 0x561932846c80 2024-05-08T18:11:00.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.600+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94666221769280] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x561932846c80 2024-05-08T18:11:00.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.600+0000 7f1139485980 20 remove_watcher() i=4 2024-05-08T18:11:00.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.600+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94666221763280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932855240 con 0x7f112801d450 2024-05-08T18:11:00.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.604+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94666221763280] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.604+0000 7f1139485980 20 remove_watcher() i=5 2024-05-08T18:11:00.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.604+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94666221771184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619328528c0 con 0x7f112801d450 2024-05-08T18:11:00.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.604+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94666221771184] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.604+0000 7f1139485980 20 remove_watcher() i=6 2024-05-08T18:11:00.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.604+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94666221775296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561932855240 con 0x7f112801d450 2024-05-08T18:11:00.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94666221775296] v32'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f112802e070 con 0x7f112801d450 2024-05-08T18:11:00.609 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 20 remove_watcher() i=7 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f112801d450 msgr2=0x7f112801a620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f112801d450 0x7f112801a620 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932846c80 msgr2=0x561932849140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932846c80 0x561932849140 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f1120009040 msgr2=0x7f11200eda10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f1120009040 0x7f11200eda10 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56193284cbb0 msgr2=0x56193284f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56193284cbb0 0x56193284f070 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f10000383f0 msgr2=0x7f100003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f10000383f0 0x7f100003a8b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x561932813a40 tx=0x7f113001f000 comp rx=0 tx=0).stop 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 msgr2=0x56193283b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x56193283b800 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f11200bdd90 tx=0x7f11200ea320 comp rx=0 tx=0).stop 2024-05-08T18:11:00.610 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 shutdown_connections 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f112801d450 0x7f112801a620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f1120009040 0x7f11200eda10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x56193284cbb0 0x56193284f070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932846c80 0x561932849140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1136f99640 1 -- 172.21.15.114:0/1857715397 reap_dead start 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f10000383f0 0x7f100003a8b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1857715397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932834290 0x56193283b800 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 >> 172.21.15.114:0/1857715397 conn(0x561932830620 msgr2=0x561932835af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 shutdown_connections 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1857715397 wait complete. 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1010038440 msgr2=0x7f101003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1010038440 0x7f101003a900 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x561932817580 tx=0x7f1130005850 comp rx=0 tx=0).stop 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 msgr2=0x561932827640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 0x561932827640 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f11200ac040 tx=0x7f11200180e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 shutdown_connections 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f1010038440 0x7f101003a900 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/1585038605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932827220 0x561932827640 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 >> 172.21.15.114:0/1585038605 conn(0x56193281c030 msgr2=0x56193281cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 shutdown_connections 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/1585038605 wait complete. 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932721290 msgr2=0x561932816520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932721290 0x561932816520 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f101c0383f0 msgr2=0x7f101c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f101c0383f0 0x7f101c03a8b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f11200ae000 tx=0x7f11200a6000 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 msgr2=0x56193280f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x56193280f470 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f112800b7d0 tx=0x7f1128000ee0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 shutdown_connections 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x561932721290 0x561932816520 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f101c0383f0 0x7f101c03a8b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 --2- 172.21.15.114:0/3836498734 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561932690f60 0x56193280f470 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 >> 172.21.15.114:0/3836498734 conn(0x561932717650 msgr2=0x561932802630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 shutdown_connections 2024-05-08T18:11:00.613 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.608+0000 7f1139485980 1 -- 172.21.15.114:0/3836498734 wait complete. 2024-05-08T18:11:00.618 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.618 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.619 ERROR:root:0 2024-05-08T18:11:00.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:00.623 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000ffd590613ca1793d-00663bc034-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:11:00.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:11:00.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T18:11:00.624 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-08T18:11:00.699 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:11:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:11:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eb09fd980 1 Processor -- start 2024-05-08T18:11:00.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eb09fd980 1 -- start start 2024-05-08T18:11:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eb09fd980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564563b2a330 0x564563b2c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eb09fd980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5645639d2710 con 0x564563b25dd0 2024-05-08T18:11:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eb09fd980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x5645639e6f00 con 0x564563b2a330 2024-05-08T18:11:00.701 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eadd10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564563b2a330 0x564563b2c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eadd10640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x564563b2a330 0x564563b2c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38300/0 (socket says 172.21.15.114:38300) 2024-05-08T18:11:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eae511640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x564563b25dd0 0x564563b261b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43546/0 (socket says 172.21.15.114:43546) 2024-05-08T18:11:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eadd10640 1 -- 172.21.15.114:0/3534910250 learned_addr learned my addr 172.21.15.114:0/3534910250 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eadd10640 1 -- 172.21.15.114:0/3534910250 >> v1:172.21.15.53:6789/0 conn(0x564563b25dd0 legacy=0x564563b261b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.702 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.700+0000 7f0eadd10640 1 -- 172.21.15.114:0/3534910250 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645639aeae0 con 0x564563b2a330 2024-05-08T18:11:00.704 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eadd10640 1 --2- 172.21.15.114:0/3534910250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b2a330 0x564563b2c720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800a5c0 tx=0x7f0e9801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45bd208ff090dfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0ead50f640 1 -- 172.21.15.114:0/3534910250 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980a6070 con 0x564563b2a330 2024-05-08T18:11:00.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0ead50f640 1 -- 172.21.15.114:0/3534910250 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e980af070 con 0x564563b2a330 2024-05-08T18:11:00.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0ead50f640 1 -- 172.21.15.114:0/3534910250 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980aa5c0 con 0x564563b2a330 2024-05-08T18:11:00.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3534910250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b2a330 msgr2=0x564563b2c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.705 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/3534910250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b2a330 0x564563b2c720 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800a5c0 tx=0x7f0e9801b340 comp rx=0 tx=0).stop 2024-05-08T18:11:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3534910250 shutdown_connections 2024-05-08T18:11:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/3534910250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b2a330 0x564563b2c720 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3534910250 >> 172.21.15.114:0/3534910250 conn(0x564563b216a0 msgr2=0x564563b23ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3534910250 shutdown_connections 2024-05-08T18:11:00.706 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.704+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3534910250 wait complete. 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 Processor -- start 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- start start 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c0dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564563a2af80 con 0x564563b25dd0 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eae511640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c0dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eae511640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c0dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38314/0 (socket says 172.21.15.114:38314) 2024-05-08T18:11:00.720 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eae511640 1 -- 172.21.15.114:0/279865553 learned_addr learned my addr 172.21.15.114:0/279865553 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eae511640 1 -- 172.21.15.114:0/279865553 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645639f2da0 con 0x564563b25dd0 2024-05-08T18:11:00.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eae511640 1 --2- 172.21.15.114:0/279865553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c0dec0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80016f0 tx=0x7f0ea8001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3736cf76820257b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0d9c608640 1 -- 172.21.15.114:0/279865553 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea8003460 con 0x564563b25dd0 2024-05-08T18:11:00.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0d9c608640 1 -- 172.21.15.114:0/279865553 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea8003620 con 0x564563b25dd0 2024-05-08T18:11:00.721 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0d9c608640 1 -- 172.21.15.114:0/279865553 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea8003940 con 0x564563b25dd0 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- 172.21.15.114:0/279865553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 msgr2=0x564563c0dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/279865553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c0dec0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80016f0 tx=0x7f0ea8001bb0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- 172.21.15.114:0/279865553 shutdown_connections 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/279865553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c0dec0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- 172.21.15.114:0/279865553 >> 172.21.15.114:0/279865553 conn(0x564563b216a0 msgr2=0x564563a9b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- 172.21.15.114:0/279865553 shutdown_connections 2024-05-08T18:11:00.723 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- 172.21.15.114:0/279865553 wait complete. 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 Processor -- start 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- start start 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c1b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.720+0000 7f0eb09fd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564563b2f750 con 0x564563b25dd0 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eae511640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c1b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eae511640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c1b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38330/0 (socket says 172.21.15.114:38330) 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eae511640 1 -- 172.21.15.114:0/1267554002 learned_addr learned my addr 172.21.15.114:0/1267554002 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.724 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eae511640 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564563c1bb90 con 0x564563b25dd0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eae511640 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c1b650 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80012f0 tx=0x7f0ea8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0d9ae05640 1 -- 172.21.15.114:0/1267554002 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea8022020 con 0x564563b25dd0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564563c1be20 con 0x564563b25dd0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0d9ae05640 1 -- 172.21.15.114:0/1267554002 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea8006820 con 0x564563b25dd0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0d9ae05640 1 -- 172.21.15.114:0/1267554002 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea8003e10 con 0x564563b25dd0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564563c1ea60 con 0x564563b25dd0 2024-05-08T18:11:00.725 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0d9ae05640 1 -- 172.21.15.114:0/1267554002 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0ea8025020 con 0x564563b25dd0 2024-05-08T18:11:00.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0d9ae05640 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d940383a0 0x7f0d9403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0d9ae05640 1 -- 172.21.15.114:0/1267554002 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0ea804e7e0 con 0x564563b25dd0 2024-05-08T18:11:00.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563b2a330 0x564563c226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.727 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d940383a0 0x7f0d9403a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c22c30 con 0x564563b2a330 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563b2a330 0x564563c226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d940383a0 0x7f0d9403a860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ae000 tx=0x7f0e980a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.724+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563b2a330 0x564563c226b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eaed12640 1 -- 172.21.15.114:0/1267554002 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea00083f0 con 0x564563b2a330 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c1fc60 con 0x564563b2a330 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eaed12640 1 -- 172.21.15.114:0/1267554002 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ea00083f0 con 0x564563b2a330 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c249f0 con 0x564563b2a330 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eaed12640 1 -- 172.21.15.114:0/1267554002 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ea00083f0 con 0x564563b2a330 2024-05-08T18:11:00.728 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c23b60 con 0x564563b2a330 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eaed12640 1 -- 172.21.15.114:0/1267554002 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ea00083f0 con 0x564563b2a330 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c23f80 con 0x564563b2a330 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eaed12640 1 -- 172.21.15.114:0/1267554002 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ea00083f0 con 0x564563b2a330 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 Processor -- start 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- start start 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 0x564563c33760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564563a2efc0 con 0x564563c33340 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eadd10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 0x564563c33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eadd10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 0x564563c33760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38342/0 (socket says 172.21.15.114:38342) 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eadd10640 1 -- 172.21.15.114:0/1175064107 learned_addr learned my addr 172.21.15.114:0/1175064107 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eadd10640 1 -- 172.21.15.114:0/1175064107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564563c33ca0 con 0x564563c33340 2024-05-08T18:11:00.730 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 0x564563c33760 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ac040 tx=0x7f0e980180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0d93fff640 1 -- 172.21.15.114:0/1175064107 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980b3b90 con 0x564563c33340 2024-05-08T18:11:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564563c34740 con 0x564563c33340 2024-05-08T18:11:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0d93fff640 1 -- 172.21.15.114:0/1175064107 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e980b3d30 con 0x564563c33340 2024-05-08T18:11:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0d93fff640 1 -- 172.21.15.114:0/1175064107 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980c8560 con 0x564563c33340 2024-05-08T18:11:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.728+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564563c34bb0 con 0x564563c33340 2024-05-08T18:11:00.731 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0d93fff640 1 -- 172.21.15.114:0/1175064107 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0e980d1440 con 0x564563c33340 2024-05-08T18:11:00.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0d93fff640 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d880383f0 0x7f0d8803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0d93fff640 1 -- 172.21.15.114:0/1175064107 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0e980ec160 con 0x564563c33340 2024-05-08T18:11:00.733 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d880383f0 0x7f0d8803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 Processor -- start 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- start start 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d880383f0 0x7f0d8803a8b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x564563c23f00 tx=0x7f0ea0003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c407d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564563c0e5b0 con 0x564563c403b0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eadd10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eadd10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38356/0 (socket says 172.21.15.114:38356) 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eadd10640 1 -- 172.21.15.114:0/3416817193 learned_addr learned my addr 172.21.15.114:0/3416817193 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eadd10640 1 -- 172.21.15.114:0/3416817193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564563c40da0 con 0x564563c403b0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eadd10640 1 --2- 172.21.15.114:0/3416817193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c407d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ea3e0 tx=0x7f0e980bccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7baf08905609c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0d91ffb640 1 -- 172.21.15.114:0/3416817193 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980d1730 con 0x564563c403b0 2024-05-08T18:11:00.734 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0d91ffb640 1 -- 172.21.15.114:0/3416817193 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e980d18d0 con 0x564563c403b0 2024-05-08T18:11:00.735 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0d91ffb640 1 -- 172.21.15.114:0/3416817193 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980bd390 con 0x564563c403b0 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3416817193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 msgr2=0x564563c407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/3416817193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c407d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ea3e0 tx=0x7f0e980bccd0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3416817193 shutdown_connections 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/3416817193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c407d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3416817193 >> 172.21.15.114:0/3416817193 conn(0x564563c3c740 msgr2=0x564563c3a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3416817193 shutdown_connections 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- 172.21.15.114:0/3416817193 wait complete. 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 Processor -- start 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.732+0000 7f0eb09fd980 1 -- start start 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c47930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x564563c414b0 con 0x564563c403b0 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eadd10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c47930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eadd10640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c47930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38366/0 (socket says 172.21.15.114:38366) 2024-05-08T18:11:00.737 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 learned_addr learned my addr 172.21.15.114:0/1710627524 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564563c47e70 con 0x564563c403b0 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c47930 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0e980b37e0 tx=0x7f0e980ea370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0d7ffff640 1 -- 172.21.15.114:0/1710627524 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980d1730 con 0x564563c403b0 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564563c48100 con 0x564563c403b0 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0d7ffff640 1 -- 172.21.15.114:0/1710627524 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e980be740 con 0x564563c403b0 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0d7ffff640 1 -- 172.21.15.114:0/1710627524 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e980c7cf0 con 0x564563c403b0 2024-05-08T18:11:00.738 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564563c48100 con 0x564563c403b0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0d7ffff640 1 -- 172.21.15.114:0/1710627524 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0e980f3060 con 0x564563c403b0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0d7ffff640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d780383a0 0x7f0d7803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0d7ffff640 1 -- 172.21.15.114:0/1710627524 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0e980edd90 con 0x564563c403b0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d780383a0 0x7f0d7803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563c52c50 0x564563c550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c55840 con 0x564563c52c50 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eae511640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563c52c50 0x564563c550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d780383a0 0x7f0d7803a860 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0008fd0 tx=0x7f0ea001b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.743 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.736+0000 7f0eae511640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563c52c50 0x564563c550f0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 realm 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c55c50 con 0x564563c52c50 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c56520 con 0x564563c52c50 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.744 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c568c0 con 0x564563c52c50 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c57110 con 0x564563c52c50 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 20 searching for the correct realm 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564563c58e80 0x564563c5b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564563c58e80 0x564563c5b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564563c58e80 0x564563c5b270 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.745 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eadd10640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0e980f5070 0x7f0e980ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0e980f5070 0x7f0e980ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eaed12640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0e980f5070 0x7f0e980ee9d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0ea8027020 0x7f0ea804b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.740+0000 7f0eae511640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0ea8027020 0x7f0ea804b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.746 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0ea8027020 0x7f0ea804b260 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.751 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.752 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.744+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.753 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.754 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.748+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c58e80 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.755 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0ea8027020 2024-05-08T18:11:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x564563c52c50 2024-05-08T18:11:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564563c5b7b0 con 0x7f0e980f5070 2024-05-08T18:11:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.759 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c57a60 con 0x564563c52c50 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c582b0 con 0x564563c52c50 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.760 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c582b0 con 0x564563c52c50 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 zone default found 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 4 Realm: () 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 zonegroup default 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c5bbe0 con 0x7f0ea8027020 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.761 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c5d5f0 con 0x564563c58e80 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.752+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c5dac0 con 0x564563c58e80 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 20 started sync module instance, tier type = 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5ca60 con 0x7f0e980f5070 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.762 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856026639952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5e3d0 con 0x7f0e980f5070 2024-05-08T18:11:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5ec20 con 0x564563c52c50 2024-05-08T18:11:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856026639952] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856026644256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5e7f0 con 0x564563c52c50 2024-05-08T18:11:00.763 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.756+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5f2e0 con 0x564563c58e80 2024-05-08T18:11:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856026644256] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856026645312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5e760 con 0x564563c58e80 2024-05-08T18:11:00.764 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c60090 con 0x7f0e980f5070 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856026651520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c60960 con 0x7f0e980f5070 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.760+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c61360 con 0x564563c52c50 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856026645312] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856026651520] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856026650320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c60e70 con 0x564563c52c50 2024-05-08T18:11:00.765 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c61830 con 0x7f0ea8027020 2024-05-08T18:11:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856026657664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c61c50 con 0x7f0ea8027020 2024-05-08T18:11:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c62670 con 0x7f0ea8027020 2024-05-08T18:11:00.766 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.764+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856026650320] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.767 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856026657664] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856026653872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c61c50 con 0x7f0ea8027020 2024-05-08T18:11:00.768 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c62ae0 con 0x7f0ea8027020 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856026662448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c62f40 con 0x7f0ea8027020 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 20 add_watcher() i=0 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 20 add_watcher() i=1 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 20 add_watcher() i=2 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 20 add_watcher() i=3 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 20 add_watcher() i=4 2024-05-08T18:11:00.770 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.768+0000 7f0eb09fd980 20 add_watcher() i=5 2024-05-08T18:11:00.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856026653872] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.771 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 add_watcher() i=6 2024-05-08T18:11:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856026662448] v32'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 add_watcher() i=7 2024-05-08T18:11:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 2 all 8 watchers are set, enabling cache 2024-05-08T18:11:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c617a0 con 0x564563c52c50 2024-05-08T18:11:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.772 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856026658720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c63450 con 0x564563c52c50 2024-05-08T18:11:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856026658720] v32'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:11:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:11:00.774 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 5 note: GC not initialized 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0cdf7fe640 20 reqs_thread_entry: start 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 init_complete bucket index max shards: 11 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 Filter name: none 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0cdd7fa640 20 reqs_thread_entry: start 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.775 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.772+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c89a40 con 0x7f0ea8027020 2024-05-08T18:11:00.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T18:11:00.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:11:00.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:11:00.776 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c90330 con 0x7f0ea8027020 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.776+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94856026848672 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564563c8b9e0 con 0x564563c52c50 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94856026650320 notify 137438953501 ret 0) ==== 678+0+0 (crc 0 0 0) 0x564563c1ea60 con 0x564563c52c50 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0d91ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94856026650320 notifier 4905 bl.length()=636 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0d91ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0d91ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94856026848672 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0d91ffb640 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0d74003eb0 con 0x564563c52c50 2024-05-08T18:11:00.779 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94856026848672 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564563c1be20 con 0x564563c52c50 2024-05-08T18:11:00.780 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:11:00.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0d64fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.780 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856026658720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c87740 con 0x564563c52c50 2024-05-08T18:11:00.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94856026658720] v32'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.781 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856026639952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c87740 con 0x7f0e980f5070 2024-05-08T18:11:00.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94856026639952] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eb09fd980 20 remove_watcher() i=0 2024-05-08T18:11:00.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eb09fd980 2 removed watcher, disabling cache 2024-05-08T18:11:00.782 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.780+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856026644256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c87740 con 0x564563c52c50 2024-05-08T18:11:00.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.784+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94856026644256] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.784+0000 7f0eb09fd980 20 remove_watcher() i=1 2024-05-08T18:11:00.784 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.784+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856026645312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c87740 con 0x564563c58e80 2024-05-08T18:11:00.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eadd10640 1 -- 172.21.15.114:0/1710627524 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94856026645312] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e980ce020 con 0x564563c58e80 2024-05-08T18:11:00.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eb09fd980 20 remove_watcher() i=2 2024-05-08T18:11:00.787 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856026651520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5ce50 con 0x7f0e980f5070 2024-05-08T18:11:00.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eaed12640 1 -- 172.21.15.114:0/1710627524 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94856026651520] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea002f040 con 0x7f0e980f5070 2024-05-08T18:11:00.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eb09fd980 20 remove_watcher() i=3 2024-05-08T18:11:00.788 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856026650320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5ce50 con 0x564563c52c50 2024-05-08T18:11:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94856026650320] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x564563c52c50 2024-05-08T18:11:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eb09fd980 20 remove_watcher() i=4 2024-05-08T18:11:00.790 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.788+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856026657664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5ce50 con 0x7f0ea8027020 2024-05-08T18:11:00.791 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.792+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94856026657664] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.792+0000 7f0eb09fd980 20 remove_watcher() i=5 2024-05-08T18:11:00.792 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.792+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856026653872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c5ce50 con 0x7f0ea8027020 2024-05-08T18:11:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.792+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94856026653872] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.792+0000 7f0eb09fd980 20 remove_watcher() i=6 2024-05-08T18:11:00.794 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.792+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856026662448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564563c604b0 con 0x7f0ea8027020 2024-05-08T18:11:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94856026662448] v32'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea801b040 con 0x7f0ea8027020 2024-05-08T18:11:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 20 remove_watcher() i=7 2024-05-08T18:11:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0ea8027020 msgr2=0x7f0ea804b260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f0ea8027020 0x7f0ea804b260 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.798 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563c52c50 msgr2=0x564563c550f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563c52c50 0x564563c550f0 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0e980f5070 msgr2=0x7f0e980ee9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0e980f5070 0x7f0e980ee9d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564563c58e80 msgr2=0x564563c5b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x564563c58e80 0x564563c5b270 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d780383a0 msgr2=0x7f0d7803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d780383a0 0x7f0d7803a860 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0008fd0 tx=0x7f0ea001b070 comp rx=0 tx=0).stop 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 msgr2=0x564563c47930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1710627524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c403b0 0x564563c47930 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f0e980b37e0 tx=0x7f0e980ea370 comp rx=0 tx=0).stop 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 reap_dead start 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eae511640 1 -- 172.21.15.114:0/1710627524 reap_dead start 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 shutdown_connections 2024-05-08T18:11:00.799 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 >> 172.21.15.114:0/1710627524 conn(0x564563c3c740 msgr2=0x564563c39da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 shutdown_connections 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1710627524 wait complete. 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d880383f0 msgr2=0x7f0d8803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d880383f0 0x7f0d8803a8b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x564563c23f00 tx=0x7f0ea0003070 comp rx=0 tx=0).stop 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 msgr2=0x564563c33760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 0x564563c33760 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ac040 tx=0x7f0e980180e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 shutdown_connections 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d880383f0 0x7f0d8803a8b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1175064107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563c33340 0x564563c33760 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 >> 172.21.15.114:0/1175064107 conn(0x564563c28150 msgr2=0x564563c28c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 shutdown_connections 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1175064107 wait complete. 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563b2a330 msgr2=0x564563c226b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.800 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563b2a330 0x564563c226b0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d940383a0 msgr2=0x7f0d9403a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d940383a0 0x7f0d9403a860 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0e980ae000 tx=0x7f0e980a6000 comp rx=0 tx=0).stop 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 msgr2=0x564563c1b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c1b650 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80012f0 tx=0x7f0ea8001260 comp rx=0 tx=0).stop 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 shutdown_connections 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x564563b2a330 0x564563c226b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d940383a0 0x7f0d9403a860 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 --2- 172.21.15.114:0/1267554002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564563b25dd0 0x564563c1b650 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.802 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 >> 172.21.15.114:0/1267554002 conn(0x564563b216a0 msgr2=0x564563c0c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 shutdown_connections 2024-05-08T18:11:00.803 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.796+0000 7f0eb09fd980 1 -- 172.21.15.114:0/1267554002 wait complete. 2024-05-08T18:11:00.807 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.807 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.807 ERROR:root:0 2024-05-08T18:11:00.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:11:00.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:11:00.808 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:11:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:11:00.886 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:11:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9c858980 1 Processor -- start 2024-05-08T18:11:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9c858980 1 -- start start 2024-05-08T18:11:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9c858980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f67797a7f0 0x55f677a08bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9c858980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f6778b1710 con 0x55f677a09100 2024-05-08T18:11:00.887 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9c858980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55f6778c5f00 con 0x55f67797a7f0 2024-05-08T18:11:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9a36c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55f67797a7f0 0x55f677a08bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f99b6b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x55f677a09100 0x55f677a0b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43552/0 (socket says 172.21.15.114:43552) 2024-05-08T18:11:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f99b6b640 1 -- 172.21.15.114:0/3713133481 learned_addr learned my addr 172.21.15.114:0/3713133481 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:11:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9a36c640 1 -- 172.21.15.114:0/3713133481 >> v1:172.21.15.53:6789/0 conn(0x55f677a09100 legacy=0x55f677a0b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.888 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9a36c640 1 -- 172.21.15.114:0/3713133481 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f67788dae0 con 0x55f67797a7f0 2024-05-08T18:11:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.888+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/3713133481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677a08bc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00a480 tx=0x7f0f8c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee343894140fdd41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9936a640 1 -- 172.21.15.114:0/3713133481 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f8c0b0070 con 0x55f67797a7f0 2024-05-08T18:11:00.891 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9936a640 1 -- 172.21.15.114:0/3713133481 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0ab540 con 0x55f67797a7f0 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9936a640 1 -- 172.21.15.114:0/3713133481 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f8c0ab840 con 0x55f67797a7f0 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 -- 172.21.15.114:0/3713133481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 msgr2=0x55f677a08bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 --2- 172.21.15.114:0/3713133481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677a08bc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00a480 tx=0x7f0f8c01b280 comp rx=0 tx=0).stop 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 -- 172.21.15.114:0/3713133481 shutdown_connections 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 --2- 172.21.15.114:0/3713133481 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677a08bc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 -- 172.21.15.114:0/3713133481 >> 172.21.15.114:0/3713133481 conn(0x55f677a006a0 msgr2=0x55f677a02ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 -- 172.21.15.114:0/3713133481 shutdown_connections 2024-05-08T18:11:00.892 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.892+0000 7f0f9c858980 1 -- 172.21.15.114:0/3713133481 wait complete. 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9c858980 1 Processor -- start 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9c858980 1 -- start start 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9c858980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677af0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9c858980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f677909f80 con 0x55f67797a7f0 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9a36c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677af0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9a36c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677af0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38388/0 (socket says 172.21.15.114:38388) 2024-05-08T18:11:00.905 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9a36c640 1 -- 172.21.15.114:0/4192987052 learned_addr learned my addr 172.21.15.114:0/4192987052 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9a36c640 1 -- 172.21.15.114:0/4192987052 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6778d1da0 con 0x55f67797a7f0 2024-05-08T18:11:00.906 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/4192987052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677af0fa0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0ae040 tx=0x7f0f8c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c01ce0da51ee86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0e88608640 1 -- 172.21.15.114:0/4192987052 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f8c0b0040 con 0x55f67797a7f0 2024-05-08T18:11:00.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0e88608640 1 -- 172.21.15.114:0/4192987052 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0ab9b0 con 0x55f67797a7f0 2024-05-08T18:11:00.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.904+0000 7f0e88608640 1 -- 172.21.15.114:0/4192987052 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f8c0abc90 con 0x55f67797a7f0 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/4192987052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 msgr2=0x55f677af0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 --2- 172.21.15.114:0/4192987052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677af0fa0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c0ae040 tx=0x7f0f8c003030 comp rx=0 tx=0).stop 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/4192987052 shutdown_connections 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 --2- 172.21.15.114:0/4192987052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f67797a7f0 0x55f677af0fa0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/4192987052 >> 172.21.15.114:0/4192987052 conn(0x55f677a006a0 msgr2=0x55f677aecb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/4192987052 shutdown_connections 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/4192987052 wait complete. 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 Processor -- start 2024-05-08T18:11:00.908 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- start start 2024-05-08T18:11:00.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 0x55f677a06420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f677a0d720 con 0x55f677a09100 2024-05-08T18:11:00.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9a36c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 0x55f677a06420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9a36c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 0x55f677a06420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38404/0 (socket says 172.21.15.114:38404) 2024-05-08T18:11:00.909 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9a36c640 1 -- 172.21.15.114:0/2832098597 learned_addr learned my addr 172.21.15.114:0/2832098597 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9a36c640 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f677a06960 con 0x55f677a09100 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 0x55f677a06420 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c01bb20 tx=0x7f0f8c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0e86e05640 1 -- 172.21.15.114:0/2832098597 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f8c0b0070 con 0x55f677a09100 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f677a04be0 con 0x55f677a09100 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0e86e05640 1 -- 172.21.15.114:0/2832098597 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f8c0b6830 con 0x55f677a09100 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0e86e05640 1 -- 172.21.15.114:0/2832098597 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f8c0b6b10 con 0x55f677a09100 2024-05-08T18:11:00.910 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f677a050d0 con 0x55f677a09100 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.908+0000 7f0e86e05640 1 -- 172.21.15.114:0/2832098597 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0f8c0b7420 con 0x55f677a09100 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0e86e05640 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e800383f0 0x7f0e8003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0e86e05640 1 -- 172.21.15.114:0/2832098597 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0f8c0bc070 con 0x55f677a09100 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e800383f0 0x7f0e8003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677aff8f0 0x55f677b01ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b02220 con 0x55f677aff8f0 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677aff8f0 0x55f677b01ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e800383f0 0x7f0e8003a8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001d80 tx=0x7f0f900012e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677aff8f0 0x55f677b01ce0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/2832098597 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f9400a4d0 con 0x55f677aff8f0 2024-05-08T18:11:00.912 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b025c0 con 0x55f677aff8f0 2024-05-08T18:11:00.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/2832098597 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f9400a4d0 con 0x55f677aff8f0 2024-05-08T18:11:00.913 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b03ea0 con 0x55f677aff8f0 2024-05-08T18:11:00.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/2832098597 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f9400a4d0 con 0x55f677aff8f0 2024-05-08T18:11:00.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b030d0 con 0x55f677aff8f0 2024-05-08T18:11:00.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/2832098597 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f9400a4d0 con 0x55f677aff8f0 2024-05-08T18:11:00.915 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b03520 con 0x55f677aff8f0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/2832098597 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f9400a4d0 con 0x55f677aff8f0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 Processor -- start 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- start start 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 0x55f677b12c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f9c858980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f67790dfc0 con 0x55f677b127e0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f99b6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 0x55f677b12c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f99b6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 0x55f677b12c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38408/0 (socket says 172.21.15.114:38408) 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f99b6b640 1 -- 172.21.15.114:0/1593713649 learned_addr learned my addr 172.21.15.114:0/1593713649 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.912+0000 7f0f99b6b640 1 -- 172.21.15.114:0/1593713649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f677b13140 con 0x55f677b127e0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 0x55f677b12c00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000d660 tx=0x7f0f9000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7ffff640 1 -- 172.21.15.114:0/1593713649 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9000c6b0 con 0x55f677b127e0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f677b13be0 con 0x55f677b127e0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7ffff640 1 -- 172.21.15.114:0/1593713649 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f9000c850 con 0x55f677b127e0 2024-05-08T18:11:00.916 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f677b140b0 con 0x55f677b127e0 2024-05-08T18:11:00.917 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7ffff640 1 -- 172.21.15.114:0/1593713649 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9000cb30 con 0x55f677b127e0 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7ffff640 1 -- 172.21.15.114:0/1593713649 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0f90023020 con 0x55f677b127e0 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7ffff640 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e740384b0 0x7f0e7403a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7ffff640 1 -- 172.21.15.114:0/1593713649 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0f90021020 con 0x55f677b127e0 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e740384b0 0x7f0e7403a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9c858980 1 Processor -- start 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9c858980 1 -- start start 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9c858980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b1fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e740384b0 0x7f0e7403a970 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55f677b02bf0 tx=0x7f0f94005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f9c858980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f677af1630 con 0x55f677b1fa70 2024-05-08T18:11:00.920 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f99b6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b1fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f99b6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b1fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38424/0 (socket says 172.21.15.114:38424) 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f99b6b640 1 -- 172.21.15.114:0/1887432009 learned_addr learned my addr 172.21.15.114:0/1887432009 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f99b6b640 1 -- 172.21.15.114:0/1887432009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f677b20420 con 0x55f677b1fa70 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/1887432009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b1fe50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0f9004f250 tx=0x7f0f90024740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d52c910570d2cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7dffb640 1 -- 172.21.15.114:0/1887432009 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9001bcc0 con 0x55f677b1fa70 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7dffb640 1 -- 172.21.15.114:0/1887432009 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f9003e0d0 con 0x55f677b1fa70 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.916+0000 7f0e7dffb640 1 -- 172.21.15.114:0/1887432009 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9001be60 con 0x55f677b1fa70 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/1887432009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 msgr2=0x55f677b1fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 --2- 172.21.15.114:0/1887432009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b1fe50 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f0f9004f250 tx=0x7f0f90024740 comp rx=0 tx=0).stop 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/1887432009 shutdown_connections 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 --2- 172.21.15.114:0/1887432009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b1fe50 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/1887432009 >> 172.21.15.114:0/1887432009 conn(0x55f677b1bdb0 msgr2=0x55f677b19e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/1887432009 shutdown_connections 2024-05-08T18:11:00.921 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/1887432009 wait complete. 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 Processor -- start 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- start start 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b26fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55f677b20be0 con 0x55f677b1fa70 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f99b6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b26fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f99b6b640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b26fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38438/0 (socket says 172.21.15.114:38438) 2024-05-08T18:11:00.922 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 learned_addr learned my addr 172.21.15.114:0/31885609 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f677b274e0 con 0x55f677b1fa70 2024-05-08T18:11:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b26fa0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000dfb0 tx=0x7f0f9004f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.928 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0e6bfff640 1 -- 172.21.15.114:0/31885609 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9004c070 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f677b27770 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0e6bfff640 1 -- 172.21.15.114:0/31885609 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f90035070 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0e6bfff640 1 -- 172.21.15.114:0/31885609 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f9001b680 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f677b27770 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0e6bfff640 1 -- 172.21.15.114:0/31885609 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0f9003f050 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0e6bfff640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e640383f0 0x7f0e6403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0e6bfff640 1 -- 172.21.15.114:0/31885609 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0f90005030 con 0x55f677b1fa70 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e640383f0 0x7f0e6403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677b322d0 0x55f677b34760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.920+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b34eb0 con 0x55f677b322d0 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677b322d0 0x55f677b34760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e640383f0 0x7f0e6403a8b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55f677a05b10 tx=0x7f0f9401f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677b322d0 0x55f677b34760 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 realm 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b352c0 con 0x55f677b322d0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b35b90 con 0x55f677b322d0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.930 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b35f30 con 0x55f677b322d0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b36780 con 0x55f677b322d0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 20 searching for the correct realm 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f677b384f0 0x55f677b3a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f677b384f0 0x55f677b3a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f677b384f0 0x55f677b3a8e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.931 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f99b6b640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0f9003f390 0x7f0f900479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0f9003f390 0x7f0f900479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0f9003f390 0x7f0f900479c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55f67797a7f0 0x7f0f8c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.924+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55f67797a7f0 0x7f0f8c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:00.932 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55f67797a7f0 0x7f0f8c0b53d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f67797a7f0 2024-05-08T18:11:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f67797a7f0 2024-05-08T18:11:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.933 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.928+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f67797a7f0 2024-05-08T18:11:00.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f67797a7f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f677b322d0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0b3040 con 0x55f67797a7f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.932+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b384f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f67797a7f0 2024-05-08T18:11:00.944 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x55f677b322d0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3ae20 con 0x7f0f9003f390 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b37100 con 0x55f677b322d0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.945 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b379a0 con 0x55f677b322d0 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b36d40 con 0x55f677b322d0 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 zone default found 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 4 Realm: () 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 zonegroup default 2024-05-08T18:11:00.946 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3b280 con 0x55f67797a7f0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.936+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3cc90 con 0x55f677b384f0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3d100 con 0x55f677b384f0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.947 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 20 started sync module instance, tier type = 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3c100 con 0x7f0f9003f390 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94517058585840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3bd60 con 0x7f0f9003f390 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3e030 con 0x55f677b322d0 2024-05-08T18:11:00.948 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94517058585840] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94517058590048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3e030 con 0x55f677b322d0 2024-05-08T18:11:00.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.940+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3e9f0 con 0x55f677b384f0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94517058594112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3f240 con 0x55f677b384f0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3fc00 con 0x7f0f9003f390 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94517058590048] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94517058598736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b3fb70 con 0x7f0f9003f390 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b409b0 con 0x55f677b322d0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94517058594112] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.944+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94517058598736] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94517058596240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b40970 con 0x55f677b322d0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b41250 con 0x55f67797a7f0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94517058596240] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94517058600944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b40e20 con 0x55f67797a7f0 2024-05-08T18:11:00.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.948+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b417e0 con 0x55f67797a7f0 2024-05-08T18:11:00.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94517058600944] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94517058603856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b417e0 con 0x55f67797a7f0 2024-05-08T18:11:00.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b421a0 con 0x55f67797a7f0 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94517058608368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b425c0 con 0x55f67797a7f0 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=0 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=1 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=2 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=3 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=4 2024-05-08T18:11:00.954 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=5 2024-05-08T18:11:00.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94517058603856] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.955 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.952+0000 7f0f9c858980 20 add_watcher() i=6 2024-05-08T18:11:00.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94517058608368] v32'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 20 add_watcher() i=7 2024-05-08T18:11:00.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 2 all 8 watchers are set, enabling cache 2024-05-08T18:11:00.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b41330 con 0x55f677b322d0 2024-05-08T18:11:00.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.956 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94517058605872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b42b00 con 0x55f677b322d0 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94517058605872] v32'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0e517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 5 note: GC not initialized 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0e4b7fe640 20 reqs_thread_entry: start 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 20 init_complete bucket index max shards: 11 2024-05-08T18:11:00.958 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 20 Filter name: none 2024-05-08T18:11:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0e497fa640 20 reqs_thread_entry: start 2024-05-08T18:11:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:11:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 20 rados->read ofs=0 len=0 2024-05-08T18:11:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.956+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b69040 con 0x55f67797a7f0 2024-05-08T18:11:00.959 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T18:11:00.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:11:00.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:11:00.960 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b6f640 con 0x55f67797a7f0 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.960+0000 7f0f9c858980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94517058793648 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f677b6ad30 con 0x55f677b322d0 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94517058596240 notify 137438953502 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55f677a050d0 con 0x55f677b322d0 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0e7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94517058596240 notifier 4912 bl.length()=649 2024-05-08T18:11:00.963 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0e7dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0e7dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94517058793648 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0e7dffb640 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0e60003eb0 con 0x55f677b322d0 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== watch-notify(notify_complete (2) cookie 94517058793648 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f677a04be0 con 0x55f677b322d0 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:11:00.964 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0e517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:00.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94517058605872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b6b4f0 con 0x55f677b322d0 2024-05-08T18:11:00.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94517058605872] v32'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.965 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94517058585840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b6b4f0 con 0x7f0f9003f390 2024-05-08T18:11:00.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94517058585840] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9c858980 20 remove_watcher() i=0 2024-05-08T18:11:00.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9c858980 2 removed watcher, disabling cache 2024-05-08T18:11:00.966 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.964+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94517058590048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b6b4f0 con 0x55f677b322d0 2024-05-08T18:11:00.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.968+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94517058590048] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.968+0000 7f0f9c858980 20 remove_watcher() i=1 2024-05-08T18:11:00.968 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.968+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94517058594112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b6b4f0 con 0x55f677b384f0 2024-05-08T18:11:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.968+0000 7f0f99b6b640 1 -- 172.21.15.114:0/31885609 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94517058594112] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9003fd20 con 0x55f677b384f0 2024-05-08T18:11:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.968+0000 7f0f9c858980 20 remove_watcher() i=2 2024-05-08T18:11:00.970 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.968+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94517058598736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b66d40 con 0x7f0f9003f390 2024-05-08T18:11:00.971 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.972+0000 7f0f9ab6d640 1 -- 172.21.15.114:0/31885609 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94517058598736] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f9401f070 con 0x7f0f9003f390 2024-05-08T18:11:00.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.972+0000 7f0f9c858980 20 remove_watcher() i=3 2024-05-08T18:11:00.972 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.972+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94517058596240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b66d40 con 0x55f677b322d0 2024-05-08T18:11:00.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.972+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94517058596240] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f677b322d0 2024-05-08T18:11:00.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.972+0000 7f0f9c858980 20 remove_watcher() i=4 2024-05-08T18:11:00.973 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.972+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94517058600944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b66d40 con 0x55f67797a7f0 2024-05-08T18:11:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.976+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94517058600944] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.976+0000 7f0f9c858980 20 remove_watcher() i=5 2024-05-08T18:11:00.975 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.976+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94517058603856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b66d40 con 0x55f67797a7f0 2024-05-08T18:11:00.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.976+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94517058603856] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.976+0000 7f0f9c858980 20 remove_watcher() i=6 2024-05-08T18:11:00.978 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.976+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94517058608368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f677b66d40 con 0x55f67797a7f0 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94517058608368] v32'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f8c0f0040 con 0x55f67797a7f0 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 20 remove_watcher() i=7 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55f67797a7f0 msgr2=0x7f0f8c0b53d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x55f67797a7f0 0x7f0f8c0b53d0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677b322d0 msgr2=0x55f677b34760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677b322d0 0x55f677b34760 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.982 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0f9003f390 msgr2=0x7f0f900479c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f0f9003f390 0x7f0f900479c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f677b384f0 msgr2=0x55f677b3a8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55f677b384f0 0x55f677b3a8e0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e640383f0 msgr2=0x7f0e6403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e640383f0 0x7f0e6403a8b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55f677a05b10 tx=0x7f0f9401f000 comp rx=0 tx=0).stop 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 msgr2=0x55f677b26fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/31885609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b1fa70 0x55f677b26fa0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000dfb0 tx=0x7f0f9004f1e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 reap_dead start 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9a36c640 1 -- 172.21.15.114:0/31885609 reap_dead start 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 shutdown_connections 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 >> 172.21.15.114:0/31885609 conn(0x55f677b1bdb0 msgr2=0x55f677b19410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 shutdown_connections 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/31885609 wait complete. 2024-05-08T18:11:00.983 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e740384b0 msgr2=0x7f0e7403a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e740384b0 0x7f0e7403a970 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x55f677b02bf0 tx=0x7f0f94005850 comp rx=0 tx=0).stop 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 msgr2=0x55f677b12c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 0x55f677b12c00 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000d660 tx=0x7f0f9000da60 comp rx=0 tx=0).stop 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 shutdown_connections 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e740384b0 0x7f0e7403a970 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/1593713649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677b127e0 0x55f677b12c00 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 >> 172.21.15.114:0/1593713649 conn(0x55f677b075f0 msgr2=0x55f677b08100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 shutdown_connections 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/1593713649 wait complete. 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677aff8f0 msgr2=0x55f677b01ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677aff8f0 0x55f677b01ce0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e800383f0 msgr2=0x7f0e8003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e800383f0 0x7f0e8003a8b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0f90001d80 tx=0x7f0f900012e0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 msgr2=0x55f677a06420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:00.984 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 0x55f677a06420 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c01bb20 tx=0x7f0f8c018020 comp rx=0 tx=0).stop 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 shutdown_connections 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55f677aff8f0 0x55f677b01ce0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0e800383f0 0x7f0e8003a8b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 --2- 172.21.15.114:0/2832098597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f677a09100 0x55f677a06420 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 >> 172.21.15.114:0/2832098597 conn(0x55f677a006a0 msgr2=0x55f677aeb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 shutdown_connections 2024-05-08T18:11:00.985 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:00.980+0000 7f0f9c858980 1 -- 172.21.15.114:0/2832098597 wait complete. 2024-05-08T18:11:00.990 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.990 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:00.991 ERROR:root:0 2024-05-08T18:11:00.991 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:11:00.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T18:11:00.991 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T18:11:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:11:01.067 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:11:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27558c980 1 Processor -- start 2024-05-08T18:11:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27558c980 1 -- start start 2024-05-08T18:11:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27558c980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560b026c35c0 0x560b026c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27558c980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b02568710 con 0x560b026bf100 2024-05-08T18:11:01.068 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27558c980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x560b0257cf00 con 0x560b026c35c0 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27289f640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x560b026c35c0 0x560b026c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc2730a0640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x560b026bf100 0x560b026bf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:43558/0 (socket says 172.21.15.114:43558) 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc2730a0640 1 -- 172.21.15.114:0/1639753195 learned_addr learned my addr 172.21.15.114:0/1639753195 (peer_addr_for_me v1:172.21.15.114:0/0) 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27209e640 1 -- 172.21.15.114:0/1639753195 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234894402 0 0) 0x560b02568710 con 0x560b026bf100 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27209e640 1 -- 172.21.15.114:0/1639753195 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc260001e20 con 0x560b026bf100 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27289f640 1 -- 172.21.15.114:0/1639753195 >> v1:172.21.15.53:6789/0 conn(0x560b026bf100 legacy=0x560b026bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.069 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.068+0000 7fc27289f640 1 -- 172.21.15.114:0/1639753195 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b02544ae0 con 0x560b026c35c0 2024-05-08T18:11:01.071 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27289f640 1 --2- 172.21.15.114:0/1639753195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b026c59b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc26400a480 tx=0x7fc26401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51de9e401555d913 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27209e640 1 -- 172.21.15.114:0/1639753195 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640b0070 con 0x560b026c35c0 2024-05-08T18:11:01.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27209e640 1 -- 172.21.15.114:0/1639753195 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640ab540 con 0x560b026c35c0 2024-05-08T18:11:01.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27209e640 1 -- 172.21.15.114:0/1639753195 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640ab820 con 0x560b026c35c0 2024-05-08T18:11:01.072 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 -- 172.21.15.114:0/1639753195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 msgr2=0x560b026c59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 --2- 172.21.15.114:0/1639753195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b026c59b0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fc26400a480 tx=0x7fc26401b280 comp rx=0 tx=0).stop 2024-05-08T18:11:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 -- 172.21.15.114:0/1639753195 shutdown_connections 2024-05-08T18:11:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 --2- 172.21.15.114:0/1639753195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b026c59b0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 -- 172.21.15.114:0/1639753195 >> 172.21.15.114:0/1639753195 conn(0x560b026327e0 msgr2=0x560b02632bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 -- 172.21.15.114:0/1639753195 shutdown_connections 2024-05-08T18:11:01.073 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.072+0000 7fc27558c980 1 -- 172.21.15.114:0/1639753195 wait complete. 2024-05-08T18:11:01.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc27558c980 1 Processor -- start 2024-05-08T18:11:01.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc27558c980 1 -- start start 2024-05-08T18:11:01.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc27558c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 0x560b027a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.086 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc27558c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b025c0f80 con 0x560b026bf100 2024-05-08T18:11:01.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc2730a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 0x560b027a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc2730a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 0x560b027a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38446/0 (socket says 172.21.15.114:38446) 2024-05-08T18:11:01.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.084+0000 7fc2730a0640 1 -- 172.21.15.114:0/4212276689 learned_addr learned my addr 172.21.15.114:0/4212276689 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:01.087 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 -- 172.21.15.114:0/4212276689 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b02588da0 con 0x560b026bf100 2024-05-08T18:11:01.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 --2- 172.21.15.114:0/4212276689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 0x560b027a9fe0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc25c001e40 tx=0x7fc25c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51954a46fa2b27ce server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc16160a640 1 -- 172.21.15.114:0/4212276689 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c012020 con 0x560b026bf100 2024-05-08T18:11:01.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc16160a640 1 -- 172.21.15.114:0/4212276689 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c00e690 con 0x560b026bf100 2024-05-08T18:11:01.088 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc16160a640 1 -- 172.21.15.114:0/4212276689 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c00e9b0 con 0x560b026bf100 2024-05-08T18:11:01.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/4212276689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 msgr2=0x560b027a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 --2- 172.21.15.114:0/4212276689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 0x560b027a9fe0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fc25c001e40 tx=0x7fc25c00b790 comp rx=0 tx=0).stop 2024-05-08T18:11:01.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/4212276689 shutdown_connections 2024-05-08T18:11:01.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 --2- 172.21.15.114:0/4212276689 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026bf100 0x560b027a9fe0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/4212276689 >> 172.21.15.114:0/4212276689 conn(0x560b026327e0 msgr2=0x560b027a5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:01.089 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/4212276689 shutdown_connections 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/4212276689 wait complete. 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 Processor -- start 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- start start 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b027b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b026c89e0 con 0x560b026c35c0 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b027b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b027b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38458/0 (socket says 172.21.15.114:38458) 2024-05-08T18:11:01.090 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 -- 172.21.15.114:0/1501539698 learned_addr learned my addr 172.21.15.114:0/1501539698 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b027b1b90 con 0x560b026c35c0 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc2730a0640 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b027b1650 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x560b027aae70 tx=0x7fc25c0040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc15fe07640 1 -- 172.21.15.114:0/1501539698 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c012030 con 0x560b026c35c0 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b027b1e20 con 0x560b026c35c0 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc15fe07640 1 -- 172.21.15.114:0/1501539698 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc25c01a6d0 con 0x560b026c35c0 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc15fe07640 1 -- 172.21.15.114:0/1501539698 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc25c01a9d0 con 0x560b026c35c0 2024-05-08T18:11:01.091 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.088+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b027b4b00 con 0x560b026c35c0 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc15fe07640 1 -- 172.21.15.114:0/1501539698 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc25c015020 con 0x560b026c35c0 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc15fe07640 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1580383f0 0x7fc15803a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc15fe07640 1 -- 172.21.15.114:0/1501539698 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc25c020070 con 0x560b026c35c0 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27289f640 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1580383f0 0x7fc15803a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027b65d0 0x560b027b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027b8fe0 con 0x560b027b65d0 2024-05-08T18:11:01.093 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027b65d0 0x560b027b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27289f640 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1580383f0 0x7fc15803a8b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2640ad000 tx=0x7fc2640a5040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027b65d0 0x560b027b89c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 -- 172.21.15.114:0/1501539698 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc26c00a4d0 con 0x560b027b65d0 2024-05-08T18:11:01.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027b5d20 con 0x560b027b65d0 2024-05-08T18:11:01.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 -- 172.21.15.114:0/1501539698 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc26c00a4d0 con 0x560b027b65d0 2024-05-08T18:11:01.094 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027bae30 con 0x560b027b65d0 2024-05-08T18:11:01.095 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 -- 172.21.15.114:0/1501539698 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc26c00a4d0 con 0x560b027b65d0 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027b9fa0 con 0x560b027b65d0 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 -- 172.21.15.114:0/1501539698 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc26c00a4d0 con 0x560b027b65d0 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ba3f0 con 0x560b027b65d0 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.092+0000 7fc2738a1640 1 -- 172.21.15.114:0/1501539698 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc26c00a4d0 con 0x560b027b65d0 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 Processor -- start 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 -- start start 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 0x560b027c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b025c4fc0 con 0x560b027c9760 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27289f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 0x560b027c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27289f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 0x560b027c9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38460/0 (socket says 172.21.15.114:38460) 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27289f640 1 -- 172.21.15.114:0/1508883005 learned_addr learned my addr 172.21.15.114:0/1508883005 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:01.096 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27289f640 1 -- 172.21.15.114:0/1508883005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b027ca0c0 con 0x560b027c9760 2024-05-08T18:11:01.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27289f640 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 0x560b027c9b80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc264017e90 tx=0x7fc264018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc15d602640 1 -- 172.21.15.114:0/1508883005 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640b0040 con 0x560b027c9760 2024-05-08T18:11:01.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b027cab60 con 0x560b027c9760 2024-05-08T18:11:01.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc15d602640 1 -- 172.21.15.114:0/1508883005 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640c6070 con 0x560b027c9760 2024-05-08T18:11:01.098 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc15d602640 1 -- 172.21.15.114:0/1508883005 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640b7530 con 0x560b027c9760 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b027cafd0 con 0x560b027c9760 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc15d602640 1 -- 172.21.15.114:0/1508883005 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc2640b76d0 con 0x560b027c9760 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc15d602640 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc14c0383f0 0x7fc14c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc15d602640 1 -- 172.21.15.114:0/1508883005 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc2640a8070 con 0x560b027c9760 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc2738a1640 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc14c0383f0 0x7fc14c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 Processor -- start 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 -- start start 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc2738a1640 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc14c0383f0 0x7fc14c03a8b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x560b027b9ac0 tx=0x7fc26c005850 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027d6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.099 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.096+0000 7fc27558c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b027aa730 con 0x560b027d67d0 2024-05-08T18:11:01.101 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027d6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027d6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38476/0 (socket says 172.21.15.114:38476) 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 -- 172.21.15.114:0/1770278036 learned_addr learned my addr 172.21.15.114:0/1770278036 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 -- 172.21.15.114:0/1770278036 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b027d71c0 con 0x560b027d67d0 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 --2- 172.21.15.114:0/1770278036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027d6bf0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc2640e9e00 tx=0x7fc2640b5b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e112bc81a93860 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc156ffd640 1 -- 172.21.15.114:0/1770278036 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640db070 con 0x560b027d67d0 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc156ffd640 1 -- 172.21.15.114:0/1770278036 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640b53d0 con 0x560b027d67d0 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc156ffd640 1 -- 172.21.15.114:0/1770278036 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640b79c0 con 0x560b027d67d0 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- 172.21.15.114:0/1770278036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 msgr2=0x560b027d6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 --2- 172.21.15.114:0/1770278036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027d6bf0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fc2640e9e00 tx=0x7fc2640b5b20 comp rx=0 tx=0).stop 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- 172.21.15.114:0/1770278036 shutdown_connections 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 --2- 172.21.15.114:0/1770278036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027d6bf0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.102 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- 172.21.15.114:0/1770278036 >> 172.21.15.114:0/1770278036 conn(0x560b027d2b60 msgr2=0x560b027d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- 172.21.15.114:0/1770278036 shutdown_connections 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- 172.21.15.114:0/1770278036 wait complete. 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 Processor -- start 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- start start 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27558c980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x560b027d78b0 con 0x560b027d67d0 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027ddcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:38484/0 (socket says 172.21.15.114:38484) 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 learned_addr learned my addr 172.21.15.114:0/2551416998 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:11:01.103 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b027de230 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc27289f640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027ddcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cd030 tx=0x7fc2640e9d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.100+0000 7fc1557fa640 1 -- 172.21.15.114:0/2551416998 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2640f0070 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b027de4c0 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc1557fa640 1 -- 172.21.15.114:0/2551416998 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2640e8380 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc1557fa640 1 -- 172.21.15.114:0/2551416998 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc264006390 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b027e11a0 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc1557fa640 1 -- 172.21.15.114:0/2551416998 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc2640f3070 con 0x560b027d67d0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc1557fa640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc13c0383f0 0x7fc13c03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.109 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc1557fa640 1 -- 172.21.15.114:0/2551416998 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc2640f6d50 con 0x560b027d67d0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2738a1640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc13c0383f0 0x7fc13c03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027e9220 0x560b027eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ebe00 con 0x560b027e9220 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027e9220 0x560b027eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2738a1640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc13c0383f0 0x7fc13c03a8b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x560b027b5c70 tx=0x7fc26c01f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027e9220 0x560b027eb6b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 realm 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ec210 con 0x560b027e9220 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.110 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ecae0 con 0x560b027e9220 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ece80 con 0x560b027e9220 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:11:01.111 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 20 searching for the correct realm 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560b027ef440 0x560b027f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027f1d70 con 0x560b027ef440 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27289f640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560b027ef440 0x560b027f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.104+0000 7fc27289f640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560b027ef440 0x560b027f1830 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc27289f640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc2640f5060 0x7fc2640aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027f1d70 con 0x7fc2640f5060 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc2640f5060 0x7fc2640aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc2640f5060 0x7fc2640aa950 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027f1d70 con 0x7fc2640f5060 2024-05-08T18:11:01.112 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027f1d70 con 0x560b027e9220 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc25c017050 0x7fc25c02c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc25c017050 0x7fc25c02c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:11:01.113 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc25c017050 0x7fc25c02c790 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:11:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc2640f5060 2024-05-08T18:11:01.121 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.108+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc2640f5060 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc2640f5060 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.122 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.112+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.123 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc2640f5060 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc2640f5060 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.124 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027ef440 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc25c017050 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x560b027e9220 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560b027ed6d0 con 0x7fc2640f5060 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:11:01.125 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.116+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027edf20 con 0x560b027e9220 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ee2c0 con 0x560b027e9220 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027ee2c0 con 0x560b027e9220 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 zone default found 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 4 Realm: () 2024-05-08T18:11:01.126 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 zonegroup default 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027eeb90 con 0x7fc25c017050 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027eeb90 con 0x560b027ef440 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027f3c80 con 0x560b027ef440 2024-05-08T18:11:01.127 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:11:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 started sync module instance, tier type = 2024-05-08T18:11:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:11:01.128 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f3020 con 0x7fc2640f5060 2024-05-08T18:11:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94605286519872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f2c80 con 0x7fc2640f5060 2024-05-08T18:11:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.120+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f4bb0 con 0x560b027e9220 2024-05-08T18:11:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94605286519872] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.130 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94605286523104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f4bb0 con 0x560b027e9220 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f55c0 con 0x560b027ef440 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94605286523104] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94605286524672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f4b20 con 0x560b027ef440 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.124+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f6300 con 0x7fc2640f5060 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94605286530576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f6ba0 con 0x7fc2640f5060 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f75c0 con 0x560b027e9220 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94605286530576] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94605286524672] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94605286535344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f66f0 con 0x560b027e9220 2024-05-08T18:11:01.131 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.128+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f7e90 con 0x7fc25c017050 2024-05-08T18:11:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94605286535344] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94605286529376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f66f0 con 0x7fc25c017050 2024-05-08T18:11:01.132 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f8340 con 0x7fc25c017050 2024-05-08T18:11:01.133 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94605286529376] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94605286537264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f8300 con 0x7fc25c017050 2024-05-08T18:11:01.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.132+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f8d40 con 0x7fc25c017050 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(58 notify.7 [create] v32'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94605286537264] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94605286541328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f8f20 con 0x7fc25c017050 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=0 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=1 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=2 2024-05-08T18:11:01.136 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=3 2024-05-08T18:11:01.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=4 2024-05-08T18:11:01.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=5 2024-05-08T18:11:01.137 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=6 2024-05-08T18:11:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94605286541328] v32'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 20 add_watcher() i=7 2024-05-08T18:11:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 2 all 8 watchers are set, enabling cache 2024-05-08T18:11:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.136+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b027fc2f0 con 0x560b027e9220 2024-05-08T18:11:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.139 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94605286542864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b027f96e0 con 0x560b027e9220 2024-05-08T18:11:01.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94605286542864] v32'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc25c008030 con 0x560b027e9220 2024-05-08T18:11:01.140 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 5 note: GC not initialized 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc128fe1640 20 reqs_thread_entry: start 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 20 init_complete bucket index max shards: 11 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 20 Filter name: none 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc0a27fc640 20 reqs_thread_entry: start 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 20 rados->read ofs=0 len=0 2024-05-08T18:11:01.141 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b0281fba0 con 0x7fc25c017050 2024-05-08T18:11:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fc25c008030 con 0x7fc25c017050 2024-05-08T18:11:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T18:11:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T18:11:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T18:11:01.142 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.140+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b028264a0 con 0x7fc25c017050 2024-05-08T18:11:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x7fc25c017050 2024-05-08T18:11:01.144 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc27558c980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc27558c980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc27558c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94605286727440 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560b02821bb0 con 0x560b027e9220 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== watch-notify(notify (1) cookie 94605286535344 notify 137438953503 ret 0) ==== 691+0+0 (crc 0 0 0) 0x560b027b4b00 con 0x560b027e9220 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc156ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94605286535344 notifier 4919 bl.length()=649 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc156ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc156ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(64 notify.4 [notify cookie 94605286727440 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc25c06c040 con 0x560b027e9220 2024-05-08T18:11:01.145 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc156ffd640 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc138003eb0 con 0x560b027e9220 2024-05-08T18:11:01.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== watch-notify(notify_complete (2) cookie 94605286727440 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560b027b1e20 con 0x560b027e9220 2024-05-08T18:11:01.146 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x560b027e9220 2024-05-08T18:11:01.146 INFO:teuthology.orchestra.run.smithi114.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T18:10:58.522723Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T18:10:58.522705Z","tags":[],"group_ids":[]} 2024-05-08T18:11:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:11:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.144+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94605286542864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b02822370 con 0x560b027e9220 2024-05-08T18:11:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94605286542864] v32'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x560b027e9220 2024-05-08T18:11:01.147 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94605286519872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b02822370 con 0x7fc2640f5060 2024-05-08T18:11:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94605286519872] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc27558c980 20 remove_watcher() i=0 2024-05-08T18:11:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc27558c980 2 removed watcher, disabling cache 2024-05-08T18:11:01.148 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94605286523104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b02822370 con 0x560b027e9220 2024-05-08T18:11:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94605286523104] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x560b027e9220 2024-05-08T18:11:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc27558c980 20 remove_watcher() i=1 2024-05-08T18:11:01.150 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.148+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94605286524672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b02822370 con 0x560b027ef440 2024-05-08T18:11:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.152+0000 7fc27289f640 1 -- 172.21.15.114:0/2551416998 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94605286524672] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2640f2030 con 0x560b027ef440 2024-05-08T18:11:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.152+0000 7fc27558c980 20 remove_watcher() i=2 2024-05-08T18:11:01.152 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.152+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94605286530576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0281d8a0 con 0x7fc2640f5060 2024-05-08T18:11:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.152+0000 7fc2738a1640 1 -- 172.21.15.114:0/2551416998 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94605286530576] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc26c01f070 con 0x7fc2640f5060 2024-05-08T18:11:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.152+0000 7fc27558c980 20 remove_watcher() i=3 2024-05-08T18:11:01.153 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.152+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94605286535344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0281d8a0 con 0x560b027e9220 2024-05-08T18:11:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.156+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94605286535344] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x560b027e9220 2024-05-08T18:11:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.156+0000 7fc27558c980 20 remove_watcher() i=4 2024-05-08T18:11:01.155 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.156+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94605286529376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0281d8a0 con 0x7fc25c017050 2024-05-08T18:11:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.156+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94605286529376] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x7fc25c017050 2024-05-08T18:11:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.156+0000 7fc27558c980 20 remove_watcher() i=5 2024-05-08T18:11:01.157 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.156+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94605286537264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0281d8a0 con 0x7fc25c017050 2024-05-08T18:11:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94605286537264] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x7fc25c017050 2024-05-08T18:11:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 20 remove_watcher() i=6 2024-05-08T18:11:01.159 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94605286541328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560b0281d8a0 con 0x7fc25c017050 2024-05-08T18:11:01.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94605286541328] v32'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc25c06c040 con 0x7fc25c017050 2024-05-08T18:11:01.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 20 remove_watcher() i=7 2024-05-08T18:11:01.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc25c017050 msgr2=0x7fc25c02c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.163 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7fc25c017050 0x7fc25c02c790 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027e9220 msgr2=0x560b027eb6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027e9220 0x560b027eb6b0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc2640f5060 msgr2=0x7fc2640aa950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7fc2640f5060 0x7fc2640aa950 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560b027ef440 msgr2=0x560b027f1830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x560b027ef440 0x560b027f1830 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc13c0383f0 msgr2=0x7fc13c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc13c0383f0 0x7fc13c03a8b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x560b027b5c70 tx=0x7fc26c01f000 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 msgr2=0x560b027ddcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc2730a0640 1 -- 172.21.15.114:0/2551416998 reap_dead start 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027ddcf0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fc2640cd030 tx=0x7fc2640e9d60 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 shutdown_connections 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/2551416998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027d67d0 0x560b027ddcf0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 >> 172.21.15.114:0/2551416998 conn(0x560b027d2b60 msgr2=0x560b027d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:01.164 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 shutdown_connections 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/2551416998 wait complete. 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc14c0383f0 msgr2=0x7fc14c03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc14c0383f0 0x7fc14c03a8b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x560b027b9ac0 tx=0x7fc26c005850 comp rx=0 tx=0).stop 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 msgr2=0x560b027c9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 0x560b027c9b80 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fc264017e90 tx=0x7fc264018020 comp rx=0 tx=0).stop 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 shutdown_connections 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc14c0383f0 0x7fc14c03a8b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1508883005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b027c9760 0x560b027c9b80 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 >> 172.21.15.114:0/1508883005 conn(0x560b027be570 msgr2=0x560b027bf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 shutdown_connections 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1508883005 wait complete. 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027b65d0 msgr2=0x560b027b89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.165 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027b65d0 0x560b027b89c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1580383f0 msgr2=0x7fc15803a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1580383f0 0x7fc15803a8b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2640ad000 tx=0x7fc2640a5040 comp rx=0 tx=0).stop 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 msgr2=0x560b027b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b027b1650 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x560b027aae70 tx=0x7fc25c0040f0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 shutdown_connections 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.160+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x560b027b65d0 0x560b027b89c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.164+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1580383f0 0x7fc15803a8b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.164+0000 7fc27558c980 1 --2- 172.21.15.114:0/1501539698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560b026c35c0 0x560b027b1650 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.164+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 >> 172.21.15.114:0/1501539698 conn(0x560b026327e0 msgr2=0x560b027a4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.164+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 shutdown_connections 2024-05-08T18:11:01.166 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:11:01.164+0000 7fc27558c980 1 -- 172.21.15.114:0/1501539698 wait complete. 2024-05-08T18:11:01.171 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:01.172 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T18:10:58.522723Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T18:10:58.522705Z', 'tags': [], 'group_ids': []} 2024-05-08T18:11:01.172 ERROR:root:0 2024-05-08T18:11:01.172 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T18:11:01.179 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.179 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.183 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.183 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T18:11:01.188 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.189 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.193 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.193 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-08T18:11:01.203 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-08T18:11:01.203 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.207 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.207 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-08T18:11:01.215 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.215 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.218 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.218 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-08T18:11:01.226 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-08T18:11:01.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.230 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.234 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-08T18:11:01.243 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-08T18:11:01.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.247 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.248 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-08T18:11:01.255 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.255 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.258 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.259 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-08T18:11:01.264 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.267 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.268 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-08T18:11:01.276 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.279 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.280 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.283 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:11:01.284 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T18:11:01.289 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:11:01.307 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T18:11:01.311 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-08T18:11:01.311 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:11:01.317 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:11:01.300483Z', 'creation_time': '2024-05-08T18:11:01.295862Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:11:01.317 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T18:11:01.323 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:11:01.300483Z', 'creation_time': '2024-05-08T18:11:01.295862Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T18:11:01.328 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:11:01.333 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:11:01.300483Z', 'creation_time': '2024-05-08T18:11:01.295862Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:11:01.334 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-08T18:11:01.338 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx0000003b587a2f6e1e392-00663bc035-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:11:01.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-08T18:11:01.353 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-08T18:11:01.366 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:11:01.420 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11'} 2024-05-08T18:11:01.443 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.450 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11'} 2024-05-08T18:11:01.472 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.472 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-08T18:11:01.493 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.506 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-08T18:11:01.520 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:11:01.520 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T18:11:01.527 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '50b0c397-f53b-4292-89b3-02a592fb10e2', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'marker': 'e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T18:11:01.460440Z', 'creation_time': '2024-05-08T18:11:01.295862Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T18:12:01.645 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-08T18:12:01.680 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.680 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-08T18:12:01.710 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.711 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T18:12:01.716 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.717 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-08T18:12:01.722 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.722 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-08T18:12:01.728 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.728 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-08T18:12:01.734 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.734 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-08T18:12:01.742 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-05-08T18:00:00.000000Z', 'epoch': 1715191200, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-05-08T18:12:01.742 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-08T18:12:01.753 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:12:01.754 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T18:12:01.759 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-08T18:12:01.759 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T18:12:01.775 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:12:01.780 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T18:12:01.796 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:12:02.157 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T18:12:02.164 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000fcba48a5610985b5-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T18:12:02.361 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T18:12:02.373 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T18:12:02.379 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T18:12:02.531 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-08T18:12:02.624 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:12:02.625 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T18:12:02.635 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-08T18:12:02.635 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T18:12:02.645 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T18:12:02.669 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T18:12:02.675 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000afe4e9f6fbe7c802-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.722 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-08T18:12:02.798 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:12:02.798 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T18:12:02.804 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000008a57055304e35c6f-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.804 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-08T18:12:02.808 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'a49ba316-612d-4e74-b7c0-c89e2b4be23c'}]}} 2024-05-08T18:12:02.808 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-08T18:12:02.831 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T18:12:02.832 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T18:12:02.837 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:12:02.837 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-08T18:12:02.843 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000bb0b33784c965761-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.844 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-08T18:12:02.848 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000da7512d30e7cda8f-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.873 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T18:12:02.878 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:12:02.878 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-08T18:12:02.883 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000186cfb11d3fb23e8-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.884 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-08T18:12:02.888 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000004a41539d64ad16ca-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.888 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-08T18:12:02.893 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T18:12:02.894 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-08T18:12:02.898 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000008af0d9d0e9174379-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.898 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-08T18:12:02.902 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000ff440cb91c327218-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.902 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-08T18:12:02.906 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000009abde689e7dfac28-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.907 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-08T18:12:02.911 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000bcb7ff8e34f89975-00663bc072-4226-default', 'HostId': '4226-default-default'} 2024-05-08T18:12:02.911 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-08T18:12:02.931 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:12:02.931 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T18:12:02.935 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-08T18:12:02.936 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-08T18:12:02.945 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:12:02.945 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T18:12:02.950 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-08T18:12:02.950 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-08T18:12:02.960 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T18:12:02.966 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-08T18:12:02.986 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-08T18:12:02.987 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:12:02.988 INFO:tasks.rgw.client.0.smithi114.stdout:2024-05-08T18:12:02.987+0000 7ff05137b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 28563) UID: 0 2024-05-08T18:12:02.988 INFO:tasks.rgw.client.0.smithi114.stdout:2024-05-08T18:12:02.987+0000 7ff054bc3a40 -1 shutting down 2024-05-08T18:12:05.249 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-08T18:12:09.088 INFO:tasks.rgw.client.0:Stopped 2024-05-08T18:12:09.089 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-08T18:12:09.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/vault-root-token 2024-05-08T18:12:09.151 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-08T18:12:09.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-08T18:12:09.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-08T18:12:09.205 DEBUG:teuthology.orchestra.run.smithi114:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-08T18:12:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setuser ceph since I am not root 2024-05-08T18:12:09.280 INFO:teuthology.orchestra.run.smithi114.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T18:12:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3cceca7980 1 Processor -- start 2024-05-08T18:12:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3cceca7980 1 -- start start 2024-05-08T18:12:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3cceca7980 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7f641bf50 0x55d7f64aab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3cceca7980 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d7f6353710 con 0x55d7f64ab0a0 2024-05-08T18:12:09.281 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3cceca7980 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x55d7f6367f00 con 0x55d7f641bf50 2024-05-08T18:12:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3ccc7bb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7f641bf50 0x55d7f64aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3ccc7bb640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x55d7f641bf50 0x55d7f64aab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:46684/0 (socket says 172.21.15.114:46684) 2024-05-08T18:12:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/312043497 learned_addr learned my addr 172.21.15.114:0/312043497 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:12:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.279+0000 7f3ccbfba640 1 --1- 172.21.15.114:0/312043497 >> v1:172.21.15.53:6789/0 conn(0x55d7f64ab0a0 0x55d7f64ad490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.114:37798/0 (socket says 172.21.15.114:37798) 2024-05-08T18:12:09.282 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.283+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/312043497 >> v1:172.21.15.53:6789/0 conn(0x55d7f64ab0a0 legacy=0x55d7f64ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.283 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.283+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/312043497 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f632fae0 con 0x55d7f641bf50 2024-05-08T18:12:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.283+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/312043497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64aab60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00a4e0 tx=0x7f3cbc01af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c644439440091d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.283+0000 7f3ccb7b9640 1 -- 172.21.15.114:0/312043497 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc0a3e60 con 0x55d7f641bf50 2024-05-08T18:12:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.283+0000 7f3ccb7b9640 1 -- 172.21.15.114:0/312043497 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0a7070 con 0x55d7f641bf50 2024-05-08T18:12:09.285 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.283+0000 7f3ccb7b9640 1 -- 172.21.15.114:0/312043497 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc0ab540 con 0x55d7f641bf50 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 -- 172.21.15.114:0/312043497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 msgr2=0x55d7f64aab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 --2- 172.21.15.114:0/312043497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64aab60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00a4e0 tx=0x7f3cbc01af20 comp rx=0 tx=0).stop 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 -- 172.21.15.114:0/312043497 shutdown_connections 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 --2- 172.21.15.114:0/312043497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64aab60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 -- 172.21.15.114:0/312043497 >> 172.21.15.114:0/312043497 conn(0x55d7f64a2640 msgr2=0x55d7f64a4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 -- 172.21.15.114:0/312043497 shutdown_connections 2024-05-08T18:12:09.286 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.287+0000 7f3cceca7980 1 -- 172.21.15.114:0/312043497 wait complete. 2024-05-08T18:12:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 Processor -- start 2024-05-08T18:12:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- start start 2024-05-08T18:12:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7f63abf80 con 0x55d7f641bf50 2024-05-08T18:12:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3ccc7bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64a82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.308 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3ccc7bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64a82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:46694/0 (socket says 172.21.15.114:46694) 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/1241974069 learned_addr learned my addr 172.21.15.114:0/1241974069 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/1241974069 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f6373da0 con 0x55d7f641bf50 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/1241974069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64a82c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc018b50 tx=0x7f3cbc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370bbb61ea480c17 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3bba60c640 1 -- 172.21.15.114:0/1241974069 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc0ab540 con 0x55d7f641bf50 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3bba60c640 1 -- 172.21.15.114:0/1241974069 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0ab6e0 con 0x55d7f641bf50 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3bba60c640 1 -- 172.21.15.114:0/1241974069 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc0ab9e0 con 0x55d7f641bf50 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- 172.21.15.114:0/1241974069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 msgr2=0x55d7f64a82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1241974069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64a82c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc018b50 tx=0x7f3cbc0033b0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- 172.21.15.114:0/1241974069 shutdown_connections 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1241974069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f64a82c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- 172.21.15.114:0/1241974069 >> 172.21.15.114:0/1241974069 conn(0x55d7f64a2640 msgr2=0x55d7f658ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- 172.21.15.114:0/1241974069 shutdown_connections 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- 172.21.15.114:0/1241974069 wait complete. 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 Processor -- start 2024-05-08T18:12:09.309 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- start start 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f659c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.303+0000 7f3cceca7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7f64af6c0 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccc7bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f659c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccc7bb640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f659c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:46706/0 (socket says 172.21.15.114:46706) 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/1641050171 learned_addr learned my addr 172.21.15.114:0/1641050171 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f659c950 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f659c410 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc01b7c0 tx=0x7f3cbc017cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3bb8e09640 1 -- 172.21.15.114:0/1641050171 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc0c3020 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7f659cbe0 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3bb8e09640 1 -- 172.21.15.114:0/1641050171 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc0bf7b0 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3bb8e09640 1 -- 172.21.15.114:0/1641050171 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cbc0bfab0 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f659f870 con 0x55d7f641bf50 2024-05-08T18:12:09.310 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3bb8e09640 1 -- 172.21.15.114:0/1641050171 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3cbc0c6020 con 0x55d7f641bf50 2024-05-08T18:12:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3bb8e09640 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3bb40383f0 0x7f3bb403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3bb8e09640 1 -- 172.21.15.114:0/1641050171 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f3cbc0ba040 con 0x55d7f641bf50 2024-05-08T18:12:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3bb40383f0 0x7f3bb403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f64ab0a0 0x55d7f65a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65a3a00 con 0x55d7f64ab0a0 2024-05-08T18:12:09.313 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f64ab0a0 0x55d7f65a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3bb40383f0 0x7f3bb403a8b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4001ec0 tx=0x7f3cb40015c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.307+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f64ab0a0 0x55d7f65a34c0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cccfbc640 1 -- 172.21.15.114:0/1641050171 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cc40083f0 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65a0a70 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cccfbc640 1 -- 172.21.15.114:0/1641050171 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3cc40083f0 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65a5830 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cccfbc640 1 -- 172.21.15.114:0/1641050171 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3cc40083f0 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65a4a60 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cccfbc640 1 -- 172.21.15.114:0/1641050171 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3cc40083f0 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65a4e80 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cccfbc640 1 -- 172.21.15.114:0/1641050171 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [call out=48b,read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3cc40083f0 con 0x55d7f64ab0a0 2024-05-08T18:12:09.314 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 Processor -- start 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 -- start start 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 0x55d7f65b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3cceca7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7f63affc0 con 0x55d7f65b41a0 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3ccbfba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 0x55d7f65b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3ccbfba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 0x55d7f65b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:46722/0 (socket says 172.21.15.114:46722) 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3475047011 learned_addr learned my addr 172.21.15.114:0/3475047011 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:12:09.315 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3475047011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f65b4b00 con 0x55d7f65b41a0 2024-05-08T18:12:09.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.311+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 0x55d7f65b45c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400e6f0 tx=0x7f3cb400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3bb1ffb640 1 -- 172.21.15.114:0/3475047011 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb4022070 con 0x55d7f65b41a0 2024-05-08T18:12:09.316 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3bb1ffb640 1 -- 172.21.15.114:0/3475047011 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb401b4b0 con 0x55d7f65b41a0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7f65b55a0 con 0x55d7f65b41a0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3bb1ffb640 1 -- 172.21.15.114:0/3475047011 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb401b7d0 con 0x55d7f65b41a0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f65b5a70 con 0x55d7f65b41a0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3bb1ffb640 1 -- 172.21.15.114:0/3475047011 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3cb4025070 con 0x55d7f65b41a0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3bb1ffb640 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ba4038440 0x7f3ba403a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3bb1ffb640 1 -- 172.21.15.114:0/3475047011 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f3cb404ff40 con 0x55d7f65b41a0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ba4038440 0x7f3ba403a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cceca7980 1 Processor -- start 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cceca7980 1 -- start start 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ba4038440 0x7f3ba403a900 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55d7f65a4e00 tx=0x7f3cc4003070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cceca7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.317 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3cceca7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7f64a8950 con 0x55d7f65c13a0 2024-05-08T18:12:09.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3ccbfba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3ccbfba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:46730/0 (socket says 172.21.15.114:46730) 2024-05-08T18:12:09.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3501428790 learned_addr learned my addr 172.21.15.114:0/3501428790 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:12:09.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.315+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3501428790 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f65c1d90 con 0x55d7f65c13a0 2024-05-08T18:12:09.319 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/3501428790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c17c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3cb404e280 tx=0x7f3cb4024870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef334f5366707022 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3bab7fe640 1 -- 172.21.15.114:0/3501428790 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb403e620 con 0x55d7f65c13a0 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3bab7fe640 1 -- 172.21.15.114:0/3501428790 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb403d070 con 0x55d7f65c13a0 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3bab7fe640 1 -- 172.21.15.114:0/3501428790 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb401b970 con 0x55d7f65c13a0 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- 172.21.15.114:0/3501428790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 msgr2=0x55d7f65c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3501428790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c17c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f3cb404e280 tx=0x7f3cb4024870 comp rx=0 tx=0).stop 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- 172.21.15.114:0/3501428790 shutdown_connections 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3501428790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c17c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- 172.21.15.114:0/3501428790 >> 172.21.15.114:0/3501428790 conn(0x55d7f65bd730 msgr2=0x55d7f65bb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- 172.21.15.114:0/3501428790 shutdown_connections 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- 172.21.15.114:0/3501428790 wait complete. 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 Processor -- start 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- start start 2024-05-08T18:12:09.320 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.321 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x55d7f65c24e0 con 0x55d7f65c13a0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ccbfba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ccbfba640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.114:46734/0 (socket says 172.21.15.114:46734) 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 learned_addr learned my addr 172.21.15.114:0/3649126182 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7f65c8e40 con 0x55d7f65c13a0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c8900 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40248b0 tx=0x7f3cb4024f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ba9ffb640 1 -- 172.21.15.114:0/3649126182 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb401bdb0 con 0x55d7f65c13a0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ba9ffb640 1 -- 172.21.15.114:0/3649126182 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb403e830 con 0x55d7f65c13a0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3ba9ffb640 1 -- 172.21.15.114:0/3649126182 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3cb403eb10 con 0x55d7f65c13a0 2024-05-08T18:12:09.322 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.319+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7f65c8e40 con 0x55d7f65c13a0 2024-05-08T18:12:09.323 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7f65c8e40 con 0x55d7f65c13a0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ba9ffb640 1 -- 172.21.15.114:0/3649126182 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3cb403ecb0 con 0x55d7f65c13a0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ba9ffb640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3b9c038440 0x7f3b9c03a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ba9ffb640 1 -- 172.21.15.114:0/3649126182 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f3cb4031d10 con 0x55d7f65c13a0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3b9c038440 0x7f3b9c03a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f65d39a0 0x55d7f65d5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d65b0 con 0x55d7f65d39a0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f65d39a0 0x55d7f65d5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3b9c038440 0x7f3b9c03a900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400f010 tx=0x7f3cc401b070 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f65d39a0 0x55d7f65d5e60 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 realm 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d6a10 con 0x55d7f65d39a0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d72b0 con 0x55d7f65d39a0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.327 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d7650 con 0x55d7f65d39a0 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:5 5.1d 5:bb63a6b0:::zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d7ea0 con 0x55d7f65d39a0 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 5 ==== osd_op_reply(5 zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 20 searching for the correct realm 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7f65d9c10 0x55d7f65dc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.323+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7f65d9c10 0x55d7f65dc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.328 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7f65d9c10 0x55d7f65dc000 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccbfba640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f3cb4027060 0x7f3cb404f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f3cb4027060 0x7f3cb404f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.330 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3cccfbc640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f3cb4027060 0x7f3cb404f460 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 6 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 7 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3cbc0c8030 0x7f3cbc0ac8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3cbc0c8030 0x7f3cbc0ac8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.327+0000 7f3ccc7bb640 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3cbc0c8030 0x7f3cbc0ac8c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.331 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 8 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 9 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 5 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.334 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.335 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.331+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 3 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.337 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=137b] v32'3 uv2 ondisk = 1) ==== 144+0+137 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 4 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 6 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 12 ==== osd_op_reply(29 [pgnls start_epoch 32 out=107b] v32'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.338 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.341 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=82b] v32'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.335+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d9c10 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cbc0c8030 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x55d7f65d39a0 2024-05-08T18:12:09.342 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 13 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc540 con 0x7f3cb4027060 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got zone_info.e99f9810-9b3d-4ce9-95f6-943c8fddbc84 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got period_config.default 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d87f0 con 0x55d7f65d39a0 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:12:09.343 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d9040 con 0x55d7f65d39a0 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:40 5.19 5:99428584:::zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65d8430 con 0x55d7f65d39a0 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 16 ==== osd_op_reply(40 zonegroup_info.50b0c397-f53b-4292-89b3-02a592fb10e2 [read 0~436 out=436b] v0'0 uv2 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 zone default found 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 4 Realm: () 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 4 ZoneGroup: default (50b0c397-f53b-4292-89b3-02a592fb10e2) 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 4 Zone: default (e99f9810-9b3d-4ce9-95f6-943c8fddbc84) 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 zonegroup default 2024-05-08T18:12:09.344 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.345 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.339+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dc9a0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 rados_obj.operate() r=0 bl.length=187 2024-05-08T18:12:09.346 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65de7d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 rados->read ofs=0 len=0 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dec40 con 0x55d7f65d9c10 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 started sync module instance, tier type = 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 20 started zone id=e99f9810-9b3d-4ce9-95f6-943c8fddbc84 (name=default) with tier type = 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65ddc40 con 0x7f3cb4027060 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 9 ==== osd_op_reply(44 notify.0 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94386039676976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dd8a0 con 0x7f3cb4027060 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.343+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dfb70 con 0x55d7f65d39a0 2024-05-08T18:12:09.347 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94386039676976] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 17 ==== osd_op_reply(46 notify.1 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94386039681184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dfb70 con 0x55d7f65d39a0 2024-05-08T18:12:09.348 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e0530 con 0x55d7f65d9c10 2024-05-08T18:12:09.349 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 18 ==== osd_op_reply(47 notify.1 [watch watch cookie 94386039681184] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 12 ==== osd_op_reply(48 notify.2 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94386039682752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65dfae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.350 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.347+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e1280 con 0x7f3cb4027060 2024-05-08T18:12:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 11 ==== osd_op_reply(50 notify.3 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94386039688960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e1b20 con 0x7f3cb4027060 2024-05-08T18:12:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e2520 con 0x55d7f65d39a0 2024-05-08T18:12:09.351 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94386039682752] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.352 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94386039688960] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 19 ==== osd_op_reply(52 notify.4 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94386039687456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e1670 con 0x55d7f65d39a0 2024-05-08T18:12:09.353 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.351+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e2df0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.355 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.355+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 20 ==== osd_op_reply(53 notify.4 [watch watch cookie 94386039687456] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.355+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 9 ==== osd_op_reply(54 notify.5 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.355+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94386039693360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e1670 con 0x7f3cbc0c8030 2024-05-08T18:12:09.356 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.355+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3350 con 0x7f3cbc0c8030 2024-05-08T18:12:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 10 ==== osd_op_reply(55 notify.5 [watch watch cookie 94386039693360] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 11 ==== osd_op_reply(56 notify.6 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94386039696928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3310 con 0x7f3cbc0c8030 2024-05-08T18:12:09.358 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3cd0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 12 ==== osd_op_reply(57 notify.6 [watch watch cookie 94386039696928] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.361 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 13 ==== osd_op_reply(58 notify.7 [create] v32'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94386039695152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3cd0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=0 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=1 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=2 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=3 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=4 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=5 2024-05-08T18:12:09.362 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.359+0000 7f3cceca7980 20 add_watcher() i=6 2024-05-08T18:12:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 14 ==== osd_op_reply(59 notify.7 [watch watch cookie 94386039695152] v32'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 20 add_watcher() i=7 2024-05-08T18:12:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 2 all 8 watchers are set, enabling cache 2024-05-08T18:12:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e6fc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.363 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 21 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.364 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94386039699856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e4260 con 0x55d7f65d39a0 2024-05-08T18:12:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 22 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94386039699856] v32'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3b827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:12:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T18:12:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T18:12:09.365 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.363+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e6760 con 0x55d7f65d39a0 2024-05-08T18:12:09.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.367+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 23 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.367 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.367+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e67a0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.367+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 15 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.369 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.367+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e6930 con 0x55d7f65d9c10 2024-05-08T18:12:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.371+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.371 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.371+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f0570 con 0x55d7f65d39a0 2024-05-08T18:12:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.371+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 24 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'275 uv164 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.371+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f0530 con 0x7f3cb4027060 2024-05-08T18:12:09.373 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.371+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'87 uv86 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.374 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.371+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f07e0 con 0x55d7f65d9c10 2024-05-08T18:12:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.375+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.375 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.375+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f0dd0 con 0x55d7f65d39a0 2024-05-08T18:12:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.375+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 25 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.377 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.375+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f0dd0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.379+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 16 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.380 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.379+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f0dd0 con 0x7f3cb4027060 2024-05-08T18:12:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.383+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.382 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.383+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f1340 con 0x55d7f65d9c10 2024-05-08T18:12:09.383 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.383+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.384 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.383+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f1340 con 0x7f3cb4027060 2024-05-08T18:12:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.383+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'88 uv58 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.385 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.383+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.387+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 17 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.387 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.387+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x7f3cb4027060 2024-05-08T18:12:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.387+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.388 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.387+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.390 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.391+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 18 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'62 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.391 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.391+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x55d7f65d39a0 2024-05-08T18:12:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.391+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 26 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'276 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.392 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.391+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.395+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'80 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.394 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.395+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x7f3cb4027060 2024-05-08T18:12:09.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.395+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'89 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.396 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.395+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f17f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.395+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.397 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.395+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f19c0 con 0x55d7f65d39a0 2024-05-08T18:12:09.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.399+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 27 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.399 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.399+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d39a0 2024-05-08T18:12:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.399+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 28 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'277 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.401 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.399+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.403+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'81 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.403 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.403+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x7f3cb4027060 2024-05-08T18:12:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.403+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.405 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.403+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.407+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.406 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.407+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.407+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.408 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.407+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.407+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.409 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.407+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.411+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.411 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.411+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.415+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 19 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.414 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.415+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.415 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.415+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.416 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.415+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.419+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 20 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.418 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.419+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.419+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'82 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.420 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.419+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.422 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.423+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 21 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'63 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.423 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.423+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65f00d0 con 0x7f3cb4027060 2024-05-08T18:12:09.425 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.423+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.423+0000 7f3b817e2640 20 reqs_thread_entry: start 2024-05-08T18:12:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 20 init_complete bucket index max shards: 11 2024-05-08T18:12:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 20 Filter name: none 2024-05-08T18:12:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3af2ffd640 20 reqs_thread_entry: start 2024-05-08T18:12:09.426 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-08T18:12:09.427 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:94 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 26 ==== osd_op_reply(94 gc.23 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.428 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:95 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 27 ==== osd_op_reply(95 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:96 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.429 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 28 ==== osd_op_reply(96 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:97 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 29 ==== osd_op_reply(97 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:98 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 30 ==== osd_op_reply(98 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.430 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.427+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:99 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 31 ==== osd_op_reply(99 gc.23 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-08T18:12:09.431 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:100 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 32 ==== osd_op_reply(100 gc.24 [call] v32'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:101 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 33 ==== osd_op_reply(101 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.432 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:102 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 34 ==== osd_op_reply(102 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:103 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.433 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 35 ==== osd_op_reply(103 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:104 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 36 ==== osd_op_reply(104 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.431+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.434 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 37 ==== osd_op_reply(105 gc.24 [call] v32'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-08T18:12:09.435 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:106 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 38 ==== osd_op_reply(106 gc.25 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.436 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:107 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 39 ==== osd_op_reply(107 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 40 ==== osd_op_reply(108 gc.25 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.437 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 41 ==== osd_op_reply(109 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.435+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.439+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.438 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.439+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.439+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:111 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.439+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 43 ==== osd_op_reply(111 gc.25 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.439+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-08T18:12:09.440 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.439+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 22 ==== osd_op_reply(112 gc.26 [call] v32'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.442 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 23 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:114 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 24 ==== osd_op_reply(114 gc.26 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.443 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:115 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.444 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 25 ==== osd_op_reply(115 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:116 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 26 ==== osd_op_reply(116 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.445 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.443+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:117 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 27 ==== osd_op_reply(117 gc.26 [call] v32'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-08T18:12:09.448 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:118 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 44 ==== osd_op_reply(118 gc.27 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:119 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.449 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 45 ==== osd_op_reply(119 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.447+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:120 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 46 ==== osd_op_reply(120 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:121 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 47 ==== osd_op_reply(121 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:122 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 48 ==== osd_op_reply(122 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.451 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:123 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 49 ==== osd_op_reply(123 gc.27 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-08T18:12:09.452 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.451+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:124 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 28 ==== osd_op_reply(124 gc.28 [call] v32'57 uv57 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.454 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:125 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 29 ==== osd_op_reply(125 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.455 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:126 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 30 ==== osd_op_reply(126 gc.28 [call out=24b] v0'0 uv57 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.456 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:127 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 31 ==== osd_op_reply(127 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.457 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:128 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.455+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 32 ==== osd_op_reply(128 gc.28 [call out=15b] v0'0 uv57 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.459+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.458 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.459+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:129 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.459+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 33 ==== osd_op_reply(129 gc.28 [call] v32'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.459+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-08T18:12:09.460 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.459+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:130 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 50 ==== osd_op_reply(130 gc.29 [call] v32'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.462 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:131 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 51 ==== osd_op_reply(131 gc.29 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:132 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 52 ==== osd_op_reply(132 gc.29 [call out=24b] v0'0 uv83 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:133 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 53 ==== osd_op_reply(133 gc.29 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.463 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:134 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 54 ==== osd_op_reply(134 gc.29 [call out=15b] v0'0 uv83 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.464 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:135 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 55 ==== osd_op_reply(135 gc.29 [call] v32'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-08T18:12:09.465 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.463+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:136 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 34 ==== osd_op_reply(136 gc.30 [call] v32'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:137 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 35 ==== osd_op_reply(137 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.468 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:138 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 36 ==== osd_op_reply(138 gc.30 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.469 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.467+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:139 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 37 ==== osd_op_reply(139 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.470 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:140 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 38 ==== osd_op_reply(140 gc.30 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.471 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:141 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.473 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 39 ==== osd_op_reply(141 gc.30 [call] v32'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-08T18:12:09.474 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.471+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:142 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 20 ==== osd_op_reply(142 gc.31 [call] v32'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.476 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:143 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 21 ==== osd_op_reply(143 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:144 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x7f3cb4027060 2024-05-08T18:12:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 22 ==== osd_op_reply(144 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.477 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:145 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 23 ==== osd_op_reply(145 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:146 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 24 ==== osd_op_reply(146 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.478 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.475+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:147 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.479+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 25 ==== osd_op_reply(147 gc.31 [call] v32'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.479+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-08T18:12:09.480 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.479+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:148 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 29 ==== osd_op_reply(148 gc.0 [call] v32'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:149 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 30 ==== osd_op_reply(149 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.482 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:150 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d39a0 2024-05-08T18:12:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 31 ==== osd_op_reply(150 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:151 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 32 ==== osd_op_reply(151 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:152 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.483 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 33 ==== osd_op_reply(152 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.484 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.483+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:153 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 34 ==== osd_op_reply(153 gc.0 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-08T18:12:09.486 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:154 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.488 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 40 ==== osd_op_reply(154 gc.1 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:155 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 41 ==== osd_op_reply(155 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.489 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.487+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:156 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 42 ==== osd_op_reply(156 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.490 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:157 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 43 ==== osd_op_reply(157 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.491 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:158 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 44 ==== osd_op_reply(158 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.492 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.491+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:159 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cbc0c8030 2024-05-08T18:12:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.495+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 45 ==== osd_op_reply(159 gc.1 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.495+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-08T18:12:09.495 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.495+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:160 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.495+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 56 ==== osd_op_reply(160 gc.2 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.497 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.495+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:161 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.495+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 57 ==== osd_op_reply(161 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:162 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 58 ==== osd_op_reply(162 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.498 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:163 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 59 ==== osd_op_reply(163 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.499 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:164 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 60 ==== osd_op_reply(164 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.499+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:165 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d9c10 2024-05-08T18:12:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 61 ==== osd_op_reply(165 gc.2 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-08T18:12:09.502 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:166 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 35 ==== osd_op_reply(166 gc.3 [call] v32'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.504 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:167 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 36 ==== osd_op_reply(167 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:168 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d39a0 2024-05-08T18:12:09.505 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 37 ==== osd_op_reply(168 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:169 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 38 ==== osd_op_reply(169 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.503+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:170 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.507+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 39 ==== osd_op_reply(170 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.506 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.507+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.510 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.507+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:171 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x55d7f65d39a0 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.507+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 40 ==== osd_op_reply(171 gc.3 [call] v32'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.507+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.507+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:172 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 26 ==== osd_op_reply(172 gc.4 [call] v32'90 uv90 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:173 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 27 ==== osd_op_reply(173 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.511 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:174 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x7f3cb4027060 2024-05-08T18:12:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 28 ==== osd_op_reply(174 gc.4 [call out=24b] v0'0 uv90 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:175 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 29 ==== osd_op_reply(175 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.512 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.513 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:176 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e200 con 0x7f3cb4027060 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 30 ==== osd_op_reply(176 gc.4 [call out=1714b] v0'0 uv90 ondisk = 0) ==== 148+0+1714 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 20 garbage collection: RGWGC::process iterating over entry tag='e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.548063878408769090', time=2024-05-08T18:12:17.157002+0000, chain.objs.size()=7 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_1 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:177 3.33s0 3:cf57600f:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_1:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660e6b0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_2 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:178 3.21s0 3:859ff5c9:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_2:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6611250 con 0x7f3cbc0c8030 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_3 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:179 3.34s0 3:2e8879ec:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_3:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6611250 con 0x55d7f65d39a0 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_4 2024-05-08T18:12:09.514 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:180 3.2fs0 3:f574da78:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_4:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f66161d0 con 0x55d7f65d9c10 2024-05-08T18:12:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_5 2024-05-08T18:12:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:181 3.15s0 3:abf1dd9a:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_5:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6618cc0 con 0x7f3cb4027060 2024-05-08T18:12:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_6 2024-05-08T18:12:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:182 3.32s0 3:4ed0fdb7:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_6:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f661b530 con 0x55d7f65d9c10 2024-05-08T18:12:09.515 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_7 2024-05-08T18:12:09.516 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.511+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:183 3.as0 3:52210338:::e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_7:head [call refcount.put in=83b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f661dda0 con 0x55d7f65d9c10 2024-05-08T18:12:09.518 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.519+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 46 ==== osd_op_reply(177 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_1 [call] v32'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.519+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 41 ==== osd_op_reply(179 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_3 [call] v32'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.521 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.519+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 47 ==== osd_op_reply(178 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_2 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.523+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 62 ==== osd_op_reply(180 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_4 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.523+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 63 ==== osd_op_reply(183 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_7 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.522 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.523+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 64 ==== osd_op_reply(182 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_6 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.523+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 31 ==== osd_op_reply(181 e99f9810-9b3d-4ce9-95f6-943c8fddbc84.4226.11__shadow_.rvE1-hardygHSTfj1HqDg75R4V4YiR9_5 [call] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.523 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.523+0000 7f3cceca7980 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T18:12:09.524 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.523+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:184 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6618750 con 0x7f3cb4027060 2024-05-08T18:12:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.527+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 32 ==== osd_op_reply(184 gc.4 [call] v32'91 uv91 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.526 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.527+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:185 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6618710 con 0x7f3cb4027060 2024-05-08T18:12:09.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.527+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 33 ==== osd_op_reply(185 gc.4 [call] v32'92 uv92 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.527+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-08T18:12:09.528 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.527+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:186 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d9c10 2024-05-08T18:12:09.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 65 ==== osd_op_reply(186 gc.5 [call] v32'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.530 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:187 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d9c10 2024-05-08T18:12:09.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 66 ==== osd_op_reply(187 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.531 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:188 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d1f0 con 0x55d7f65d9c10 2024-05-08T18:12:09.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 67 ==== osd_op_reply(188 gc.5 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:189 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d9c10 2024-05-08T18:12:09.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 68 ==== osd_op_reply(189 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.532 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:190 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d9c10 2024-05-08T18:12:09.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 69 ==== osd_op_reply(190 gc.5 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.533 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.531+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:191 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d9c10 2024-05-08T18:12:09.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 70 ==== osd_op_reply(191 gc.5 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-08T18:12:09.534 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:192 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 42 ==== osd_op_reply(192 gc.6 [call] v32'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.537 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:193 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 43 ==== osd_op_reply(193 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:194 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 44 ==== osd_op_reply(194 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.535+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:195 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 45 ==== osd_op_reply(195 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.538 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:196 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 46 ==== osd_op_reply(196 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.539 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:197 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x55d7f65d39a0 2024-05-08T18:12:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 47 ==== osd_op_reply(197 gc.6 [call] v32'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-08T18:12:09.541 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.539+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:198 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6610bc0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 48 ==== osd_op_reply(198 gc.7 [call] v32'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.543 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:199 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cbc0c8030 2024-05-08T18:12:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 49 ==== osd_op_reply(199 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.544 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:200 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cbc0c8030 2024-05-08T18:12:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 50 ==== osd_op_reply(200 gc.7 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:201 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cbc0c8030 2024-05-08T18:12:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 51 ==== osd_op_reply(201 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.545 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.543+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:202 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cbc0c8030 2024-05-08T18:12:09.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.547+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 52 ==== osd_op_reply(202 gc.7 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.547+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.547+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:203 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cbc0c8030 2024-05-08T18:12:09.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.547+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 53 ==== osd_op_reply(203 gc.7 [call] v32'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.547+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-08T18:12:09.549 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.547+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:204 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cb4027060 2024-05-08T18:12:09.550 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 34 ==== osd_op_reply(204 gc.8 [call] v32'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:205 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f6616630 con 0x7f3cb4027060 2024-05-08T18:12:09.551 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 35 ==== osd_op_reply(205 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:206 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660d6a0 con 0x7f3cb4027060 2024-05-08T18:12:09.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 36 ==== osd_op_reply(206 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.552 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:207 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eb30 con 0x7f3cb4027060 2024-05-08T18:12:09.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 37 ==== osd_op_reply(207 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:208 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eb30 con 0x7f3cb4027060 2024-05-08T18:12:09.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 38 ==== osd_op_reply(208 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.553 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.551+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:209 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eb30 con 0x7f3cb4027060 2024-05-08T18:12:09.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 39 ==== osd_op_reply(209 gc.8 [call] v32'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-08T18:12:09.555 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:210 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eb30 con 0x55d7f65d9c10 2024-05-08T18:12:09.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 71 ==== osd_op_reply(210 gc.9 [call] v32'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:211 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eb30 con 0x55d7f65d9c10 2024-05-08T18:12:09.557 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 72 ==== osd_op_reply(211 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.555+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:212 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 73 ==== osd_op_reply(212 gc.9 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:213 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.558 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 74 ==== osd_op_reply(213 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:214 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 75 ==== osd_op_reply(214 gc.9 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.559 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:215 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 76 ==== osd_op_reply(215 gc.9 [call] v32'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-08T18:12:09.561 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.559+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:216 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 40 ==== osd_op_reply(216 gc.10 [call] v32'93 uv93 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.563 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:217 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 41 ==== osd_op_reply(217 gc.10 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.564 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:218 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 42 ==== osd_op_reply(218 gc.10 [call out=24b] v0'0 uv93 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.565 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:219 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 43 ==== osd_op_reply(219 gc.10 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:220 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 44 ==== osd_op_reply(220 gc.10 [call out=15b] v0'0 uv93 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.566 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.563+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:221 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.567+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 45 ==== osd_op_reply(221 gc.10 [call] v32'94 uv94 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.567+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-08T18:12:09.569 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.567+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:222 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 54 ==== osd_op_reply(222 gc.11 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.570 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:223 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 55 ==== osd_op_reply(223 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:224 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 56 ==== osd_op_reply(224 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.572 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:225 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 57 ==== osd_op_reply(225 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.573 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:226 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 58 ==== osd_op_reply(226 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.571+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:227 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.575+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 59 ==== osd_op_reply(227 gc.11 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.575+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-08T18:12:09.576 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.575+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:228 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.578 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 46 ==== osd_op_reply(228 gc.12 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:229 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.579 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 47 ==== osd_op_reply(229 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:230 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 48 ==== osd_op_reply(230 gc.12 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:231 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 49 ==== osd_op_reply(231 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:232 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 50 ==== osd_op_reply(232 gc.12 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.581 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.579+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:233 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.583+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 51 ==== osd_op_reply(233 gc.12 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.583+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-08T18:12:09.583 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.583+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:234 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 60 ==== osd_op_reply(234 gc.13 [call] v32'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:235 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 61 ==== osd_op_reply(235 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.587 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:236 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 62 ==== osd_op_reply(236 gc.13 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:237 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 63 ==== osd_op_reply(237 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.589 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.590 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.587+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:238 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.591+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 64 ==== osd_op_reply(238 gc.13 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.591+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.591 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.591+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:239 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 65 ==== osd_op_reply(239 gc.13 [call] v32'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-08T18:12:09.594 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:240 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 48 ==== osd_op_reply(240 gc.14 [call] v32'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.596 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:241 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 49 ==== osd_op_reply(241 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.597 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:242 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 50 ==== osd_op_reply(242 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.595+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:243 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 51 ==== osd_op_reply(243 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.598 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:244 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 52 ==== osd_op_reply(244 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:245 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 53 ==== osd_op_reply(245 gc.14 [call] v32'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-08T18:12:09.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.599+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:246 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.603+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 77 ==== osd_op_reply(246 gc.15 [call] v32'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.603+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:247 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.603+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 78 ==== osd_op_reply(247 gc.15 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.603+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.605 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.603+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:248 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 79 ==== osd_op_reply(248 gc.15 [call out=24b] v0'0 uv85 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:249 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 80 ==== osd_op_reply(249 gc.15 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.607 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:250 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 81 ==== osd_op_reply(250 gc.15 [call out=15b] v0'0 uv85 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.608 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.607+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:251 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.611 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.611+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 82 ==== osd_op_reply(251 gc.15 [call] v32'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.611+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-08T18:12:09.612 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.611+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:252 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 52 ==== osd_op_reply(252 gc.16 [call] v32'95 uv95 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.614 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:253 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 53 ==== osd_op_reply(253 gc.16 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:254 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 54 ==== osd_op_reply(254 gc.16 [call out=24b] v0'0 uv95 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.615 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:255 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 55 ==== osd_op_reply(255 gc.16 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.616 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:256 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 56 ==== osd_op_reply(256 gc.16 [call out=15b] v0'0 uv95 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.617 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.615+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:257 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.619 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.619+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 57 ==== osd_op_reply(257 gc.16 [call] v32'96 uv96 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.619+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-08T18:12:09.620 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.619+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:258 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.619+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 83 ==== osd_op_reply(258 gc.17 [call] v32'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.621 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.619+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:259 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 84 ==== osd_op_reply(259 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.622 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:260 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 85 ==== osd_op_reply(260 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.623 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:261 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 86 ==== osd_op_reply(261 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.624 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:262 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 87 ==== osd_op_reply(262 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.625 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.623+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:263 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.627+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 88 ==== osd_op_reply(263 gc.17 [call] v32'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.627+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-08T18:12:09.627 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.627+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:264 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 54 ==== osd_op_reply(264 gc.18 [call] v32'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.630 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:265 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 55 ==== osd_op_reply(265 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:266 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.631 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 56 ==== osd_op_reply(266 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:267 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 57 ==== osd_op_reply(267 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.632 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:268 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 58 ==== osd_op_reply(268 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.633 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.631+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:269 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.635+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 59 ==== osd_op_reply(269 gc.18 [call] v32'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.635+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-08T18:12:09.636 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.635+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:270 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 60 ==== osd_op_reply(270 gc.19 [call] v32'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.638 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:271 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 61 ==== osd_op_reply(271 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:272 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 62 ==== osd_op_reply(272 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.639 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:273 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 63 ==== osd_op_reply(273 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.640 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:274 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 64 ==== osd_op_reply(274 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.641 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.639+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:275 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d39a0 2024-05-08T18:12:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.643+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 65 ==== osd_op_reply(275 gc.19 [call] v32'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.643+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-08T18:12:09.643 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.643+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:276 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 89 ==== osd_op_reply(276 gc.20 [call] v32'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.646 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:277 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 90 ==== osd_op_reply(277 gc.20 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:278 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 91 ==== osd_op_reply(278 gc.20 [call out=24b] v0'0 uv87 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.647 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:279 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 92 ==== osd_op_reply(279 gc.20 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:280 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.648 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 93 ==== osd_op_reply(280 gc.20 [call out=15b] v0'0 uv87 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.649 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.647+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:281 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 94 ==== osd_op_reply(281 gc.20 [call] v32'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-08T18:12:09.651 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:282 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 58 ==== osd_op_reply(282 gc.21 [call] v32'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.653 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:283 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 59 ==== osd_op_reply(283 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.651+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:284 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.654 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 60 ==== osd_op_reply(284 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:285 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 61 ==== osd_op_reply(285 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:286 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 62 ==== osd_op_reply(286 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.655 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.656 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:287 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x7f3cb4027060 2024-05-08T18:12:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 63 ==== osd_op_reply(287 gc.21 [call] v32'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-08T18:12:09.658 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.655+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:288 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 95 ==== osd_op_reply(288 gc.22 [call] v32'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.660 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:289 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 96 ==== osd_op_reply(289 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:290 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 97 ==== osd_op_reply(290 gc.22 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.661 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.659+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:291 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 98 ==== osd_op_reply(291 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.662 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T18:12:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:292 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 99 ==== osd_op_reply(292 gc.22 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3cceca7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T18:12:09.663 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:293 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f660eae0 con 0x55d7f65d9c10 2024-05-08T18:12:09.665 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.663+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 100 ==== osd_op_reply(293 gc.22 [call] v32'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.666 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.667+0000 7f3b827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T18:12:09.667 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.667+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94386039699856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65eebf0 con 0x55d7f65d39a0 2024-05-08T18:12:09.668 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.667+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94386039699856] v32'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.669 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.667+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94386039676976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3990 con 0x7f3cb4027060 2024-05-08T18:12:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94386039676976] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3cceca7980 20 remove_watcher() i=0 2024-05-08T18:12:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3cceca7980 2 removed watcher, disabling cache 2024-05-08T18:12:09.671 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94386039681184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3990 con 0x55d7f65d39a0 2024-05-08T18:12:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94386039681184] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3cceca7980 20 remove_watcher() i=1 2024-05-08T18:12:09.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.671+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94386039682752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65df0a0 con 0x55d7f65d9c10 2024-05-08T18:12:09.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.675+0000 7f3ccbfba640 1 -- 172.21.15.114:0/3649126182 <== osd.3 v2:172.21.15.114:6808/3988457904 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94386039682752] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cb4024030 con 0x55d7f65d9c10 2024-05-08T18:12:09.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.675+0000 7f3cceca7980 20 remove_watcher() i=2 2024-05-08T18:12:09.676 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.675+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94386039688960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3990 con 0x7f3cb4027060 2024-05-08T18:12:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.679+0000 7f3cccfbc640 1 -- 172.21.15.114:0/3649126182 <== osd.2 v2:172.21.15.114:6810/2279342404 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94386039688960] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cc402f040 con 0x7f3cb4027060 2024-05-08T18:12:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.679+0000 7f3cceca7980 20 remove_watcher() i=3 2024-05-08T18:12:09.678 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.679+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94386039687456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65df6c0 con 0x55d7f65d39a0 2024-05-08T18:12:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.679+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.1 v2:172.21.15.114:6800/1559856467 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94386039687456] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x55d7f65d39a0 2024-05-08T18:12:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.679+0000 7f3cceca7980 20 remove_watcher() i=4 2024-05-08T18:12:09.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.679+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94386039693360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65df0a0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.683+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 66 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94386039693360] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.683+0000 7f3cceca7980 20 remove_watcher() i=5 2024-05-08T18:12:09.685 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.683+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94386039696928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65e3990 con 0x7f3cbc0c8030 2024-05-08T18:12:09.686 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 67 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94386039696928] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 20 remove_watcher() i=6 2024-05-08T18:12:09.687 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94386039695152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d7f65df6c0 con 0x7f3cbc0c8030 2024-05-08T18:12:09.692 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 <== osd.0 v2:172.21.15.53:6800/803213352 68 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94386039695152] v32'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3cbc0c8410 con 0x7f3cbc0c8030 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 20 remove_watcher() i=7 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3cbc0c8030 msgr2=0x7f3cbc0ac8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7f3cbc0c8030 0x7f3cbc0ac8c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f65d39a0 msgr2=0x55d7f65d5e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f65d39a0 0x55d7f65d5e60 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f3cb4027060 msgr2=0x7f3cb404f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f3cb4027060 0x7f3cb404f460 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7f65d9c10 msgr2=0x55d7f65dc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.687+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x55d7f65d9c10 0x55d7f65dc000 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3b9c038440 msgr2=0x7f3b9c03a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3b9c038440 0x7f3b9c03a900 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400f010 tx=0x7f3cc401b070 comp rx=0 tx=0).stop 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 reap_dead start 2024-05-08T18:12:09.693 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 msgr2=0x55d7f65c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3649126182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65c13a0 0x55d7f65c8900 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40248b0 tx=0x7f3cb4024f90 comp rx=0 tx=0).stop 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3ccc7bb640 1 -- 172.21.15.114:0/3649126182 reap_dead start 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 shutdown_connections 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 >> 172.21.15.114:0/3649126182 conn(0x55d7f65bd730 msgr2=0x55d7f65c2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 shutdown_connections 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3649126182 wait complete. 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ba4038440 msgr2=0x7f3ba403a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ba4038440 0x7f3ba403a900 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55d7f65a4e00 tx=0x7f3cc4003070 comp rx=0 tx=0).stop 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 msgr2=0x55d7f65b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 0x55d7f65b45c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400e6f0 tx=0x7f3cb400e720 comp rx=0 tx=0).stop 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 shutdown_connections 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3ba4038440 0x7f3ba403a900 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.694 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/3475047011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f65b41a0 0x55d7f65b45c0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 >> 172.21.15.114:0/3475047011 conn(0x55d7f65a8fb0 msgr2=0x55d7f65a9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 shutdown_connections 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/3475047011 wait complete. 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f64ab0a0 msgr2=0x55d7f65a34c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f64ab0a0 0x55d7f65a34c0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3bb40383f0 msgr2=0x7f3bb403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3bb40383f0 0x7f3bb403a8b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4001ec0 tx=0x7f3cb40015c0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 msgr2=0x55d7f659c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f659c410 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc01b7c0 tx=0x7f3cbc017cc0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 shutdown_connections 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x55d7f64ab0a0 0x55d7f65a34c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.695 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3bb40383f0 0x7f3bb403a8b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 --2- 172.21.15.114:0/1641050171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7f641bf50 0x55d7f659c410 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 >> 172.21.15.114:0/1641050171 conn(0x55d7f64a2640 msgr2=0x55d7f64a6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 shutdown_connections 2024-05-08T18:12:09.696 INFO:teuthology.orchestra.run.smithi114.stderr:2024-05-08T18:12:09.691+0000 7f3cceca7980 1 -- 172.21.15.114:0/1641050171 wait complete. 2024-05-08T18:12:09.708 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T18:12:09.721 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T18:12:09.722 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:12:09.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcf4ec2640 1 Processor -- start 2024-05-08T18:12:09.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcf4ec2640 1 -- start start 2024-05-08T18:12:09.855 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcf4ec2640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcf012c4c0 0x7fbcf012c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcf4ec2640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf0073b00 con 0x7fbcf0070fd0 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcf4ec2640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf00721f0 con 0x7fbcf012c4c0 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcee59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcf012c4c0 0x7fbcf012c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcee59c640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fbcf012c4c0 0x7fbcf012c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58148/0 (socket says 172.21.15.53:58148) 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcedd9b640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fbcf0070fd0 0x7fbcf0071430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33828/0 (socket says 172.21.15.53:33828) 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcee59c640 1 -- 172.21.15.53:0/1948984852 learned_addr learned my addr 172.21.15.53:0/1948984852 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcee59c640 1 -- 172.21.15.53:0/1948984852 >> v1:172.21.15.53:6789/0 conn(0x7fbcf0070fd0 legacy=0x7fbcf0071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.856 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.854+0000 7fbcee59c640 1 -- 172.21.15.53:0/1948984852 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf0073330 con 0x7fbcf012c4c0 2024-05-08T18:12:09.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcee59c640 1 --2- 172.21.15.53:0/1948984852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf012c4c0 0x7fbcf012c8a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbce00097f0 tx=0x7fbce001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bca403fe759ad6f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.859 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbced59a640 1 -- 172.21.15.53:0/1948984852 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce00b0070 con 0x7fbcf012c4c0 2024-05-08T18:12:09.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbced59a640 1 -- 172.21.15.53:0/1948984852 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce00ab530 con 0x7fbcf012c4c0 2024-05-08T18:12:09.860 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbced59a640 1 -- 172.21.15.53:0/1948984852 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce00ab830 con 0x7fbcf012c4c0 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/1948984852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf012c4c0 msgr2=0x7fbcf012c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 --2- 172.21.15.53:0/1948984852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf012c4c0 0x7fbcf012c8a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbce00097f0 tx=0x7fbce001c430 comp rx=0 tx=0).stop 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/1948984852 shutdown_connections 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 --2- 172.21.15.53:0/1948984852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf012c4c0 0x7fbcf012c8a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/1948984852 >> 172.21.15.53:0/1948984852 conn(0x7fbcf009e030 msgr2=0x7fbcf009e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/1948984852 shutdown_connections 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/1948984852 wait complete. 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 Processor -- start 2024-05-08T18:12:09.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- start start 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 0x7fbcf011b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcf4ec2640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0138300 con 0x7fbcf0070fd0 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 0x7fbcf011b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcee59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 0x7fbcf011b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58160/0 (socket says 172.21.15.53:58160) 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcee59c640 1 -- 172.21.15.53:0/3157283383 learned_addr learned my addr 172.21.15.53:0/3157283383 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.858+0000 7fbcee59c640 1 -- 172.21.15.53:0/3157283383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf0135040 con 0x7fbcf0070fd0 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcee59c640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 0x7fbcf011b1d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbce0019040 tx=0x7fbce00191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce00bb070 con 0x7fbcf0070fd0 2024-05-08T18:12:09.863 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce00b6440 con 0x7fbcf0070fd0 2024-05-08T18:12:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf011e330 con 0x7fbcf0070fd0 2024-05-08T18:12:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbce00b0040 con 0x7fbcf0070fd0 2024-05-08T18:12:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf011b710 con 0x7fbcf0070fd0 2024-05-08T18:12:09.864 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf0064150 con 0x7fbcf0070fd0 2024-05-08T18:12:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fbce00be070 con 0x7fbcf0070fd0 2024-05-08T18:12:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcdeffd640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbcd0039b50 0x7fbcd003c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fbce00e77c0 con 0x7fbcf0070fd0 2024-05-08T18:12:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcedd9b640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbcd0039b50 0x7fbcd003c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:09.865 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.862+0000 7fbcedd9b640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbcd0039b50 0x7fbcd003c010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbce40015a0 tx=0x7fbce4007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:09.868 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:09.866+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbce00160b0 con 0x7fbcf0070fd0 2024-05-08T18:12:10.029 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.026+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcf011c3d0 con 0x7fbcd0039b50 2024-05-08T18:12:10.077 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.078+0000 7fbcdeffd640 1 -- 172.21.15.53:0/3157283383 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665721 (secure 0 0 0) 0x7fbcf011c3d0 con 0x7fbcd0039b50 2024-05-08T18:12:10.085 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:10.091 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:12:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbcd0039b50 msgr2=0x7fbcd003c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.093 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbcd0039b50 0x7fbcd003c010 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbce40015a0 tx=0x7fbce4007a30 comp rx=0 tx=0).stop 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 msgr2=0x7fbcf011b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 0x7fbcf011b1d0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fbce0019040 tx=0x7fbce00191d0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 shutdown_connections 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fbcd0039b50 0x7fbcd003c010 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 --2- 172.21.15.53:0/3157283383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbcf0070fd0 0x7fbcf011b1d0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 >> 172.21.15.53:0/3157283383 conn(0x7fbcf009e030 msgr2=0x7fbcf0130900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 shutdown_connections 2024-05-08T18:12:10.094 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.082+0000 7fbcf4ec2640 1 -- 172.21.15.53:0/3157283383 wait complete. 2024-05-08T18:12:10.104 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-08T18:12:09.410202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26410498,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4852,"num_read_kb":4437,"num_write":2048,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4432,"ondisk_log_size":4432,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177844,"kb_used_data":40660,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309516,"statfs":{"total":386547056640,"available":386364944384,"internally_reserved":0,"allocated":41635840,"data_stored":40481212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25809396,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":468,"num_write":386,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006898"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589617+0000","last_change":"2024-05-08T18:08:47.510504+0000","last_active":"2024-05-08T18:09:28.589617+0000","last_peered":"2024-05-08T18:09:28.589617+0000","last_clean":"2024-05-08T18:09:28.589617+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:09:28.589617+0000","last_undegraded":"2024-05-08T18:09:28.589617+0000","last_fullsized":"2024-05-08T18:09:28.589617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755613+0000","last_change":"2024-05-08T18:08:49.501074+0000","last_active":"2024-05-08T18:12:02.755613+0000","last_peered":"2024-05-08T18:12:02.755613+0000","last_clean":"2024-05-08T18:12:02.755613+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:12:02.755613+0000","last_undegraded":"2024-05-08T18:12:02.755613+0000","last_fullsized":"2024-05-08T18:12:02.755613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583198+0000","last_change":"2024-05-08T18:08:47.517769+0000","last_active":"2024-05-08T18:09:28.583198+0000","last_peered":"2024-05-08T18:09:28.583198+0000","last_clean":"2024-05-08T18:09:28.583198+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:09:28.583198+0000","last_undegraded":"2024-05-08T18:09:28.583198+0000","last_fullsized":"2024-05-08T18:09:28.583198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688121+0000","last_change":"2024-05-08T18:08:49.505238+0000","last_active":"2024-05-08T18:12:02.688121+0000","last_peered":"2024-05-08T18:12:02.688121+0000","last_clean":"2024-05-08T18:12:02.688121+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:12:02.688121+0000","last_undegraded":"2024-05-08T18:12:02.688121+0000","last_fullsized":"2024-05-08T18:12:02.688121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:44.433982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602848+0000","last_change":"2024-05-08T18:08:47.529012+0000","last_active":"2024-05-08T18:09:28.602848+0000","last_peered":"2024-05-08T18:09:28.602848+0000","last_clean":"2024-05-08T18:09:28.602848+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:09:28.602848+0000","last_undegraded":"2024-05-08T18:09:28.602848+0000","last_fullsized":"2024-05-08T18:09:28.602848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:59.877643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.243439+0000","last_change":"2024-05-08T18:08:49.512376+0000","last_active":"2024-05-08T18:12:02.243439+0000","last_peered":"2024-05-08T18:12:02.243439+0000","last_clean":"2024-05-08T18:12:02.243439+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:02.243439+0000","last_undegraded":"2024-05-08T18:12:02.243439+0000","last_fullsized":"2024-05-08T18:12:02.243439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:50.199302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584975+0000","last_change":"2024-05-08T18:08:47.506602+0000","last_active":"2024-05-08T18:09:28.584975+0000","last_peered":"2024-05-08T18:09:28.584975+0000","last_clean":"2024-05-08T18:09:28.584975+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:09:28.584975+0000","last_undegraded":"2024-05-08T18:09:28.584975+0000","last_fullsized":"2024-05-08T18:09:28.584975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603042+0000","last_change":"2024-05-08T18:08:49.514808+0000","last_active":"2024-05-08T18:09:28.603042+0000","last_peered":"2024-05-08T18:09:28.603042+0000","last_clean":"2024-05-08T18:09:28.603042+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:09:28.603042+0000","last_undegraded":"2024-05-08T18:09:28.603042+0000","last_fullsized":"2024-05-08T18:09:28.603042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:07.745157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594223+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:09:28.594223+0000","last_peered":"2024-05-08T18:09:28.594223+0000","last_clean":"2024-05-08T18:09:28.594223+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:09:28.594223+0000","last_undegraded":"2024-05-08T18:09:28.594223+0000","last_fullsized":"2024-05-08T18:09:28.594223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:19.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.621110+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:11:01.621110+0000","last_peered":"2024-05-08T18:11:01.621110+0000","last_clean":"2024-05-08T18:11:01.621110+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:11:01.621110+0000","last_undegraded":"2024-05-08T18:11:01.621110+0000","last_fullsized":"2024-05-08T18:11:01.621110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.476707+0000","last_change":"2024-05-08T18:08:47.517680+0000","last_active":"2024-05-08T18:10:16.476707+0000","last_peered":"2024-05-08T18:10:16.476707+0000","last_clean":"2024-05-08T18:10:16.476707+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:10:16.476707+0000","last_undegraded":"2024-05-08T18:10:16.476707+0000","last_fullsized":"2024-05-08T18:10:16.476707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.598289+0000","last_change":"2024-05-08T18:08:49.512339+0000","last_active":"2024-05-08T18:12:02.598289+0000","last_peered":"2024-05-08T18:12:02.598289+0000","last_clean":"2024-05-08T18:12:02.598289+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:02.598289+0000","last_undegraded":"2024-05-08T18:12:02.598289+0000","last_fullsized":"2024-05-08T18:12:02.598289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:17.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597200+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:09:28.597200+0000","last_peered":"2024-05-08T18:09:28.597200+0000","last_clean":"2024-05-08T18:09:28.597200+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:09:28.597200+0000","last_undegraded":"2024-05-08T18:09:28.597200+0000","last_fullsized":"2024-05-08T18:09:28.597200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:58.240945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755650+0000","last_change":"2024-05-08T18:08:49.497230+0000","last_active":"2024-05-08T18:12:02.755650+0000","last_peered":"2024-05-08T18:12:02.755650+0000","last_clean":"2024-05-08T18:12:02.755650+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:02.755650+0000","last_undegraded":"2024-05-08T18:12:02.755650+0000","last_fullsized":"2024-05-08T18:12:02.755650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.419603+0000","last_change":"2024-05-08T18:08:47.511982+0000","last_active":"2024-05-08T18:09:33.419603+0000","last_peered":"2024-05-08T18:09:33.419603+0000","last_clean":"2024-05-08T18:09:33.419603+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:09:33.419603+0000","last_undegraded":"2024-05-08T18:09:33.419603+0000","last_fullsized":"2024-05-08T18:09:33.419603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755669+0000","last_change":"2024-05-08T18:08:49.515516+0000","last_active":"2024-05-08T18:12:02.755669+0000","last_peered":"2024-05-08T18:12:02.755669+0000","last_clean":"2024-05-08T18:12:02.755669+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:02.755669+0000","last_undegraded":"2024-05-08T18:12:02.755669+0000","last_fullsized":"2024-05-08T18:12:02.755669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391545+0000","last_change":"2024-05-08T18:08:49.508214+0000","last_active":"2024-05-08T18:12:02.391545+0000","last_peered":"2024-05-08T18:12:02.391545+0000","last_clean":"2024-05-08T18:12:02.391545+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:12:02.391545+0000","last_undegraded":"2024-05-08T18:12:02.391545+0000","last_fullsized":"2024-05-08T18:12:02.391545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:02.344619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582645+0000","last_change":"2024-05-08T18:08:47.511822+0000","last_active":"2024-05-08T18:09:28.582645+0000","last_peered":"2024-05-08T18:09:28.582645+0000","last_clean":"2024-05-08T18:09:28.582645+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:09:28.582645+0000","last_undegraded":"2024-05-08T18:09:28.582645+0000","last_fullsized":"2024-05-08T18:09:28.582645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755519+0000","last_change":"2024-05-08T18:08:49.500178+0000","last_active":"2024-05-08T18:12:02.755519+0000","last_peered":"2024-05-08T18:12:02.755519+0000","last_clean":"2024-05-08T18:12:02.755519+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:02.755519+0000","last_undegraded":"2024-05-08T18:12:02.755519+0000","last_fullsized":"2024-05-08T18:12:02.755519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594972+0000","last_change":"2024-05-08T18:08:47.513087+0000","last_active":"2024-05-08T18:09:28.594972+0000","last_peered":"2024-05-08T18:09:28.594972+0000","last_clean":"2024-05-08T18:09:28.594972+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:09:28.594972+0000","last_undegraded":"2024-05-08T18:09:28.594972+0000","last_fullsized":"2024-05-08T18:09:28.594972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575992+0000","last_change":"2024-05-08T18:08:49.500044+0000","last_active":"2024-05-08T18:09:28.575992+0000","last_peered":"2024-05-08T18:09:28.575992+0000","last_clean":"2024-05-08T18:09:28.575992+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:09:28.575992+0000","last_undegraded":"2024-05-08T18:09:28.575992+0000","last_fullsized":"2024-05-08T18:09:28.575992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:30.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575062+0000","last_change":"2024-05-08T18:08:47.513484+0000","last_active":"2024-05-08T18:09:28.575062+0000","last_peered":"2024-05-08T18:09:28.575062+0000","last_clean":"2024-05-08T18:09:28.575062+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:09:28.575062+0000","last_undegraded":"2024-05-08T18:09:28.575062+0000","last_fullsized":"2024-05-08T18:09:28.575062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640685+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:01.640685+0000","last_peered":"2024-05-08T18:11:01.640685+0000","last_clean":"2024-05-08T18:11:01.640685+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:01.640685+0000","last_undegraded":"2024-05-08T18:11:01.640685+0000","last_fullsized":"2024-05-08T18:11:01.640685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:31.685937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'5","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431674+0000","last_change":"2024-05-08T18:08:47.496959+0000","last_active":"2024-05-08T18:11:16.431674+0000","last_peered":"2024-05-08T18:11:16.431674+0000","last_clean":"2024-05-08T18:11:16.431674+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:11:16.431674+0000","last_undegraded":"2024-05-08T18:11:16.431674+0000","last_fullsized":"2024-05-08T18:11:16.431674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755450+0000","last_change":"2024-05-08T18:08:49.511519+0000","last_active":"2024-05-08T18:12:02.755450+0000","last_peered":"2024-05-08T18:12:02.755450+0000","last_clean":"2024-05-08T18:12:02.755450+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:02.755450+0000","last_undegraded":"2024-05-08T18:12:02.755450+0000","last_fullsized":"2024-05-08T18:12:02.755450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:07.067518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422686+0000","last_change":"2024-05-08T18:08:47.513517+0000","last_active":"2024-05-08T18:11:16.422686+0000","last_peered":"2024-05-08T18:11:16.422686+0000","last_clean":"2024-05-08T18:11:16.422686+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:11:16.422686+0000","last_undegraded":"2024-05-08T18:11:16.422686+0000","last_fullsized":"2024-05-08T18:11:16.422686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.105302+0000","last_change":"2024-05-08T18:08:49.496030+0000","last_active":"2024-05-08T18:09:33.105302+0000","last_peered":"2024-05-08T18:09:33.105302+0000","last_clean":"2024-05-08T18:09:33.105302+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:09:33.105302+0000","last_undegraded":"2024-05-08T18:09:33.105302+0000","last_fullsized":"2024-05-08T18:09:33.105302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432206+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:11:11.432206+0000","last_peered":"2024-05-08T18:11:11.432206+0000","last_clean":"2024-05-08T18:11:11.432206+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:11:11.432206+0000","last_undegraded":"2024-05-08T18:11:11.432206+0000","last_fullsized":"2024-05-08T18:11:11.432206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:03.768445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.646508+0000","last_change":"2024-05-08T18:08:57.567982+0000","last_active":"2024-05-08T18:12:02.646508+0000","last_peered":"2024-05-08T18:12:02.646508+0000","last_clean":"2024-05-08T18:12:02.646508+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:12:02.646508+0000","last_undegraded":"2024-05-08T18:12:02.646508+0000","last_fullsized":"2024-05-08T18:12:02.646508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:52.349480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.756078+0000","last_change":"2024-05-08T18:08:49.512724+0000","last_active":"2024-05-08T18:12:02.756078+0000","last_peered":"2024-05-08T18:12:02.756078+0000","last_clean":"2024-05-08T18:12:02.756078+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:02.756078+0000","last_undegraded":"2024-05-08T18:12:02.756078+0000","last_fullsized":"2024-05-08T18:12:02.756078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:36.090445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593298+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:09:28.593298+0000","last_peered":"2024-05-08T18:09:28.593298+0000","last_clean":"2024-05-08T18:09:28.593298+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:09:28.593298+0000","last_undegraded":"2024-05-08T18:09:28.593298+0000","last_fullsized":"2024-05-08T18:09:28.593298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:34.298278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597381+0000","last_change":"2024-05-08T18:08:51.505825+0000","last_active":"2024-05-08T18:09:28.597381+0000","last_peered":"2024-05-08T18:09:28.597381+0000","last_clean":"2024-05-08T18:09:28.597381+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:09:28.597381+0000","last_undegraded":"2024-05-08T18:09:28.597381+0000","last_fullsized":"2024-05-08T18:09:28.597381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:07.975264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.580226+0000","last_change":"2024-05-08T18:08:53.550245+0000","last_active":"2024-05-08T18:10:59.580226+0000","last_peered":"2024-05-08T18:10:59.580226+0000","last_clean":"2024-05-08T18:10:59.580226+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:10:59.580226+0000","last_undegraded":"2024-05-08T18:10:59.580226+0000","last_fullsized":"2024-05-08T18:10:59.580226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:46.416684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582464+0000","last_change":"2024-05-08T18:08:55.544376+0000","last_active":"2024-05-08T18:09:28.582464+0000","last_peered":"2024-05-08T18:09:28.582464+0000","last_clean":"2024-05-08T18:09:28.582464+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:09:28.582464+0000","last_undegraded":"2024-05-08T18:09:28.582464+0000","last_fullsized":"2024-05-08T18:09:28.582464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.499404+0000","last_change":"2024-05-08T18:08:57.562642+0000","last_active":"2024-05-08T18:10:16.499404+0000","last_peered":"2024-05-08T18:10:16.499404+0000","last_clean":"2024-05-08T18:10:16.499404+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:10:16.499404+0000","last_undegraded":"2024-05-08T18:10:16.499404+0000","last_fullsized":"2024-05-08T18:10:16.499404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597657+0000","last_change":"2024-05-08T18:08:49.513376+0000","last_active":"2024-05-08T18:12:02.597657+0000","last_peered":"2024-05-08T18:12:02.597657+0000","last_clean":"2024-05-08T18:12:02.597657+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:02.597657+0000","last_undegraded":"2024-05-08T18:12:02.597657+0000","last_fullsized":"2024-05-08T18:12:02.597657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:18.558772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579314+0000","last_change":"2024-05-08T18:08:47.514599+0000","last_active":"2024-05-08T18:09:28.579314+0000","last_peered":"2024-05-08T18:09:28.579314+0000","last_clean":"2024-05-08T18:09:28.579314+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:09:28.579314+0000","last_undegraded":"2024-05-08T18:09:28.579314+0000","last_fullsized":"2024-05-08T18:09:28.579314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578587+0000","last_change":"2024-05-08T18:08:51.510019+0000","last_active":"2024-05-08T18:09:28.578587+0000","last_peered":"2024-05-08T18:09:28.578587+0000","last_clean":"2024-05-08T18:09:28.578587+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:09:28.578587+0000","last_undegraded":"2024-05-08T18:09:28.578587+0000","last_fullsized":"2024-05-08T18:09:28.578587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:08.155776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581714+0000","last_change":"2024-05-08T18:08:53.529258+0000","last_active":"2024-05-08T18:09:28.581714+0000","last_peered":"2024-05-08T18:09:28.581714+0000","last_clean":"2024-05-08T18:09:28.581714+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:09:28.581714+0000","last_undegraded":"2024-05-08T18:09:28.581714+0000","last_fullsized":"2024-05-08T18:09:28.581714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:41.643997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574807+0000","last_change":"2024-05-08T18:08:55.556181+0000","last_active":"2024-05-08T18:09:28.574807+0000","last_peered":"2024-05-08T18:09:28.574807+0000","last_clean":"2024-05-08T18:09:28.574807+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:09:28.574807+0000","last_undegraded":"2024-05-08T18:09:28.574807+0000","last_fullsized":"2024-05-08T18:09:28.574807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.792229+0000","last_change":"2024-05-08T18:08:57.565097+0000","last_active":"2024-05-08T18:12:01.792229+0000","last_peered":"2024-05-08T18:12:01.792229+0000","last_clean":"2024-05-08T18:12:01.792229+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:12:01.792229+0000","last_undegraded":"2024-05-08T18:12:01.792229+0000","last_fullsized":"2024-05-08T18:12:01.792229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392228+0000","last_change":"2024-05-08T18:08:49.515508+0000","last_active":"2024-05-08T18:12:02.392228+0000","last_peered":"2024-05-08T18:12:02.392228+0000","last_clean":"2024-05-08T18:12:02.392228+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:02.392228+0000","last_undegraded":"2024-05-08T18:12:02.392228+0000","last_fullsized":"2024-05-08T18:12:02.392228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:35.075462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.423730+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:09:33.423730+0000","last_peered":"2024-05-08T18:09:33.423730+0000","last_clean":"2024-05-08T18:09:33.423730+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:09:33.423730+0000","last_undegraded":"2024-05-08T18:09:33.423730+0000","last_fullsized":"2024-05-08T18:09:33.423730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:39.673917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581355+0000","last_change":"2024-05-08T18:08:51.512103+0000","last_active":"2024-05-08T18:09:28.581355+0000","last_peered":"2024-05-08T18:09:28.581355+0000","last_clean":"2024-05-08T18:09:28.581355+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:09:28.581355+0000","last_undegraded":"2024-05-08T18:09:28.581355+0000","last_fullsized":"2024-05-08T18:09:28.581355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:29.355971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.644505+0000","last_change":"2024-05-08T18:08:53.547887+0000","last_active":"2024-05-08T18:11:01.644505+0000","last_peered":"2024-05-08T18:11:01.644505+0000","last_clean":"2024-05-08T18:11:01.644505+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:11:01.644505+0000","last_undegraded":"2024-05-08T18:11:01.644505+0000","last_fullsized":"2024-05-08T18:11:01.644505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:37.748836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":391,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754663+0000","last_change":"2024-05-08T18:08:55.569300+0000","last_active":"2024-05-08T18:12:01.754663+0000","last_peered":"2024-05-08T18:12:01.754663+0000","last_clean":"2024-05-08T18:12:01.754663+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:01.754663+0000","last_undegraded":"2024-05-08T18:12:01.754663+0000","last_fullsized":"2024-05-08T18:12:01.754663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:39.688576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.867775+0000","last_change":"2024-05-08T18:08:57.564089+0000","last_active":"2024-05-08T18:12:02.867775+0000","last_peered":"2024-05-08T18:12:02.867775+0000","last_clean":"2024-05-08T18:12:02.867775+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:02.867775+0000","last_undegraded":"2024-05-08T18:12:02.867775+0000","last_fullsized":"2024-05-08T18:12:02.867775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:58.387686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785001+0000","last_change":"2024-05-08T18:08:49.502184+0000","last_active":"2024-05-08T18:10:16.785001+0000","last_peered":"2024-05-08T18:10:16.785001+0000","last_clean":"2024-05-08T18:10:16.785001+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:10:16.785001+0000","last_undegraded":"2024-05-08T18:10:16.785001+0000","last_fullsized":"2024-05-08T18:10:16.785001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.897867+0000","last_change":"2024-05-08T18:08:47.498742+0000","last_active":"2024-05-08T18:09:31.897867+0000","last_peered":"2024-05-08T18:09:31.897867+0000","last_clean":"2024-05-08T18:09:31.897867+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:09:31.897867+0000","last_undegraded":"2024-05-08T18:09:31.897867+0000","last_fullsized":"2024-05-08T18:09:31.897867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:17.448245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607265+0000","last_change":"2024-05-08T18:08:51.513252+0000","last_active":"2024-05-08T18:09:28.607265+0000","last_peered":"2024-05-08T18:09:28.607265+0000","last_clean":"2024-05-08T18:09:28.607265+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:09:28.607265+0000","last_undegraded":"2024-05-08T18:09:28.607265+0000","last_fullsized":"2024-05-08T18:09:28.607265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:27.262513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431613+0000","last_change":"2024-05-08T18:08:53.550029+0000","last_active":"2024-05-08T18:11:21.431613+0000","last_peered":"2024-05-08T18:11:21.431613+0000","last_clean":"2024-05-08T18:11:21.431613+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:11:21.431613+0000","last_undegraded":"2024-05-08T18:11:21.431613+0000","last_fullsized":"2024-05-08T18:11:21.431613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:31.369561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.764223+0000","last_change":"2024-05-08T18:08:55.559384+0000","last_active":"2024-05-08T18:12:02.764223+0000","last_peered":"2024-05-08T18:12:02.764223+0000","last_clean":"2024-05-08T18:12:02.764223+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:02.764223+0000","last_undegraded":"2024-05-08T18:12:02.764223+0000","last_fullsized":"2024-05-08T18:12:02.764223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:12.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'11","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706714+0000","last_change":"2024-05-08T18:08:49.510841+0000","last_active":"2024-05-08T18:12:02.706714+0000","last_peered":"2024-05-08T18:12:02.706714+0000","last_clean":"2024-05-08T18:12:02.706714+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:02.706714+0000","last_undegraded":"2024-05-08T18:12:02.706714+0000","last_fullsized":"2024-05-08T18:12:02.706714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:50.298264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590076+0000","last_change":"2024-05-08T18:08:47.512906+0000","last_active":"2024-05-08T18:09:28.590076+0000","last_peered":"2024-05-08T18:09:28.590076+0000","last_clean":"2024-05-08T18:09:28.590076+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:09:28.590076+0000","last_undegraded":"2024-05-08T18:09:28.590076+0000","last_fullsized":"2024-05-08T18:09:28.590076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572207+0000","last_change":"2024-05-08T18:08:51.514762+0000","last_active":"2024-05-08T18:09:28.572207+0000","last_peered":"2024-05-08T18:09:28.572207+0000","last_clean":"2024-05-08T18:09:28.572207+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:09:28.572207+0000","last_undegraded":"2024-05-08T18:09:28.572207+0000","last_fullsized":"2024-05-08T18:09:28.572207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:04.358592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.586282+0000","last_change":"2024-05-08T18:08:53.535349+0000","last_active":"2024-05-08T18:10:59.586282+0000","last_peered":"2024-05-08T18:10:59.586282+0000","last_clean":"2024-05-08T18:10:59.586282+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:10:59.586282+0000","last_undegraded":"2024-05-08T18:10:59.586282+0000","last_fullsized":"2024-05-08T18:10:59.586282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:54.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583740+0000","last_change":"2024-05-08T18:08:55.543395+0000","last_active":"2024-05-08T18:09:28.583740+0000","last_peered":"2024-05-08T18:09:28.583740+0000","last_clean":"2024-05-08T18:09:28.583740+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:09:28.583740+0000","last_undegraded":"2024-05-08T18:09:28.583740+0000","last_fullsized":"2024-05-08T18:09:28.583740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:20.271109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.502622+0000","last_change":"2024-05-08T18:08:57.563745+0000","last_active":"2024-05-08T18:10:16.502622+0000","last_peered":"2024-05-08T18:10:16.502622+0000","last_clean":"2024-05-08T18:10:16.502622+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:10:16.502622+0000","last_undegraded":"2024-05-08T18:10:16.502622+0000","last_fullsized":"2024-05-08T18:10:16.502622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:30.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785596+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:10:16.785596+0000","last_peered":"2024-05-08T18:10:16.785596+0000","last_clean":"2024-05-08T18:10:16.785596+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:10:16.785596+0000","last_undegraded":"2024-05-08T18:10:16.785596+0000","last_fullsized":"2024-05-08T18:10:16.785596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:25.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591192+0000","last_change":"2024-05-08T18:08:47.513909+0000","last_active":"2024-05-08T18:09:28.591192+0000","last_peered":"2024-05-08T18:09:28.591192+0000","last_clean":"2024-05-08T18:09:28.591192+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:09:28.591192+0000","last_undegraded":"2024-05-08T18:09:28.591192+0000","last_fullsized":"2024-05-08T18:09:28.591192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407203+0000","last_change":"2024-05-08T18:09:28.594816+0000","last_active":"2024-05-08T18:09:31.407203+0000","last_peered":"2024-05-08T18:09:31.407203+0000","last_clean":"2024-05-08T18:09:31.407203+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:09:31.407203+0000","last_undegraded":"2024-05-08T18:09:31.407203+0000","last_fullsized":"2024-05-08T18:09:31.407203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:28.103174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.557932+0000","last_change":"2024-05-08T18:08:53.558331+0000","last_active":"2024-05-08T18:10:59.557932+0000","last_peered":"2024-05-08T18:10:59.557932+0000","last_clean":"2024-05-08T18:10:59.557932+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:10:59.557932+0000","last_undegraded":"2024-05-08T18:10:59.557932+0000","last_fullsized":"2024-05-08T18:10:59.557932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:26.213210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576613+0000","last_change":"2024-05-08T18:08:55.546287+0000","last_active":"2024-05-08T18:09:28.576613+0000","last_peered":"2024-05-08T18:09:28.576613+0000","last_clean":"2024-05-08T18:09:28.576613+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:09:28.576613+0000","last_undegraded":"2024-05-08T18:09:28.576613+0000","last_fullsized":"2024-05-08T18:09:28.576613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:10.826721+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:10:10.826721+0000","last_peered":"2024-05-08T18:10:10.826721+0000","last_clean":"2024-05-08T18:10:10.826721+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:10:10.826721+0000","last_undegraded":"2024-05-08T18:10:10.826721+0000","last_fullsized":"2024-05-08T18:10:10.826721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620354+0000","last_change":"2024-05-08T18:08:49.508936+0000","last_active":"2024-05-08T18:12:02.620354+0000","last_peered":"2024-05-08T18:12:02.620354+0000","last_clean":"2024-05-08T18:12:02.620354+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:02.620354+0000","last_undegraded":"2024-05-08T18:12:02.620354+0000","last_fullsized":"2024-05-08T18:12:02.620354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:21.051104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599345+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:09:28.599345+0000","last_peered":"2024-05-08T18:09:28.599345+0000","last_clean":"2024-05-08T18:09:28.599345+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:09:28.599345+0000","last_undegraded":"2024-05-08T18:09:28.599345+0000","last_fullsized":"2024-05-08T18:09:28.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:40.628230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584773+0000","last_change":"2024-05-08T18:08:51.511856+0000","last_active":"2024-05-08T18:09:28.584773+0000","last_peered":"2024-05-08T18:09:28.584773+0000","last_clean":"2024-05-08T18:09:28.584773+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:09:28.584773+0000","last_undegraded":"2024-05-08T18:09:28.584773+0000","last_fullsized":"2024-05-08T18:09:28.584773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:46.281518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.589041+0000","last_change":"2024-05-08T18:08:53.543547+0000","last_active":"2024-05-08T18:10:59.589041+0000","last_peered":"2024-05-08T18:10:59.589041+0000","last_clean":"2024-05-08T18:10:59.589041+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:10:59.589041+0000","last_undegraded":"2024-05-08T18:10:59.589041+0000","last_fullsized":"2024-05-08T18:10:59.589041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:16.619812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":355,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.962765+0000","last_change":"2024-05-08T18:08:55.546405+0000","last_active":"2024-05-08T18:12:02.962765+0000","last_peered":"2024-05-08T18:12:02.962765+0000","last_clean":"2024-05-08T18:12:02.962765+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:02.962765+0000","last_undegraded":"2024-05-08T18:12:02.962765+0000","last_fullsized":"2024-05-08T18:12:02.962765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578554+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:09:28.578554+0000","last_peered":"2024-05-08T18:09:28.578554+0000","last_clean":"2024-05-08T18:09:28.578554+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:09:28.578554+0000","last_undegraded":"2024-05-08T18:09:28.578554+0000","last_fullsized":"2024-05-08T18:09:28.578554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:35.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.451117+0000","last_change":"2024-05-08T18:08:49.491239+0000","last_active":"2024-05-08T18:10:57.451117+0000","last_peered":"2024-05-08T18:10:57.451117+0000","last_clean":"2024-05-08T18:10:57.451117+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:10:57.451117+0000","last_undegraded":"2024-05-08T18:10:57.451117+0000","last_fullsized":"2024-05-08T18:10:57.451117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.412627+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:09:33.412627+0000","last_peered":"2024-05-08T18:09:33.412627+0000","last_clean":"2024-05-08T18:09:33.412627+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:09:33.412627+0000","last_undegraded":"2024-05-08T18:09:33.412627+0000","last_fullsized":"2024-05-08T18:09:33.412627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:02.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407275+0000","last_change":"2024-05-08T18:09:28.599715+0000","last_active":"2024-05-08T18:09:31.407275+0000","last_peered":"2024-05-08T18:09:31.407275+0000","last_clean":"2024-05-08T18:09:31.407275+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:09:31.407275+0000","last_undegraded":"2024-05-08T18:09:31.407275+0000","last_fullsized":"2024-05-08T18:09:31.407275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:11.718211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.591215+0000","last_change":"2024-05-08T18:08:53.550420+0000","last_active":"2024-05-08T18:10:59.591215+0000","last_peered":"2024-05-08T18:10:59.591215+0000","last_clean":"2024-05-08T18:10:59.591215+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:10:59.591215+0000","last_undegraded":"2024-05-08T18:10:59.591215+0000","last_fullsized":"2024-05-08T18:10:59.591215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.341867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576602+0000","last_change":"2024-05-08T18:08:55.554490+0000","last_active":"2024-05-08T18:09:28.576602+0000","last_peered":"2024-05-08T18:09:28.576602+0000","last_clean":"2024-05-08T18:09:28.576602+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:09:28.576602+0000","last_undegraded":"2024-05-08T18:09:28.576602+0000","last_fullsized":"2024-05-08T18:09:28.576602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.922608+0000","last_change":"2024-05-08T18:08:57.554614+0000","last_active":"2024-05-08T18:12:02.922608+0000","last_peered":"2024-05-08T18:12:02.922608+0000","last_clean":"2024-05-08T18:12:02.922608+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:02.922608+0000","last_undegraded":"2024-05-08T18:12:02.922608+0000","last_fullsized":"2024-05-08T18:12:02.922608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:05.491234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658994+0000","last_change":"2024-05-08T18:08:49.519440+0000","last_active":"2024-05-08T18:09:32.658994+0000","last_peered":"2024-05-08T18:09:32.658994+0000","last_clean":"2024-05-08T18:09:32.658994+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:09:32.658994+0000","last_undegraded":"2024-05-08T18:09:32.658994+0000","last_fullsized":"2024-05-08T18:09:32.658994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581363+0000","last_change":"2024-05-08T18:08:47.496893+0000","last_active":"2024-05-08T18:09:28.581363+0000","last_peered":"2024-05-08T18:09:28.581363+0000","last_clean":"2024-05-08T18:09:28.581363+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:09:28.581363+0000","last_undegraded":"2024-05-08T18:09:28.581363+0000","last_fullsized":"2024-05-08T18:09:28.581363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:34.452347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584821+0000","last_change":"2024-05-08T18:08:51.507807+0000","last_active":"2024-05-08T18:09:28.584821+0000","last_peered":"2024-05-08T18:09:28.584821+0000","last_clean":"2024-05-08T18:09:28.584821+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:09:28.584821+0000","last_undegraded":"2024-05-08T18:09:28.584821+0000","last_fullsized":"2024-05-08T18:09:28.584821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:57.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.563219+0000","last_change":"2024-05-08T18:08:53.519537+0000","last_active":"2024-05-08T18:10:59.563219+0000","last_peered":"2024-05-08T18:10:59.563219+0000","last_clean":"2024-05-08T18:10:59.563219+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:10:59.563219+0000","last_undegraded":"2024-05-08T18:10:59.563219+0000","last_fullsized":"2024-05-08T18:10:59.563219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:52.757767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598872+0000","last_change":"2024-05-08T18:08:55.570542+0000","last_active":"2024-05-08T18:09:28.598872+0000","last_peered":"2024-05-08T18:09:28.598872+0000","last_clean":"2024-05-08T18:09:28.598872+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:09:28.598872+0000","last_undegraded":"2024-05-08T18:09:28.598872+0000","last_fullsized":"2024-05-08T18:09:28.598872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:08.738890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429230+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:11:01.429230+0000","last_peered":"2024-05-08T18:11:01.429230+0000","last_clean":"2024-05-08T18:11:01.429230+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:11:01.429230+0000","last_undegraded":"2024-05-08T18:11:01.429230+0000","last_fullsized":"2024-05-08T18:11:01.429230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:49.482320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688757+0000","last_change":"2024-05-08T18:08:49.515298+0000","last_active":"2024-05-08T18:12:02.688757+0000","last_peered":"2024-05-08T18:12:02.688757+0000","last_clean":"2024-05-08T18:12:02.688757+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:02.688757+0000","last_undegraded":"2024-05-08T18:12:02.688757+0000","last_fullsized":"2024-05-08T18:12:02.688757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:48.730204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429546+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:11:01.429546+0000","last_peered":"2024-05-08T18:11:01.429546+0000","last_clean":"2024-05-08T18:11:01.429546+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:11:01.429546+0000","last_undegraded":"2024-05-08T18:11:01.429546+0000","last_fullsized":"2024-05-08T18:11:01.429546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:05.053205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582954+0000","last_change":"2024-05-08T18:08:51.522113+0000","last_active":"2024-05-08T18:09:28.582954+0000","last_peered":"2024-05-08T18:09:28.582954+0000","last_clean":"2024-05-08T18:09:28.582954+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:09:28.582954+0000","last_undegraded":"2024-05-08T18:09:28.582954+0000","last_fullsized":"2024-05-08T18:09:28.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:38.116549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.603131+0000","last_change":"2024-05-08T18:08:53.521466+0000","last_active":"2024-05-08T18:10:59.603131+0000","last_peered":"2024-05-08T18:10:59.603131+0000","last_clean":"2024-05-08T18:10:59.603131+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:10:59.603131+0000","last_undegraded":"2024-05-08T18:10:59.603131+0000","last_fullsized":"2024-05-08T18:10:59.603131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:54.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.948610+0000","last_change":"2024-05-08T18:08:55.551517+0000","last_active":"2024-05-08T18:12:02.948610+0000","last_peered":"2024-05-08T18:12:02.948610+0000","last_clean":"2024-05-08T18:12:02.948610+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:02.948610+0000","last_undegraded":"2024-05-08T18:12:02.948610+0000","last_fullsized":"2024-05-08T18:12:02.948610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:54.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420148+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:11:06.420148+0000","last_peered":"2024-05-08T18:11:06.420148+0000","last_clean":"2024-05-08T18:11:06.420148+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:11:06.420148+0000","last_undegraded":"2024-05-08T18:11:06.420148+0000","last_fullsized":"2024-05-08T18:11:06.420148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.783846+0000","last_change":"2024-05-08T18:08:49.511424+0000","last_active":"2024-05-08T18:10:16.783846+0000","last_peered":"2024-05-08T18:10:16.783846+0000","last_clean":"2024-05-08T18:10:16.783846+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:10:16.783846+0000","last_undegraded":"2024-05-08T18:10:16.783846+0000","last_fullsized":"2024-05-08T18:10:16.783846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.346107+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:11:01.346107+0000","last_peered":"2024-05-08T18:11:01.346107+0000","last_clean":"2024-05-08T18:11:01.346107+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:11:01.346107+0000","last_undegraded":"2024-05-08T18:11:01.346107+0000","last_fullsized":"2024-05-08T18:11:01.346107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:07.886229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.121864+0000","last_change":"2024-05-08T18:08:51.518382+0000","last_active":"2024-05-08T18:11:01.121864+0000","last_peered":"2024-05-08T18:11:01.121864+0000","last_clean":"2024-05-08T18:11:01.121864+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:11:01.121864+0000","last_undegraded":"2024-05-08T18:11:01.121864+0000","last_fullsized":"2024-05-08T18:11:01.121864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:09.759130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597807+0000","last_change":"2024-05-08T18:08:53.558518+0000","last_active":"2024-05-08T18:09:28.597807+0000","last_peered":"2024-05-08T18:09:28.597807+0000","last_clean":"2024-05-08T18:09:28.597807+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:09:28.597807+0000","last_undegraded":"2024-05-08T18:09:28.597807+0000","last_fullsized":"2024-05-08T18:09:28.597807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:55.547274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.874118+0000","last_change":"2024-05-08T18:08:55.557075+0000","last_active":"2024-05-08T18:12:02.874118+0000","last_peered":"2024-05-08T18:12:02.874118+0000","last_clean":"2024-05-08T18:12:02.874118+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:02.874118+0000","last_undegraded":"2024-05-08T18:12:02.874118+0000","last_fullsized":"2024-05-08T18:12:02.874118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.278025+0000","last_change":"2024-05-08T18:08:57.569509+0000","last_active":"2024-05-08T18:11:01.278025+0000","last_peered":"2024-05-08T18:11:01.278025+0000","last_clean":"2024-05-08T18:11:01.278025+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:11:01.278025+0000","last_undegraded":"2024-05-08T18:11:01.278025+0000","last_fullsized":"2024-05-08T18:11:01.278025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:46.790373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862531+0000","last_change":"2024-05-08T18:08:49.518367+0000","last_active":"2024-05-08T18:12:02.862531+0000","last_peered":"2024-05-08T18:12:02.862531+0000","last_clean":"2024-05-08T18:12:02.862531+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:02.862531+0000","last_undegraded":"2024-05-08T18:12:02.862531+0000","last_fullsized":"2024-05-08T18:12:02.862531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:06.824034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587763+0000","last_change":"2024-05-08T18:08:47.529160+0000","last_active":"2024-05-08T18:09:28.587763+0000","last_peered":"2024-05-08T18:09:28.587763+0000","last_clean":"2024-05-08T18:09:28.587763+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:09:28.587763+0000","last_undegraded":"2024-05-08T18:09:28.587763+0000","last_fullsized":"2024-05-08T18:09:28.587763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:54.279504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607171+0000","last_change":"2024-05-08T18:08:51.511533+0000","last_active":"2024-05-08T18:09:28.607171+0000","last_peered":"2024-05-08T18:09:28.607171+0000","last_clean":"2024-05-08T18:09:28.607171+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:09:28.607171+0000","last_undegraded":"2024-05-08T18:09:28.607171+0000","last_fullsized":"2024-05-08T18:09:28.607171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:10.403888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.582144+0000","last_change":"2024-05-08T18:08:53.517418+0000","last_active":"2024-05-08T18:10:59.582144+0000","last_peered":"2024-05-08T18:10:59.582144+0000","last_clean":"2024-05-08T18:10:59.582144+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:10:59.582144+0000","last_undegraded":"2024-05-08T18:10:59.582144+0000","last_fullsized":"2024-05-08T18:10:59.582144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:45.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586484+0000","last_change":"2024-05-08T18:08:55.541260+0000","last_active":"2024-05-08T18:09:28.586484+0000","last_peered":"2024-05-08T18:09:28.586484+0000","last_clean":"2024-05-08T18:09:28.586484+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:09:28.586484+0000","last_undegraded":"2024-05-08T18:09:28.586484+0000","last_fullsized":"2024-05-08T18:09:28.586484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:47.311202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.828028+0000","last_change":"2024-05-08T18:08:57.568017+0000","last_active":"2024-05-08T18:12:02.828028+0000","last_peered":"2024-05-08T18:12:02.828028+0000","last_clean":"2024-05-08T18:12:02.828028+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:12:02.828028+0000","last_undegraded":"2024-05-08T18:12:02.828028+0000","last_fullsized":"2024-05-08T18:12:02.828028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.143701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.707182+0000","last_change":"2024-05-08T18:08:49.510311+0000","last_active":"2024-05-08T18:12:02.707182+0000","last_peered":"2024-05-08T18:12:02.707182+0000","last_clean":"2024-05-08T18:12:02.707182+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:02.707182+0000","last_undegraded":"2024-05-08T18:12:02.707182+0000","last_fullsized":"2024-05-08T18:12:02.707182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:19.250288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571588+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:09:28.571588+0000","last_peered":"2024-05-08T18:09:28.571588+0000","last_clean":"2024-05-08T18:09:28.571588+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:09:28.571588+0000","last_undegraded":"2024-05-08T18:09:28.571588+0000","last_fullsized":"2024-05-08T18:09:28.571588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:09.321105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602411+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:09:28.602411+0000","last_peered":"2024-05-08T18:09:28.602411+0000","last_clean":"2024-05-08T18:09:28.602411+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:09:28.602411+0000","last_undegraded":"2024-05-08T18:09:28.602411+0000","last_fullsized":"2024-05-08T18:09:28.602411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:48.933240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.429157+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:09:33.429157+0000","last_peered":"2024-05-08T18:09:33.429157+0000","last_clean":"2024-05-08T18:09:33.429157+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:09:33.429157+0000","last_undegraded":"2024-05-08T18:09:33.429157+0000","last_fullsized":"2024-05-08T18:09:33.429157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:30.152904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575232+0000","last_change":"2024-05-08T18:08:51.520538+0000","last_active":"2024-05-08T18:09:28.575232+0000","last_peered":"2024-05-08T18:09:28.575232+0000","last_clean":"2024-05-08T18:09:28.575232+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:09:28.575232+0000","last_undegraded":"2024-05-08T18:09:28.575232+0000","last_fullsized":"2024-05-08T18:09:28.575232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:05.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.624394+0000","last_change":"2024-05-08T18:08:53.552241+0000","last_active":"2024-05-08T18:12:02.624394+0000","last_peered":"2024-05-08T18:12:02.624394+0000","last_clean":"2024-05-08T18:12:02.624394+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:02.624394+0000","last_undegraded":"2024-05-08T18:12:02.624394+0000","last_fullsized":"2024-05-08T18:12:02.624394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:31.496707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580217+0000","last_change":"2024-05-08T18:08:55.565611+0000","last_active":"2024-05-08T18:09:28.580217+0000","last_peered":"2024-05-08T18:09:28.580217+0000","last_clean":"2024-05-08T18:09:28.580217+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:09:28.580217+0000","last_undegraded":"2024-05-08T18:09:28.580217+0000","last_fullsized":"2024-05-08T18:09:28.580217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:14.430171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.781603+0000","last_change":"2024-05-08T18:08:57.567916+0000","last_active":"2024-05-08T18:12:02.781603+0000","last_peered":"2024-05-08T18:12:02.781603+0000","last_clean":"2024-05-08T18:12:02.781603+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:02.781603+0000","last_undegraded":"2024-05-08T18:12:02.781603+0000","last_fullsized":"2024-05-08T18:12:02.781603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:51.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599193+0000","last_change":"2024-05-08T18:08:49.510047+0000","last_active":"2024-05-08T18:12:02.599193+0000","last_peered":"2024-05-08T18:12:02.599193+0000","last_clean":"2024-05-08T18:12:02.599193+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:12:02.599193+0000","last_undegraded":"2024-05-08T18:12:02.599193+0000","last_fullsized":"2024-05-08T18:12:02.599193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:12.681511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586341+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:09:28.586341+0000","last_peered":"2024-05-08T18:09:28.586341+0000","last_clean":"2024-05-08T18:09:28.586341+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:09:28.586341+0000","last_undegraded":"2024-05-08T18:09:28.586341+0000","last_fullsized":"2024-05-08T18:09:28.586341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:48.054967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576589+0000","last_change":"2024-05-08T18:08:47.515311+0000","last_active":"2024-05-08T18:09:28.576589+0000","last_peered":"2024-05-08T18:09:28.576589+0000","last_clean":"2024-05-08T18:09:28.576589+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:09:28.576589+0000","last_undegraded":"2024-05-08T18:09:28.576589+0000","last_fullsized":"2024-05-08T18:09:28.576589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607650+0000","last_change":"2024-05-08T18:08:51.512536+0000","last_active":"2024-05-08T18:09:28.607650+0000","last_peered":"2024-05-08T18:09:28.607650+0000","last_clean":"2024-05-08T18:09:28.607650+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:09:28.607650+0000","last_undegraded":"2024-05-08T18:09:28.607650+0000","last_fullsized":"2024-05-08T18:09:28.607650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:58.676437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754539+0000","last_change":"2024-05-08T18:08:53.530304+0000","last_active":"2024-05-08T18:12:01.754539+0000","last_peered":"2024-05-08T18:12:01.754539+0000","last_clean":"2024-05-08T18:12:01.754539+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:01.754539+0000","last_undegraded":"2024-05-08T18:12:01.754539+0000","last_fullsized":"2024-05-08T18:12:01.754539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:39.103025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592749+0000","last_change":"2024-05-08T18:08:55.568400+0000","last_active":"2024-05-08T18:09:28.592749+0000","last_peered":"2024-05-08T18:09:28.592749+0000","last_clean":"2024-05-08T18:09:28.592749+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:09:28.592749+0000","last_undegraded":"2024-05-08T18:09:28.592749+0000","last_fullsized":"2024-05-08T18:09:28.592749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:48.835521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.496391+0000","last_change":"2024-05-08T18:08:57.579069+0000","last_active":"2024-05-08T18:10:16.496391+0000","last_peered":"2024-05-08T18:10:16.496391+0000","last_clean":"2024-05-08T18:10:16.496391+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:10:16.496391+0000","last_undegraded":"2024-05-08T18:10:16.496391+0000","last_fullsized":"2024-05-08T18:10:16.496391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:45.209949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755355+0000","last_change":"2024-05-08T18:08:49.501820+0000","last_active":"2024-05-08T18:12:02.755355+0000","last_peered":"2024-05-08T18:12:02.755355+0000","last_clean":"2024-05-08T18:12:02.755355+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:02.755355+0000","last_undegraded":"2024-05-08T18:12:02.755355+0000","last_fullsized":"2024-05-08T18:12:02.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579628+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:09:28.579628+0000","last_peered":"2024-05-08T18:09:28.579628+0000","last_clean":"2024-05-08T18:09:28.579628+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:09:28.579628+0000","last_undegraded":"2024-05-08T18:09:28.579628+0000","last_fullsized":"2024-05-08T18:09:28.579628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576151+0000","last_change":"2024-05-08T18:08:47.513124+0000","last_active":"2024-05-08T18:09:28.576151+0000","last_peered":"2024-05-08T18:09:28.576151+0000","last_clean":"2024-05-08T18:09:28.576151+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:09:28.576151+0000","last_undegraded":"2024-05-08T18:09:28.576151+0000","last_fullsized":"2024-05-08T18:09:28.576151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590814+0000","last_change":"2024-05-08T18:08:51.508831+0000","last_active":"2024-05-08T18:09:28.590814+0000","last_peered":"2024-05-08T18:09:28.590814+0000","last_clean":"2024-05-08T18:09:28.590814+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:09:28.590814+0000","last_undegraded":"2024-05-08T18:09:28.590814+0000","last_fullsized":"2024-05-08T18:09:28.590814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:04.126643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754979+0000","last_change":"2024-05-08T18:08:53.525229+0000","last_active":"2024-05-08T18:12:01.754979+0000","last_peered":"2024-05-08T18:12:01.754979+0000","last_clean":"2024-05-08T18:12:01.754979+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:01.754979+0000","last_undegraded":"2024-05-08T18:12:01.754979+0000","last_fullsized":"2024-05-08T18:12:01.754979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:06.372182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581183+0000","last_change":"2024-05-08T18:08:55.567310+0000","last_active":"2024-05-08T18:09:28.581183+0000","last_peered":"2024-05-08T18:09:28.581183+0000","last_clean":"2024-05-08T18:09:28.581183+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:09:28.581183+0000","last_undegraded":"2024-05-08T18:09:28.581183+0000","last_fullsized":"2024-05-08T18:09:28.581183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:30.447596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.450125+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:09:33.450125+0000","last_peered":"2024-05-08T18:09:33.450125+0000","last_clean":"2024-05-08T18:09:33.450125+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:09:33.450125+0000","last_undegraded":"2024-05-08T18:09:33.450125+0000","last_fullsized":"2024-05-08T18:09:33.450125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:09.186479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774957+0000","last_change":"2024-05-08T18:08:49.493587+0000","last_active":"2024-05-08T18:12:02.774957+0000","last_peered":"2024-05-08T18:12:02.774957+0000","last_clean":"2024-05-08T18:12:02.774957+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:02.774957+0000","last_undegraded":"2024-05-08T18:12:02.774957+0000","last_fullsized":"2024-05-08T18:12:02.774957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593308+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:09:28.593308+0000","last_peered":"2024-05-08T18:09:28.593308+0000","last_clean":"2024-05-08T18:09:28.593308+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:09:28.593308+0000","last_undegraded":"2024-05-08T18:09:28.593308+0000","last_fullsized":"2024-05-08T18:09:28.593308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:57:14.342510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581432+0000","last_change":"2024-05-08T18:08:47.507237+0000","last_active":"2024-05-08T18:09:28.581432+0000","last_peered":"2024-05-08T18:09:28.581432+0000","last_clean":"2024-05-08T18:09:28.581432+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:09:28.581432+0000","last_undegraded":"2024-05-08T18:09:28.581432+0000","last_fullsized":"2024-05-08T18:09:28.581432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579952+0000","last_change":"2024-05-08T18:08:51.510525+0000","last_active":"2024-05-08T18:09:28.579952+0000","last_peered":"2024-05-08T18:09:28.579952+0000","last_clean":"2024-05-08T18:09:28.579952+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:09:28.579952+0000","last_undegraded":"2024-05-08T18:09:28.579952+0000","last_fullsized":"2024-05-08T18:09:28.579952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:35.735245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.660422+0000","last_change":"2024-05-08T18:08:53.551086+0000","last_active":"2024-05-08T18:12:01.660422+0000","last_peered":"2024-05-08T18:12:01.660422+0000","last_clean":"2024-05-08T18:12:01.660422+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:01.660422+0000","last_undegraded":"2024-05-08T18:12:01.660422+0000","last_fullsized":"2024-05-08T18:12:01.660422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:35.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602251+0000","last_change":"2024-05-08T18:08:55.569487+0000","last_active":"2024-05-08T18:09:28.602251+0000","last_peered":"2024-05-08T18:09:28.602251+0000","last_clean":"2024-05-08T18:09:28.602251+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:09:28.602251+0000","last_undegraded":"2024-05-08T18:09:28.602251+0000","last_fullsized":"2024-05-08T18:09:28.602251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:08.021899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.257052+0000","last_change":"2024-05-08T18:08:57.567414+0000","last_active":"2024-05-08T18:11:01.257052+0000","last_peered":"2024-05-08T18:11:01.257052+0000","last_clean":"2024-05-08T18:11:01.257052+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:11:01.257052+0000","last_undegraded":"2024-05-08T18:11:01.257052+0000","last_fullsized":"2024-05-08T18:11:01.257052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:16.573083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689283+0000","last_change":"2024-05-08T18:09:28.612611+0000","last_active":"2024-05-08T18:12:02.689283+0000","last_peered":"2024-05-08T18:12:02.689283+0000","last_clean":"2024-05-08T18:12:02.689283+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:12:02.689283+0000","last_undegraded":"2024-05-08T18:12:02.689283+0000","last_fullsized":"2024-05-08T18:12:02.689283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892803+0000","last_change":"2024-05-08T18:08:47.517520+0000","last_active":"2024-05-08T18:09:31.892803+0000","last_peered":"2024-05-08T18:09:31.892803+0000","last_clean":"2024-05-08T18:09:31.892803+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:09:31.892803+0000","last_undegraded":"2024-05-08T18:09:31.892803+0000","last_fullsized":"2024-05-08T18:09:31.892803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580404+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:09:28.580404+0000","last_peered":"2024-05-08T18:09:28.580404+0000","last_clean":"2024-05-08T18:09:28.580404+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:09:28.580404+0000","last_undegraded":"2024-05-08T18:09:28.580404+0000","last_fullsized":"2024-05-08T18:09:28.580404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:02.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417770+0000","last_change":"2024-05-08T18:08:51.511005+0000","last_active":"2024-05-08T18:10:56.417770+0000","last_peered":"2024-05-08T18:10:56.417770+0000","last_clean":"2024-05-08T18:10:56.417770+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:10:56.417770+0000","last_undegraded":"2024-05-08T18:10:56.417770+0000","last_fullsized":"2024-05-08T18:10:56.417770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:10.746341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.601402+0000","last_change":"2024-05-08T18:08:53.554240+0000","last_active":"2024-05-08T18:10:59.601402+0000","last_peered":"2024-05-08T18:10:59.601402+0000","last_clean":"2024-05-08T18:10:59.601402+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:10:59.601402+0000","last_undegraded":"2024-05-08T18:10:59.601402+0000","last_fullsized":"2024-05-08T18:10:59.601402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:40.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581262+0000","last_change":"2024-05-08T18:08:55.551427+0000","last_active":"2024-05-08T18:09:28.581262+0000","last_peered":"2024-05-08T18:09:28.581262+0000","last_clean":"2024-05-08T18:09:28.581262+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:09:28.581262+0000","last_undegraded":"2024-05-08T18:09:28.581262+0000","last_fullsized":"2024-05-08T18:09:28.581262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:25.290543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.494426+0000","last_change":"2024-05-08T18:08:57.564941+0000","last_active":"2024-05-08T18:11:01.494426+0000","last_peered":"2024-05-08T18:11:01.494426+0000","last_clean":"2024-05-08T18:11:01.494426+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:11:01.494426+0000","last_undegraded":"2024-05-08T18:11:01.494426+0000","last_fullsized":"2024-05-08T18:11:01.494426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:55.289619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597441+0000","last_change":"2024-05-08T18:08:49.519773+0000","last_active":"2024-05-08T18:12:02.597441+0000","last_peered":"2024-05-08T18:12:02.597441+0000","last_clean":"2024-05-08T18:12:02.597441+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:02.597441+0000","last_undegraded":"2024-05-08T18:12:02.597441+0000","last_fullsized":"2024-05-08T18:12:02.597441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583257+0000","last_change":"2024-05-08T18:08:47.517709+0000","last_active":"2024-05-08T18:09:28.583257+0000","last_peered":"2024-05-08T18:09:28.583257+0000","last_clean":"2024-05-08T18:09:28.583257+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:09:28.583257+0000","last_undegraded":"2024-05-08T18:09:28.583257+0000","last_fullsized":"2024-05-08T18:09:28.583257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598381+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:09:28.598381+0000","last_peered":"2024-05-08T18:09:28.598381+0000","last_clean":"2024-05-08T18:09:28.598381+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:09:28.598381+0000","last_undegraded":"2024-05-08T18:09:28.598381+0000","last_fullsized":"2024-05-08T18:09:28.598381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:21.080378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592808+0000","last_change":"2024-05-08T18:08:51.505864+0000","last_active":"2024-05-08T18:09:28.592808+0000","last_peered":"2024-05-08T18:09:28.592808+0000","last_clean":"2024-05-08T18:09:28.592808+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:09:28.592808+0000","last_undegraded":"2024-05-08T18:09:28.592808+0000","last_fullsized":"2024-05-08T18:09:28.592808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:06.233890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572702+0000","last_change":"2024-05-08T18:08:53.553633+0000","last_active":"2024-05-08T18:09:28.572702+0000","last_peered":"2024-05-08T18:09:28.572702+0000","last_clean":"2024-05-08T18:09:28.572702+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:09:28.572702+0000","last_undegraded":"2024-05-08T18:09:28.572702+0000","last_fullsized":"2024-05-08T18:09:28.572702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:23.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.768768+0000","last_change":"2024-05-08T18:08:55.556466+0000","last_active":"2024-05-08T18:12:02.768768+0000","last_peered":"2024-05-08T18:12:02.768768+0000","last_clean":"2024-05-08T18:12:02.768768+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:02.768768+0000","last_undegraded":"2024-05-08T18:12:02.768768+0000","last_fullsized":"2024-05-08T18:12:02.768768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598317+0000","last_change":"2024-05-08T18:08:57.559589+0000","last_active":"2024-05-08T18:09:28.598317+0000","last_peered":"2024-05-08T18:09:28.598317+0000","last_clean":"2024-05-08T18:09:28.598317+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:09:28.598317+0000","last_undegraded":"2024-05-08T18:09:28.598317+0000","last_fullsized":"2024-05-08T18:09:28.598317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:44.469070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270592+0000","last_change":"2024-05-08T18:08:49.510615+0000","last_active":"2024-05-08T18:12:02.270592+0000","last_peered":"2024-05-08T18:12:02.270592+0000","last_clean":"2024-05-08T18:12:02.270592+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:02.270592+0000","last_undegraded":"2024-05-08T18:12:02.270592+0000","last_fullsized":"2024-05-08T18:12:02.270592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:03.732312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892852+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:09:31.892852+0000","last_peered":"2024-05-08T18:09:31.892852+0000","last_clean":"2024-05-08T18:09:31.892852+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:09:31.892852+0000","last_undegraded":"2024-05-08T18:09:31.892852+0000","last_fullsized":"2024-05-08T18:09:31.892852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:57.257231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580836+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:09:28.580836+0000","last_peered":"2024-05-08T18:09:28.580836+0000","last_clean":"2024-05-08T18:09:28.580836+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:09:28.580836+0000","last_undegraded":"2024-05-08T18:09:28.580836+0000","last_fullsized":"2024-05-08T18:09:28.580836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:37.747046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603006+0000","last_change":"2024-05-08T18:08:51.513370+0000","last_active":"2024-05-08T18:09:28.603006+0000","last_peered":"2024-05-08T18:09:28.603006+0000","last_clean":"2024-05-08T18:09:28.603006+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:09:28.603006+0000","last_undegraded":"2024-05-08T18:09:28.603006+0000","last_fullsized":"2024-05-08T18:09:28.603006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:16.244827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602730+0000","last_change":"2024-05-08T18:08:53.549741+0000","last_active":"2024-05-08T18:09:28.602730+0000","last_peered":"2024-05-08T18:09:28.602730+0000","last_clean":"2024-05-08T18:09:28.602730+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:09:28.602730+0000","last_undegraded":"2024-05-08T18:09:28.602730+0000","last_fullsized":"2024-05-08T18:09:28.602730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:21.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.924485+0000","last_change":"2024-05-08T18:08:55.543586+0000","last_active":"2024-05-08T18:12:02.924485+0000","last_peered":"2024-05-08T18:12:02.924485+0000","last_clean":"2024-05-08T18:12:02.924485+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:02.924485+0000","last_undegraded":"2024-05-08T18:12:02.924485+0000","last_fullsized":"2024-05-08T18:12:02.924485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.633075+0000","last_change":"2024-05-08T18:08:57.573590+0000","last_active":"2024-05-08T18:11:01.633075+0000","last_peered":"2024-05-08T18:11:01.633075+0000","last_clean":"2024-05-08T18:11:01.633075+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:11:01.633075+0000","last_undegraded":"2024-05-08T18:11:01.633075+0000","last_fullsized":"2024-05-08T18:11:01.633075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425042+0000","last_change":"2024-05-08T18:09:28.589121+0000","last_active":"2024-05-08T18:10:56.425042+0000","last_peered":"2024-05-08T18:10:56.425042+0000","last_clean":"2024-05-08T18:10:56.425042+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:10:56.425042+0000","last_undegraded":"2024-05-08T18:10:56.425042+0000","last_fullsized":"2024-05-08T18:10:56.425042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:55.349405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584979+0000","last_change":"2024-05-08T18:08:47.512221+0000","last_active":"2024-05-08T18:09:28.584979+0000","last_peered":"2024-05-08T18:09:28.584979+0000","last_clean":"2024-05-08T18:09:28.584979+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:09:28.584979+0000","last_undegraded":"2024-05-08T18:09:28.584979+0000","last_fullsized":"2024-05-08T18:09:28.584979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599261+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:09:28.599261+0000","last_peered":"2024-05-08T18:09:28.599261+0000","last_clean":"2024-05-08T18:09:28.599261+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:09:28.599261+0000","last_undegraded":"2024-05-08T18:09:28.599261+0000","last_fullsized":"2024-05-08T18:09:28.599261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:13.321704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589247+0000","last_change":"2024-05-08T18:08:51.510230+0000","last_active":"2024-05-08T18:09:28.589247+0000","last_peered":"2024-05-08T18:09:28.589247+0000","last_clean":"2024-05-08T18:09:28.589247+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:09:28.589247+0000","last_undegraded":"2024-05-08T18:09:28.589247+0000","last_fullsized":"2024-05-08T18:09:28.589247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:26.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.426469+0000","last_change":"2024-05-08T18:08:53.550482+0000","last_active":"2024-05-08T18:11:01.426469+0000","last_peered":"2024-05-08T18:11:01.426469+0000","last_clean":"2024-05-08T18:11:01.426469+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:11:01.426469+0000","last_undegraded":"2024-05-08T18:11:01.426469+0000","last_fullsized":"2024-05-08T18:11:01.426469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:48.461545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7721,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":87,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579744+0000","last_change":"2024-05-08T18:08:55.554634+0000","last_active":"2024-05-08T18:09:28.579744+0000","last_peered":"2024-05-08T18:09:28.579744+0000","last_clean":"2024-05-08T18:09:28.579744+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:09:28.579744+0000","last_undegraded":"2024-05-08T18:09:28.579744+0000","last_fullsized":"2024-05-08T18:09:28.579744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586328+0000","last_change":"2024-05-08T18:08:57.564366+0000","last_active":"2024-05-08T18:09:28.586328+0000","last_peered":"2024-05-08T18:09:28.586328+0000","last_clean":"2024-05-08T18:09:28.586328+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:09:28.586328+0000","last_undegraded":"2024-05-08T18:09:28.586328+0000","last_fullsized":"2024-05-08T18:09:28.586328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:12.274417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.585033+0000","last_change":"2024-05-08T18:08:57.586231+0000","last_active":"2024-05-08T18:09:28.585033+0000","last_peered":"2024-05-08T18:09:28.585033+0000","last_clean":"2024-05-08T18:09:28.585033+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:09:28.585033+0000","last_undegraded":"2024-05-08T18:09:28.585033+0000","last_fullsized":"2024-05-08T18:09:28.585033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:26.309299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391896+0000","last_change":"2024-05-08T18:08:49.517973+0000","last_active":"2024-05-08T18:12:02.391896+0000","last_peered":"2024-05-08T18:12:02.391896+0000","last_clean":"2024-05-08T18:12:02.391896+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:12:02.391896+0000","last_undegraded":"2024-05-08T18:12:02.391896+0000","last_fullsized":"2024-05-08T18:12:02.391896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593683+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:09:28.593683+0000","last_peered":"2024-05-08T18:09:28.593683+0000","last_clean":"2024-05-08T18:09:28.593683+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:09:28.593683+0000","last_undegraded":"2024-05-08T18:09:28.593683+0000","last_fullsized":"2024-05-08T18:09:28.593683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:09.399882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576250+0000","last_change":"2024-05-08T18:08:51.517003+0000","last_active":"2024-05-08T18:09:28.576250+0000","last_peered":"2024-05-08T18:09:28.576250+0000","last_clean":"2024-05-08T18:09:28.576250+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:09:28.576250+0000","last_undegraded":"2024-05-08T18:09:28.576250+0000","last_fullsized":"2024-05-08T18:09:28.576250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.213274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.587556+0000","last_change":"2024-05-08T18:08:53.546900+0000","last_active":"2024-05-08T18:10:59.587556+0000","last_peered":"2024-05-08T18:10:59.587556+0000","last_clean":"2024-05-08T18:10:59.587556+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:10:59.587556+0000","last_undegraded":"2024-05-08T18:10:59.587556+0000","last_fullsized":"2024-05-08T18:10:59.587556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:31.873538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588783+0000","last_change":"2024-05-08T18:08:55.558807+0000","last_active":"2024-05-08T18:09:28.588783+0000","last_peered":"2024-05-08T18:09:28.588783+0000","last_clean":"2024-05-08T18:09:28.588783+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:09:28.588783+0000","last_undegraded":"2024-05-08T18:09:28.588783+0000","last_fullsized":"2024-05-08T18:09:28.588783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:28.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.395796+0000","last_change":"2024-05-08T18:08:57.554621+0000","last_active":"2024-05-08T18:12:02.395796+0000","last_peered":"2024-05-08T18:12:02.395796+0000","last_clean":"2024-05-08T18:12:02.395796+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:02.395796+0000","last_undegraded":"2024-05-08T18:12:02.395796+0000","last_fullsized":"2024-05-08T18:12:02.395796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:36.523989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392595+0000","last_change":"2024-05-08T18:08:49.515316+0000","last_active":"2024-05-08T18:12:02.392595+0000","last_peered":"2024-05-08T18:12:02.392595+0000","last_clean":"2024-05-08T18:12:02.392595+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:02.392595+0000","last_undegraded":"2024-05-08T18:12:02.392595+0000","last_fullsized":"2024-05-08T18:12:02.392595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430491+0000","last_change":"2024-05-08T18:08:47.514514+0000","last_active":"2024-05-08T18:11:16.430491+0000","last_peered":"2024-05-08T18:11:16.430491+0000","last_clean":"2024-05-08T18:11:16.430491+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:11:16.430491+0000","last_undegraded":"2024-05-08T18:11:16.430491+0000","last_fullsized":"2024-05-08T18:11:16.430491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603376+0000","last_change":"2024-05-08T18:08:51.510753+0000","last_active":"2024-05-08T18:09:28.603376+0000","last_peered":"2024-05-08T18:09:28.603376+0000","last_clean":"2024-05-08T18:09:28.603376+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:09:28.603376+0000","last_undegraded":"2024-05-08T18:09:28.603376+0000","last_fullsized":"2024-05-08T18:09:28.603376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:41.695717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.670842+0000","last_change":"2024-05-08T18:08:53.524878+0000","last_active":"2024-05-08T18:12:01.670842+0000","last_peered":"2024-05-08T18:12:01.670842+0000","last_clean":"2024-05-08T18:12:01.670842+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:01.670842+0000","last_undegraded":"2024-05-08T18:12:01.670842+0000","last_fullsized":"2024-05-08T18:12:01.670842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:40.829168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580812+0000","last_change":"2024-05-08T18:08:55.565178+0000","last_active":"2024-05-08T18:09:28.580812+0000","last_peered":"2024-05-08T18:09:28.580812+0000","last_clean":"2024-05-08T18:09:28.580812+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:09:28.580812+0000","last_undegraded":"2024-05-08T18:09:28.580812+0000","last_fullsized":"2024-05-08T18:09:28.580812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:05.564412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578264+0000","last_change":"2024-05-08T18:08:57.565323+0000","last_active":"2024-05-08T18:09:28.578264+0000","last_peered":"2024-05-08T18:09:28.578264+0000","last_clean":"2024-05-08T18:09:28.578264+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:09:28.578264+0000","last_undegraded":"2024-05-08T18:09:28.578264+0000","last_fullsized":"2024-05-08T18:09:28.578264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:04.648587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755243+0000","last_change":"2024-05-08T18:08:49.506944+0000","last_active":"2024-05-08T18:12:02.755243+0000","last_peered":"2024-05-08T18:12:02.755243+0000","last_clean":"2024-05-08T18:12:02.755243+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:02.755243+0000","last_undegraded":"2024-05-08T18:12:02.755243+0000","last_fullsized":"2024-05-08T18:12:02.755243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591593+0000","last_change":"2024-05-08T18:08:47.513365+0000","last_active":"2024-05-08T18:09:28.591593+0000","last_peered":"2024-05-08T18:09:28.591593+0000","last_clean":"2024-05-08T18:09:28.591593+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:09:28.591593+0000","last_undegraded":"2024-05-08T18:09:28.591593+0000","last_fullsized":"2024-05-08T18:09:28.591593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578971+0000","last_change":"2024-05-08T18:08:51.521427+0000","last_active":"2024-05-08T18:09:28.578971+0000","last_peered":"2024-05-08T18:09:28.578971+0000","last_clean":"2024-05-08T18:09:28.578971+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:09:28.578971+0000","last_undegraded":"2024-05-08T18:09:28.578971+0000","last_fullsized":"2024-05-08T18:09:28.578971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:32.182561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.761960+0000","last_change":"2024-05-08T18:08:53.517027+0000","last_active":"2024-05-08T18:12:01.761960+0000","last_peered":"2024-05-08T18:12:01.761960+0000","last_clean":"2024-05-08T18:12:01.761960+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:01.761960+0000","last_undegraded":"2024-05-08T18:12:01.761960+0000","last_fullsized":"2024-05-08T18:12:01.761960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:22.586335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572557+0000","last_change":"2024-05-08T18:08:55.556729+0000","last_active":"2024-05-08T18:09:28.572557+0000","last_peered":"2024-05-08T18:09:28.572557+0000","last_clean":"2024-05-08T18:09:28.572557+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:09:28.572557+0000","last_undegraded":"2024-05-08T18:09:28.572557+0000","last_fullsized":"2024-05-08T18:09:28.572557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597437+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:09:28.597437+0000","last_peered":"2024-05-08T18:09:28.597437+0000","last_clean":"2024-05-08T18:09:28.597437+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:09:28.597437+0000","last_undegraded":"2024-05-08T18:09:28.597437+0000","last_fullsized":"2024-05-08T18:09:28.597437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:48.822666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'17","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.269318+0000","last_change":"2024-05-08T18:08:49.512382+0000","last_active":"2024-05-08T18:12:02.269318+0000","last_peered":"2024-05-08T18:12:02.269318+0000","last_clean":"2024-05-08T18:12:02.269318+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:02.269318+0000","last_undegraded":"2024-05-08T18:12:02.269318+0000","last_fullsized":"2024-05-08T18:12:02.269318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.812761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.742937+0000","last_change":"2024-05-08T18:08:47.495539+0000","last_active":"2024-05-08T18:12:02.742937+0000","last_peered":"2024-05-08T18:12:02.742937+0000","last_clean":"2024-05-08T18:12:02.742937+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:12:02.742937+0000","last_undegraded":"2024-05-08T18:12:02.742937+0000","last_fullsized":"2024-05-08T18:12:02.742937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592581+0000","last_change":"2024-05-08T18:08:51.502037+0000","last_active":"2024-05-08T18:09:28.592581+0000","last_peered":"2024-05-08T18:09:28.592581+0000","last_clean":"2024-05-08T18:09:28.592581+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:09:28.592581+0000","last_undegraded":"2024-05-08T18:09:28.592581+0000","last_fullsized":"2024-05-08T18:09:28.592581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:20.268773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.567089+0000","last_change":"2024-05-08T18:08:53.521376+0000","last_active":"2024-05-08T18:10:59.567089+0000","last_peered":"2024-05-08T18:10:59.567089+0000","last_clean":"2024-05-08T18:10:59.567089+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:10:59.567089+0000","last_undegraded":"2024-05-08T18:10:59.567089+0000","last_fullsized":"2024-05-08T18:10:59.567089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:32.004417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580450+0000","last_change":"2024-05-08T18:08:55.546548+0000","last_active":"2024-05-08T18:09:28.580450+0000","last_peered":"2024-05-08T18:09:28.580450+0000","last_clean":"2024-05-08T18:09:28.580450+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:09:28.580450+0000","last_undegraded":"2024-05-08T18:09:28.580450+0000","last_fullsized":"2024-05-08T18:09:28.580450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:18.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.491598+0000","last_change":"2024-05-08T18:08:49.510714+0000","last_active":"2024-05-08T18:10:16.491598+0000","last_peered":"2024-05-08T18:10:16.491598+0000","last_clean":"2024-05-08T18:10:16.491598+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:10:16.491598+0000","last_undegraded":"2024-05-08T18:10:16.491598+0000","last_fullsized":"2024-05-08T18:10:16.491598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:41.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.893083+0000","last_change":"2024-05-08T18:08:47.516678+0000","last_active":"2024-05-08T18:09:31.893083+0000","last_peered":"2024-05-08T18:09:31.893083+0000","last_clean":"2024-05-08T18:09:31.893083+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:09:31.893083+0000","last_undegraded":"2024-05-08T18:09:31.893083+0000","last_fullsized":"2024-05-08T18:09:31.893083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:38.680445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584360+0000","last_change":"2024-05-08T18:08:51.511759+0000","last_active":"2024-05-08T18:09:28.584360+0000","last_peered":"2024-05-08T18:09:28.584360+0000","last_clean":"2024-05-08T18:09:28.584360+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:09:28.584360+0000","last_undegraded":"2024-05-08T18:09:28.584360+0000","last_fullsized":"2024-05-08T18:09:28.584360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.597073+0000","last_change":"2024-05-08T18:08:53.525502+0000","last_active":"2024-05-08T18:10:59.597073+0000","last_peered":"2024-05-08T18:10:59.597073+0000","last_clean":"2024-05-08T18:10:59.597073+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:10:59.597073+0000","last_undegraded":"2024-05-08T18:10:59.597073+0000","last_fullsized":"2024-05-08T18:10:59.597073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:21.841040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584718+0000","last_change":"2024-05-08T18:08:55.547190+0000","last_active":"2024-05-08T18:09:28.584718+0000","last_peered":"2024-05-08T18:09:28.584718+0000","last_clean":"2024-05-08T18:09:28.584718+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:09:28.584718+0000","last_undegraded":"2024-05-08T18:09:28.584718+0000","last_fullsized":"2024-05-08T18:09:28.584718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:41.115717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.484509+0000","last_change":"2024-05-08T18:08:57.565259+0000","last_active":"2024-05-08T18:11:01.484509+0000","last_peered":"2024-05-08T18:11:01.484509+0000","last_clean":"2024-05-08T18:11:01.484509+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:11:01.484509+0000","last_undegraded":"2024-05-08T18:11:01.484509+0000","last_fullsized":"2024-05-08T18:11:01.484509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.143663+0000","last_change":"2024-05-08T18:08:49.500137+0000","last_active":"2024-05-08T18:09:34.143663+0000","last_peered":"2024-05-08T18:09:34.143663+0000","last_clean":"2024-05-08T18:09:34.143663+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:09:34.143663+0000","last_undegraded":"2024-05-08T18:09:34.143663+0000","last_fullsized":"2024-05-08T18:09:34.143663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571914+0000","last_change":"2024-05-08T18:08:47.514529+0000","last_active":"2024-05-08T18:09:28.571914+0000","last_peered":"2024-05-08T18:09:28.571914+0000","last_clean":"2024-05-08T18:09:28.571914+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:09:28.571914+0000","last_undegraded":"2024-05-08T18:09:28.571914+0000","last_fullsized":"2024-05-08T18:09:28.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589371+0000","last_change":"2024-05-08T18:08:51.508583+0000","last_active":"2024-05-08T18:09:28.589371+0000","last_peered":"2024-05-08T18:09:28.589371+0000","last_clean":"2024-05-08T18:09:28.589371+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:09:28.589371+0000","last_undegraded":"2024-05-08T18:09:28.589371+0000","last_fullsized":"2024-05-08T18:09:28.589371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:08.838007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.568180+0000","last_change":"2024-05-08T18:08:53.547333+0000","last_active":"2024-05-08T18:10:59.568180+0000","last_peered":"2024-05-08T18:10:59.568180+0000","last_clean":"2024-05-08T18:10:59.568180+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:10:59.568180+0000","last_undegraded":"2024-05-08T18:10:59.568180+0000","last_fullsized":"2024-05-08T18:10:59.568180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:19.951491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574072+0000","last_change":"2024-05-08T18:08:55.565939+0000","last_active":"2024-05-08T18:09:28.574072+0000","last_peered":"2024-05-08T18:09:28.574072+0000","last_clean":"2024-05-08T18:09:28.574072+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:09:28.574072+0000","last_undegraded":"2024-05-08T18:09:28.574072+0000","last_fullsized":"2024-05-08T18:09:28.574072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592447+0000","last_change":"2024-05-08T18:08:57.553775+0000","last_active":"2024-05-08T18:09:28.592447+0000","last_peered":"2024-05-08T18:09:28.592447+0000","last_clean":"2024-05-08T18:09:28.592447+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:09:28.592447+0000","last_undegraded":"2024-05-08T18:09:28.592447+0000","last_fullsized":"2024-05-08T18:09:28.592447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:06.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597284+0000","last_change":"2024-05-08T18:08:49.514883+0000","last_active":"2024-05-08T18:12:02.597284+0000","last_peered":"2024-05-08T18:12:02.597284+0000","last_clean":"2024-05-08T18:12:02.597284+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:02.597284+0000","last_undegraded":"2024-05-08T18:12:02.597284+0000","last_fullsized":"2024-05-08T18:12:02.597284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:37.616434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572752+0000","last_change":"2024-05-08T18:08:47.519395+0000","last_active":"2024-05-08T18:09:28.572752+0000","last_peered":"2024-05-08T18:09:28.572752+0000","last_clean":"2024-05-08T18:09:28.572752+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:09:28.572752+0000","last_undegraded":"2024-05-08T18:09:28.572752+0000","last_fullsized":"2024-05-08T18:09:28.572752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.596279+0000","last_change":"2024-05-08T18:09:28.594515+0000","last_active":"2024-05-08T18:09:28.596279+0000","last_peered":"2024-05-08T18:09:28.596279+0000","last_clean":"2024-05-08T18:09:28.596279+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:09:28.596279+0000","last_undegraded":"2024-05-08T18:09:28.596279+0000","last_fullsized":"2024-05-08T18:09:28.596279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:46.308954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.593776+0000","last_change":"2024-05-08T18:08:53.515915+0000","last_active":"2024-05-08T18:10:59.593776+0000","last_peered":"2024-05-08T18:10:59.593776+0000","last_clean":"2024-05-08T18:10:59.593776+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:10:59.593776+0000","last_undegraded":"2024-05-08T18:10:59.593776+0000","last_fullsized":"2024-05-08T18:10:59.593776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:06.840324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578824+0000","last_change":"2024-05-08T18:08:55.554524+0000","last_active":"2024-05-08T18:09:28.578824+0000","last_peered":"2024-05-08T18:09:28.578824+0000","last_clean":"2024-05-08T18:09:28.578824+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:09:28.578824+0000","last_undegraded":"2024-05-08T18:09:28.578824+0000","last_fullsized":"2024-05-08T18:09:28.578824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.628108+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:01.628108+0000","last_peered":"2024-05-08T18:11:01.628108+0000","last_clean":"2024-05-08T18:11:01.628108+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:01.628108+0000","last_undegraded":"2024-05-08T18:11:01.628108+0000","last_fullsized":"2024-05-08T18:11:01.628108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:07.709412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755239+0000","last_change":"2024-05-08T18:08:49.494211+0000","last_active":"2024-05-08T18:12:02.755239+0000","last_peered":"2024-05-08T18:12:02.755239+0000","last_clean":"2024-05-08T18:12:02.755239+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:02.755239+0000","last_undegraded":"2024-05-08T18:12:02.755239+0000","last_fullsized":"2024-05-08T18:12:02.755239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.435190+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:09:33.435190+0000","last_peered":"2024-05-08T18:09:33.435190+0000","last_clean":"2024-05-08T18:09:33.435190+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:09:33.435190+0000","last_undegraded":"2024-05-08T18:09:33.435190+0000","last_fullsized":"2024-05-08T18:09:33.435190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:44.062312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.108918+0000","last_change":"2024-05-08T18:08:51.520425+0000","last_active":"2024-05-08T18:11:01.108918+0000","last_peered":"2024-05-08T18:11:01.108918+0000","last_clean":"2024-05-08T18:11:01.108918+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:11:01.108918+0000","last_undegraded":"2024-05-08T18:11:01.108918+0000","last_fullsized":"2024-05-08T18:11:01.108918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:44.630963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602335+0000","last_change":"2024-05-08T18:08:53.555586+0000","last_active":"2024-05-08T18:09:28.602335+0000","last_peered":"2024-05-08T18:09:28.602335+0000","last_clean":"2024-05-08T18:09:28.602335+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:09:28.602335+0000","last_undegraded":"2024-05-08T18:09:28.602335+0000","last_fullsized":"2024-05-08T18:09:28.602335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:12.189650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754623+0000","last_change":"2024-05-08T18:08:55.549323+0000","last_active":"2024-05-08T18:12:01.754623+0000","last_peered":"2024-05-08T18:12:01.754623+0000","last_clean":"2024-05-08T18:12:01.754623+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:01.754623+0000","last_undegraded":"2024-05-08T18:12:01.754623+0000","last_fullsized":"2024-05-08T18:12:01.754623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:43.656689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.446010+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:10:57.446010+0000","last_peered":"2024-05-08T18:10:57.446010+0000","last_clean":"2024-05-08T18:10:57.446010+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:10:57.446010+0000","last_undegraded":"2024-05-08T18:10:57.446010+0000","last_fullsized":"2024-05-08T18:10:57.446010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:56.783174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755627+0000","last_change":"2024-05-08T18:08:49.492567+0000","last_active":"2024-05-08T18:12:02.755627+0000","last_peered":"2024-05-08T18:12:02.755627+0000","last_clean":"2024-05-08T18:12:02.755627+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:02.755627+0000","last_undegraded":"2024-05-08T18:12:02.755627+0000","last_fullsized":"2024-05-08T18:12:02.755627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:32.167217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576478+0000","last_change":"2024-05-08T18:08:47.491784+0000","last_active":"2024-05-08T18:09:28.576478+0000","last_peered":"2024-05-08T18:09:28.576478+0000","last_clean":"2024-05-08T18:09:28.576478+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:09:28.576478+0000","last_undegraded":"2024-05-08T18:09:28.576478+0000","last_fullsized":"2024-05-08T18:09:28.576478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575218+0000","last_change":"2024-05-08T18:08:51.521020+0000","last_active":"2024-05-08T18:09:28.575218+0000","last_peered":"2024-05-08T18:09:28.575218+0000","last_clean":"2024-05-08T18:09:28.575218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:09:28.575218+0000","last_undegraded":"2024-05-08T18:09:28.575218+0000","last_fullsized":"2024-05-08T18:09:28.575218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:46.447955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.554181+0000","last_change":"2024-05-08T18:08:53.521741+0000","last_active":"2024-05-08T18:10:59.554181+0000","last_peered":"2024-05-08T18:10:59.554181+0000","last_clean":"2024-05-08T18:10:59.554181+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:10:59.554181+0000","last_undegraded":"2024-05-08T18:10:59.554181+0000","last_fullsized":"2024-05-08T18:10:59.554181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:03.551719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576295+0000","last_change":"2024-05-08T18:08:55.542837+0000","last_active":"2024-05-08T18:09:28.576295+0000","last_peered":"2024-05-08T18:09:28.576295+0000","last_clean":"2024-05-08T18:09:28.576295+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:09:28.576295+0000","last_undegraded":"2024-05-08T18:09:28.576295+0000","last_fullsized":"2024-05-08T18:09:28.576295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:11.110077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.653210+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:09:32.653210+0000","last_peered":"2024-05-08T18:09:32.653210+0000","last_clean":"2024-05-08T18:09:32.653210+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:09:32.653210+0000","last_undegraded":"2024-05-08T18:09:32.653210+0000","last_fullsized":"2024-05-08T18:09:32.653210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106581+0000","last_change":"2024-05-08T18:08:49.493842+0000","last_active":"2024-05-08T18:09:33.106581+0000","last_peered":"2024-05-08T18:09:33.106581+0000","last_clean":"2024-05-08T18:09:33.106581+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:09:33.106581+0000","last_undegraded":"2024-05-08T18:09:33.106581+0000","last_fullsized":"2024-05-08T18:09:33.106581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.575041+0000","last_change":"2024-05-08T18:08:47.528745+0000","last_active":"2024-05-08T18:11:01.575041+0000","last_peered":"2024-05-08T18:11:01.575041+0000","last_clean":"2024-05-08T18:11:01.575041+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:11:01.575041+0000","last_undegraded":"2024-05-08T18:11:01.575041+0000","last_fullsized":"2024-05-08T18:11:01.575041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:48.149891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583711+0000","last_change":"2024-05-08T18:08:51.507416+0000","last_active":"2024-05-08T18:09:28.583711+0000","last_peered":"2024-05-08T18:09:28.583711+0000","last_clean":"2024-05-08T18:09:28.583711+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:09:28.583711+0000","last_undegraded":"2024-05-08T18:09:28.583711+0000","last_fullsized":"2024-05-08T18:09:28.583711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:22.734601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.557316+0000","last_change":"2024-05-08T18:08:53.539793+0000","last_active":"2024-05-08T18:10:59.557316+0000","last_peered":"2024-05-08T18:10:59.557316+0000","last_clean":"2024-05-08T18:10:59.557316+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:10:59.557316+0000","last_undegraded":"2024-05-08T18:10:59.557316+0000","last_fullsized":"2024-05-08T18:10:59.557316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:09.466170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591164+0000","last_change":"2024-05-08T18:08:55.558593+0000","last_active":"2024-05-08T18:09:28.591164+0000","last_peered":"2024-05-08T18:09:28.591164+0000","last_clean":"2024-05-08T18:09:28.591164+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:09:28.591164+0000","last_undegraded":"2024-05-08T18:09:28.591164+0000","last_fullsized":"2024-05-08T18:09:28.591164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:20.041348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597627+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:09:28.597627+0000","last_peered":"2024-05-08T18:09:28.597627+0000","last_clean":"2024-05-08T18:09:28.597627+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:09:28.597627+0000","last_undegraded":"2024-05-08T18:09:28.597627+0000","last_fullsized":"2024-05-08T18:09:28.597627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:45.231457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391535+0000","last_change":"2024-05-08T18:08:49.512357+0000","last_active":"2024-05-08T18:12:02.391535+0000","last_peered":"2024-05-08T18:12:02.391535+0000","last_clean":"2024-05-08T18:12:02.391535+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:02.391535+0000","last_undegraded":"2024-05-08T18:12:02.391535+0000","last_fullsized":"2024-05-08T18:12:02.391535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.801605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.616390+0000","last_change":"2024-05-08T18:08:47.517076+0000","last_active":"2024-05-08T18:09:32.616390+0000","last_peered":"2024-05-08T18:09:32.616390+0000","last_clean":"2024-05-08T18:09:32.616390+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:09:32.616390+0000","last_undegraded":"2024-05-08T18:09:32.616390+0000","last_fullsized":"2024-05-08T18:09:32.616390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:16.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573625+0000","last_change":"2024-05-08T18:08:51.522287+0000","last_active":"2024-05-08T18:09:28.573625+0000","last_peered":"2024-05-08T18:09:28.573625+0000","last_clean":"2024-05-08T18:09:28.573625+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:09:28.573625+0000","last_undegraded":"2024-05-08T18:09:28.573625+0000","last_fullsized":"2024-05-08T18:09:28.573625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.590133+0000","last_change":"2024-05-08T18:08:53.555489+0000","last_active":"2024-05-08T18:10:59.590133+0000","last_peered":"2024-05-08T18:10:59.590133+0000","last_clean":"2024-05-08T18:10:59.590133+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:10:59.590133+0000","last_undegraded":"2024-05-08T18:10:59.590133+0000","last_fullsized":"2024-05-08T18:10:59.590133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.464298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593054+0000","last_change":"2024-05-08T18:08:55.564029+0000","last_active":"2024-05-08T18:09:28.593054+0000","last_peered":"2024-05-08T18:09:28.593054+0000","last_clean":"2024-05-08T18:09:28.593054+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:09:28.593054+0000","last_undegraded":"2024-05-08T18:09:28.593054+0000","last_fullsized":"2024-05-08T18:09:28.593054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:00.158035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.605714+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:10:59.605714+0000","last_peered":"2024-05-08T18:10:59.605714+0000","last_clean":"2024-05-08T18:10:59.605714+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:10:59.605714+0000","last_undegraded":"2024-05-08T18:10:59.605714+0000","last_fullsized":"2024-05-08T18:10:59.605714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:41:06.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658006+0000","last_change":"2024-05-08T18:08:49.492218+0000","last_active":"2024-05-08T18:09:32.658006+0000","last_peered":"2024-05-08T18:09:32.658006+0000","last_clean":"2024-05-08T18:09:32.658006+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:09:32.658006+0000","last_undegraded":"2024-05-08T18:09:32.658006+0000","last_fullsized":"2024-05-08T18:09:32.658006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:46.076624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.576608+0000","last_change":"2024-05-08T18:08:47.498035+0000","last_active":"2024-05-08T18:12:02.576608+0000","last_peered":"2024-05-08T18:12:02.576608+0000","last_clean":"2024-05-08T18:12:02.576608+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:12:02.576608+0000","last_undegraded":"2024-05-08T18:12:02.576608+0000","last_fullsized":"2024-05-08T18:12:02.576608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.122142+0000","last_change":"2024-05-08T18:08:51.513601+0000","last_active":"2024-05-08T18:11:01.122142+0000","last_peered":"2024-05-08T18:11:01.122142+0000","last_clean":"2024-05-08T18:11:01.122142+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:11:01.122142+0000","last_undegraded":"2024-05-08T18:11:01.122142+0000","last_fullsized":"2024-05-08T18:11:01.122142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:52.312237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.672936+0000","last_change":"2024-05-08T18:08:53.547362+0000","last_active":"2024-05-08T18:12:01.672936+0000","last_peered":"2024-05-08T18:12:01.672936+0000","last_clean":"2024-05-08T18:12:01.672936+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:01.672936+0000","last_undegraded":"2024-05-08T18:12:01.672936+0000","last_fullsized":"2024-05-08T18:12:01.672936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:18.076232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580054+0000","last_change":"2024-05-08T18:08:55.546216+0000","last_active":"2024-05-08T18:09:28.580054+0000","last_peered":"2024-05-08T18:09:28.580054+0000","last_clean":"2024-05-08T18:09:28.580054+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:09:28.580054+0000","last_undegraded":"2024-05-08T18:09:28.580054+0000","last_fullsized":"2024-05-08T18:09:28.580054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.609546+0000","last_change":"2024-05-08T18:08:57.560370+0000","last_active":"2024-05-08T18:10:59.609546+0000","last_peered":"2024-05-08T18:10:59.609546+0000","last_clean":"2024-05-08T18:10:59.609546+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:10:59.609546+0000","last_undegraded":"2024-05-08T18:10:59.609546+0000","last_fullsized":"2024-05-08T18:10:59.609546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:35.794410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490224+0000","last_change":"2024-05-08T18:08:49.513755+0000","last_active":"2024-05-08T18:10:16.490224+0000","last_peered":"2024-05-08T18:10:16.490224+0000","last_clean":"2024-05-08T18:10:16.490224+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:10:16.490224+0000","last_undegraded":"2024-05-08T18:10:16.490224+0000","last_fullsized":"2024-05-08T18:10:16.490224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:12.911502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576973+0000","last_change":"2024-05-08T18:08:47.510817+0000","last_active":"2024-05-08T18:09:28.576973+0000","last_peered":"2024-05-08T18:09:28.576973+0000","last_clean":"2024-05-08T18:09:28.576973+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:09:28.576973+0000","last_undegraded":"2024-05-08T18:09:28.576973+0000","last_fullsized":"2024-05-08T18:09:28.576973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.419152+0000","last_change":"2024-05-08T18:08:49.494065+0000","last_active":"2024-05-08T18:11:01.419152+0000","last_peered":"2024-05-08T18:11:01.419152+0000","last_clean":"2024-05-08T18:11:01.419152+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:11:01.419152+0000","last_undegraded":"2024-05-08T18:11:01.419152+0000","last_fullsized":"2024-05-08T18:11:01.419152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417623+0000","last_change":"2024-05-08T18:08:47.496722+0000","last_active":"2024-05-08T18:10:56.417623+0000","last_peered":"2024-05-08T18:10:56.417623+0000","last_clean":"2024-05-08T18:10:56.417623+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:10:56.417623+0000","last_undegraded":"2024-05-08T18:10:56.417623+0000","last_fullsized":"2024-05-08T18:10:56.417623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689939+0000","last_change":"2024-05-08T18:08:49.513141+0000","last_active":"2024-05-08T18:12:02.689939+0000","last_peered":"2024-05-08T18:12:02.689939+0000","last_clean":"2024-05-08T18:12:02.689939+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:02.689939+0000","last_undegraded":"2024-05-08T18:12:02.689939+0000","last_fullsized":"2024-05-08T18:12:02.689939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:05.438608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593736+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:09:28.593736+0000","last_peered":"2024-05-08T18:09:28.593736+0000","last_clean":"2024-05-08T18:09:28.593736+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:09:28.593736+0000","last_undegraded":"2024-05-08T18:09:28.593736+0000","last_fullsized":"2024-05-08T18:09:28.593736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:49.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.268349+0000","last_change":"2024-05-08T18:08:49.494261+0000","last_active":"2024-05-08T18:12:02.268349+0000","last_peered":"2024-05-08T18:12:02.268349+0000","last_clean":"2024-05-08T18:12:02.268349+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:02.268349+0000","last_undegraded":"2024-05-08T18:12:02.268349+0000","last_fullsized":"2024-05-08T18:12:02.268349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.584121+0000","last_change":"2024-05-08T18:08:47.515649+0000","last_active":"2024-05-08T18:12:02.584121+0000","last_peered":"2024-05-08T18:12:02.584121+0000","last_clean":"2024-05-08T18:12:02.584121+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:02.584121+0000","last_undegraded":"2024-05-08T18:12:02.584121+0000","last_fullsized":"2024-05-08T18:12:02.584121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'3","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270740+0000","last_change":"2024-05-08T18:08:49.519128+0000","last_active":"2024-05-08T18:12:02.270740+0000","last_peered":"2024-05-08T18:12:02.270740+0000","last_clean":"2024-05-08T18:12:02.270740+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:02.270740+0000","last_undegraded":"2024-05-08T18:12:02.270740+0000","last_fullsized":"2024-05-08T18:12:02.270740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.190876+0000","last_change":"2024-05-08T18:08:47.497513+0000","last_active":"2024-05-08T18:12:02.190876+0000","last_peered":"2024-05-08T18:12:02.190876+0000","last_clean":"2024-05-08T18:12:02.190876+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:12:02.190876+0000","last_undegraded":"2024-05-08T18:12:02.190876+0000","last_fullsized":"2024-05-08T18:12:02.190876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706315+0000","last_change":"2024-05-08T18:08:49.518071+0000","last_active":"2024-05-08T18:12:02.706315+0000","last_peered":"2024-05-08T18:12:02.706315+0000","last_clean":"2024-05-08T18:12:02.706315+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:02.706315+0000","last_undegraded":"2024-05-08T18:12:02.706315+0000","last_fullsized":"2024-05-08T18:12:02.706315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:20.720628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574630+0000","last_change":"2024-05-08T18:08:47.512086+0000","last_active":"2024-05-08T18:09:28.574630+0000","last_peered":"2024-05-08T18:09:28.574630+0000","last_clean":"2024-05-08T18:09:28.574630+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:09:28.574630+0000","last_undegraded":"2024-05-08T18:09:28.574630+0000","last_fullsized":"2024-05-08T18:09:28.574630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390792+0000","last_change":"2024-05-08T18:08:49.497455+0000","last_active":"2024-05-08T18:12:02.390792+0000","last_peered":"2024-05-08T18:12:02.390792+0000","last_clean":"2024-05-08T18:12:02.390792+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:02.390792+0000","last_undegraded":"2024-05-08T18:12:02.390792+0000","last_fullsized":"2024-05-08T18:12:02.390792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594186+0000","last_change":"2024-05-08T18:08:47.514190+0000","last_active":"2024-05-08T18:09:28.594186+0000","last_peered":"2024-05-08T18:09:28.594186+0000","last_clean":"2024-05-08T18:09:28.594186+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:09:28.594186+0000","last_undegraded":"2024-05-08T18:09:28.594186+0000","last_fullsized":"2024-05-08T18:09:28.594186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599228+0000","last_change":"2024-05-08T18:08:49.495860+0000","last_active":"2024-05-08T18:12:02.599228+0000","last_peered":"2024-05-08T18:12:02.599228+0000","last_clean":"2024-05-08T18:12:02.599228+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:02.599228+0000","last_undegraded":"2024-05-08T18:12:02.599228+0000","last_fullsized":"2024-05-08T18:12:02.599228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580203+0000","last_change":"2024-05-08T18:08:47.515080+0000","last_active":"2024-05-08T18:09:28.580203+0000","last_peered":"2024-05-08T18:09:28.580203+0000","last_clean":"2024-05-08T18:09:28.580203+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:09:28.580203+0000","last_undegraded":"2024-05-08T18:09:28.580203+0000","last_fullsized":"2024-05-08T18:09:28.580203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.479725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640668+0000","last_change":"2024-05-08T18:08:49.498817+0000","last_active":"2024-05-08T18:11:01.640668+0000","last_peered":"2024-05-08T18:11:01.640668+0000","last_clean":"2024-05-08T18:11:01.640668+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:11:01.640668+0000","last_undegraded":"2024-05-08T18:11:01.640668+0000","last_fullsized":"2024-05-08T18:11:01.640668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:19.437499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587366+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:09:28.587366+0000","last_peered":"2024-05-08T18:09:28.587366+0000","last_clean":"2024-05-08T18:09:28.587366+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:09:28.587366+0000","last_undegraded":"2024-05-08T18:09:28.587366+0000","last_fullsized":"2024-05-08T18:09:28.587366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:29.150400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.690148+0000","last_change":"2024-05-08T18:08:49.514593+0000","last_active":"2024-05-08T18:12:02.690148+0000","last_peered":"2024-05-08T18:12:02.690148+0000","last_clean":"2024-05-08T18:12:02.690148+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:02.690148+0000","last_undegraded":"2024-05-08T18:12:02.690148+0000","last_fullsized":"2024-05-08T18:12:02.690148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:59.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576899+0000","last_change":"2024-05-08T18:08:47.515074+0000","last_active":"2024-05-08T18:09:28.576899+0000","last_peered":"2024-05-08T18:09:28.576899+0000","last_clean":"2024-05-08T18:09:28.576899+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:09:28.576899+0000","last_undegraded":"2024-05-08T18:09:28.576899+0000","last_fullsized":"2024-05-08T18:09:28.576899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391996+0000","last_change":"2024-05-08T18:08:49.516189+0000","last_active":"2024-05-08T18:12:02.391996+0000","last_peered":"2024-05-08T18:12:02.391996+0000","last_clean":"2024-05-08T18:12:02.391996+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:02.391996+0000","last_undegraded":"2024-05-08T18:12:02.391996+0000","last_fullsized":"2024-05-08T18:12:02.391996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573546+0000","last_change":"2024-05-08T18:08:47.525612+0000","last_active":"2024-05-08T18:09:28.573546+0000","last_peered":"2024-05-08T18:09:28.573546+0000","last_clean":"2024-05-08T18:09:28.573546+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:09:28.573546+0000","last_undegraded":"2024-05-08T18:09:28.573546+0000","last_fullsized":"2024-05-08T18:09:28.573546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390438+0000","last_change":"2024-05-08T18:08:49.496733+0000","last_active":"2024-05-08T18:12:02.390438+0000","last_peered":"2024-05-08T18:12:02.390438+0000","last_clean":"2024-05-08T18:12:02.390438+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:02.390438+0000","last_undegraded":"2024-05-08T18:12:02.390438+0000","last_fullsized":"2024-05-08T18:12:02.390438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573307+0000","last_change":"2024-05-08T18:08:47.513204+0000","last_active":"2024-05-08T18:09:28.573307+0000","last_peered":"2024-05-08T18:09:28.573307+0000","last_clean":"2024-05-08T18:09:28.573307+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:09:28.573307+0000","last_undegraded":"2024-05-08T18:09:28.573307+0000","last_fullsized":"2024-05-08T18:09:28.573307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490742+0000","last_change":"2024-05-08T18:08:49.519642+0000","last_active":"2024-05-08T18:10:16.490742+0000","last_peered":"2024-05-08T18:10:16.490742+0000","last_clean":"2024-05-08T18:10:16.490742+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:10:16.490742+0000","last_undegraded":"2024-05-08T18:10:16.490742+0000","last_fullsized":"2024-05-08T18:10:16.490742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.551432+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.551432+0000","last_peered":"2024-05-08T18:12:02.551432+0000","last_clean":"2024-05-08T18:12:02.551432+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.551432+0000","last_undegraded":"2024-05-08T18:12:02.551432+0000","last_fullsized":"2024-05-08T18:12:02.551432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:15.066942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640294+0000","last_change":"2024-05-08T18:08:49.499082+0000","last_active":"2024-05-08T18:11:01.640294+0000","last_peered":"2024-05-08T18:11:01.640294+0000","last_clean":"2024-05-08T18:11:01.640294+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:11:01.640294+0000","last_undegraded":"2024-05-08T18:11:01.640294+0000","last_fullsized":"2024-05-08T18:11:01.640294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:02.112670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599094+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:09:28.599094+0000","last_peered":"2024-05-08T18:09:28.599094+0000","last_clean":"2024-05-08T18:09:28.599094+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:09:28.599094+0000","last_undegraded":"2024-05-08T18:09:28.599094+0000","last_fullsized":"2024-05-08T18:09:28.599094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.626603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602483+0000","last_change":"2024-05-08T18:08:49.507865+0000","last_active":"2024-05-08T18:09:28.602483+0000","last_peered":"2024-05-08T18:09:28.602483+0000","last_clean":"2024-05-08T18:09:28.602483+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:09:28.602483+0000","last_undegraded":"2024-05-08T18:09:28.602483+0000","last_fullsized":"2024-05-08T18:09:28.602483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:42.616990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.559608+0000","last_change":"2024-05-08T18:08:47.519469+0000","last_active":"2024-05-08T18:12:02.559608+0000","last_peered":"2024-05-08T18:12:02.559608+0000","last_clean":"2024-05-08T18:12:02.559608+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:02.559608+0000","last_undegraded":"2024-05-08T18:12:02.559608+0000","last_fullsized":"2024-05-08T18:12:02.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.142579+0000","last_change":"2024-05-08T18:08:49.497950+0000","last_active":"2024-05-08T18:09:34.142579+0000","last_peered":"2024-05-08T18:09:34.142579+0000","last_clean":"2024-05-08T18:09:34.142579+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:09:34.142579+0000","last_undegraded":"2024-05-08T18:09:34.142579+0000","last_fullsized":"2024-05-08T18:09:34.142579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:30.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432525+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:11:11.432525+0000","last_peered":"2024-05-08T18:11:11.432525+0000","last_clean":"2024-05-08T18:11:11.432525+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:11:11.432525+0000","last_undegraded":"2024-05-08T18:11:11.432525+0000","last_fullsized":"2024-05-08T18:11:11.432525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:03.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588195+0000","last_change":"2024-05-08T18:08:47.516126+0000","last_active":"2024-05-08T18:09:28.588195+0000","last_peered":"2024-05-08T18:09:28.588195+0000","last_clean":"2024-05-08T18:09:28.588195+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:09:28.588195+0000","last_undegraded":"2024-05-08T18:09:28.588195+0000","last_fullsized":"2024-05-08T18:09:28.588195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:27.835638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.450829+0000","last_change":"2024-05-08T18:08:49.501282+0000","last_active":"2024-05-08T18:10:57.450829+0000","last_peered":"2024-05-08T18:10:57.450829+0000","last_clean":"2024-05-08T18:10:57.450829+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:10:57.450829+0000","last_undegraded":"2024-05-08T18:10:57.450829+0000","last_fullsized":"2024-05-08T18:10:57.450829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:32.711877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.577094+0000","last_change":"2024-05-08T18:08:47.515944+0000","last_active":"2024-05-08T18:09:28.577094+0000","last_peered":"2024-05-08T18:09:28.577094+0000","last_clean":"2024-05-08T18:09:28.577094+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:09:28.577094+0000","last_undegraded":"2024-05-08T18:09:28.577094+0000","last_fullsized":"2024-05-08T18:09:28.577094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106837+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:09:33.106837+0000","last_peered":"2024-05-08T18:09:33.106837+0000","last_clean":"2024-05-08T18:09:33.106837+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:09:33.106837+0000","last_undegraded":"2024-05-08T18:09:33.106837+0000","last_fullsized":"2024-05-08T18:09:33.106837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.519711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11093,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1191,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46348,"kb_used_data":11012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325492,"statfs":{"total":96636764160,"available":96589303808,"internally_reserved":0,"allocated":11276288,"data_stored":10956261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42452,"kb_used_data":7116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329388,"statfs":{"total":96636764160,"available":96593293312,"internally_reserved":0,"allocated":7286784,"data_stored":7026447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":13930496,"data_stored":13641551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40104,"kb_used_data":8928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331736,"statfs":{"total":96636764160,"available":96595697664,"internally_reserved":0,"allocated":9142272,"data_stored":8856953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:12:10.116 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:12:10.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.270+0000 7f2a212b9640 1 Processor -- start 2024-05-08T18:12:10.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.270+0000 7f2a212b9640 1 -- start start 2024-05-08T18:12:10.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a212b9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a1c132730 0x7f2a1c134b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a212b9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1c12cfb0 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a212b9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1c0721f0 con 0x7f2a1c132730 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a1affd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f2a1c12c4c0 0x7f2a1c12c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33834/0 (socket says 172.21.15.53:33834) 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a1a7fc640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f2a1c132730 0x7f2a1c134b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a1affd640 1 -- 172.21.15.53:0/2578634050 learned_addr learned my addr 172.21.15.53:0/2578634050 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a1a7fc640 1 -- 172.21.15.53:0/2578634050 >> v1:172.21.15.53:6789/0 conn(0x7f2a1c12c4c0 legacy=0x7f2a1c12c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a1a7fc640 1 -- 172.21.15.53:0/2578634050 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c073b00 con 0x7f2a1c132730 2024-05-08T18:12:10.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a1a7fc640 1 --2- 172.21.15.53:0/2578634050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c132730 0x7f2a1c134b20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009740 tx=0x7f2a1001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e696cf9453d47b71 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:10.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a19ffb640 1 -- 172.21.15.53:0/2578634050 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a100b0070 con 0x7f2a1c132730 2024-05-08T18:12:10.277 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a19ffb640 1 -- 172.21.15.53:0/2578634050 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a100ab530 con 0x7f2a1c132730 2024-05-08T18:12:10.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a19ffb640 1 -- 172.21.15.53:0/2578634050 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a100ab830 con 0x7f2a1c132730 2024-05-08T18:12:10.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a212b9640 1 -- 172.21.15.53:0/2578634050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c132730 msgr2=0x7f2a1c134b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.274+0000 7f2a212b9640 1 --2- 172.21.15.53:0/2578634050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c132730 0x7f2a1c134b20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009740 tx=0x7f2a1001c370 comp rx=0 tx=0).stop 2024-05-08T18:12:10.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/2578634050 shutdown_connections 2024-05-08T18:12:10.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 --2- 172.21.15.53:0/2578634050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c132730 0x7f2a1c134b20 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/2578634050 >> 172.21.15.53:0/2578634050 conn(0x7f2a1c09e030 msgr2=0x7f2a1c09e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:10.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/2578634050 shutdown_connections 2024-05-08T18:12:10.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/2578634050 wait complete. 2024-05-08T18:12:10.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 Processor -- start 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- start start 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 0x7f2a1c11afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c137c10 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 0x7f2a1c11afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a1affd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 0x7f2a1c11afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58180/0 (socket says 172.21.15.53:58180) 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a1affd640 1 -- 172.21.15.53:0/1410278534 learned_addr learned my addr 172.21.15.53:0/1410278534 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a1affd640 1 -- 172.21.15.53:0/1410278534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c12feb0 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a1affd640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 0x7f2a1c11afa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00c480 tx=0x7f2a0c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0c017070 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c005c20 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c11dd60 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a0c0070d0 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.281 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c11e1f0 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f2a0c01a070 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a1c064150 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a037fe640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2a08039b50 0x7f2a0803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:10.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f2a0c04cf40 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.278+0000 7f2a1a7fc640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2a08039b50 0x7f2a0803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:10.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.282+0000 7f2a1a7fc640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2a08039b50 0x7f2a0803c010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2a100ad000 tx=0x7f2a10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:10.286 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.286+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2a0c007270 con 0x7f2a1c12c4c0 2024-05-08T18:12:10.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.442+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a1c11c950 con 0x7f2a08039b50 2024-05-08T18:12:10.490 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.490+0000 7f2a037fe640 1 -- 172.21.15.53:0/1410278534 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665721 (secure 0 0 0) 0x7f2a1c11c950 con 0x7f2a08039b50 2024-05-08T18:12:10.495 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:10.503 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2a08039b50 msgr2=0x7f2a0803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2a08039b50 0x7f2a0803c010 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2a100ad000 tx=0x7f2a10008040 comp rx=0 tx=0).stop 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 msgr2=0x7f2a1c11afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 0x7f2a1c11afa0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00c480 tx=0x7f2a0c00c940 comp rx=0 tx=0).stop 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 shutdown_connections 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f2a08039b50 0x7f2a0803c010 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 --2- 172.21.15.53:0/1410278534 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c12c4c0 0x7f2a1c11afa0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.504 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 >> 172.21.15.53:0/1410278534 conn(0x7f2a1c09e030 msgr2=0x7f2a1c06dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 shutdown_connections 2024-05-08T18:12:10.505 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.498+0000 7f2a212b9640 1 -- 172.21.15.53:0/1410278534 wait complete. 2024-05-08T18:12:10.522 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-08T18:12:09.410202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26410498,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4852,"num_read_kb":4437,"num_write":2048,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4432,"ondisk_log_size":4432,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177844,"kb_used_data":40660,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309516,"statfs":{"total":386547056640,"available":386364944384,"internally_reserved":0,"allocated":41635840,"data_stored":40481212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25809396,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":468,"num_write":386,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006898"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589617+0000","last_change":"2024-05-08T18:08:47.510504+0000","last_active":"2024-05-08T18:09:28.589617+0000","last_peered":"2024-05-08T18:09:28.589617+0000","last_clean":"2024-05-08T18:09:28.589617+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:09:28.589617+0000","last_undegraded":"2024-05-08T18:09:28.589617+0000","last_fullsized":"2024-05-08T18:09:28.589617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755613+0000","last_change":"2024-05-08T18:08:49.501074+0000","last_active":"2024-05-08T18:12:02.755613+0000","last_peered":"2024-05-08T18:12:02.755613+0000","last_clean":"2024-05-08T18:12:02.755613+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:12:02.755613+0000","last_undegraded":"2024-05-08T18:12:02.755613+0000","last_fullsized":"2024-05-08T18:12:02.755613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583198+0000","last_change":"2024-05-08T18:08:47.517769+0000","last_active":"2024-05-08T18:09:28.583198+0000","last_peered":"2024-05-08T18:09:28.583198+0000","last_clean":"2024-05-08T18:09:28.583198+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:09:28.583198+0000","last_undegraded":"2024-05-08T18:09:28.583198+0000","last_fullsized":"2024-05-08T18:09:28.583198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688121+0000","last_change":"2024-05-08T18:08:49.505238+0000","last_active":"2024-05-08T18:12:02.688121+0000","last_peered":"2024-05-08T18:12:02.688121+0000","last_clean":"2024-05-08T18:12:02.688121+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:12:02.688121+0000","last_undegraded":"2024-05-08T18:12:02.688121+0000","last_fullsized":"2024-05-08T18:12:02.688121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:44.433982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602848+0000","last_change":"2024-05-08T18:08:47.529012+0000","last_active":"2024-05-08T18:09:28.602848+0000","last_peered":"2024-05-08T18:09:28.602848+0000","last_clean":"2024-05-08T18:09:28.602848+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:09:28.602848+0000","last_undegraded":"2024-05-08T18:09:28.602848+0000","last_fullsized":"2024-05-08T18:09:28.602848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:59.877643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.243439+0000","last_change":"2024-05-08T18:08:49.512376+0000","last_active":"2024-05-08T18:12:02.243439+0000","last_peered":"2024-05-08T18:12:02.243439+0000","last_clean":"2024-05-08T18:12:02.243439+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:02.243439+0000","last_undegraded":"2024-05-08T18:12:02.243439+0000","last_fullsized":"2024-05-08T18:12:02.243439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:50.199302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584975+0000","last_change":"2024-05-08T18:08:47.506602+0000","last_active":"2024-05-08T18:09:28.584975+0000","last_peered":"2024-05-08T18:09:28.584975+0000","last_clean":"2024-05-08T18:09:28.584975+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:09:28.584975+0000","last_undegraded":"2024-05-08T18:09:28.584975+0000","last_fullsized":"2024-05-08T18:09:28.584975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603042+0000","last_change":"2024-05-08T18:08:49.514808+0000","last_active":"2024-05-08T18:09:28.603042+0000","last_peered":"2024-05-08T18:09:28.603042+0000","last_clean":"2024-05-08T18:09:28.603042+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:09:28.603042+0000","last_undegraded":"2024-05-08T18:09:28.603042+0000","last_fullsized":"2024-05-08T18:09:28.603042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:07.745157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594223+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:09:28.594223+0000","last_peered":"2024-05-08T18:09:28.594223+0000","last_clean":"2024-05-08T18:09:28.594223+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:09:28.594223+0000","last_undegraded":"2024-05-08T18:09:28.594223+0000","last_fullsized":"2024-05-08T18:09:28.594223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:19.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.621110+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:11:01.621110+0000","last_peered":"2024-05-08T18:11:01.621110+0000","last_clean":"2024-05-08T18:11:01.621110+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:11:01.621110+0000","last_undegraded":"2024-05-08T18:11:01.621110+0000","last_fullsized":"2024-05-08T18:11:01.621110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.476707+0000","last_change":"2024-05-08T18:08:47.517680+0000","last_active":"2024-05-08T18:10:16.476707+0000","last_peered":"2024-05-08T18:10:16.476707+0000","last_clean":"2024-05-08T18:10:16.476707+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:10:16.476707+0000","last_undegraded":"2024-05-08T18:10:16.476707+0000","last_fullsized":"2024-05-08T18:10:16.476707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.598289+0000","last_change":"2024-05-08T18:08:49.512339+0000","last_active":"2024-05-08T18:12:02.598289+0000","last_peered":"2024-05-08T18:12:02.598289+0000","last_clean":"2024-05-08T18:12:02.598289+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:02.598289+0000","last_undegraded":"2024-05-08T18:12:02.598289+0000","last_fullsized":"2024-05-08T18:12:02.598289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:17.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597200+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:09:28.597200+0000","last_peered":"2024-05-08T18:09:28.597200+0000","last_clean":"2024-05-08T18:09:28.597200+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:09:28.597200+0000","last_undegraded":"2024-05-08T18:09:28.597200+0000","last_fullsized":"2024-05-08T18:09:28.597200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:58.240945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755650+0000","last_change":"2024-05-08T18:08:49.497230+0000","last_active":"2024-05-08T18:12:02.755650+0000","last_peered":"2024-05-08T18:12:02.755650+0000","last_clean":"2024-05-08T18:12:02.755650+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:02.755650+0000","last_undegraded":"2024-05-08T18:12:02.755650+0000","last_fullsized":"2024-05-08T18:12:02.755650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.419603+0000","last_change":"2024-05-08T18:08:47.511982+0000","last_active":"2024-05-08T18:09:33.419603+0000","last_peered":"2024-05-08T18:09:33.419603+0000","last_clean":"2024-05-08T18:09:33.419603+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:09:33.419603+0000","last_undegraded":"2024-05-08T18:09:33.419603+0000","last_fullsized":"2024-05-08T18:09:33.419603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755669+0000","last_change":"2024-05-08T18:08:49.515516+0000","last_active":"2024-05-08T18:12:02.755669+0000","last_peered":"2024-05-08T18:12:02.755669+0000","last_clean":"2024-05-08T18:12:02.755669+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:02.755669+0000","last_undegraded":"2024-05-08T18:12:02.755669+0000","last_fullsized":"2024-05-08T18:12:02.755669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391545+0000","last_change":"2024-05-08T18:08:49.508214+0000","last_active":"2024-05-08T18:12:02.391545+0000","last_peered":"2024-05-08T18:12:02.391545+0000","last_clean":"2024-05-08T18:12:02.391545+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:12:02.391545+0000","last_undegraded":"2024-05-08T18:12:02.391545+0000","last_fullsized":"2024-05-08T18:12:02.391545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:02.344619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582645+0000","last_change":"2024-05-08T18:08:47.511822+0000","last_active":"2024-05-08T18:09:28.582645+0000","last_peered":"2024-05-08T18:09:28.582645+0000","last_clean":"2024-05-08T18:09:28.582645+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:09:28.582645+0000","last_undegraded":"2024-05-08T18:09:28.582645+0000","last_fullsized":"2024-05-08T18:09:28.582645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755519+0000","last_change":"2024-05-08T18:08:49.500178+0000","last_active":"2024-05-08T18:12:02.755519+0000","last_peered":"2024-05-08T18:12:02.755519+0000","last_clean":"2024-05-08T18:12:02.755519+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:02.755519+0000","last_undegraded":"2024-05-08T18:12:02.755519+0000","last_fullsized":"2024-05-08T18:12:02.755519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594972+0000","last_change":"2024-05-08T18:08:47.513087+0000","last_active":"2024-05-08T18:09:28.594972+0000","last_peered":"2024-05-08T18:09:28.594972+0000","last_clean":"2024-05-08T18:09:28.594972+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:09:28.594972+0000","last_undegraded":"2024-05-08T18:09:28.594972+0000","last_fullsized":"2024-05-08T18:09:28.594972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575992+0000","last_change":"2024-05-08T18:08:49.500044+0000","last_active":"2024-05-08T18:09:28.575992+0000","last_peered":"2024-05-08T18:09:28.575992+0000","last_clean":"2024-05-08T18:09:28.575992+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:09:28.575992+0000","last_undegraded":"2024-05-08T18:09:28.575992+0000","last_fullsized":"2024-05-08T18:09:28.575992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:30.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575062+0000","last_change":"2024-05-08T18:08:47.513484+0000","last_active":"2024-05-08T18:09:28.575062+0000","last_peered":"2024-05-08T18:09:28.575062+0000","last_clean":"2024-05-08T18:09:28.575062+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:09:28.575062+0000","last_undegraded":"2024-05-08T18:09:28.575062+0000","last_fullsized":"2024-05-08T18:09:28.575062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640685+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:01.640685+0000","last_peered":"2024-05-08T18:11:01.640685+0000","last_clean":"2024-05-08T18:11:01.640685+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:01.640685+0000","last_undegraded":"2024-05-08T18:11:01.640685+0000","last_fullsized":"2024-05-08T18:11:01.640685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:31.685937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'5","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431674+0000","last_change":"2024-05-08T18:08:47.496959+0000","last_active":"2024-05-08T18:11:16.431674+0000","last_peered":"2024-05-08T18:11:16.431674+0000","last_clean":"2024-05-08T18:11:16.431674+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:11:16.431674+0000","last_undegraded":"2024-05-08T18:11:16.431674+0000","last_fullsized":"2024-05-08T18:11:16.431674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755450+0000","last_change":"2024-05-08T18:08:49.511519+0000","last_active":"2024-05-08T18:12:02.755450+0000","last_peered":"2024-05-08T18:12:02.755450+0000","last_clean":"2024-05-08T18:12:02.755450+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:02.755450+0000","last_undegraded":"2024-05-08T18:12:02.755450+0000","last_fullsized":"2024-05-08T18:12:02.755450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:07.067518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422686+0000","last_change":"2024-05-08T18:08:47.513517+0000","last_active":"2024-05-08T18:11:16.422686+0000","last_peered":"2024-05-08T18:11:16.422686+0000","last_clean":"2024-05-08T18:11:16.422686+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:11:16.422686+0000","last_undegraded":"2024-05-08T18:11:16.422686+0000","last_fullsized":"2024-05-08T18:11:16.422686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.105302+0000","last_change":"2024-05-08T18:08:49.496030+0000","last_active":"2024-05-08T18:09:33.105302+0000","last_peered":"2024-05-08T18:09:33.105302+0000","last_clean":"2024-05-08T18:09:33.105302+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:09:33.105302+0000","last_undegraded":"2024-05-08T18:09:33.105302+0000","last_fullsized":"2024-05-08T18:09:33.105302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432206+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:11:11.432206+0000","last_peered":"2024-05-08T18:11:11.432206+0000","last_clean":"2024-05-08T18:11:11.432206+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:11:11.432206+0000","last_undegraded":"2024-05-08T18:11:11.432206+0000","last_fullsized":"2024-05-08T18:11:11.432206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:03.768445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.646508+0000","last_change":"2024-05-08T18:08:57.567982+0000","last_active":"2024-05-08T18:12:02.646508+0000","last_peered":"2024-05-08T18:12:02.646508+0000","last_clean":"2024-05-08T18:12:02.646508+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:12:02.646508+0000","last_undegraded":"2024-05-08T18:12:02.646508+0000","last_fullsized":"2024-05-08T18:12:02.646508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:52.349480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.756078+0000","last_change":"2024-05-08T18:08:49.512724+0000","last_active":"2024-05-08T18:12:02.756078+0000","last_peered":"2024-05-08T18:12:02.756078+0000","last_clean":"2024-05-08T18:12:02.756078+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:02.756078+0000","last_undegraded":"2024-05-08T18:12:02.756078+0000","last_fullsized":"2024-05-08T18:12:02.756078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:36.090445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593298+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:09:28.593298+0000","last_peered":"2024-05-08T18:09:28.593298+0000","last_clean":"2024-05-08T18:09:28.593298+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:09:28.593298+0000","last_undegraded":"2024-05-08T18:09:28.593298+0000","last_fullsized":"2024-05-08T18:09:28.593298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:34.298278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597381+0000","last_change":"2024-05-08T18:08:51.505825+0000","last_active":"2024-05-08T18:09:28.597381+0000","last_peered":"2024-05-08T18:09:28.597381+0000","last_clean":"2024-05-08T18:09:28.597381+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:09:28.597381+0000","last_undegraded":"2024-05-08T18:09:28.597381+0000","last_fullsized":"2024-05-08T18:09:28.597381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:07.975264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.580226+0000","last_change":"2024-05-08T18:08:53.550245+0000","last_active":"2024-05-08T18:10:59.580226+0000","last_peered":"2024-05-08T18:10:59.580226+0000","last_clean":"2024-05-08T18:10:59.580226+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:10:59.580226+0000","last_undegraded":"2024-05-08T18:10:59.580226+0000","last_fullsized":"2024-05-08T18:10:59.580226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:46.416684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582464+0000","last_change":"2024-05-08T18:08:55.544376+0000","last_active":"2024-05-08T18:09:28.582464+0000","last_peered":"2024-05-08T18:09:28.582464+0000","last_clean":"2024-05-08T18:09:28.582464+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:09:28.582464+0000","last_undegraded":"2024-05-08T18:09:28.582464+0000","last_fullsized":"2024-05-08T18:09:28.582464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.499404+0000","last_change":"2024-05-08T18:08:57.562642+0000","last_active":"2024-05-08T18:10:16.499404+0000","last_peered":"2024-05-08T18:10:16.499404+0000","last_clean":"2024-05-08T18:10:16.499404+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:10:16.499404+0000","last_undegraded":"2024-05-08T18:10:16.499404+0000","last_fullsized":"2024-05-08T18:10:16.499404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597657+0000","last_change":"2024-05-08T18:08:49.513376+0000","last_active":"2024-05-08T18:12:02.597657+0000","last_peered":"2024-05-08T18:12:02.597657+0000","last_clean":"2024-05-08T18:12:02.597657+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:02.597657+0000","last_undegraded":"2024-05-08T18:12:02.597657+0000","last_fullsized":"2024-05-08T18:12:02.597657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:18.558772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579314+0000","last_change":"2024-05-08T18:08:47.514599+0000","last_active":"2024-05-08T18:09:28.579314+0000","last_peered":"2024-05-08T18:09:28.579314+0000","last_clean":"2024-05-08T18:09:28.579314+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:09:28.579314+0000","last_undegraded":"2024-05-08T18:09:28.579314+0000","last_fullsized":"2024-05-08T18:09:28.579314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578587+0000","last_change":"2024-05-08T18:08:51.510019+0000","last_active":"2024-05-08T18:09:28.578587+0000","last_peered":"2024-05-08T18:09:28.578587+0000","last_clean":"2024-05-08T18:09:28.578587+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:09:28.578587+0000","last_undegraded":"2024-05-08T18:09:28.578587+0000","last_fullsized":"2024-05-08T18:09:28.578587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:08.155776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581714+0000","last_change":"2024-05-08T18:08:53.529258+0000","last_active":"2024-05-08T18:09:28.581714+0000","last_peered":"2024-05-08T18:09:28.581714+0000","last_clean":"2024-05-08T18:09:28.581714+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:09:28.581714+0000","last_undegraded":"2024-05-08T18:09:28.581714+0000","last_fullsized":"2024-05-08T18:09:28.581714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:41.643997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574807+0000","last_change":"2024-05-08T18:08:55.556181+0000","last_active":"2024-05-08T18:09:28.574807+0000","last_peered":"2024-05-08T18:09:28.574807+0000","last_clean":"2024-05-08T18:09:28.574807+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:09:28.574807+0000","last_undegraded":"2024-05-08T18:09:28.574807+0000","last_fullsized":"2024-05-08T18:09:28.574807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.792229+0000","last_change":"2024-05-08T18:08:57.565097+0000","last_active":"2024-05-08T18:12:01.792229+0000","last_peered":"2024-05-08T18:12:01.792229+0000","last_clean":"2024-05-08T18:12:01.792229+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:12:01.792229+0000","last_undegraded":"2024-05-08T18:12:01.792229+0000","last_fullsized":"2024-05-08T18:12:01.792229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392228+0000","last_change":"2024-05-08T18:08:49.515508+0000","last_active":"2024-05-08T18:12:02.392228+0000","last_peered":"2024-05-08T18:12:02.392228+0000","last_clean":"2024-05-08T18:12:02.392228+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:02.392228+0000","last_undegraded":"2024-05-08T18:12:02.392228+0000","last_fullsized":"2024-05-08T18:12:02.392228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:35.075462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.423730+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:09:33.423730+0000","last_peered":"2024-05-08T18:09:33.423730+0000","last_clean":"2024-05-08T18:09:33.423730+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:09:33.423730+0000","last_undegraded":"2024-05-08T18:09:33.423730+0000","last_fullsized":"2024-05-08T18:09:33.423730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:39.673917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581355+0000","last_change":"2024-05-08T18:08:51.512103+0000","last_active":"2024-05-08T18:09:28.581355+0000","last_peered":"2024-05-08T18:09:28.581355+0000","last_clean":"2024-05-08T18:09:28.581355+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:09:28.581355+0000","last_undegraded":"2024-05-08T18:09:28.581355+0000","last_fullsized":"2024-05-08T18:09:28.581355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:29.355971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.644505+0000","last_change":"2024-05-08T18:08:53.547887+0000","last_active":"2024-05-08T18:11:01.644505+0000","last_peered":"2024-05-08T18:11:01.644505+0000","last_clean":"2024-05-08T18:11:01.644505+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:11:01.644505+0000","last_undegraded":"2024-05-08T18:11:01.644505+0000","last_fullsized":"2024-05-08T18:11:01.644505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:37.748836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":391,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754663+0000","last_change":"2024-05-08T18:08:55.569300+0000","last_active":"2024-05-08T18:12:01.754663+0000","last_peered":"2024-05-08T18:12:01.754663+0000","last_clean":"2024-05-08T18:12:01.754663+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:01.754663+0000","last_undegraded":"2024-05-08T18:12:01.754663+0000","last_fullsized":"2024-05-08T18:12:01.754663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:39.688576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.867775+0000","last_change":"2024-05-08T18:08:57.564089+0000","last_active":"2024-05-08T18:12:02.867775+0000","last_peered":"2024-05-08T18:12:02.867775+0000","last_clean":"2024-05-08T18:12:02.867775+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:02.867775+0000","last_undegraded":"2024-05-08T18:12:02.867775+0000","last_fullsized":"2024-05-08T18:12:02.867775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:58.387686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785001+0000","last_change":"2024-05-08T18:08:49.502184+0000","last_active":"2024-05-08T18:10:16.785001+0000","last_peered":"2024-05-08T18:10:16.785001+0000","last_clean":"2024-05-08T18:10:16.785001+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:10:16.785001+0000","last_undegraded":"2024-05-08T18:10:16.785001+0000","last_fullsized":"2024-05-08T18:10:16.785001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.897867+0000","last_change":"2024-05-08T18:08:47.498742+0000","last_active":"2024-05-08T18:09:31.897867+0000","last_peered":"2024-05-08T18:09:31.897867+0000","last_clean":"2024-05-08T18:09:31.897867+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:09:31.897867+0000","last_undegraded":"2024-05-08T18:09:31.897867+0000","last_fullsized":"2024-05-08T18:09:31.897867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:17.448245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607265+0000","last_change":"2024-05-08T18:08:51.513252+0000","last_active":"2024-05-08T18:09:28.607265+0000","last_peered":"2024-05-08T18:09:28.607265+0000","last_clean":"2024-05-08T18:09:28.607265+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:09:28.607265+0000","last_undegraded":"2024-05-08T18:09:28.607265+0000","last_fullsized":"2024-05-08T18:09:28.607265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:27.262513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431613+0000","last_change":"2024-05-08T18:08:53.550029+0000","last_active":"2024-05-08T18:11:21.431613+0000","last_peered":"2024-05-08T18:11:21.431613+0000","last_clean":"2024-05-08T18:11:21.431613+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:11:21.431613+0000","last_undegraded":"2024-05-08T18:11:21.431613+0000","last_fullsized":"2024-05-08T18:11:21.431613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:31.369561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.764223+0000","last_change":"2024-05-08T18:08:55.559384+0000","last_active":"2024-05-08T18:12:02.764223+0000","last_peered":"2024-05-08T18:12:02.764223+0000","last_clean":"2024-05-08T18:12:02.764223+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:02.764223+0000","last_undegraded":"2024-05-08T18:12:02.764223+0000","last_fullsized":"2024-05-08T18:12:02.764223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:12.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'11","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706714+0000","last_change":"2024-05-08T18:08:49.510841+0000","last_active":"2024-05-08T18:12:02.706714+0000","last_peered":"2024-05-08T18:12:02.706714+0000","last_clean":"2024-05-08T18:12:02.706714+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:02.706714+0000","last_undegraded":"2024-05-08T18:12:02.706714+0000","last_fullsized":"2024-05-08T18:12:02.706714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:50.298264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590076+0000","last_change":"2024-05-08T18:08:47.512906+0000","last_active":"2024-05-08T18:09:28.590076+0000","last_peered":"2024-05-08T18:09:28.590076+0000","last_clean":"2024-05-08T18:09:28.590076+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:09:28.590076+0000","last_undegraded":"2024-05-08T18:09:28.590076+0000","last_fullsized":"2024-05-08T18:09:28.590076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572207+0000","last_change":"2024-05-08T18:08:51.514762+0000","last_active":"2024-05-08T18:09:28.572207+0000","last_peered":"2024-05-08T18:09:28.572207+0000","last_clean":"2024-05-08T18:09:28.572207+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:09:28.572207+0000","last_undegraded":"2024-05-08T18:09:28.572207+0000","last_fullsized":"2024-05-08T18:09:28.572207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:04.358592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.586282+0000","last_change":"2024-05-08T18:08:53.535349+0000","last_active":"2024-05-08T18:10:59.586282+0000","last_peered":"2024-05-08T18:10:59.586282+0000","last_clean":"2024-05-08T18:10:59.586282+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:10:59.586282+0000","last_undegraded":"2024-05-08T18:10:59.586282+0000","last_fullsized":"2024-05-08T18:10:59.586282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:54.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583740+0000","last_change":"2024-05-08T18:08:55.543395+0000","last_active":"2024-05-08T18:09:28.583740+0000","last_peered":"2024-05-08T18:09:28.583740+0000","last_clean":"2024-05-08T18:09:28.583740+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:09:28.583740+0000","last_undegraded":"2024-05-08T18:09:28.583740+0000","last_fullsized":"2024-05-08T18:09:28.583740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:20.271109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.502622+0000","last_change":"2024-05-08T18:08:57.563745+0000","last_active":"2024-05-08T18:10:16.502622+0000","last_peered":"2024-05-08T18:10:16.502622+0000","last_clean":"2024-05-08T18:10:16.502622+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:10:16.502622+0000","last_undegraded":"2024-05-08T18:10:16.502622+0000","last_fullsized":"2024-05-08T18:10:16.502622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:30.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785596+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:10:16.785596+0000","last_peered":"2024-05-08T18:10:16.785596+0000","last_clean":"2024-05-08T18:10:16.785596+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:10:16.785596+0000","last_undegraded":"2024-05-08T18:10:16.785596+0000","last_fullsized":"2024-05-08T18:10:16.785596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:25.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591192+0000","last_change":"2024-05-08T18:08:47.513909+0000","last_active":"2024-05-08T18:09:28.591192+0000","last_peered":"2024-05-08T18:09:28.591192+0000","last_clean":"2024-05-08T18:09:28.591192+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:09:28.591192+0000","last_undegraded":"2024-05-08T18:09:28.591192+0000","last_fullsized":"2024-05-08T18:09:28.591192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407203+0000","last_change":"2024-05-08T18:09:28.594816+0000","last_active":"2024-05-08T18:09:31.407203+0000","last_peered":"2024-05-08T18:09:31.407203+0000","last_clean":"2024-05-08T18:09:31.407203+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:09:31.407203+0000","last_undegraded":"2024-05-08T18:09:31.407203+0000","last_fullsized":"2024-05-08T18:09:31.407203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:28.103174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.557932+0000","last_change":"2024-05-08T18:08:53.558331+0000","last_active":"2024-05-08T18:10:59.557932+0000","last_peered":"2024-05-08T18:10:59.557932+0000","last_clean":"2024-05-08T18:10:59.557932+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:10:59.557932+0000","last_undegraded":"2024-05-08T18:10:59.557932+0000","last_fullsized":"2024-05-08T18:10:59.557932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:26.213210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576613+0000","last_change":"2024-05-08T18:08:55.546287+0000","last_active":"2024-05-08T18:09:28.576613+0000","last_peered":"2024-05-08T18:09:28.576613+0000","last_clean":"2024-05-08T18:09:28.576613+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:09:28.576613+0000","last_undegraded":"2024-05-08T18:09:28.576613+0000","last_fullsized":"2024-05-08T18:09:28.576613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:10.826721+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:10:10.826721+0000","last_peered":"2024-05-08T18:10:10.826721+0000","last_clean":"2024-05-08T18:10:10.826721+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:10:10.826721+0000","last_undegraded":"2024-05-08T18:10:10.826721+0000","last_fullsized":"2024-05-08T18:10:10.826721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620354+0000","last_change":"2024-05-08T18:08:49.508936+0000","last_active":"2024-05-08T18:12:02.620354+0000","last_peered":"2024-05-08T18:12:02.620354+0000","last_clean":"2024-05-08T18:12:02.620354+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:02.620354+0000","last_undegraded":"2024-05-08T18:12:02.620354+0000","last_fullsized":"2024-05-08T18:12:02.620354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:21.051104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599345+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:09:28.599345+0000","last_peered":"2024-05-08T18:09:28.599345+0000","last_clean":"2024-05-08T18:09:28.599345+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:09:28.599345+0000","last_undegraded":"2024-05-08T18:09:28.599345+0000","last_fullsized":"2024-05-08T18:09:28.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:40.628230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584773+0000","last_change":"2024-05-08T18:08:51.511856+0000","last_active":"2024-05-08T18:09:28.584773+0000","last_peered":"2024-05-08T18:09:28.584773+0000","last_clean":"2024-05-08T18:09:28.584773+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:09:28.584773+0000","last_undegraded":"2024-05-08T18:09:28.584773+0000","last_fullsized":"2024-05-08T18:09:28.584773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:46.281518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.589041+0000","last_change":"2024-05-08T18:08:53.543547+0000","last_active":"2024-05-08T18:10:59.589041+0000","last_peered":"2024-05-08T18:10:59.589041+0000","last_clean":"2024-05-08T18:10:59.589041+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:10:59.589041+0000","last_undegraded":"2024-05-08T18:10:59.589041+0000","last_fullsized":"2024-05-08T18:10:59.589041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:16.619812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":355,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.962765+0000","last_change":"2024-05-08T18:08:55.546405+0000","last_active":"2024-05-08T18:12:02.962765+0000","last_peered":"2024-05-08T18:12:02.962765+0000","last_clean":"2024-05-08T18:12:02.962765+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:02.962765+0000","last_undegraded":"2024-05-08T18:12:02.962765+0000","last_fullsized":"2024-05-08T18:12:02.962765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578554+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:09:28.578554+0000","last_peered":"2024-05-08T18:09:28.578554+0000","last_clean":"2024-05-08T18:09:28.578554+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:09:28.578554+0000","last_undegraded":"2024-05-08T18:09:28.578554+0000","last_fullsized":"2024-05-08T18:09:28.578554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:35.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.451117+0000","last_change":"2024-05-08T18:08:49.491239+0000","last_active":"2024-05-08T18:10:57.451117+0000","last_peered":"2024-05-08T18:10:57.451117+0000","last_clean":"2024-05-08T18:10:57.451117+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:10:57.451117+0000","last_undegraded":"2024-05-08T18:10:57.451117+0000","last_fullsized":"2024-05-08T18:10:57.451117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.412627+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:09:33.412627+0000","last_peered":"2024-05-08T18:09:33.412627+0000","last_clean":"2024-05-08T18:09:33.412627+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:09:33.412627+0000","last_undegraded":"2024-05-08T18:09:33.412627+0000","last_fullsized":"2024-05-08T18:09:33.412627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:02.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407275+0000","last_change":"2024-05-08T18:09:28.599715+0000","last_active":"2024-05-08T18:09:31.407275+0000","last_peered":"2024-05-08T18:09:31.407275+0000","last_clean":"2024-05-08T18:09:31.407275+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:09:31.407275+0000","last_undegraded":"2024-05-08T18:09:31.407275+0000","last_fullsized":"2024-05-08T18:09:31.407275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:11.718211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.591215+0000","last_change":"2024-05-08T18:08:53.550420+0000","last_active":"2024-05-08T18:10:59.591215+0000","last_peered":"2024-05-08T18:10:59.591215+0000","last_clean":"2024-05-08T18:10:59.591215+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:10:59.591215+0000","last_undegraded":"2024-05-08T18:10:59.591215+0000","last_fullsized":"2024-05-08T18:10:59.591215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.341867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576602+0000","last_change":"2024-05-08T18:08:55.554490+0000","last_active":"2024-05-08T18:09:28.576602+0000","last_peered":"2024-05-08T18:09:28.576602+0000","last_clean":"2024-05-08T18:09:28.576602+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:09:28.576602+0000","last_undegraded":"2024-05-08T18:09:28.576602+0000","last_fullsized":"2024-05-08T18:09:28.576602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.922608+0000","last_change":"2024-05-08T18:08:57.554614+0000","last_active":"2024-05-08T18:12:02.922608+0000","last_peered":"2024-05-08T18:12:02.922608+0000","last_clean":"2024-05-08T18:12:02.922608+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:02.922608+0000","last_undegraded":"2024-05-08T18:12:02.922608+0000","last_fullsized":"2024-05-08T18:12:02.922608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:05.491234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658994+0000","last_change":"2024-05-08T18:08:49.519440+0000","last_active":"2024-05-08T18:09:32.658994+0000","last_peered":"2024-05-08T18:09:32.658994+0000","last_clean":"2024-05-08T18:09:32.658994+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:09:32.658994+0000","last_undegraded":"2024-05-08T18:09:32.658994+0000","last_fullsized":"2024-05-08T18:09:32.658994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581363+0000","last_change":"2024-05-08T18:08:47.496893+0000","last_active":"2024-05-08T18:09:28.581363+0000","last_peered":"2024-05-08T18:09:28.581363+0000","last_clean":"2024-05-08T18:09:28.581363+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:09:28.581363+0000","last_undegraded":"2024-05-08T18:09:28.581363+0000","last_fullsized":"2024-05-08T18:09:28.581363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:34.452347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584821+0000","last_change":"2024-05-08T18:08:51.507807+0000","last_active":"2024-05-08T18:09:28.584821+0000","last_peered":"2024-05-08T18:09:28.584821+0000","last_clean":"2024-05-08T18:09:28.584821+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:09:28.584821+0000","last_undegraded":"2024-05-08T18:09:28.584821+0000","last_fullsized":"2024-05-08T18:09:28.584821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:57.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.563219+0000","last_change":"2024-05-08T18:08:53.519537+0000","last_active":"2024-05-08T18:10:59.563219+0000","last_peered":"2024-05-08T18:10:59.563219+0000","last_clean":"2024-05-08T18:10:59.563219+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:10:59.563219+0000","last_undegraded":"2024-05-08T18:10:59.563219+0000","last_fullsized":"2024-05-08T18:10:59.563219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:52.757767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598872+0000","last_change":"2024-05-08T18:08:55.570542+0000","last_active":"2024-05-08T18:09:28.598872+0000","last_peered":"2024-05-08T18:09:28.598872+0000","last_clean":"2024-05-08T18:09:28.598872+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:09:28.598872+0000","last_undegraded":"2024-05-08T18:09:28.598872+0000","last_fullsized":"2024-05-08T18:09:28.598872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:08.738890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429230+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:11:01.429230+0000","last_peered":"2024-05-08T18:11:01.429230+0000","last_clean":"2024-05-08T18:11:01.429230+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:11:01.429230+0000","last_undegraded":"2024-05-08T18:11:01.429230+0000","last_fullsized":"2024-05-08T18:11:01.429230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:49.482320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688757+0000","last_change":"2024-05-08T18:08:49.515298+0000","last_active":"2024-05-08T18:12:02.688757+0000","last_peered":"2024-05-08T18:12:02.688757+0000","last_clean":"2024-05-08T18:12:02.688757+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:02.688757+0000","last_undegraded":"2024-05-08T18:12:02.688757+0000","last_fullsized":"2024-05-08T18:12:02.688757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:48.730204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429546+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:11:01.429546+0000","last_peered":"2024-05-08T18:11:01.429546+0000","last_clean":"2024-05-08T18:11:01.429546+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:11:01.429546+0000","last_undegraded":"2024-05-08T18:11:01.429546+0000","last_fullsized":"2024-05-08T18:11:01.429546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:05.053205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582954+0000","last_change":"2024-05-08T18:08:51.522113+0000","last_active":"2024-05-08T18:09:28.582954+0000","last_peered":"2024-05-08T18:09:28.582954+0000","last_clean":"2024-05-08T18:09:28.582954+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:09:28.582954+0000","last_undegraded":"2024-05-08T18:09:28.582954+0000","last_fullsized":"2024-05-08T18:09:28.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:38.116549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.603131+0000","last_change":"2024-05-08T18:08:53.521466+0000","last_active":"2024-05-08T18:10:59.603131+0000","last_peered":"2024-05-08T18:10:59.603131+0000","last_clean":"2024-05-08T18:10:59.603131+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:10:59.603131+0000","last_undegraded":"2024-05-08T18:10:59.603131+0000","last_fullsized":"2024-05-08T18:10:59.603131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:54.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.948610+0000","last_change":"2024-05-08T18:08:55.551517+0000","last_active":"2024-05-08T18:12:02.948610+0000","last_peered":"2024-05-08T18:12:02.948610+0000","last_clean":"2024-05-08T18:12:02.948610+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:02.948610+0000","last_undegraded":"2024-05-08T18:12:02.948610+0000","last_fullsized":"2024-05-08T18:12:02.948610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:54.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420148+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:11:06.420148+0000","last_peered":"2024-05-08T18:11:06.420148+0000","last_clean":"2024-05-08T18:11:06.420148+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:11:06.420148+0000","last_undegraded":"2024-05-08T18:11:06.420148+0000","last_fullsized":"2024-05-08T18:11:06.420148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.783846+0000","last_change":"2024-05-08T18:08:49.511424+0000","last_active":"2024-05-08T18:10:16.783846+0000","last_peered":"2024-05-08T18:10:16.783846+0000","last_clean":"2024-05-08T18:10:16.783846+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:10:16.783846+0000","last_undegraded":"2024-05-08T18:10:16.783846+0000","last_fullsized":"2024-05-08T18:10:16.783846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.346107+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:11:01.346107+0000","last_peered":"2024-05-08T18:11:01.346107+0000","last_clean":"2024-05-08T18:11:01.346107+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:11:01.346107+0000","last_undegraded":"2024-05-08T18:11:01.346107+0000","last_fullsized":"2024-05-08T18:11:01.346107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:07.886229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.121864+0000","last_change":"2024-05-08T18:08:51.518382+0000","last_active":"2024-05-08T18:11:01.121864+0000","last_peered":"2024-05-08T18:11:01.121864+0000","last_clean":"2024-05-08T18:11:01.121864+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:11:01.121864+0000","last_undegraded":"2024-05-08T18:11:01.121864+0000","last_fullsized":"2024-05-08T18:11:01.121864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:09.759130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597807+0000","last_change":"2024-05-08T18:08:53.558518+0000","last_active":"2024-05-08T18:09:28.597807+0000","last_peered":"2024-05-08T18:09:28.597807+0000","last_clean":"2024-05-08T18:09:28.597807+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:09:28.597807+0000","last_undegraded":"2024-05-08T18:09:28.597807+0000","last_fullsized":"2024-05-08T18:09:28.597807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:55.547274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.874118+0000","last_change":"2024-05-08T18:08:55.557075+0000","last_active":"2024-05-08T18:12:02.874118+0000","last_peered":"2024-05-08T18:12:02.874118+0000","last_clean":"2024-05-08T18:12:02.874118+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:02.874118+0000","last_undegraded":"2024-05-08T18:12:02.874118+0000","last_fullsized":"2024-05-08T18:12:02.874118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.278025+0000","last_change":"2024-05-08T18:08:57.569509+0000","last_active":"2024-05-08T18:11:01.278025+0000","last_peered":"2024-05-08T18:11:01.278025+0000","last_clean":"2024-05-08T18:11:01.278025+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:11:01.278025+0000","last_undegraded":"2024-05-08T18:11:01.278025+0000","last_fullsized":"2024-05-08T18:11:01.278025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:46.790373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862531+0000","last_change":"2024-05-08T18:08:49.518367+0000","last_active":"2024-05-08T18:12:02.862531+0000","last_peered":"2024-05-08T18:12:02.862531+0000","last_clean":"2024-05-08T18:12:02.862531+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:02.862531+0000","last_undegraded":"2024-05-08T18:12:02.862531+0000","last_fullsized":"2024-05-08T18:12:02.862531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:06.824034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587763+0000","last_change":"2024-05-08T18:08:47.529160+0000","last_active":"2024-05-08T18:09:28.587763+0000","last_peered":"2024-05-08T18:09:28.587763+0000","last_clean":"2024-05-08T18:09:28.587763+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:09:28.587763+0000","last_undegraded":"2024-05-08T18:09:28.587763+0000","last_fullsized":"2024-05-08T18:09:28.587763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:54.279504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607171+0000","last_change":"2024-05-08T18:08:51.511533+0000","last_active":"2024-05-08T18:09:28.607171+0000","last_peered":"2024-05-08T18:09:28.607171+0000","last_clean":"2024-05-08T18:09:28.607171+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:09:28.607171+0000","last_undegraded":"2024-05-08T18:09:28.607171+0000","last_fullsized":"2024-05-08T18:09:28.607171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:10.403888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.582144+0000","last_change":"2024-05-08T18:08:53.517418+0000","last_active":"2024-05-08T18:10:59.582144+0000","last_peered":"2024-05-08T18:10:59.582144+0000","last_clean":"2024-05-08T18:10:59.582144+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:10:59.582144+0000","last_undegraded":"2024-05-08T18:10:59.582144+0000","last_fullsized":"2024-05-08T18:10:59.582144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:45.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586484+0000","last_change":"2024-05-08T18:08:55.541260+0000","last_active":"2024-05-08T18:09:28.586484+0000","last_peered":"2024-05-08T18:09:28.586484+0000","last_clean":"2024-05-08T18:09:28.586484+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:09:28.586484+0000","last_undegraded":"2024-05-08T18:09:28.586484+0000","last_fullsized":"2024-05-08T18:09:28.586484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:47.311202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.828028+0000","last_change":"2024-05-08T18:08:57.568017+0000","last_active":"2024-05-08T18:12:02.828028+0000","last_peered":"2024-05-08T18:12:02.828028+0000","last_clean":"2024-05-08T18:12:02.828028+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:12:02.828028+0000","last_undegraded":"2024-05-08T18:12:02.828028+0000","last_fullsized":"2024-05-08T18:12:02.828028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.143701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.707182+0000","last_change":"2024-05-08T18:08:49.510311+0000","last_active":"2024-05-08T18:12:02.707182+0000","last_peered":"2024-05-08T18:12:02.707182+0000","last_clean":"2024-05-08T18:12:02.707182+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:02.707182+0000","last_undegraded":"2024-05-08T18:12:02.707182+0000","last_fullsized":"2024-05-08T18:12:02.707182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:19.250288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571588+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:09:28.571588+0000","last_peered":"2024-05-08T18:09:28.571588+0000","last_clean":"2024-05-08T18:09:28.571588+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:09:28.571588+0000","last_undegraded":"2024-05-08T18:09:28.571588+0000","last_fullsized":"2024-05-08T18:09:28.571588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:09.321105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602411+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:09:28.602411+0000","last_peered":"2024-05-08T18:09:28.602411+0000","last_clean":"2024-05-08T18:09:28.602411+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:09:28.602411+0000","last_undegraded":"2024-05-08T18:09:28.602411+0000","last_fullsized":"2024-05-08T18:09:28.602411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:48.933240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.429157+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:09:33.429157+0000","last_peered":"2024-05-08T18:09:33.429157+0000","last_clean":"2024-05-08T18:09:33.429157+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:09:33.429157+0000","last_undegraded":"2024-05-08T18:09:33.429157+0000","last_fullsized":"2024-05-08T18:09:33.429157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:30.152904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575232+0000","last_change":"2024-05-08T18:08:51.520538+0000","last_active":"2024-05-08T18:09:28.575232+0000","last_peered":"2024-05-08T18:09:28.575232+0000","last_clean":"2024-05-08T18:09:28.575232+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:09:28.575232+0000","last_undegraded":"2024-05-08T18:09:28.575232+0000","last_fullsized":"2024-05-08T18:09:28.575232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:05.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.624394+0000","last_change":"2024-05-08T18:08:53.552241+0000","last_active":"2024-05-08T18:12:02.624394+0000","last_peered":"2024-05-08T18:12:02.624394+0000","last_clean":"2024-05-08T18:12:02.624394+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:02.624394+0000","last_undegraded":"2024-05-08T18:12:02.624394+0000","last_fullsized":"2024-05-08T18:12:02.624394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:31.496707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580217+0000","last_change":"2024-05-08T18:08:55.565611+0000","last_active":"2024-05-08T18:09:28.580217+0000","last_peered":"2024-05-08T18:09:28.580217+0000","last_clean":"2024-05-08T18:09:28.580217+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:09:28.580217+0000","last_undegraded":"2024-05-08T18:09:28.580217+0000","last_fullsized":"2024-05-08T18:09:28.580217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:14.430171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.781603+0000","last_change":"2024-05-08T18:08:57.567916+0000","last_active":"2024-05-08T18:12:02.781603+0000","last_peered":"2024-05-08T18:12:02.781603+0000","last_clean":"2024-05-08T18:12:02.781603+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:02.781603+0000","last_undegraded":"2024-05-08T18:12:02.781603+0000","last_fullsized":"2024-05-08T18:12:02.781603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:51.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599193+0000","last_change":"2024-05-08T18:08:49.510047+0000","last_active":"2024-05-08T18:12:02.599193+0000","last_peered":"2024-05-08T18:12:02.599193+0000","last_clean":"2024-05-08T18:12:02.599193+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:12:02.599193+0000","last_undegraded":"2024-05-08T18:12:02.599193+0000","last_fullsized":"2024-05-08T18:12:02.599193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:12.681511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586341+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:09:28.586341+0000","last_peered":"2024-05-08T18:09:28.586341+0000","last_clean":"2024-05-08T18:09:28.586341+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:09:28.586341+0000","last_undegraded":"2024-05-08T18:09:28.586341+0000","last_fullsized":"2024-05-08T18:09:28.586341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:48.054967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576589+0000","last_change":"2024-05-08T18:08:47.515311+0000","last_active":"2024-05-08T18:09:28.576589+0000","last_peered":"2024-05-08T18:09:28.576589+0000","last_clean":"2024-05-08T18:09:28.576589+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:09:28.576589+0000","last_undegraded":"2024-05-08T18:09:28.576589+0000","last_fullsized":"2024-05-08T18:09:28.576589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607650+0000","last_change":"2024-05-08T18:08:51.512536+0000","last_active":"2024-05-08T18:09:28.607650+0000","last_peered":"2024-05-08T18:09:28.607650+0000","last_clean":"2024-05-08T18:09:28.607650+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:09:28.607650+0000","last_undegraded":"2024-05-08T18:09:28.607650+0000","last_fullsized":"2024-05-08T18:09:28.607650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:58.676437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754539+0000","last_change":"2024-05-08T18:08:53.530304+0000","last_active":"2024-05-08T18:12:01.754539+0000","last_peered":"2024-05-08T18:12:01.754539+0000","last_clean":"2024-05-08T18:12:01.754539+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:01.754539+0000","last_undegraded":"2024-05-08T18:12:01.754539+0000","last_fullsized":"2024-05-08T18:12:01.754539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:39.103025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592749+0000","last_change":"2024-05-08T18:08:55.568400+0000","last_active":"2024-05-08T18:09:28.592749+0000","last_peered":"2024-05-08T18:09:28.592749+0000","last_clean":"2024-05-08T18:09:28.592749+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:09:28.592749+0000","last_undegraded":"2024-05-08T18:09:28.592749+0000","last_fullsized":"2024-05-08T18:09:28.592749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:48.835521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.496391+0000","last_change":"2024-05-08T18:08:57.579069+0000","last_active":"2024-05-08T18:10:16.496391+0000","last_peered":"2024-05-08T18:10:16.496391+0000","last_clean":"2024-05-08T18:10:16.496391+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:10:16.496391+0000","last_undegraded":"2024-05-08T18:10:16.496391+0000","last_fullsized":"2024-05-08T18:10:16.496391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:45.209949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755355+0000","last_change":"2024-05-08T18:08:49.501820+0000","last_active":"2024-05-08T18:12:02.755355+0000","last_peered":"2024-05-08T18:12:02.755355+0000","last_clean":"2024-05-08T18:12:02.755355+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:02.755355+0000","last_undegraded":"2024-05-08T18:12:02.755355+0000","last_fullsized":"2024-05-08T18:12:02.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579628+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:09:28.579628+0000","last_peered":"2024-05-08T18:09:28.579628+0000","last_clean":"2024-05-08T18:09:28.579628+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:09:28.579628+0000","last_undegraded":"2024-05-08T18:09:28.579628+0000","last_fullsized":"2024-05-08T18:09:28.579628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576151+0000","last_change":"2024-05-08T18:08:47.513124+0000","last_active":"2024-05-08T18:09:28.576151+0000","last_peered":"2024-05-08T18:09:28.576151+0000","last_clean":"2024-05-08T18:09:28.576151+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:09:28.576151+0000","last_undegraded":"2024-05-08T18:09:28.576151+0000","last_fullsized":"2024-05-08T18:09:28.576151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590814+0000","last_change":"2024-05-08T18:08:51.508831+0000","last_active":"2024-05-08T18:09:28.590814+0000","last_peered":"2024-05-08T18:09:28.590814+0000","last_clean":"2024-05-08T18:09:28.590814+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:09:28.590814+0000","last_undegraded":"2024-05-08T18:09:28.590814+0000","last_fullsized":"2024-05-08T18:09:28.590814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:04.126643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754979+0000","last_change":"2024-05-08T18:08:53.525229+0000","last_active":"2024-05-08T18:12:01.754979+0000","last_peered":"2024-05-08T18:12:01.754979+0000","last_clean":"2024-05-08T18:12:01.754979+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:01.754979+0000","last_undegraded":"2024-05-08T18:12:01.754979+0000","last_fullsized":"2024-05-08T18:12:01.754979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:06.372182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581183+0000","last_change":"2024-05-08T18:08:55.567310+0000","last_active":"2024-05-08T18:09:28.581183+0000","last_peered":"2024-05-08T18:09:28.581183+0000","last_clean":"2024-05-08T18:09:28.581183+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:09:28.581183+0000","last_undegraded":"2024-05-08T18:09:28.581183+0000","last_fullsized":"2024-05-08T18:09:28.581183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:30.447596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.450125+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:09:33.450125+0000","last_peered":"2024-05-08T18:09:33.450125+0000","last_clean":"2024-05-08T18:09:33.450125+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:09:33.450125+0000","last_undegraded":"2024-05-08T18:09:33.450125+0000","last_fullsized":"2024-05-08T18:09:33.450125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:09.186479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774957+0000","last_change":"2024-05-08T18:08:49.493587+0000","last_active":"2024-05-08T18:12:02.774957+0000","last_peered":"2024-05-08T18:12:02.774957+0000","last_clean":"2024-05-08T18:12:02.774957+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:02.774957+0000","last_undegraded":"2024-05-08T18:12:02.774957+0000","last_fullsized":"2024-05-08T18:12:02.774957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593308+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:09:28.593308+0000","last_peered":"2024-05-08T18:09:28.593308+0000","last_clean":"2024-05-08T18:09:28.593308+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:09:28.593308+0000","last_undegraded":"2024-05-08T18:09:28.593308+0000","last_fullsized":"2024-05-08T18:09:28.593308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:57:14.342510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581432+0000","last_change":"2024-05-08T18:08:47.507237+0000","last_active":"2024-05-08T18:09:28.581432+0000","last_peered":"2024-05-08T18:09:28.581432+0000","last_clean":"2024-05-08T18:09:28.581432+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:09:28.581432+0000","last_undegraded":"2024-05-08T18:09:28.581432+0000","last_fullsized":"2024-05-08T18:09:28.581432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579952+0000","last_change":"2024-05-08T18:08:51.510525+0000","last_active":"2024-05-08T18:09:28.579952+0000","last_peered":"2024-05-08T18:09:28.579952+0000","last_clean":"2024-05-08T18:09:28.579952+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:09:28.579952+0000","last_undegraded":"2024-05-08T18:09:28.579952+0000","last_fullsized":"2024-05-08T18:09:28.579952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:35.735245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.660422+0000","last_change":"2024-05-08T18:08:53.551086+0000","last_active":"2024-05-08T18:12:01.660422+0000","last_peered":"2024-05-08T18:12:01.660422+0000","last_clean":"2024-05-08T18:12:01.660422+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:01.660422+0000","last_undegraded":"2024-05-08T18:12:01.660422+0000","last_fullsized":"2024-05-08T18:12:01.660422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:35.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602251+0000","last_change":"2024-05-08T18:08:55.569487+0000","last_active":"2024-05-08T18:09:28.602251+0000","last_peered":"2024-05-08T18:09:28.602251+0000","last_clean":"2024-05-08T18:09:28.602251+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:09:28.602251+0000","last_undegraded":"2024-05-08T18:09:28.602251+0000","last_fullsized":"2024-05-08T18:09:28.602251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:08.021899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.257052+0000","last_change":"2024-05-08T18:08:57.567414+0000","last_active":"2024-05-08T18:11:01.257052+0000","last_peered":"2024-05-08T18:11:01.257052+0000","last_clean":"2024-05-08T18:11:01.257052+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:11:01.257052+0000","last_undegraded":"2024-05-08T18:11:01.257052+0000","last_fullsized":"2024-05-08T18:11:01.257052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:16.573083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689283+0000","last_change":"2024-05-08T18:09:28.612611+0000","last_active":"2024-05-08T18:12:02.689283+0000","last_peered":"2024-05-08T18:12:02.689283+0000","last_clean":"2024-05-08T18:12:02.689283+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:12:02.689283+0000","last_undegraded":"2024-05-08T18:12:02.689283+0000","last_fullsized":"2024-05-08T18:12:02.689283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892803+0000","last_change":"2024-05-08T18:08:47.517520+0000","last_active":"2024-05-08T18:09:31.892803+0000","last_peered":"2024-05-08T18:09:31.892803+0000","last_clean":"2024-05-08T18:09:31.892803+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:09:31.892803+0000","last_undegraded":"2024-05-08T18:09:31.892803+0000","last_fullsized":"2024-05-08T18:09:31.892803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580404+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:09:28.580404+0000","last_peered":"2024-05-08T18:09:28.580404+0000","last_clean":"2024-05-08T18:09:28.580404+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:09:28.580404+0000","last_undegraded":"2024-05-08T18:09:28.580404+0000","last_fullsized":"2024-05-08T18:09:28.580404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:02.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417770+0000","last_change":"2024-05-08T18:08:51.511005+0000","last_active":"2024-05-08T18:10:56.417770+0000","last_peered":"2024-05-08T18:10:56.417770+0000","last_clean":"2024-05-08T18:10:56.417770+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:10:56.417770+0000","last_undegraded":"2024-05-08T18:10:56.417770+0000","last_fullsized":"2024-05-08T18:10:56.417770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:10.746341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.601402+0000","last_change":"2024-05-08T18:08:53.554240+0000","last_active":"2024-05-08T18:10:59.601402+0000","last_peered":"2024-05-08T18:10:59.601402+0000","last_clean":"2024-05-08T18:10:59.601402+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:10:59.601402+0000","last_undegraded":"2024-05-08T18:10:59.601402+0000","last_fullsized":"2024-05-08T18:10:59.601402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:40.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581262+0000","last_change":"2024-05-08T18:08:55.551427+0000","last_active":"2024-05-08T18:09:28.581262+0000","last_peered":"2024-05-08T18:09:28.581262+0000","last_clean":"2024-05-08T18:09:28.581262+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:09:28.581262+0000","last_undegraded":"2024-05-08T18:09:28.581262+0000","last_fullsized":"2024-05-08T18:09:28.581262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:25.290543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.494426+0000","last_change":"2024-05-08T18:08:57.564941+0000","last_active":"2024-05-08T18:11:01.494426+0000","last_peered":"2024-05-08T18:11:01.494426+0000","last_clean":"2024-05-08T18:11:01.494426+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:11:01.494426+0000","last_undegraded":"2024-05-08T18:11:01.494426+0000","last_fullsized":"2024-05-08T18:11:01.494426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:55.289619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597441+0000","last_change":"2024-05-08T18:08:49.519773+0000","last_active":"2024-05-08T18:12:02.597441+0000","last_peered":"2024-05-08T18:12:02.597441+0000","last_clean":"2024-05-08T18:12:02.597441+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:02.597441+0000","last_undegraded":"2024-05-08T18:12:02.597441+0000","last_fullsized":"2024-05-08T18:12:02.597441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583257+0000","last_change":"2024-05-08T18:08:47.517709+0000","last_active":"2024-05-08T18:09:28.583257+0000","last_peered":"2024-05-08T18:09:28.583257+0000","last_clean":"2024-05-08T18:09:28.583257+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:09:28.583257+0000","last_undegraded":"2024-05-08T18:09:28.583257+0000","last_fullsized":"2024-05-08T18:09:28.583257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598381+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:09:28.598381+0000","last_peered":"2024-05-08T18:09:28.598381+0000","last_clean":"2024-05-08T18:09:28.598381+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:09:28.598381+0000","last_undegraded":"2024-05-08T18:09:28.598381+0000","last_fullsized":"2024-05-08T18:09:28.598381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:21.080378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592808+0000","last_change":"2024-05-08T18:08:51.505864+0000","last_active":"2024-05-08T18:09:28.592808+0000","last_peered":"2024-05-08T18:09:28.592808+0000","last_clean":"2024-05-08T18:09:28.592808+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:09:28.592808+0000","last_undegraded":"2024-05-08T18:09:28.592808+0000","last_fullsized":"2024-05-08T18:09:28.592808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:06.233890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572702+0000","last_change":"2024-05-08T18:08:53.553633+0000","last_active":"2024-05-08T18:09:28.572702+0000","last_peered":"2024-05-08T18:09:28.572702+0000","last_clean":"2024-05-08T18:09:28.572702+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:09:28.572702+0000","last_undegraded":"2024-05-08T18:09:28.572702+0000","last_fullsized":"2024-05-08T18:09:28.572702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:23.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.768768+0000","last_change":"2024-05-08T18:08:55.556466+0000","last_active":"2024-05-08T18:12:02.768768+0000","last_peered":"2024-05-08T18:12:02.768768+0000","last_clean":"2024-05-08T18:12:02.768768+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:02.768768+0000","last_undegraded":"2024-05-08T18:12:02.768768+0000","last_fullsized":"2024-05-08T18:12:02.768768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598317+0000","last_change":"2024-05-08T18:08:57.559589+0000","last_active":"2024-05-08T18:09:28.598317+0000","last_peered":"2024-05-08T18:09:28.598317+0000","last_clean":"2024-05-08T18:09:28.598317+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:09:28.598317+0000","last_undegraded":"2024-05-08T18:09:28.598317+0000","last_fullsized":"2024-05-08T18:09:28.598317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:44.469070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270592+0000","last_change":"2024-05-08T18:08:49.510615+0000","last_active":"2024-05-08T18:12:02.270592+0000","last_peered":"2024-05-08T18:12:02.270592+0000","last_clean":"2024-05-08T18:12:02.270592+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:02.270592+0000","last_undegraded":"2024-05-08T18:12:02.270592+0000","last_fullsized":"2024-05-08T18:12:02.270592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:03.732312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892852+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:09:31.892852+0000","last_peered":"2024-05-08T18:09:31.892852+0000","last_clean":"2024-05-08T18:09:31.892852+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:09:31.892852+0000","last_undegraded":"2024-05-08T18:09:31.892852+0000","last_fullsized":"2024-05-08T18:09:31.892852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:57.257231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580836+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:09:28.580836+0000","last_peered":"2024-05-08T18:09:28.580836+0000","last_clean":"2024-05-08T18:09:28.580836+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:09:28.580836+0000","last_undegraded":"2024-05-08T18:09:28.580836+0000","last_fullsized":"2024-05-08T18:09:28.580836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:37.747046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603006+0000","last_change":"2024-05-08T18:08:51.513370+0000","last_active":"2024-05-08T18:09:28.603006+0000","last_peered":"2024-05-08T18:09:28.603006+0000","last_clean":"2024-05-08T18:09:28.603006+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:09:28.603006+0000","last_undegraded":"2024-05-08T18:09:28.603006+0000","last_fullsized":"2024-05-08T18:09:28.603006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:16.244827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602730+0000","last_change":"2024-05-08T18:08:53.549741+0000","last_active":"2024-05-08T18:09:28.602730+0000","last_peered":"2024-05-08T18:09:28.602730+0000","last_clean":"2024-05-08T18:09:28.602730+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:09:28.602730+0000","last_undegraded":"2024-05-08T18:09:28.602730+0000","last_fullsized":"2024-05-08T18:09:28.602730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:21.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.924485+0000","last_change":"2024-05-08T18:08:55.543586+0000","last_active":"2024-05-08T18:12:02.924485+0000","last_peered":"2024-05-08T18:12:02.924485+0000","last_clean":"2024-05-08T18:12:02.924485+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:02.924485+0000","last_undegraded":"2024-05-08T18:12:02.924485+0000","last_fullsized":"2024-05-08T18:12:02.924485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.633075+0000","last_change":"2024-05-08T18:08:57.573590+0000","last_active":"2024-05-08T18:11:01.633075+0000","last_peered":"2024-05-08T18:11:01.633075+0000","last_clean":"2024-05-08T18:11:01.633075+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:11:01.633075+0000","last_undegraded":"2024-05-08T18:11:01.633075+0000","last_fullsized":"2024-05-08T18:11:01.633075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425042+0000","last_change":"2024-05-08T18:09:28.589121+0000","last_active":"2024-05-08T18:10:56.425042+0000","last_peered":"2024-05-08T18:10:56.425042+0000","last_clean":"2024-05-08T18:10:56.425042+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:10:56.425042+0000","last_undegraded":"2024-05-08T18:10:56.425042+0000","last_fullsized":"2024-05-08T18:10:56.425042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:55.349405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584979+0000","last_change":"2024-05-08T18:08:47.512221+0000","last_active":"2024-05-08T18:09:28.584979+0000","last_peered":"2024-05-08T18:09:28.584979+0000","last_clean":"2024-05-08T18:09:28.584979+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:09:28.584979+0000","last_undegraded":"2024-05-08T18:09:28.584979+0000","last_fullsized":"2024-05-08T18:09:28.584979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599261+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:09:28.599261+0000","last_peered":"2024-05-08T18:09:28.599261+0000","last_clean":"2024-05-08T18:09:28.599261+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:09:28.599261+0000","last_undegraded":"2024-05-08T18:09:28.599261+0000","last_fullsized":"2024-05-08T18:09:28.599261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:13.321704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589247+0000","last_change":"2024-05-08T18:08:51.510230+0000","last_active":"2024-05-08T18:09:28.589247+0000","last_peered":"2024-05-08T18:09:28.589247+0000","last_clean":"2024-05-08T18:09:28.589247+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:09:28.589247+0000","last_undegraded":"2024-05-08T18:09:28.589247+0000","last_fullsized":"2024-05-08T18:09:28.589247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:26.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.426469+0000","last_change":"2024-05-08T18:08:53.550482+0000","last_active":"2024-05-08T18:11:01.426469+0000","last_peered":"2024-05-08T18:11:01.426469+0000","last_clean":"2024-05-08T18:11:01.426469+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:11:01.426469+0000","last_undegraded":"2024-05-08T18:11:01.426469+0000","last_fullsized":"2024-05-08T18:11:01.426469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:48.461545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7721,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":87,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579744+0000","last_change":"2024-05-08T18:08:55.554634+0000","last_active":"2024-05-08T18:09:28.579744+0000","last_peered":"2024-05-08T18:09:28.579744+0000","last_clean":"2024-05-08T18:09:28.579744+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:09:28.579744+0000","last_undegraded":"2024-05-08T18:09:28.579744+0000","last_fullsized":"2024-05-08T18:09:28.579744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586328+0000","last_change":"2024-05-08T18:08:57.564366+0000","last_active":"2024-05-08T18:09:28.586328+0000","last_peered":"2024-05-08T18:09:28.586328+0000","last_clean":"2024-05-08T18:09:28.586328+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:09:28.586328+0000","last_undegraded":"2024-05-08T18:09:28.586328+0000","last_fullsized":"2024-05-08T18:09:28.586328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:12.274417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.585033+0000","last_change":"2024-05-08T18:08:57.586231+0000","last_active":"2024-05-08T18:09:28.585033+0000","last_peered":"2024-05-08T18:09:28.585033+0000","last_clean":"2024-05-08T18:09:28.585033+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:09:28.585033+0000","last_undegraded":"2024-05-08T18:09:28.585033+0000","last_fullsized":"2024-05-08T18:09:28.585033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:26.309299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391896+0000","last_change":"2024-05-08T18:08:49.517973+0000","last_active":"2024-05-08T18:12:02.391896+0000","last_peered":"2024-05-08T18:12:02.391896+0000","last_clean":"2024-05-08T18:12:02.391896+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:12:02.391896+0000","last_undegraded":"2024-05-08T18:12:02.391896+0000","last_fullsized":"2024-05-08T18:12:02.391896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593683+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:09:28.593683+0000","last_peered":"2024-05-08T18:09:28.593683+0000","last_clean":"2024-05-08T18:09:28.593683+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:09:28.593683+0000","last_undegraded":"2024-05-08T18:09:28.593683+0000","last_fullsized":"2024-05-08T18:09:28.593683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:09.399882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576250+0000","last_change":"2024-05-08T18:08:51.517003+0000","last_active":"2024-05-08T18:09:28.576250+0000","last_peered":"2024-05-08T18:09:28.576250+0000","last_clean":"2024-05-08T18:09:28.576250+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:09:28.576250+0000","last_undegraded":"2024-05-08T18:09:28.576250+0000","last_fullsized":"2024-05-08T18:09:28.576250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.213274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.587556+0000","last_change":"2024-05-08T18:08:53.546900+0000","last_active":"2024-05-08T18:10:59.587556+0000","last_peered":"2024-05-08T18:10:59.587556+0000","last_clean":"2024-05-08T18:10:59.587556+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:10:59.587556+0000","last_undegraded":"2024-05-08T18:10:59.587556+0000","last_fullsized":"2024-05-08T18:10:59.587556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:31.873538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588783+0000","last_change":"2024-05-08T18:08:55.558807+0000","last_active":"2024-05-08T18:09:28.588783+0000","last_peered":"2024-05-08T18:09:28.588783+0000","last_clean":"2024-05-08T18:09:28.588783+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:09:28.588783+0000","last_undegraded":"2024-05-08T18:09:28.588783+0000","last_fullsized":"2024-05-08T18:09:28.588783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:28.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.395796+0000","last_change":"2024-05-08T18:08:57.554621+0000","last_active":"2024-05-08T18:12:02.395796+0000","last_peered":"2024-05-08T18:12:02.395796+0000","last_clean":"2024-05-08T18:12:02.395796+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:02.395796+0000","last_undegraded":"2024-05-08T18:12:02.395796+0000","last_fullsized":"2024-05-08T18:12:02.395796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:36.523989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392595+0000","last_change":"2024-05-08T18:08:49.515316+0000","last_active":"2024-05-08T18:12:02.392595+0000","last_peered":"2024-05-08T18:12:02.392595+0000","last_clean":"2024-05-08T18:12:02.392595+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:02.392595+0000","last_undegraded":"2024-05-08T18:12:02.392595+0000","last_fullsized":"2024-05-08T18:12:02.392595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430491+0000","last_change":"2024-05-08T18:08:47.514514+0000","last_active":"2024-05-08T18:11:16.430491+0000","last_peered":"2024-05-08T18:11:16.430491+0000","last_clean":"2024-05-08T18:11:16.430491+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:11:16.430491+0000","last_undegraded":"2024-05-08T18:11:16.430491+0000","last_fullsized":"2024-05-08T18:11:16.430491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603376+0000","last_change":"2024-05-08T18:08:51.510753+0000","last_active":"2024-05-08T18:09:28.603376+0000","last_peered":"2024-05-08T18:09:28.603376+0000","last_clean":"2024-05-08T18:09:28.603376+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:09:28.603376+0000","last_undegraded":"2024-05-08T18:09:28.603376+0000","last_fullsized":"2024-05-08T18:09:28.603376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:41.695717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.670842+0000","last_change":"2024-05-08T18:08:53.524878+0000","last_active":"2024-05-08T18:12:01.670842+0000","last_peered":"2024-05-08T18:12:01.670842+0000","last_clean":"2024-05-08T18:12:01.670842+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:01.670842+0000","last_undegraded":"2024-05-08T18:12:01.670842+0000","last_fullsized":"2024-05-08T18:12:01.670842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:40.829168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580812+0000","last_change":"2024-05-08T18:08:55.565178+0000","last_active":"2024-05-08T18:09:28.580812+0000","last_peered":"2024-05-08T18:09:28.580812+0000","last_clean":"2024-05-08T18:09:28.580812+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:09:28.580812+0000","last_undegraded":"2024-05-08T18:09:28.580812+0000","last_fullsized":"2024-05-08T18:09:28.580812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:05.564412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578264+0000","last_change":"2024-05-08T18:08:57.565323+0000","last_active":"2024-05-08T18:09:28.578264+0000","last_peered":"2024-05-08T18:09:28.578264+0000","last_clean":"2024-05-08T18:09:28.578264+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:09:28.578264+0000","last_undegraded":"2024-05-08T18:09:28.578264+0000","last_fullsized":"2024-05-08T18:09:28.578264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:04.648587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755243+0000","last_change":"2024-05-08T18:08:49.506944+0000","last_active":"2024-05-08T18:12:02.755243+0000","last_peered":"2024-05-08T18:12:02.755243+0000","last_clean":"2024-05-08T18:12:02.755243+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:02.755243+0000","last_undegraded":"2024-05-08T18:12:02.755243+0000","last_fullsized":"2024-05-08T18:12:02.755243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591593+0000","last_change":"2024-05-08T18:08:47.513365+0000","last_active":"2024-05-08T18:09:28.591593+0000","last_peered":"2024-05-08T18:09:28.591593+0000","last_clean":"2024-05-08T18:09:28.591593+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:09:28.591593+0000","last_undegraded":"2024-05-08T18:09:28.591593+0000","last_fullsized":"2024-05-08T18:09:28.591593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578971+0000","last_change":"2024-05-08T18:08:51.521427+0000","last_active":"2024-05-08T18:09:28.578971+0000","last_peered":"2024-05-08T18:09:28.578971+0000","last_clean":"2024-05-08T18:09:28.578971+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:09:28.578971+0000","last_undegraded":"2024-05-08T18:09:28.578971+0000","last_fullsized":"2024-05-08T18:09:28.578971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:32.182561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.761960+0000","last_change":"2024-05-08T18:08:53.517027+0000","last_active":"2024-05-08T18:12:01.761960+0000","last_peered":"2024-05-08T18:12:01.761960+0000","last_clean":"2024-05-08T18:12:01.761960+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:01.761960+0000","last_undegraded":"2024-05-08T18:12:01.761960+0000","last_fullsized":"2024-05-08T18:12:01.761960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:22.586335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572557+0000","last_change":"2024-05-08T18:08:55.556729+0000","last_active":"2024-05-08T18:09:28.572557+0000","last_peered":"2024-05-08T18:09:28.572557+0000","last_clean":"2024-05-08T18:09:28.572557+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:09:28.572557+0000","last_undegraded":"2024-05-08T18:09:28.572557+0000","last_fullsized":"2024-05-08T18:09:28.572557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597437+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:09:28.597437+0000","last_peered":"2024-05-08T18:09:28.597437+0000","last_clean":"2024-05-08T18:09:28.597437+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:09:28.597437+0000","last_undegraded":"2024-05-08T18:09:28.597437+0000","last_fullsized":"2024-05-08T18:09:28.597437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:48.822666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'17","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.269318+0000","last_change":"2024-05-08T18:08:49.512382+0000","last_active":"2024-05-08T18:12:02.269318+0000","last_peered":"2024-05-08T18:12:02.269318+0000","last_clean":"2024-05-08T18:12:02.269318+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:02.269318+0000","last_undegraded":"2024-05-08T18:12:02.269318+0000","last_fullsized":"2024-05-08T18:12:02.269318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.812761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.742937+0000","last_change":"2024-05-08T18:08:47.495539+0000","last_active":"2024-05-08T18:12:02.742937+0000","last_peered":"2024-05-08T18:12:02.742937+0000","last_clean":"2024-05-08T18:12:02.742937+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:12:02.742937+0000","last_undegraded":"2024-05-08T18:12:02.742937+0000","last_fullsized":"2024-05-08T18:12:02.742937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592581+0000","last_change":"2024-05-08T18:08:51.502037+0000","last_active":"2024-05-08T18:09:28.592581+0000","last_peered":"2024-05-08T18:09:28.592581+0000","last_clean":"2024-05-08T18:09:28.592581+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:09:28.592581+0000","last_undegraded":"2024-05-08T18:09:28.592581+0000","last_fullsized":"2024-05-08T18:09:28.592581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:20.268773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.567089+0000","last_change":"2024-05-08T18:08:53.521376+0000","last_active":"2024-05-08T18:10:59.567089+0000","last_peered":"2024-05-08T18:10:59.567089+0000","last_clean":"2024-05-08T18:10:59.567089+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:10:59.567089+0000","last_undegraded":"2024-05-08T18:10:59.567089+0000","last_fullsized":"2024-05-08T18:10:59.567089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:32.004417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580450+0000","last_change":"2024-05-08T18:08:55.546548+0000","last_active":"2024-05-08T18:09:28.580450+0000","last_peered":"2024-05-08T18:09:28.580450+0000","last_clean":"2024-05-08T18:09:28.580450+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:09:28.580450+0000","last_undegraded":"2024-05-08T18:09:28.580450+0000","last_fullsized":"2024-05-08T18:09:28.580450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:18.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.491598+0000","last_change":"2024-05-08T18:08:49.510714+0000","last_active":"2024-05-08T18:10:16.491598+0000","last_peered":"2024-05-08T18:10:16.491598+0000","last_clean":"2024-05-08T18:10:16.491598+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:10:16.491598+0000","last_undegraded":"2024-05-08T18:10:16.491598+0000","last_fullsized":"2024-05-08T18:10:16.491598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:41.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.893083+0000","last_change":"2024-05-08T18:08:47.516678+0000","last_active":"2024-05-08T18:09:31.893083+0000","last_peered":"2024-05-08T18:09:31.893083+0000","last_clean":"2024-05-08T18:09:31.893083+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:09:31.893083+0000","last_undegraded":"2024-05-08T18:09:31.893083+0000","last_fullsized":"2024-05-08T18:09:31.893083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:38.680445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584360+0000","last_change":"2024-05-08T18:08:51.511759+0000","last_active":"2024-05-08T18:09:28.584360+0000","last_peered":"2024-05-08T18:09:28.584360+0000","last_clean":"2024-05-08T18:09:28.584360+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:09:28.584360+0000","last_undegraded":"2024-05-08T18:09:28.584360+0000","last_fullsized":"2024-05-08T18:09:28.584360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.597073+0000","last_change":"2024-05-08T18:08:53.525502+0000","last_active":"2024-05-08T18:10:59.597073+0000","last_peered":"2024-05-08T18:10:59.597073+0000","last_clean":"2024-05-08T18:10:59.597073+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:10:59.597073+0000","last_undegraded":"2024-05-08T18:10:59.597073+0000","last_fullsized":"2024-05-08T18:10:59.597073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:21.841040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584718+0000","last_change":"2024-05-08T18:08:55.547190+0000","last_active":"2024-05-08T18:09:28.584718+0000","last_peered":"2024-05-08T18:09:28.584718+0000","last_clean":"2024-05-08T18:09:28.584718+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:09:28.584718+0000","last_undegraded":"2024-05-08T18:09:28.584718+0000","last_fullsized":"2024-05-08T18:09:28.584718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:41.115717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.484509+0000","last_change":"2024-05-08T18:08:57.565259+0000","last_active":"2024-05-08T18:11:01.484509+0000","last_peered":"2024-05-08T18:11:01.484509+0000","last_clean":"2024-05-08T18:11:01.484509+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:11:01.484509+0000","last_undegraded":"2024-05-08T18:11:01.484509+0000","last_fullsized":"2024-05-08T18:11:01.484509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.143663+0000","last_change":"2024-05-08T18:08:49.500137+0000","last_active":"2024-05-08T18:09:34.143663+0000","last_peered":"2024-05-08T18:09:34.143663+0000","last_clean":"2024-05-08T18:09:34.143663+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:09:34.143663+0000","last_undegraded":"2024-05-08T18:09:34.143663+0000","last_fullsized":"2024-05-08T18:09:34.143663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571914+0000","last_change":"2024-05-08T18:08:47.514529+0000","last_active":"2024-05-08T18:09:28.571914+0000","last_peered":"2024-05-08T18:09:28.571914+0000","last_clean":"2024-05-08T18:09:28.571914+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:09:28.571914+0000","last_undegraded":"2024-05-08T18:09:28.571914+0000","last_fullsized":"2024-05-08T18:09:28.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589371+0000","last_change":"2024-05-08T18:08:51.508583+0000","last_active":"2024-05-08T18:09:28.589371+0000","last_peered":"2024-05-08T18:09:28.589371+0000","last_clean":"2024-05-08T18:09:28.589371+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:09:28.589371+0000","last_undegraded":"2024-05-08T18:09:28.589371+0000","last_fullsized":"2024-05-08T18:09:28.589371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:08.838007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.568180+0000","last_change":"2024-05-08T18:08:53.547333+0000","last_active":"2024-05-08T18:10:59.568180+0000","last_peered":"2024-05-08T18:10:59.568180+0000","last_clean":"2024-05-08T18:10:59.568180+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:10:59.568180+0000","last_undegraded":"2024-05-08T18:10:59.568180+0000","last_fullsized":"2024-05-08T18:10:59.568180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:19.951491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574072+0000","last_change":"2024-05-08T18:08:55.565939+0000","last_active":"2024-05-08T18:09:28.574072+0000","last_peered":"2024-05-08T18:09:28.574072+0000","last_clean":"2024-05-08T18:09:28.574072+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:09:28.574072+0000","last_undegraded":"2024-05-08T18:09:28.574072+0000","last_fullsized":"2024-05-08T18:09:28.574072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592447+0000","last_change":"2024-05-08T18:08:57.553775+0000","last_active":"2024-05-08T18:09:28.592447+0000","last_peered":"2024-05-08T18:09:28.592447+0000","last_clean":"2024-05-08T18:09:28.592447+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:09:28.592447+0000","last_undegraded":"2024-05-08T18:09:28.592447+0000","last_fullsized":"2024-05-08T18:09:28.592447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:06.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597284+0000","last_change":"2024-05-08T18:08:49.514883+0000","last_active":"2024-05-08T18:12:02.597284+0000","last_peered":"2024-05-08T18:12:02.597284+0000","last_clean":"2024-05-08T18:12:02.597284+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:02.597284+0000","last_undegraded":"2024-05-08T18:12:02.597284+0000","last_fullsized":"2024-05-08T18:12:02.597284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:37.616434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572752+0000","last_change":"2024-05-08T18:08:47.519395+0000","last_active":"2024-05-08T18:09:28.572752+0000","last_peered":"2024-05-08T18:09:28.572752+0000","last_clean":"2024-05-08T18:09:28.572752+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:09:28.572752+0000","last_undegraded":"2024-05-08T18:09:28.572752+0000","last_fullsized":"2024-05-08T18:09:28.572752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.596279+0000","last_change":"2024-05-08T18:09:28.594515+0000","last_active":"2024-05-08T18:09:28.596279+0000","last_peered":"2024-05-08T18:09:28.596279+0000","last_clean":"2024-05-08T18:09:28.596279+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:09:28.596279+0000","last_undegraded":"2024-05-08T18:09:28.596279+0000","last_fullsized":"2024-05-08T18:09:28.596279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:46.308954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.593776+0000","last_change":"2024-05-08T18:08:53.515915+0000","last_active":"2024-05-08T18:10:59.593776+0000","last_peered":"2024-05-08T18:10:59.593776+0000","last_clean":"2024-05-08T18:10:59.593776+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:10:59.593776+0000","last_undegraded":"2024-05-08T18:10:59.593776+0000","last_fullsized":"2024-05-08T18:10:59.593776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:06.840324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578824+0000","last_change":"2024-05-08T18:08:55.554524+0000","last_active":"2024-05-08T18:09:28.578824+0000","last_peered":"2024-05-08T18:09:28.578824+0000","last_clean":"2024-05-08T18:09:28.578824+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:09:28.578824+0000","last_undegraded":"2024-05-08T18:09:28.578824+0000","last_fullsized":"2024-05-08T18:09:28.578824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.628108+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:01.628108+0000","last_peered":"2024-05-08T18:11:01.628108+0000","last_clean":"2024-05-08T18:11:01.628108+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:01.628108+0000","last_undegraded":"2024-05-08T18:11:01.628108+0000","last_fullsized":"2024-05-08T18:11:01.628108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:07.709412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755239+0000","last_change":"2024-05-08T18:08:49.494211+0000","last_active":"2024-05-08T18:12:02.755239+0000","last_peered":"2024-05-08T18:12:02.755239+0000","last_clean":"2024-05-08T18:12:02.755239+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:02.755239+0000","last_undegraded":"2024-05-08T18:12:02.755239+0000","last_fullsized":"2024-05-08T18:12:02.755239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.435190+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:09:33.435190+0000","last_peered":"2024-05-08T18:09:33.435190+0000","last_clean":"2024-05-08T18:09:33.435190+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:09:33.435190+0000","last_undegraded":"2024-05-08T18:09:33.435190+0000","last_fullsized":"2024-05-08T18:09:33.435190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:44.062312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.108918+0000","last_change":"2024-05-08T18:08:51.520425+0000","last_active":"2024-05-08T18:11:01.108918+0000","last_peered":"2024-05-08T18:11:01.108918+0000","last_clean":"2024-05-08T18:11:01.108918+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:11:01.108918+0000","last_undegraded":"2024-05-08T18:11:01.108918+0000","last_fullsized":"2024-05-08T18:11:01.108918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:44.630963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602335+0000","last_change":"2024-05-08T18:08:53.555586+0000","last_active":"2024-05-08T18:09:28.602335+0000","last_peered":"2024-05-08T18:09:28.602335+0000","last_clean":"2024-05-08T18:09:28.602335+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:09:28.602335+0000","last_undegraded":"2024-05-08T18:09:28.602335+0000","last_fullsized":"2024-05-08T18:09:28.602335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:12.189650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754623+0000","last_change":"2024-05-08T18:08:55.549323+0000","last_active":"2024-05-08T18:12:01.754623+0000","last_peered":"2024-05-08T18:12:01.754623+0000","last_clean":"2024-05-08T18:12:01.754623+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:01.754623+0000","last_undegraded":"2024-05-08T18:12:01.754623+0000","last_fullsized":"2024-05-08T18:12:01.754623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:43.656689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.446010+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:10:57.446010+0000","last_peered":"2024-05-08T18:10:57.446010+0000","last_clean":"2024-05-08T18:10:57.446010+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:10:57.446010+0000","last_undegraded":"2024-05-08T18:10:57.446010+0000","last_fullsized":"2024-05-08T18:10:57.446010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:56.783174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755627+0000","last_change":"2024-05-08T18:08:49.492567+0000","last_active":"2024-05-08T18:12:02.755627+0000","last_peered":"2024-05-08T18:12:02.755627+0000","last_clean":"2024-05-08T18:12:02.755627+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:02.755627+0000","last_undegraded":"2024-05-08T18:12:02.755627+0000","last_fullsized":"2024-05-08T18:12:02.755627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:32.167217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576478+0000","last_change":"2024-05-08T18:08:47.491784+0000","last_active":"2024-05-08T18:09:28.576478+0000","last_peered":"2024-05-08T18:09:28.576478+0000","last_clean":"2024-05-08T18:09:28.576478+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:09:28.576478+0000","last_undegraded":"2024-05-08T18:09:28.576478+0000","last_fullsized":"2024-05-08T18:09:28.576478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575218+0000","last_change":"2024-05-08T18:08:51.521020+0000","last_active":"2024-05-08T18:09:28.575218+0000","last_peered":"2024-05-08T18:09:28.575218+0000","last_clean":"2024-05-08T18:09:28.575218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:09:28.575218+0000","last_undegraded":"2024-05-08T18:09:28.575218+0000","last_fullsized":"2024-05-08T18:09:28.575218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:46.447955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.554181+0000","last_change":"2024-05-08T18:08:53.521741+0000","last_active":"2024-05-08T18:10:59.554181+0000","last_peered":"2024-05-08T18:10:59.554181+0000","last_clean":"2024-05-08T18:10:59.554181+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:10:59.554181+0000","last_undegraded":"2024-05-08T18:10:59.554181+0000","last_fullsized":"2024-05-08T18:10:59.554181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:03.551719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576295+0000","last_change":"2024-05-08T18:08:55.542837+0000","last_active":"2024-05-08T18:09:28.576295+0000","last_peered":"2024-05-08T18:09:28.576295+0000","last_clean":"2024-05-08T18:09:28.576295+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:09:28.576295+0000","last_undegraded":"2024-05-08T18:09:28.576295+0000","last_fullsized":"2024-05-08T18:09:28.576295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:11.110077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.653210+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:09:32.653210+0000","last_peered":"2024-05-08T18:09:32.653210+0000","last_clean":"2024-05-08T18:09:32.653210+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:09:32.653210+0000","last_undegraded":"2024-05-08T18:09:32.653210+0000","last_fullsized":"2024-05-08T18:09:32.653210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106581+0000","last_change":"2024-05-08T18:08:49.493842+0000","last_active":"2024-05-08T18:09:33.106581+0000","last_peered":"2024-05-08T18:09:33.106581+0000","last_clean":"2024-05-08T18:09:33.106581+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:09:33.106581+0000","last_undegraded":"2024-05-08T18:09:33.106581+0000","last_fullsized":"2024-05-08T18:09:33.106581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.575041+0000","last_change":"2024-05-08T18:08:47.528745+0000","last_active":"2024-05-08T18:11:01.575041+0000","last_peered":"2024-05-08T18:11:01.575041+0000","last_clean":"2024-05-08T18:11:01.575041+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:11:01.575041+0000","last_undegraded":"2024-05-08T18:11:01.575041+0000","last_fullsized":"2024-05-08T18:11:01.575041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:48.149891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583711+0000","last_change":"2024-05-08T18:08:51.507416+0000","last_active":"2024-05-08T18:09:28.583711+0000","last_peered":"2024-05-08T18:09:28.583711+0000","last_clean":"2024-05-08T18:09:28.583711+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:09:28.583711+0000","last_undegraded":"2024-05-08T18:09:28.583711+0000","last_fullsized":"2024-05-08T18:09:28.583711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:22.734601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.557316+0000","last_change":"2024-05-08T18:08:53.539793+0000","last_active":"2024-05-08T18:10:59.557316+0000","last_peered":"2024-05-08T18:10:59.557316+0000","last_clean":"2024-05-08T18:10:59.557316+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:10:59.557316+0000","last_undegraded":"2024-05-08T18:10:59.557316+0000","last_fullsized":"2024-05-08T18:10:59.557316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:09.466170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591164+0000","last_change":"2024-05-08T18:08:55.558593+0000","last_active":"2024-05-08T18:09:28.591164+0000","last_peered":"2024-05-08T18:09:28.591164+0000","last_clean":"2024-05-08T18:09:28.591164+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:09:28.591164+0000","last_undegraded":"2024-05-08T18:09:28.591164+0000","last_fullsized":"2024-05-08T18:09:28.591164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:20.041348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597627+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:09:28.597627+0000","last_peered":"2024-05-08T18:09:28.597627+0000","last_clean":"2024-05-08T18:09:28.597627+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:09:28.597627+0000","last_undegraded":"2024-05-08T18:09:28.597627+0000","last_fullsized":"2024-05-08T18:09:28.597627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:45.231457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391535+0000","last_change":"2024-05-08T18:08:49.512357+0000","last_active":"2024-05-08T18:12:02.391535+0000","last_peered":"2024-05-08T18:12:02.391535+0000","last_clean":"2024-05-08T18:12:02.391535+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:02.391535+0000","last_undegraded":"2024-05-08T18:12:02.391535+0000","last_fullsized":"2024-05-08T18:12:02.391535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.801605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.616390+0000","last_change":"2024-05-08T18:08:47.517076+0000","last_active":"2024-05-08T18:09:32.616390+0000","last_peered":"2024-05-08T18:09:32.616390+0000","last_clean":"2024-05-08T18:09:32.616390+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:09:32.616390+0000","last_undegraded":"2024-05-08T18:09:32.616390+0000","last_fullsized":"2024-05-08T18:09:32.616390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:16.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573625+0000","last_change":"2024-05-08T18:08:51.522287+0000","last_active":"2024-05-08T18:09:28.573625+0000","last_peered":"2024-05-08T18:09:28.573625+0000","last_clean":"2024-05-08T18:09:28.573625+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:09:28.573625+0000","last_undegraded":"2024-05-08T18:09:28.573625+0000","last_fullsized":"2024-05-08T18:09:28.573625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.590133+0000","last_change":"2024-05-08T18:08:53.555489+0000","last_active":"2024-05-08T18:10:59.590133+0000","last_peered":"2024-05-08T18:10:59.590133+0000","last_clean":"2024-05-08T18:10:59.590133+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:10:59.590133+0000","last_undegraded":"2024-05-08T18:10:59.590133+0000","last_fullsized":"2024-05-08T18:10:59.590133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.464298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593054+0000","last_change":"2024-05-08T18:08:55.564029+0000","last_active":"2024-05-08T18:09:28.593054+0000","last_peered":"2024-05-08T18:09:28.593054+0000","last_clean":"2024-05-08T18:09:28.593054+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:09:28.593054+0000","last_undegraded":"2024-05-08T18:09:28.593054+0000","last_fullsized":"2024-05-08T18:09:28.593054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:00.158035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.605714+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:10:59.605714+0000","last_peered":"2024-05-08T18:10:59.605714+0000","last_clean":"2024-05-08T18:10:59.605714+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:10:59.605714+0000","last_undegraded":"2024-05-08T18:10:59.605714+0000","last_fullsized":"2024-05-08T18:10:59.605714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:41:06.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658006+0000","last_change":"2024-05-08T18:08:49.492218+0000","last_active":"2024-05-08T18:09:32.658006+0000","last_peered":"2024-05-08T18:09:32.658006+0000","last_clean":"2024-05-08T18:09:32.658006+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:09:32.658006+0000","last_undegraded":"2024-05-08T18:09:32.658006+0000","last_fullsized":"2024-05-08T18:09:32.658006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:46.076624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.576608+0000","last_change":"2024-05-08T18:08:47.498035+0000","last_active":"2024-05-08T18:12:02.576608+0000","last_peered":"2024-05-08T18:12:02.576608+0000","last_clean":"2024-05-08T18:12:02.576608+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:12:02.576608+0000","last_undegraded":"2024-05-08T18:12:02.576608+0000","last_fullsized":"2024-05-08T18:12:02.576608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.122142+0000","last_change":"2024-05-08T18:08:51.513601+0000","last_active":"2024-05-08T18:11:01.122142+0000","last_peered":"2024-05-08T18:11:01.122142+0000","last_clean":"2024-05-08T18:11:01.122142+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:11:01.122142+0000","last_undegraded":"2024-05-08T18:11:01.122142+0000","last_fullsized":"2024-05-08T18:11:01.122142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:52.312237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.672936+0000","last_change":"2024-05-08T18:08:53.547362+0000","last_active":"2024-05-08T18:12:01.672936+0000","last_peered":"2024-05-08T18:12:01.672936+0000","last_clean":"2024-05-08T18:12:01.672936+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:01.672936+0000","last_undegraded":"2024-05-08T18:12:01.672936+0000","last_fullsized":"2024-05-08T18:12:01.672936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:18.076232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580054+0000","last_change":"2024-05-08T18:08:55.546216+0000","last_active":"2024-05-08T18:09:28.580054+0000","last_peered":"2024-05-08T18:09:28.580054+0000","last_clean":"2024-05-08T18:09:28.580054+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:09:28.580054+0000","last_undegraded":"2024-05-08T18:09:28.580054+0000","last_fullsized":"2024-05-08T18:09:28.580054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.609546+0000","last_change":"2024-05-08T18:08:57.560370+0000","last_active":"2024-05-08T18:10:59.609546+0000","last_peered":"2024-05-08T18:10:59.609546+0000","last_clean":"2024-05-08T18:10:59.609546+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:10:59.609546+0000","last_undegraded":"2024-05-08T18:10:59.609546+0000","last_fullsized":"2024-05-08T18:10:59.609546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:35.794410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490224+0000","last_change":"2024-05-08T18:08:49.513755+0000","last_active":"2024-05-08T18:10:16.490224+0000","last_peered":"2024-05-08T18:10:16.490224+0000","last_clean":"2024-05-08T18:10:16.490224+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:10:16.490224+0000","last_undegraded":"2024-05-08T18:10:16.490224+0000","last_fullsized":"2024-05-08T18:10:16.490224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:12.911502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576973+0000","last_change":"2024-05-08T18:08:47.510817+0000","last_active":"2024-05-08T18:09:28.576973+0000","last_peered":"2024-05-08T18:09:28.576973+0000","last_clean":"2024-05-08T18:09:28.576973+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:09:28.576973+0000","last_undegraded":"2024-05-08T18:09:28.576973+0000","last_fullsized":"2024-05-08T18:09:28.576973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.419152+0000","last_change":"2024-05-08T18:08:49.494065+0000","last_active":"2024-05-08T18:11:01.419152+0000","last_peered":"2024-05-08T18:11:01.419152+0000","last_clean":"2024-05-08T18:11:01.419152+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:11:01.419152+0000","last_undegraded":"2024-05-08T18:11:01.419152+0000","last_fullsized":"2024-05-08T18:11:01.419152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417623+0000","last_change":"2024-05-08T18:08:47.496722+0000","last_active":"2024-05-08T18:10:56.417623+0000","last_peered":"2024-05-08T18:10:56.417623+0000","last_clean":"2024-05-08T18:10:56.417623+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:10:56.417623+0000","last_undegraded":"2024-05-08T18:10:56.417623+0000","last_fullsized":"2024-05-08T18:10:56.417623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689939+0000","last_change":"2024-05-08T18:08:49.513141+0000","last_active":"2024-05-08T18:12:02.689939+0000","last_peered":"2024-05-08T18:12:02.689939+0000","last_clean":"2024-05-08T18:12:02.689939+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:02.689939+0000","last_undegraded":"2024-05-08T18:12:02.689939+0000","last_fullsized":"2024-05-08T18:12:02.689939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:05.438608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593736+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:09:28.593736+0000","last_peered":"2024-05-08T18:09:28.593736+0000","last_clean":"2024-05-08T18:09:28.593736+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:09:28.593736+0000","last_undegraded":"2024-05-08T18:09:28.593736+0000","last_fullsized":"2024-05-08T18:09:28.593736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:49.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.268349+0000","last_change":"2024-05-08T18:08:49.494261+0000","last_active":"2024-05-08T18:12:02.268349+0000","last_peered":"2024-05-08T18:12:02.268349+0000","last_clean":"2024-05-08T18:12:02.268349+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:02.268349+0000","last_undegraded":"2024-05-08T18:12:02.268349+0000","last_fullsized":"2024-05-08T18:12:02.268349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.584121+0000","last_change":"2024-05-08T18:08:47.515649+0000","last_active":"2024-05-08T18:12:02.584121+0000","last_peered":"2024-05-08T18:12:02.584121+0000","last_clean":"2024-05-08T18:12:02.584121+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:02.584121+0000","last_undegraded":"2024-05-08T18:12:02.584121+0000","last_fullsized":"2024-05-08T18:12:02.584121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'3","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270740+0000","last_change":"2024-05-08T18:08:49.519128+0000","last_active":"2024-05-08T18:12:02.270740+0000","last_peered":"2024-05-08T18:12:02.270740+0000","last_clean":"2024-05-08T18:12:02.270740+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:02.270740+0000","last_undegraded":"2024-05-08T18:12:02.270740+0000","last_fullsized":"2024-05-08T18:12:02.270740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.190876+0000","last_change":"2024-05-08T18:08:47.497513+0000","last_active":"2024-05-08T18:12:02.190876+0000","last_peered":"2024-05-08T18:12:02.190876+0000","last_clean":"2024-05-08T18:12:02.190876+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:12:02.190876+0000","last_undegraded":"2024-05-08T18:12:02.190876+0000","last_fullsized":"2024-05-08T18:12:02.190876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706315+0000","last_change":"2024-05-08T18:08:49.518071+0000","last_active":"2024-05-08T18:12:02.706315+0000","last_peered":"2024-05-08T18:12:02.706315+0000","last_clean":"2024-05-08T18:12:02.706315+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:02.706315+0000","last_undegraded":"2024-05-08T18:12:02.706315+0000","last_fullsized":"2024-05-08T18:12:02.706315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:20.720628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574630+0000","last_change":"2024-05-08T18:08:47.512086+0000","last_active":"2024-05-08T18:09:28.574630+0000","last_peered":"2024-05-08T18:09:28.574630+0000","last_clean":"2024-05-08T18:09:28.574630+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:09:28.574630+0000","last_undegraded":"2024-05-08T18:09:28.574630+0000","last_fullsized":"2024-05-08T18:09:28.574630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390792+0000","last_change":"2024-05-08T18:08:49.497455+0000","last_active":"2024-05-08T18:12:02.390792+0000","last_peered":"2024-05-08T18:12:02.390792+0000","last_clean":"2024-05-08T18:12:02.390792+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:02.390792+0000","last_undegraded":"2024-05-08T18:12:02.390792+0000","last_fullsized":"2024-05-08T18:12:02.390792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594186+0000","last_change":"2024-05-08T18:08:47.514190+0000","last_active":"2024-05-08T18:09:28.594186+0000","last_peered":"2024-05-08T18:09:28.594186+0000","last_clean":"2024-05-08T18:09:28.594186+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:09:28.594186+0000","last_undegraded":"2024-05-08T18:09:28.594186+0000","last_fullsized":"2024-05-08T18:09:28.594186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599228+0000","last_change":"2024-05-08T18:08:49.495860+0000","last_active":"2024-05-08T18:12:02.599228+0000","last_peered":"2024-05-08T18:12:02.599228+0000","last_clean":"2024-05-08T18:12:02.599228+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:02.599228+0000","last_undegraded":"2024-05-08T18:12:02.599228+0000","last_fullsized":"2024-05-08T18:12:02.599228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580203+0000","last_change":"2024-05-08T18:08:47.515080+0000","last_active":"2024-05-08T18:09:28.580203+0000","last_peered":"2024-05-08T18:09:28.580203+0000","last_clean":"2024-05-08T18:09:28.580203+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:09:28.580203+0000","last_undegraded":"2024-05-08T18:09:28.580203+0000","last_fullsized":"2024-05-08T18:09:28.580203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.479725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640668+0000","last_change":"2024-05-08T18:08:49.498817+0000","last_active":"2024-05-08T18:11:01.640668+0000","last_peered":"2024-05-08T18:11:01.640668+0000","last_clean":"2024-05-08T18:11:01.640668+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:11:01.640668+0000","last_undegraded":"2024-05-08T18:11:01.640668+0000","last_fullsized":"2024-05-08T18:11:01.640668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:19.437499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587366+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:09:28.587366+0000","last_peered":"2024-05-08T18:09:28.587366+0000","last_clean":"2024-05-08T18:09:28.587366+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:09:28.587366+0000","last_undegraded":"2024-05-08T18:09:28.587366+0000","last_fullsized":"2024-05-08T18:09:28.587366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:29.150400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.690148+0000","last_change":"2024-05-08T18:08:49.514593+0000","last_active":"2024-05-08T18:12:02.690148+0000","last_peered":"2024-05-08T18:12:02.690148+0000","last_clean":"2024-05-08T18:12:02.690148+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:02.690148+0000","last_undegraded":"2024-05-08T18:12:02.690148+0000","last_fullsized":"2024-05-08T18:12:02.690148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:59.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576899+0000","last_change":"2024-05-08T18:08:47.515074+0000","last_active":"2024-05-08T18:09:28.576899+0000","last_peered":"2024-05-08T18:09:28.576899+0000","last_clean":"2024-05-08T18:09:28.576899+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:09:28.576899+0000","last_undegraded":"2024-05-08T18:09:28.576899+0000","last_fullsized":"2024-05-08T18:09:28.576899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391996+0000","last_change":"2024-05-08T18:08:49.516189+0000","last_active":"2024-05-08T18:12:02.391996+0000","last_peered":"2024-05-08T18:12:02.391996+0000","last_clean":"2024-05-08T18:12:02.391996+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:02.391996+0000","last_undegraded":"2024-05-08T18:12:02.391996+0000","last_fullsized":"2024-05-08T18:12:02.391996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573546+0000","last_change":"2024-05-08T18:08:47.525612+0000","last_active":"2024-05-08T18:09:28.573546+0000","last_peered":"2024-05-08T18:09:28.573546+0000","last_clean":"2024-05-08T18:09:28.573546+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:09:28.573546+0000","last_undegraded":"2024-05-08T18:09:28.573546+0000","last_fullsized":"2024-05-08T18:09:28.573546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390438+0000","last_change":"2024-05-08T18:08:49.496733+0000","last_active":"2024-05-08T18:12:02.390438+0000","last_peered":"2024-05-08T18:12:02.390438+0000","last_clean":"2024-05-08T18:12:02.390438+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:02.390438+0000","last_undegraded":"2024-05-08T18:12:02.390438+0000","last_fullsized":"2024-05-08T18:12:02.390438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573307+0000","last_change":"2024-05-08T18:08:47.513204+0000","last_active":"2024-05-08T18:09:28.573307+0000","last_peered":"2024-05-08T18:09:28.573307+0000","last_clean":"2024-05-08T18:09:28.573307+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:09:28.573307+0000","last_undegraded":"2024-05-08T18:09:28.573307+0000","last_fullsized":"2024-05-08T18:09:28.573307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490742+0000","last_change":"2024-05-08T18:08:49.519642+0000","last_active":"2024-05-08T18:10:16.490742+0000","last_peered":"2024-05-08T18:10:16.490742+0000","last_clean":"2024-05-08T18:10:16.490742+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:10:16.490742+0000","last_undegraded":"2024-05-08T18:10:16.490742+0000","last_fullsized":"2024-05-08T18:10:16.490742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.551432+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.551432+0000","last_peered":"2024-05-08T18:12:02.551432+0000","last_clean":"2024-05-08T18:12:02.551432+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.551432+0000","last_undegraded":"2024-05-08T18:12:02.551432+0000","last_fullsized":"2024-05-08T18:12:02.551432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:15.066942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640294+0000","last_change":"2024-05-08T18:08:49.499082+0000","last_active":"2024-05-08T18:11:01.640294+0000","last_peered":"2024-05-08T18:11:01.640294+0000","last_clean":"2024-05-08T18:11:01.640294+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:11:01.640294+0000","last_undegraded":"2024-05-08T18:11:01.640294+0000","last_fullsized":"2024-05-08T18:11:01.640294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:02.112670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599094+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:09:28.599094+0000","last_peered":"2024-05-08T18:09:28.599094+0000","last_clean":"2024-05-08T18:09:28.599094+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:09:28.599094+0000","last_undegraded":"2024-05-08T18:09:28.599094+0000","last_fullsized":"2024-05-08T18:09:28.599094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.626603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602483+0000","last_change":"2024-05-08T18:08:49.507865+0000","last_active":"2024-05-08T18:09:28.602483+0000","last_peered":"2024-05-08T18:09:28.602483+0000","last_clean":"2024-05-08T18:09:28.602483+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:09:28.602483+0000","last_undegraded":"2024-05-08T18:09:28.602483+0000","last_fullsized":"2024-05-08T18:09:28.602483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:42.616990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.559608+0000","last_change":"2024-05-08T18:08:47.519469+0000","last_active":"2024-05-08T18:12:02.559608+0000","last_peered":"2024-05-08T18:12:02.559608+0000","last_clean":"2024-05-08T18:12:02.559608+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:02.559608+0000","last_undegraded":"2024-05-08T18:12:02.559608+0000","last_fullsized":"2024-05-08T18:12:02.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.142579+0000","last_change":"2024-05-08T18:08:49.497950+0000","last_active":"2024-05-08T18:09:34.142579+0000","last_peered":"2024-05-08T18:09:34.142579+0000","last_clean":"2024-05-08T18:09:34.142579+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:09:34.142579+0000","last_undegraded":"2024-05-08T18:09:34.142579+0000","last_fullsized":"2024-05-08T18:09:34.142579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:30.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432525+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:11:11.432525+0000","last_peered":"2024-05-08T18:11:11.432525+0000","last_clean":"2024-05-08T18:11:11.432525+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:11:11.432525+0000","last_undegraded":"2024-05-08T18:11:11.432525+0000","last_fullsized":"2024-05-08T18:11:11.432525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:03.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588195+0000","last_change":"2024-05-08T18:08:47.516126+0000","last_active":"2024-05-08T18:09:28.588195+0000","last_peered":"2024-05-08T18:09:28.588195+0000","last_clean":"2024-05-08T18:09:28.588195+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:09:28.588195+0000","last_undegraded":"2024-05-08T18:09:28.588195+0000","last_fullsized":"2024-05-08T18:09:28.588195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:27.835638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.450829+0000","last_change":"2024-05-08T18:08:49.501282+0000","last_active":"2024-05-08T18:10:57.450829+0000","last_peered":"2024-05-08T18:10:57.450829+0000","last_clean":"2024-05-08T18:10:57.450829+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:10:57.450829+0000","last_undegraded":"2024-05-08T18:10:57.450829+0000","last_fullsized":"2024-05-08T18:10:57.450829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:32.711877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.577094+0000","last_change":"2024-05-08T18:08:47.515944+0000","last_active":"2024-05-08T18:09:28.577094+0000","last_peered":"2024-05-08T18:09:28.577094+0000","last_clean":"2024-05-08T18:09:28.577094+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:09:28.577094+0000","last_undegraded":"2024-05-08T18:09:28.577094+0000","last_fullsized":"2024-05-08T18:09:28.577094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106837+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:09:33.106837+0000","last_peered":"2024-05-08T18:09:33.106837+0000","last_clean":"2024-05-08T18:09:33.106837+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:09:33.106837+0000","last_undegraded":"2024-05-08T18:09:33.106837+0000","last_fullsized":"2024-05-08T18:09:33.106837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.519711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11093,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1191,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46348,"kb_used_data":11012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325492,"statfs":{"total":96636764160,"available":96589303808,"internally_reserved":0,"allocated":11276288,"data_stored":10956261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42452,"kb_used_data":7116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329388,"statfs":{"total":96636764160,"available":96593293312,"internally_reserved":0,"allocated":7286784,"data_stored":7026447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":13930496,"data_stored":13641551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40104,"kb_used_data":8928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331736,"statfs":{"total":96636764160,"available":96595697664,"internally_reserved":0,"allocated":9142272,"data_stored":8856953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:12:10.531 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T18:12:10.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:12:10.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 Processor -- start 2024-05-08T18:12:10.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 -- start start 2024-05-08T18:12:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1c00735f0 0x7fc1c0132550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c0073d90 con 0x7fc1c0098500 2024-05-08T18:12:10.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c006eca0 con 0x7fc1c00735f0 2024-05-08T18:12:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5b87640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fc1c00735f0 0x7fc1c0132550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c6388640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fc1c0098500 0x7fc1c00988e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33842/0 (socket says 172.21.15.53:33842) 2024-05-08T18:12:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c6388640 1 -- 172.21.15.53:0/916423772 learned_addr learned my addr 172.21.15.53:0/916423772 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5b87640 1 -- 172.21.15.53:0/916423772 >> v1:172.21.15.53:6789/0 conn(0x7fc1c0098500 legacy=0x7fc1c00988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.692 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5b87640 1 -- 172.21.15.53:0/916423772 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c006e1c0 con 0x7fc1c00735f0 2024-05-08T18:12:10.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5b87640 1 --2- 172.21.15.53:0/916423772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c00735f0 0x7fc1c0132550 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009740 tx=0x7fc1b001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846eb1c4ecf943af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:10.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5386640 1 -- 172.21.15.53:0/916423772 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1b00b0070 con 0x7fc1c00735f0 2024-05-08T18:12:10.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5386640 1 -- 172.21.15.53:0/916423772 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b00ab530 con 0x7fc1c00735f0 2024-05-08T18:12:10.693 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c5386640 1 -- 172.21.15.53:0/916423772 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1b00ab830 con 0x7fc1c00735f0 2024-05-08T18:12:10.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 -- 172.21.15.53:0/916423772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c00735f0 msgr2=0x7fc1c0132550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.690+0000 7fc1c85ec640 1 --2- 172.21.15.53:0/916423772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c00735f0 0x7fc1c0132550 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc1b0009740 tx=0x7fc1b001c370 comp rx=0 tx=0).stop 2024-05-08T18:12:10.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/916423772 shutdown_connections 2024-05-08T18:12:10.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 --2- 172.21.15.53:0/916423772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c00735f0 0x7fc1c0132550 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/916423772 >> 172.21.15.53:0/916423772 conn(0x7fc1c0099390 msgr2=0x7fc1c009b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/916423772 shutdown_connections 2024-05-08T18:12:10.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/916423772 wait complete. 2024-05-08T18:12:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 Processor -- start 2024-05-08T18:12:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- start start 2024-05-08T18:12:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 0x7fc1c0097300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:10.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c0135640 con 0x7fc1c0098500 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c6388640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 0x7fc1c0097300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c6388640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 0x7fc1c0097300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58198/0 (socket says 172.21.15.53:58198) 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c6388640 1 -- 172.21.15.53:0/1281032243 learned_addr learned my addr 172.21.15.53:0/1281032243 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c6388640 1 -- 172.21.15.53:0/1281032243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c0131850 con 0x7fc1c0098500 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c6388640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 0x7fc1c0097300 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c450 tx=0x7fc1bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1bc017070 con 0x7fc1c0098500 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc005c20 con 0x7fc1c0098500 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1bc0070d0 con 0x7fc1c0098500 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c0130090 con 0x7fc1c0098500 2024-05-08T18:12:10.697 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c0130b60 con 0x7fc1c0098500 2024-05-08T18:12:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c01314a0 con 0x7fc1c0098500 2024-05-08T18:12:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fc1bc01a070 con 0x7fc1c0098500 2024-05-08T18:12:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1b6ffd640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1a4039b50 0x7fc1a403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fc1bc04cff0 con 0x7fc1c0098500 2024-05-08T18:12:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.694+0000 7fc1c5b87640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1a4039b50 0x7fc1a403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:10.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.698+0000 7fc1c5b87640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1a4039b50 0x7fc1a403c010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00ad000 tx=0x7fc1b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:10.701 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.698+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc1bc04b3b0 con 0x7fc1c0098500 2024-05-08T18:12:10.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-08T18:12:10.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.858+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1c0064150 con 0x7fc1a4039b50 2024-05-08T18:12:10.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.906+0000 7fc1b6ffd640 1 -- 172.21.15.53:0/1281032243 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665721 (secure 0 0 0) 0x7fc1c0064150 con 0x7fc1a4039b50 2024-05-08T18:12:10.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:10.919 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:12:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1a4039b50 msgr2=0x7fc1a403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1a4039b50 0x7fc1a403c010 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00ad000 tx=0x7fc1b0008040 comp rx=0 tx=0).stop 2024-05-08T18:12:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 msgr2=0x7fc1c0097300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 0x7fc1c0097300 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c450 tx=0x7fc1bc00c910 comp rx=0 tx=0).stop 2024-05-08T18:12:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 shutdown_connections 2024-05-08T18:12:10.921 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fc1a4039b50 0x7fc1a403c010 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 --2- 172.21.15.53:0/1281032243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc1c0098500 0x7fc1c0097300 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 >> 172.21.15.53:0/1281032243 conn(0x7fc1c0099390 msgr2=0x7fc1c01237a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 shutdown_connections 2024-05-08T18:12:10.922 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:10.910+0000 7fc1c85ec640 1 -- 172.21.15.53:0/1281032243 wait complete. 2024-05-08T18:12:10.930 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-05-08T18:12:09.410202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26410498,"num_objects":227,"num_object_clones":0,"num_object_copies":461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4852,"num_read_kb":4437,"num_write":2048,"num_write_kb":60585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4432,"ondisk_log_size":4432,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":177844,"kb_used_data":40660,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377309516,"statfs":{"total":386547056640,"available":386364944384,"internally_reserved":0,"allocated":41635840,"data_stored":40481212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":140437270},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25809396,"num_objects":9,"num_object_clones":0,"num_object_copies":25,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":510,"num_read_kb":468,"num_write":386,"num_write_kb":29372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006898"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589617+0000","last_change":"2024-05-08T18:08:47.510504+0000","last_active":"2024-05-08T18:09:28.589617+0000","last_peered":"2024-05-08T18:09:28.589617+0000","last_clean":"2024-05-08T18:09:28.589617+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:09:28.589617+0000","last_undegraded":"2024-05-08T18:09:28.589617+0000","last_fullsized":"2024-05-08T18:09:28.589617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755613+0000","last_change":"2024-05-08T18:08:49.501074+0000","last_active":"2024-05-08T18:12:02.755613+0000","last_peered":"2024-05-08T18:12:02.755613+0000","last_clean":"2024-05-08T18:12:02.755613+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:12:02.755613+0000","last_undegraded":"2024-05-08T18:12:02.755613+0000","last_fullsized":"2024-05-08T18:12:02.755613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583198+0000","last_change":"2024-05-08T18:08:47.517769+0000","last_active":"2024-05-08T18:09:28.583198+0000","last_peered":"2024-05-08T18:09:28.583198+0000","last_clean":"2024-05-08T18:09:28.583198+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:09:28.583198+0000","last_undegraded":"2024-05-08T18:09:28.583198+0000","last_fullsized":"2024-05-08T18:09:28.583198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688121+0000","last_change":"2024-05-08T18:08:49.505238+0000","last_active":"2024-05-08T18:12:02.688121+0000","last_peered":"2024-05-08T18:12:02.688121+0000","last_clean":"2024-05-08T18:12:02.688121+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:12:02.688121+0000","last_undegraded":"2024-05-08T18:12:02.688121+0000","last_fullsized":"2024-05-08T18:12:02.688121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:44.433982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602848+0000","last_change":"2024-05-08T18:08:47.529012+0000","last_active":"2024-05-08T18:09:28.602848+0000","last_peered":"2024-05-08T18:09:28.602848+0000","last_clean":"2024-05-08T18:09:28.602848+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:09:28.602848+0000","last_undegraded":"2024-05-08T18:09:28.602848+0000","last_fullsized":"2024-05-08T18:09:28.602848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:59.877643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.243439+0000","last_change":"2024-05-08T18:08:49.512376+0000","last_active":"2024-05-08T18:12:02.243439+0000","last_peered":"2024-05-08T18:12:02.243439+0000","last_clean":"2024-05-08T18:12:02.243439+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:02.243439+0000","last_undegraded":"2024-05-08T18:12:02.243439+0000","last_fullsized":"2024-05-08T18:12:02.243439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:50.199302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584975+0000","last_change":"2024-05-08T18:08:47.506602+0000","last_active":"2024-05-08T18:09:28.584975+0000","last_peered":"2024-05-08T18:09:28.584975+0000","last_clean":"2024-05-08T18:09:28.584975+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:09:28.584975+0000","last_undegraded":"2024-05-08T18:09:28.584975+0000","last_fullsized":"2024-05-08T18:09:28.584975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603042+0000","last_change":"2024-05-08T18:08:49.514808+0000","last_active":"2024-05-08T18:09:28.603042+0000","last_peered":"2024-05-08T18:09:28.603042+0000","last_clean":"2024-05-08T18:09:28.603042+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:09:28.603042+0000","last_undegraded":"2024-05-08T18:09:28.603042+0000","last_fullsized":"2024-05-08T18:09:28.603042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:07.745157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594223+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:09:28.594223+0000","last_peered":"2024-05-08T18:09:28.594223+0000","last_clean":"2024-05-08T18:09:28.594223+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:09:28.594223+0000","last_undegraded":"2024-05-08T18:09:28.594223+0000","last_fullsized":"2024-05-08T18:09:28.594223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:19.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.621110+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:11:01.621110+0000","last_peered":"2024-05-08T18:11:01.621110+0000","last_clean":"2024-05-08T18:11:01.621110+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:11:01.621110+0000","last_undegraded":"2024-05-08T18:11:01.621110+0000","last_fullsized":"2024-05-08T18:11:01.621110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.476707+0000","last_change":"2024-05-08T18:08:47.517680+0000","last_active":"2024-05-08T18:10:16.476707+0000","last_peered":"2024-05-08T18:10:16.476707+0000","last_clean":"2024-05-08T18:10:16.476707+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:10:16.476707+0000","last_undegraded":"2024-05-08T18:10:16.476707+0000","last_fullsized":"2024-05-08T18:10:16.476707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.598289+0000","last_change":"2024-05-08T18:08:49.512339+0000","last_active":"2024-05-08T18:12:02.598289+0000","last_peered":"2024-05-08T18:12:02.598289+0000","last_clean":"2024-05-08T18:12:02.598289+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:02.598289+0000","last_undegraded":"2024-05-08T18:12:02.598289+0000","last_fullsized":"2024-05-08T18:12:02.598289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:17.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597200+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:09:28.597200+0000","last_peered":"2024-05-08T18:09:28.597200+0000","last_clean":"2024-05-08T18:09:28.597200+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:09:28.597200+0000","last_undegraded":"2024-05-08T18:09:28.597200+0000","last_fullsized":"2024-05-08T18:09:28.597200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:58.240945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755650+0000","last_change":"2024-05-08T18:08:49.497230+0000","last_active":"2024-05-08T18:12:02.755650+0000","last_peered":"2024-05-08T18:12:02.755650+0000","last_clean":"2024-05-08T18:12:02.755650+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:02.755650+0000","last_undegraded":"2024-05-08T18:12:02.755650+0000","last_fullsized":"2024-05-08T18:12:02.755650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.419603+0000","last_change":"2024-05-08T18:08:47.511982+0000","last_active":"2024-05-08T18:09:33.419603+0000","last_peered":"2024-05-08T18:09:33.419603+0000","last_clean":"2024-05-08T18:09:33.419603+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:09:33.419603+0000","last_undegraded":"2024-05-08T18:09:33.419603+0000","last_fullsized":"2024-05-08T18:09:33.419603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755669+0000","last_change":"2024-05-08T18:08:49.515516+0000","last_active":"2024-05-08T18:12:02.755669+0000","last_peered":"2024-05-08T18:12:02.755669+0000","last_clean":"2024-05-08T18:12:02.755669+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:02.755669+0000","last_undegraded":"2024-05-08T18:12:02.755669+0000","last_fullsized":"2024-05-08T18:12:02.755669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391545+0000","last_change":"2024-05-08T18:08:49.508214+0000","last_active":"2024-05-08T18:12:02.391545+0000","last_peered":"2024-05-08T18:12:02.391545+0000","last_clean":"2024-05-08T18:12:02.391545+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:12:02.391545+0000","last_undegraded":"2024-05-08T18:12:02.391545+0000","last_fullsized":"2024-05-08T18:12:02.391545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:02.344619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582645+0000","last_change":"2024-05-08T18:08:47.511822+0000","last_active":"2024-05-08T18:09:28.582645+0000","last_peered":"2024-05-08T18:09:28.582645+0000","last_clean":"2024-05-08T18:09:28.582645+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:09:28.582645+0000","last_undegraded":"2024-05-08T18:09:28.582645+0000","last_fullsized":"2024-05-08T18:09:28.582645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755519+0000","last_change":"2024-05-08T18:08:49.500178+0000","last_active":"2024-05-08T18:12:02.755519+0000","last_peered":"2024-05-08T18:12:02.755519+0000","last_clean":"2024-05-08T18:12:02.755519+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:02.755519+0000","last_undegraded":"2024-05-08T18:12:02.755519+0000","last_fullsized":"2024-05-08T18:12:02.755519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594972+0000","last_change":"2024-05-08T18:08:47.513087+0000","last_active":"2024-05-08T18:09:28.594972+0000","last_peered":"2024-05-08T18:09:28.594972+0000","last_clean":"2024-05-08T18:09:28.594972+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:09:28.594972+0000","last_undegraded":"2024-05-08T18:09:28.594972+0000","last_fullsized":"2024-05-08T18:09:28.594972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575992+0000","last_change":"2024-05-08T18:08:49.500044+0000","last_active":"2024-05-08T18:09:28.575992+0000","last_peered":"2024-05-08T18:09:28.575992+0000","last_clean":"2024-05-08T18:09:28.575992+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:09:28.575992+0000","last_undegraded":"2024-05-08T18:09:28.575992+0000","last_fullsized":"2024-05-08T18:09:28.575992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:30.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575062+0000","last_change":"2024-05-08T18:08:47.513484+0000","last_active":"2024-05-08T18:09:28.575062+0000","last_peered":"2024-05-08T18:09:28.575062+0000","last_clean":"2024-05-08T18:09:28.575062+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:09:28.575062+0000","last_undegraded":"2024-05-08T18:09:28.575062+0000","last_fullsized":"2024-05-08T18:09:28.575062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640685+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:01.640685+0000","last_peered":"2024-05-08T18:11:01.640685+0000","last_clean":"2024-05-08T18:11:01.640685+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:01.640685+0000","last_undegraded":"2024-05-08T18:11:01.640685+0000","last_fullsized":"2024-05-08T18:11:01.640685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:31.685937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'5","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431674+0000","last_change":"2024-05-08T18:08:47.496959+0000","last_active":"2024-05-08T18:11:16.431674+0000","last_peered":"2024-05-08T18:11:16.431674+0000","last_clean":"2024-05-08T18:11:16.431674+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:11:16.431674+0000","last_undegraded":"2024-05-08T18:11:16.431674+0000","last_fullsized":"2024-05-08T18:11:16.431674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755450+0000","last_change":"2024-05-08T18:08:49.511519+0000","last_active":"2024-05-08T18:12:02.755450+0000","last_peered":"2024-05-08T18:12:02.755450+0000","last_clean":"2024-05-08T18:12:02.755450+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:02.755450+0000","last_undegraded":"2024-05-08T18:12:02.755450+0000","last_fullsized":"2024-05-08T18:12:02.755450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:07.067518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422686+0000","last_change":"2024-05-08T18:08:47.513517+0000","last_active":"2024-05-08T18:11:16.422686+0000","last_peered":"2024-05-08T18:11:16.422686+0000","last_clean":"2024-05-08T18:11:16.422686+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:11:16.422686+0000","last_undegraded":"2024-05-08T18:11:16.422686+0000","last_fullsized":"2024-05-08T18:11:16.422686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.105302+0000","last_change":"2024-05-08T18:08:49.496030+0000","last_active":"2024-05-08T18:09:33.105302+0000","last_peered":"2024-05-08T18:09:33.105302+0000","last_clean":"2024-05-08T18:09:33.105302+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:09:33.105302+0000","last_undegraded":"2024-05-08T18:09:33.105302+0000","last_fullsized":"2024-05-08T18:09:33.105302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432206+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:11:11.432206+0000","last_peered":"2024-05-08T18:11:11.432206+0000","last_clean":"2024-05-08T18:11:11.432206+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:11:11.432206+0000","last_undegraded":"2024-05-08T18:11:11.432206+0000","last_fullsized":"2024-05-08T18:11:11.432206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:03.768445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.646508+0000","last_change":"2024-05-08T18:08:57.567982+0000","last_active":"2024-05-08T18:12:02.646508+0000","last_peered":"2024-05-08T18:12:02.646508+0000","last_clean":"2024-05-08T18:12:02.646508+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:12:02.646508+0000","last_undegraded":"2024-05-08T18:12:02.646508+0000","last_fullsized":"2024-05-08T18:12:02.646508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:52.349480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.756078+0000","last_change":"2024-05-08T18:08:49.512724+0000","last_active":"2024-05-08T18:12:02.756078+0000","last_peered":"2024-05-08T18:12:02.756078+0000","last_clean":"2024-05-08T18:12:02.756078+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:02.756078+0000","last_undegraded":"2024-05-08T18:12:02.756078+0000","last_fullsized":"2024-05-08T18:12:02.756078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:36.090445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593298+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:09:28.593298+0000","last_peered":"2024-05-08T18:09:28.593298+0000","last_clean":"2024-05-08T18:09:28.593298+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:09:28.593298+0000","last_undegraded":"2024-05-08T18:09:28.593298+0000","last_fullsized":"2024-05-08T18:09:28.593298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:34.298278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597381+0000","last_change":"2024-05-08T18:08:51.505825+0000","last_active":"2024-05-08T18:09:28.597381+0000","last_peered":"2024-05-08T18:09:28.597381+0000","last_clean":"2024-05-08T18:09:28.597381+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:09:28.597381+0000","last_undegraded":"2024-05-08T18:09:28.597381+0000","last_fullsized":"2024-05-08T18:09:28.597381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:07.975264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.580226+0000","last_change":"2024-05-08T18:08:53.550245+0000","last_active":"2024-05-08T18:10:59.580226+0000","last_peered":"2024-05-08T18:10:59.580226+0000","last_clean":"2024-05-08T18:10:59.580226+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:10:59.580226+0000","last_undegraded":"2024-05-08T18:10:59.580226+0000","last_fullsized":"2024-05-08T18:10:59.580226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:46.416684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582464+0000","last_change":"2024-05-08T18:08:55.544376+0000","last_active":"2024-05-08T18:09:28.582464+0000","last_peered":"2024-05-08T18:09:28.582464+0000","last_clean":"2024-05-08T18:09:28.582464+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:09:28.582464+0000","last_undegraded":"2024-05-08T18:09:28.582464+0000","last_fullsized":"2024-05-08T18:09:28.582464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.499404+0000","last_change":"2024-05-08T18:08:57.562642+0000","last_active":"2024-05-08T18:10:16.499404+0000","last_peered":"2024-05-08T18:10:16.499404+0000","last_clean":"2024-05-08T18:10:16.499404+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:10:16.499404+0000","last_undegraded":"2024-05-08T18:10:16.499404+0000","last_fullsized":"2024-05-08T18:10:16.499404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597657+0000","last_change":"2024-05-08T18:08:49.513376+0000","last_active":"2024-05-08T18:12:02.597657+0000","last_peered":"2024-05-08T18:12:02.597657+0000","last_clean":"2024-05-08T18:12:02.597657+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:02.597657+0000","last_undegraded":"2024-05-08T18:12:02.597657+0000","last_fullsized":"2024-05-08T18:12:02.597657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:18.558772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579314+0000","last_change":"2024-05-08T18:08:47.514599+0000","last_active":"2024-05-08T18:09:28.579314+0000","last_peered":"2024-05-08T18:09:28.579314+0000","last_clean":"2024-05-08T18:09:28.579314+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:09:28.579314+0000","last_undegraded":"2024-05-08T18:09:28.579314+0000","last_fullsized":"2024-05-08T18:09:28.579314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578587+0000","last_change":"2024-05-08T18:08:51.510019+0000","last_active":"2024-05-08T18:09:28.578587+0000","last_peered":"2024-05-08T18:09:28.578587+0000","last_clean":"2024-05-08T18:09:28.578587+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:09:28.578587+0000","last_undegraded":"2024-05-08T18:09:28.578587+0000","last_fullsized":"2024-05-08T18:09:28.578587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:08.155776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581714+0000","last_change":"2024-05-08T18:08:53.529258+0000","last_active":"2024-05-08T18:09:28.581714+0000","last_peered":"2024-05-08T18:09:28.581714+0000","last_clean":"2024-05-08T18:09:28.581714+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:09:28.581714+0000","last_undegraded":"2024-05-08T18:09:28.581714+0000","last_fullsized":"2024-05-08T18:09:28.581714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:41.643997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574807+0000","last_change":"2024-05-08T18:08:55.556181+0000","last_active":"2024-05-08T18:09:28.574807+0000","last_peered":"2024-05-08T18:09:28.574807+0000","last_clean":"2024-05-08T18:09:28.574807+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:09:28.574807+0000","last_undegraded":"2024-05-08T18:09:28.574807+0000","last_fullsized":"2024-05-08T18:09:28.574807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.792229+0000","last_change":"2024-05-08T18:08:57.565097+0000","last_active":"2024-05-08T18:12:01.792229+0000","last_peered":"2024-05-08T18:12:01.792229+0000","last_clean":"2024-05-08T18:12:01.792229+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:12:01.792229+0000","last_undegraded":"2024-05-08T18:12:01.792229+0000","last_fullsized":"2024-05-08T18:12:01.792229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392228+0000","last_change":"2024-05-08T18:08:49.515508+0000","last_active":"2024-05-08T18:12:02.392228+0000","last_peered":"2024-05-08T18:12:02.392228+0000","last_clean":"2024-05-08T18:12:02.392228+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:02.392228+0000","last_undegraded":"2024-05-08T18:12:02.392228+0000","last_fullsized":"2024-05-08T18:12:02.392228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:35.075462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.423730+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:09:33.423730+0000","last_peered":"2024-05-08T18:09:33.423730+0000","last_clean":"2024-05-08T18:09:33.423730+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:09:33.423730+0000","last_undegraded":"2024-05-08T18:09:33.423730+0000","last_fullsized":"2024-05-08T18:09:33.423730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:39.673917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581355+0000","last_change":"2024-05-08T18:08:51.512103+0000","last_active":"2024-05-08T18:09:28.581355+0000","last_peered":"2024-05-08T18:09:28.581355+0000","last_clean":"2024-05-08T18:09:28.581355+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:09:28.581355+0000","last_undegraded":"2024-05-08T18:09:28.581355+0000","last_fullsized":"2024-05-08T18:09:28.581355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:29.355971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.644505+0000","last_change":"2024-05-08T18:08:53.547887+0000","last_active":"2024-05-08T18:11:01.644505+0000","last_peered":"2024-05-08T18:11:01.644505+0000","last_clean":"2024-05-08T18:11:01.644505+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:11:01.644505+0000","last_undegraded":"2024-05-08T18:11:01.644505+0000","last_fullsized":"2024-05-08T18:11:01.644505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:37.748836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'282","reported_seq":391,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754663+0000","last_change":"2024-05-08T18:08:55.569300+0000","last_active":"2024-05-08T18:12:01.754663+0000","last_peered":"2024-05-08T18:12:01.754663+0000","last_clean":"2024-05-08T18:12:01.754663+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:01.754663+0000","last_undegraded":"2024-05-08T18:12:01.754663+0000","last_fullsized":"2024-05-08T18:12:01.754663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:39.688576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.867775+0000","last_change":"2024-05-08T18:08:57.564089+0000","last_active":"2024-05-08T18:12:02.867775+0000","last_peered":"2024-05-08T18:12:02.867775+0000","last_clean":"2024-05-08T18:12:02.867775+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:02.867775+0000","last_undegraded":"2024-05-08T18:12:02.867775+0000","last_fullsized":"2024-05-08T18:12:02.867775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:58.387686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785001+0000","last_change":"2024-05-08T18:08:49.502184+0000","last_active":"2024-05-08T18:10:16.785001+0000","last_peered":"2024-05-08T18:10:16.785001+0000","last_clean":"2024-05-08T18:10:16.785001+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:10:16.785001+0000","last_undegraded":"2024-05-08T18:10:16.785001+0000","last_fullsized":"2024-05-08T18:10:16.785001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.897867+0000","last_change":"2024-05-08T18:08:47.498742+0000","last_active":"2024-05-08T18:09:31.897867+0000","last_peered":"2024-05-08T18:09:31.897867+0000","last_clean":"2024-05-08T18:09:31.897867+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:09:31.897867+0000","last_undegraded":"2024-05-08T18:09:31.897867+0000","last_fullsized":"2024-05-08T18:09:31.897867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:17.448245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607265+0000","last_change":"2024-05-08T18:08:51.513252+0000","last_active":"2024-05-08T18:09:28.607265+0000","last_peered":"2024-05-08T18:09:28.607265+0000","last_clean":"2024-05-08T18:09:28.607265+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:09:28.607265+0000","last_undegraded":"2024-05-08T18:09:28.607265+0000","last_fullsized":"2024-05-08T18:09:28.607265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:27.262513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'31","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431613+0000","last_change":"2024-05-08T18:08:53.550029+0000","last_active":"2024-05-08T18:11:21.431613+0000","last_peered":"2024-05-08T18:11:21.431613+0000","last_clean":"2024-05-08T18:11:21.431613+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:11:21.431613+0000","last_undegraded":"2024-05-08T18:11:21.431613+0000","last_fullsized":"2024-05-08T18:11:21.431613+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:31.369561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'282","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.764223+0000","last_change":"2024-05-08T18:08:55.559384+0000","last_active":"2024-05-08T18:12:02.764223+0000","last_peered":"2024-05-08T18:12:02.764223+0000","last_clean":"2024-05-08T18:12:02.764223+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:02.764223+0000","last_undegraded":"2024-05-08T18:12:02.764223+0000","last_fullsized":"2024-05-08T18:12:02.764223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:12.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'11","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706714+0000","last_change":"2024-05-08T18:08:49.510841+0000","last_active":"2024-05-08T18:12:02.706714+0000","last_peered":"2024-05-08T18:12:02.706714+0000","last_clean":"2024-05-08T18:12:02.706714+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:02.706714+0000","last_undegraded":"2024-05-08T18:12:02.706714+0000","last_fullsized":"2024-05-08T18:12:02.706714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:50.298264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590076+0000","last_change":"2024-05-08T18:08:47.512906+0000","last_active":"2024-05-08T18:09:28.590076+0000","last_peered":"2024-05-08T18:09:28.590076+0000","last_clean":"2024-05-08T18:09:28.590076+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:09:28.590076+0000","last_undegraded":"2024-05-08T18:09:28.590076+0000","last_fullsized":"2024-05-08T18:09:28.590076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572207+0000","last_change":"2024-05-08T18:08:51.514762+0000","last_active":"2024-05-08T18:09:28.572207+0000","last_peered":"2024-05-08T18:09:28.572207+0000","last_clean":"2024-05-08T18:09:28.572207+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:09:28.572207+0000","last_undegraded":"2024-05-08T18:09:28.572207+0000","last_fullsized":"2024-05-08T18:09:28.572207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:04.358592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'40","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.586282+0000","last_change":"2024-05-08T18:08:53.535349+0000","last_active":"2024-05-08T18:10:59.586282+0000","last_peered":"2024-05-08T18:10:59.586282+0000","last_clean":"2024-05-08T18:10:59.586282+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:10:59.586282+0000","last_undegraded":"2024-05-08T18:10:59.586282+0000","last_fullsized":"2024-05-08T18:10:59.586282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:54.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583740+0000","last_change":"2024-05-08T18:08:55.543395+0000","last_active":"2024-05-08T18:09:28.583740+0000","last_peered":"2024-05-08T18:09:28.583740+0000","last_clean":"2024-05-08T18:09:28.583740+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:09:28.583740+0000","last_undegraded":"2024-05-08T18:09:28.583740+0000","last_fullsized":"2024-05-08T18:09:28.583740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:20.271109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.502622+0000","last_change":"2024-05-08T18:08:57.563745+0000","last_active":"2024-05-08T18:10:16.502622+0000","last_peered":"2024-05-08T18:10:16.502622+0000","last_clean":"2024-05-08T18:10:16.502622+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:10:16.502622+0000","last_undegraded":"2024-05-08T18:10:16.502622+0000","last_fullsized":"2024-05-08T18:10:16.502622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:30.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785596+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:10:16.785596+0000","last_peered":"2024-05-08T18:10:16.785596+0000","last_clean":"2024-05-08T18:10:16.785596+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:10:16.785596+0000","last_undegraded":"2024-05-08T18:10:16.785596+0000","last_fullsized":"2024-05-08T18:10:16.785596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:25.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591192+0000","last_change":"2024-05-08T18:08:47.513909+0000","last_active":"2024-05-08T18:09:28.591192+0000","last_peered":"2024-05-08T18:09:28.591192+0000","last_clean":"2024-05-08T18:09:28.591192+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:09:28.591192+0000","last_undegraded":"2024-05-08T18:09:28.591192+0000","last_fullsized":"2024-05-08T18:09:28.591192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407203+0000","last_change":"2024-05-08T18:09:28.594816+0000","last_active":"2024-05-08T18:09:31.407203+0000","last_peered":"2024-05-08T18:09:31.407203+0000","last_clean":"2024-05-08T18:09:31.407203+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:09:31.407203+0000","last_undegraded":"2024-05-08T18:09:31.407203+0000","last_fullsized":"2024-05-08T18:09:31.407203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:28.103174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.557932+0000","last_change":"2024-05-08T18:08:53.558331+0000","last_active":"2024-05-08T18:10:59.557932+0000","last_peered":"2024-05-08T18:10:59.557932+0000","last_clean":"2024-05-08T18:10:59.557932+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:10:59.557932+0000","last_undegraded":"2024-05-08T18:10:59.557932+0000","last_fullsized":"2024-05-08T18:10:59.557932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:26.213210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576613+0000","last_change":"2024-05-08T18:08:55.546287+0000","last_active":"2024-05-08T18:09:28.576613+0000","last_peered":"2024-05-08T18:09:28.576613+0000","last_clean":"2024-05-08T18:09:28.576613+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:09:28.576613+0000","last_undegraded":"2024-05-08T18:09:28.576613+0000","last_fullsized":"2024-05-08T18:09:28.576613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:10.826721+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:10:10.826721+0000","last_peered":"2024-05-08T18:10:10.826721+0000","last_clean":"2024-05-08T18:10:10.826721+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:10:10.826721+0000","last_undegraded":"2024-05-08T18:10:10.826721+0000","last_fullsized":"2024-05-08T18:10:10.826721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620354+0000","last_change":"2024-05-08T18:08:49.508936+0000","last_active":"2024-05-08T18:12:02.620354+0000","last_peered":"2024-05-08T18:12:02.620354+0000","last_clean":"2024-05-08T18:12:02.620354+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:02.620354+0000","last_undegraded":"2024-05-08T18:12:02.620354+0000","last_fullsized":"2024-05-08T18:12:02.620354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:21.051104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599345+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:09:28.599345+0000","last_peered":"2024-05-08T18:09:28.599345+0000","last_clean":"2024-05-08T18:09:28.599345+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:09:28.599345+0000","last_undegraded":"2024-05-08T18:09:28.599345+0000","last_fullsized":"2024-05-08T18:09:28.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:40.628230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584773+0000","last_change":"2024-05-08T18:08:51.511856+0000","last_active":"2024-05-08T18:09:28.584773+0000","last_peered":"2024-05-08T18:09:28.584773+0000","last_clean":"2024-05-08T18:09:28.584773+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:09:28.584773+0000","last_undegraded":"2024-05-08T18:09:28.584773+0000","last_fullsized":"2024-05-08T18:09:28.584773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:46.281518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.589041+0000","last_change":"2024-05-08T18:08:53.543547+0000","last_active":"2024-05-08T18:10:59.589041+0000","last_peered":"2024-05-08T18:10:59.589041+0000","last_clean":"2024-05-08T18:10:59.589041+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:10:59.589041+0000","last_undegraded":"2024-05-08T18:10:59.589041+0000","last_fullsized":"2024-05-08T18:10:59.589041+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:16.619812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'282","reported_seq":355,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.962765+0000","last_change":"2024-05-08T18:08:55.546405+0000","last_active":"2024-05-08T18:12:02.962765+0000","last_peered":"2024-05-08T18:12:02.962765+0000","last_clean":"2024-05-08T18:12:02.962765+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:02.962765+0000","last_undegraded":"2024-05-08T18:12:02.962765+0000","last_fullsized":"2024-05-08T18:12:02.962765+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578554+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:09:28.578554+0000","last_peered":"2024-05-08T18:09:28.578554+0000","last_clean":"2024-05-08T18:09:28.578554+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:09:28.578554+0000","last_undegraded":"2024-05-08T18:09:28.578554+0000","last_fullsized":"2024-05-08T18:09:28.578554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:35.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.451117+0000","last_change":"2024-05-08T18:08:49.491239+0000","last_active":"2024-05-08T18:10:57.451117+0000","last_peered":"2024-05-08T18:10:57.451117+0000","last_clean":"2024-05-08T18:10:57.451117+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:10:57.451117+0000","last_undegraded":"2024-05-08T18:10:57.451117+0000","last_fullsized":"2024-05-08T18:10:57.451117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.412627+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:09:33.412627+0000","last_peered":"2024-05-08T18:09:33.412627+0000","last_clean":"2024-05-08T18:09:33.412627+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:09:33.412627+0000","last_undegraded":"2024-05-08T18:09:33.412627+0000","last_fullsized":"2024-05-08T18:09:33.412627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:02.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407275+0000","last_change":"2024-05-08T18:09:28.599715+0000","last_active":"2024-05-08T18:09:31.407275+0000","last_peered":"2024-05-08T18:09:31.407275+0000","last_clean":"2024-05-08T18:09:31.407275+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:09:31.407275+0000","last_undegraded":"2024-05-08T18:09:31.407275+0000","last_fullsized":"2024-05-08T18:09:31.407275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:11.718211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.591215+0000","last_change":"2024-05-08T18:08:53.550420+0000","last_active":"2024-05-08T18:10:59.591215+0000","last_peered":"2024-05-08T18:10:59.591215+0000","last_clean":"2024-05-08T18:10:59.591215+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:10:59.591215+0000","last_undegraded":"2024-05-08T18:10:59.591215+0000","last_fullsized":"2024-05-08T18:10:59.591215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.341867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576602+0000","last_change":"2024-05-08T18:08:55.554490+0000","last_active":"2024-05-08T18:09:28.576602+0000","last_peered":"2024-05-08T18:09:28.576602+0000","last_clean":"2024-05-08T18:09:28.576602+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:09:28.576602+0000","last_undegraded":"2024-05-08T18:09:28.576602+0000","last_fullsized":"2024-05-08T18:09:28.576602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.922608+0000","last_change":"2024-05-08T18:08:57.554614+0000","last_active":"2024-05-08T18:12:02.922608+0000","last_peered":"2024-05-08T18:12:02.922608+0000","last_clean":"2024-05-08T18:12:02.922608+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:02.922608+0000","last_undegraded":"2024-05-08T18:12:02.922608+0000","last_fullsized":"2024-05-08T18:12:02.922608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:05.491234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658994+0000","last_change":"2024-05-08T18:08:49.519440+0000","last_active":"2024-05-08T18:09:32.658994+0000","last_peered":"2024-05-08T18:09:32.658994+0000","last_clean":"2024-05-08T18:09:32.658994+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:09:32.658994+0000","last_undegraded":"2024-05-08T18:09:32.658994+0000","last_fullsized":"2024-05-08T18:09:32.658994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581363+0000","last_change":"2024-05-08T18:08:47.496893+0000","last_active":"2024-05-08T18:09:28.581363+0000","last_peered":"2024-05-08T18:09:28.581363+0000","last_clean":"2024-05-08T18:09:28.581363+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:09:28.581363+0000","last_undegraded":"2024-05-08T18:09:28.581363+0000","last_fullsized":"2024-05-08T18:09:28.581363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:34.452347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584821+0000","last_change":"2024-05-08T18:08:51.507807+0000","last_active":"2024-05-08T18:09:28.584821+0000","last_peered":"2024-05-08T18:09:28.584821+0000","last_clean":"2024-05-08T18:09:28.584821+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:09:28.584821+0000","last_undegraded":"2024-05-08T18:09:28.584821+0000","last_fullsized":"2024-05-08T18:09:28.584821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:57.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'33","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.563219+0000","last_change":"2024-05-08T18:08:53.519537+0000","last_active":"2024-05-08T18:10:59.563219+0000","last_peered":"2024-05-08T18:10:59.563219+0000","last_clean":"2024-05-08T18:10:59.563219+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:10:59.563219+0000","last_undegraded":"2024-05-08T18:10:59.563219+0000","last_fullsized":"2024-05-08T18:10:59.563219+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:52.757767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598872+0000","last_change":"2024-05-08T18:08:55.570542+0000","last_active":"2024-05-08T18:09:28.598872+0000","last_peered":"2024-05-08T18:09:28.598872+0000","last_clean":"2024-05-08T18:09:28.598872+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:09:28.598872+0000","last_undegraded":"2024-05-08T18:09:28.598872+0000","last_fullsized":"2024-05-08T18:09:28.598872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:08.738890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429230+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:11:01.429230+0000","last_peered":"2024-05-08T18:11:01.429230+0000","last_clean":"2024-05-08T18:11:01.429230+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:11:01.429230+0000","last_undegraded":"2024-05-08T18:11:01.429230+0000","last_fullsized":"2024-05-08T18:11:01.429230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:49.482320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688757+0000","last_change":"2024-05-08T18:08:49.515298+0000","last_active":"2024-05-08T18:12:02.688757+0000","last_peered":"2024-05-08T18:12:02.688757+0000","last_clean":"2024-05-08T18:12:02.688757+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:02.688757+0000","last_undegraded":"2024-05-08T18:12:02.688757+0000","last_fullsized":"2024-05-08T18:12:02.688757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:48.730204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429546+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:11:01.429546+0000","last_peered":"2024-05-08T18:11:01.429546+0000","last_clean":"2024-05-08T18:11:01.429546+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:11:01.429546+0000","last_undegraded":"2024-05-08T18:11:01.429546+0000","last_fullsized":"2024-05-08T18:11:01.429546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:05.053205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639872,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582954+0000","last_change":"2024-05-08T18:08:51.522113+0000","last_active":"2024-05-08T18:09:28.582954+0000","last_peered":"2024-05-08T18:09:28.582954+0000","last_clean":"2024-05-08T18:09:28.582954+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:09:28.582954+0000","last_undegraded":"2024-05-08T18:09:28.582954+0000","last_fullsized":"2024-05-08T18:09:28.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:38.116549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.603131+0000","last_change":"2024-05-08T18:08:53.521466+0000","last_active":"2024-05-08T18:10:59.603131+0000","last_peered":"2024-05-08T18:10:59.603131+0000","last_clean":"2024-05-08T18:10:59.603131+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:10:59.603131+0000","last_undegraded":"2024-05-08T18:10:59.603131+0000","last_fullsized":"2024-05-08T18:10:59.603131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:54.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'282","reported_seq":431,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.948610+0000","last_change":"2024-05-08T18:08:55.551517+0000","last_active":"2024-05-08T18:12:02.948610+0000","last_peered":"2024-05-08T18:12:02.948610+0000","last_clean":"2024-05-08T18:12:02.948610+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:02.948610+0000","last_undegraded":"2024-05-08T18:12:02.948610+0000","last_fullsized":"2024-05-08T18:12:02.948610+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:54.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420148+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:11:06.420148+0000","last_peered":"2024-05-08T18:11:06.420148+0000","last_clean":"2024-05-08T18:11:06.420148+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:11:06.420148+0000","last_undegraded":"2024-05-08T18:11:06.420148+0000","last_fullsized":"2024-05-08T18:11:06.420148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.783846+0000","last_change":"2024-05-08T18:08:49.511424+0000","last_active":"2024-05-08T18:10:16.783846+0000","last_peered":"2024-05-08T18:10:16.783846+0000","last_clean":"2024-05-08T18:10:16.783846+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:10:16.783846+0000","last_undegraded":"2024-05-08T18:10:16.783846+0000","last_fullsized":"2024-05-08T18:10:16.783846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.346107+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:11:01.346107+0000","last_peered":"2024-05-08T18:11:01.346107+0000","last_clean":"2024-05-08T18:11:01.346107+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:11:01.346107+0000","last_undegraded":"2024-05-08T18:11:01.346107+0000","last_fullsized":"2024-05-08T18:11:01.346107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:07.886229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":413,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.121864+0000","last_change":"2024-05-08T18:08:51.518382+0000","last_active":"2024-05-08T18:11:01.121864+0000","last_peered":"2024-05-08T18:11:01.121864+0000","last_clean":"2024-05-08T18:11:01.121864+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:11:01.121864+0000","last_undegraded":"2024-05-08T18:11:01.121864+0000","last_fullsized":"2024-05-08T18:11:01.121864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:09.759130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597807+0000","last_change":"2024-05-08T18:08:53.558518+0000","last_active":"2024-05-08T18:09:28.597807+0000","last_peered":"2024-05-08T18:09:28.597807+0000","last_clean":"2024-05-08T18:09:28.597807+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:09:28.597807+0000","last_undegraded":"2024-05-08T18:09:28.597807+0000","last_fullsized":"2024-05-08T18:09:28.597807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:55.547274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'282","reported_seq":460,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.874118+0000","last_change":"2024-05-08T18:08:55.557075+0000","last_active":"2024-05-08T18:12:02.874118+0000","last_peered":"2024-05-08T18:12:02.874118+0000","last_clean":"2024-05-08T18:12:02.874118+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:02.874118+0000","last_undegraded":"2024-05-08T18:12:02.874118+0000","last_fullsized":"2024-05-08T18:12:02.874118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.278025+0000","last_change":"2024-05-08T18:08:57.569509+0000","last_active":"2024-05-08T18:11:01.278025+0000","last_peered":"2024-05-08T18:11:01.278025+0000","last_clean":"2024-05-08T18:11:01.278025+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:11:01.278025+0000","last_undegraded":"2024-05-08T18:11:01.278025+0000","last_fullsized":"2024-05-08T18:11:01.278025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:46.790373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862531+0000","last_change":"2024-05-08T18:08:49.518367+0000","last_active":"2024-05-08T18:12:02.862531+0000","last_peered":"2024-05-08T18:12:02.862531+0000","last_clean":"2024-05-08T18:12:02.862531+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:02.862531+0000","last_undegraded":"2024-05-08T18:12:02.862531+0000","last_fullsized":"2024-05-08T18:12:02.862531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:06.824034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587763+0000","last_change":"2024-05-08T18:08:47.529160+0000","last_active":"2024-05-08T18:09:28.587763+0000","last_peered":"2024-05-08T18:09:28.587763+0000","last_clean":"2024-05-08T18:09:28.587763+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:09:28.587763+0000","last_undegraded":"2024-05-08T18:09:28.587763+0000","last_fullsized":"2024-05-08T18:09:28.587763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:54.279504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607171+0000","last_change":"2024-05-08T18:08:51.511533+0000","last_active":"2024-05-08T18:09:28.607171+0000","last_peered":"2024-05-08T18:09:28.607171+0000","last_clean":"2024-05-08T18:09:28.607171+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:09:28.607171+0000","last_undegraded":"2024-05-08T18:09:28.607171+0000","last_fullsized":"2024-05-08T18:09:28.607171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:10.403888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.582144+0000","last_change":"2024-05-08T18:08:53.517418+0000","last_active":"2024-05-08T18:10:59.582144+0000","last_peered":"2024-05-08T18:10:59.582144+0000","last_clean":"2024-05-08T18:10:59.582144+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:10:59.582144+0000","last_undegraded":"2024-05-08T18:10:59.582144+0000","last_fullsized":"2024-05-08T18:10:59.582144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:45.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586484+0000","last_change":"2024-05-08T18:08:55.541260+0000","last_active":"2024-05-08T18:09:28.586484+0000","last_peered":"2024-05-08T18:09:28.586484+0000","last_clean":"2024-05-08T18:09:28.586484+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:09:28.586484+0000","last_undegraded":"2024-05-08T18:09:28.586484+0000","last_fullsized":"2024-05-08T18:09:28.586484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:47.311202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.828028+0000","last_change":"2024-05-08T18:08:57.568017+0000","last_active":"2024-05-08T18:12:02.828028+0000","last_peered":"2024-05-08T18:12:02.828028+0000","last_clean":"2024-05-08T18:12:02.828028+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:12:02.828028+0000","last_undegraded":"2024-05-08T18:12:02.828028+0000","last_fullsized":"2024-05-08T18:12:02.828028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.143701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.707182+0000","last_change":"2024-05-08T18:08:49.510311+0000","last_active":"2024-05-08T18:12:02.707182+0000","last_peered":"2024-05-08T18:12:02.707182+0000","last_clean":"2024-05-08T18:12:02.707182+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:02.707182+0000","last_undegraded":"2024-05-08T18:12:02.707182+0000","last_fullsized":"2024-05-08T18:12:02.707182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:19.250288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571588+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:09:28.571588+0000","last_peered":"2024-05-08T18:09:28.571588+0000","last_clean":"2024-05-08T18:09:28.571588+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:09:28.571588+0000","last_undegraded":"2024-05-08T18:09:28.571588+0000","last_fullsized":"2024-05-08T18:09:28.571588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:09.321105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602411+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:09:28.602411+0000","last_peered":"2024-05-08T18:09:28.602411+0000","last_clean":"2024-05-08T18:09:28.602411+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:09:28.602411+0000","last_undegraded":"2024-05-08T18:09:28.602411+0000","last_fullsized":"2024-05-08T18:09:28.602411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:48.933240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.429157+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:09:33.429157+0000","last_peered":"2024-05-08T18:09:33.429157+0000","last_clean":"2024-05-08T18:09:33.429157+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:09:33.429157+0000","last_undegraded":"2024-05-08T18:09:33.429157+0000","last_fullsized":"2024-05-08T18:09:33.429157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:30.152904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575232+0000","last_change":"2024-05-08T18:08:51.520538+0000","last_active":"2024-05-08T18:09:28.575232+0000","last_peered":"2024-05-08T18:09:28.575232+0000","last_clean":"2024-05-08T18:09:28.575232+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:09:28.575232+0000","last_undegraded":"2024-05-08T18:09:28.575232+0000","last_fullsized":"2024-05-08T18:09:28.575232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:05.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'79","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.624394+0000","last_change":"2024-05-08T18:08:53.552241+0000","last_active":"2024-05-08T18:12:02.624394+0000","last_peered":"2024-05-08T18:12:02.624394+0000","last_clean":"2024-05-08T18:12:02.624394+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:02.624394+0000","last_undegraded":"2024-05-08T18:12:02.624394+0000","last_fullsized":"2024-05-08T18:12:02.624394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:31.496707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580217+0000","last_change":"2024-05-08T18:08:55.565611+0000","last_active":"2024-05-08T18:09:28.580217+0000","last_peered":"2024-05-08T18:09:28.580217+0000","last_clean":"2024-05-08T18:09:28.580217+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:09:28.580217+0000","last_undegraded":"2024-05-08T18:09:28.580217+0000","last_fullsized":"2024-05-08T18:09:28.580217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:14.430171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.781603+0000","last_change":"2024-05-08T18:08:57.567916+0000","last_active":"2024-05-08T18:12:02.781603+0000","last_peered":"2024-05-08T18:12:02.781603+0000","last_clean":"2024-05-08T18:12:02.781603+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:02.781603+0000","last_undegraded":"2024-05-08T18:12:02.781603+0000","last_fullsized":"2024-05-08T18:12:02.781603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:51.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599193+0000","last_change":"2024-05-08T18:08:49.510047+0000","last_active":"2024-05-08T18:12:02.599193+0000","last_peered":"2024-05-08T18:12:02.599193+0000","last_clean":"2024-05-08T18:12:02.599193+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:12:02.599193+0000","last_undegraded":"2024-05-08T18:12:02.599193+0000","last_fullsized":"2024-05-08T18:12:02.599193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:12.681511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586341+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:09:28.586341+0000","last_peered":"2024-05-08T18:09:28.586341+0000","last_clean":"2024-05-08T18:09:28.586341+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:09:28.586341+0000","last_undegraded":"2024-05-08T18:09:28.586341+0000","last_fullsized":"2024-05-08T18:09:28.586341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:48.054967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576589+0000","last_change":"2024-05-08T18:08:47.515311+0000","last_active":"2024-05-08T18:09:28.576589+0000","last_peered":"2024-05-08T18:09:28.576589+0000","last_clean":"2024-05-08T18:09:28.576589+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:09:28.576589+0000","last_undegraded":"2024-05-08T18:09:28.576589+0000","last_fullsized":"2024-05-08T18:09:28.576589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607650+0000","last_change":"2024-05-08T18:08:51.512536+0000","last_active":"2024-05-08T18:09:28.607650+0000","last_peered":"2024-05-08T18:09:28.607650+0000","last_clean":"2024-05-08T18:09:28.607650+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:09:28.607650+0000","last_undegraded":"2024-05-08T18:09:28.607650+0000","last_fullsized":"2024-05-08T18:09:28.607650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:58.676437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'273","reported_seq":477,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754539+0000","last_change":"2024-05-08T18:08:53.530304+0000","last_active":"2024-05-08T18:12:01.754539+0000","last_peered":"2024-05-08T18:12:01.754539+0000","last_clean":"2024-05-08T18:12:01.754539+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:01.754539+0000","last_undegraded":"2024-05-08T18:12:01.754539+0000","last_fullsized":"2024-05-08T18:12:01.754539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:39.103025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592749+0000","last_change":"2024-05-08T18:08:55.568400+0000","last_active":"2024-05-08T18:09:28.592749+0000","last_peered":"2024-05-08T18:09:28.592749+0000","last_clean":"2024-05-08T18:09:28.592749+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:09:28.592749+0000","last_undegraded":"2024-05-08T18:09:28.592749+0000","last_fullsized":"2024-05-08T18:09:28.592749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:48.835521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.496391+0000","last_change":"2024-05-08T18:08:57.579069+0000","last_active":"2024-05-08T18:10:16.496391+0000","last_peered":"2024-05-08T18:10:16.496391+0000","last_clean":"2024-05-08T18:10:16.496391+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:10:16.496391+0000","last_undegraded":"2024-05-08T18:10:16.496391+0000","last_fullsized":"2024-05-08T18:10:16.496391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:45.209949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755355+0000","last_change":"2024-05-08T18:08:49.501820+0000","last_active":"2024-05-08T18:12:02.755355+0000","last_peered":"2024-05-08T18:12:02.755355+0000","last_clean":"2024-05-08T18:12:02.755355+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:02.755355+0000","last_undegraded":"2024-05-08T18:12:02.755355+0000","last_fullsized":"2024-05-08T18:12:02.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579628+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:09:28.579628+0000","last_peered":"2024-05-08T18:09:28.579628+0000","last_clean":"2024-05-08T18:09:28.579628+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:09:28.579628+0000","last_undegraded":"2024-05-08T18:09:28.579628+0000","last_fullsized":"2024-05-08T18:09:28.579628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576151+0000","last_change":"2024-05-08T18:08:47.513124+0000","last_active":"2024-05-08T18:09:28.576151+0000","last_peered":"2024-05-08T18:09:28.576151+0000","last_clean":"2024-05-08T18:09:28.576151+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:09:28.576151+0000","last_undegraded":"2024-05-08T18:09:28.576151+0000","last_fullsized":"2024-05-08T18:09:28.576151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590814+0000","last_change":"2024-05-08T18:08:51.508831+0000","last_active":"2024-05-08T18:09:28.590814+0000","last_peered":"2024-05-08T18:09:28.590814+0000","last_clean":"2024-05-08T18:09:28.590814+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:09:28.590814+0000","last_undegraded":"2024-05-08T18:09:28.590814+0000","last_fullsized":"2024-05-08T18:09:28.590814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:04.126643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754979+0000","last_change":"2024-05-08T18:08:53.525229+0000","last_active":"2024-05-08T18:12:01.754979+0000","last_peered":"2024-05-08T18:12:01.754979+0000","last_clean":"2024-05-08T18:12:01.754979+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:01.754979+0000","last_undegraded":"2024-05-08T18:12:01.754979+0000","last_fullsized":"2024-05-08T18:12:01.754979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:06.372182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581183+0000","last_change":"2024-05-08T18:08:55.567310+0000","last_active":"2024-05-08T18:09:28.581183+0000","last_peered":"2024-05-08T18:09:28.581183+0000","last_clean":"2024-05-08T18:09:28.581183+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:09:28.581183+0000","last_undegraded":"2024-05-08T18:09:28.581183+0000","last_fullsized":"2024-05-08T18:09:28.581183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:30.447596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.450125+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:09:33.450125+0000","last_peered":"2024-05-08T18:09:33.450125+0000","last_clean":"2024-05-08T18:09:33.450125+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:09:33.450125+0000","last_undegraded":"2024-05-08T18:09:33.450125+0000","last_fullsized":"2024-05-08T18:09:33.450125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:09.186479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774957+0000","last_change":"2024-05-08T18:08:49.493587+0000","last_active":"2024-05-08T18:12:02.774957+0000","last_peered":"2024-05-08T18:12:02.774957+0000","last_clean":"2024-05-08T18:12:02.774957+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:02.774957+0000","last_undegraded":"2024-05-08T18:12:02.774957+0000","last_fullsized":"2024-05-08T18:12:02.774957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593308+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:09:28.593308+0000","last_peered":"2024-05-08T18:09:28.593308+0000","last_clean":"2024-05-08T18:09:28.593308+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:09:28.593308+0000","last_undegraded":"2024-05-08T18:09:28.593308+0000","last_fullsized":"2024-05-08T18:09:28.593308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:57:14.342510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581432+0000","last_change":"2024-05-08T18:08:47.507237+0000","last_active":"2024-05-08T18:09:28.581432+0000","last_peered":"2024-05-08T18:09:28.581432+0000","last_clean":"2024-05-08T18:09:28.581432+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:09:28.581432+0000","last_undegraded":"2024-05-08T18:09:28.581432+0000","last_fullsized":"2024-05-08T18:09:28.581432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579952+0000","last_change":"2024-05-08T18:08:51.510525+0000","last_active":"2024-05-08T18:09:28.579952+0000","last_peered":"2024-05-08T18:09:28.579952+0000","last_clean":"2024-05-08T18:09:28.579952+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:09:28.579952+0000","last_undegraded":"2024-05-08T18:09:28.579952+0000","last_fullsized":"2024-05-08T18:09:28.579952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:35.735245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.660422+0000","last_change":"2024-05-08T18:08:53.551086+0000","last_active":"2024-05-08T18:12:01.660422+0000","last_peered":"2024-05-08T18:12:01.660422+0000","last_clean":"2024-05-08T18:12:01.660422+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:01.660422+0000","last_undegraded":"2024-05-08T18:12:01.660422+0000","last_fullsized":"2024-05-08T18:12:01.660422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:35.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602251+0000","last_change":"2024-05-08T18:08:55.569487+0000","last_active":"2024-05-08T18:09:28.602251+0000","last_peered":"2024-05-08T18:09:28.602251+0000","last_clean":"2024-05-08T18:09:28.602251+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:09:28.602251+0000","last_undegraded":"2024-05-08T18:09:28.602251+0000","last_fullsized":"2024-05-08T18:09:28.602251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:08.021899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.257052+0000","last_change":"2024-05-08T18:08:57.567414+0000","last_active":"2024-05-08T18:11:01.257052+0000","last_peered":"2024-05-08T18:11:01.257052+0000","last_clean":"2024-05-08T18:11:01.257052+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:11:01.257052+0000","last_undegraded":"2024-05-08T18:11:01.257052+0000","last_fullsized":"2024-05-08T18:11:01.257052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:16.573083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689283+0000","last_change":"2024-05-08T18:09:28.612611+0000","last_active":"2024-05-08T18:12:02.689283+0000","last_peered":"2024-05-08T18:12:02.689283+0000","last_clean":"2024-05-08T18:12:02.689283+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:12:02.689283+0000","last_undegraded":"2024-05-08T18:12:02.689283+0000","last_fullsized":"2024-05-08T18:12:02.689283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892803+0000","last_change":"2024-05-08T18:08:47.517520+0000","last_active":"2024-05-08T18:09:31.892803+0000","last_peered":"2024-05-08T18:09:31.892803+0000","last_clean":"2024-05-08T18:09:31.892803+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:09:31.892803+0000","last_undegraded":"2024-05-08T18:09:31.892803+0000","last_fullsized":"2024-05-08T18:09:31.892803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580404+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:09:28.580404+0000","last_peered":"2024-05-08T18:09:28.580404+0000","last_clean":"2024-05-08T18:09:28.580404+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:09:28.580404+0000","last_undegraded":"2024-05-08T18:09:28.580404+0000","last_fullsized":"2024-05-08T18:09:28.580404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:02.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417770+0000","last_change":"2024-05-08T18:08:51.511005+0000","last_active":"2024-05-08T18:10:56.417770+0000","last_peered":"2024-05-08T18:10:56.417770+0000","last_clean":"2024-05-08T18:10:56.417770+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:10:56.417770+0000","last_undegraded":"2024-05-08T18:10:56.417770+0000","last_fullsized":"2024-05-08T18:10:56.417770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:10.746341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'61","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.601402+0000","last_change":"2024-05-08T18:08:53.554240+0000","last_active":"2024-05-08T18:10:59.601402+0000","last_peered":"2024-05-08T18:10:59.601402+0000","last_clean":"2024-05-08T18:10:59.601402+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:10:59.601402+0000","last_undegraded":"2024-05-08T18:10:59.601402+0000","last_fullsized":"2024-05-08T18:10:59.601402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:40.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581262+0000","last_change":"2024-05-08T18:08:55.551427+0000","last_active":"2024-05-08T18:09:28.581262+0000","last_peered":"2024-05-08T18:09:28.581262+0000","last_clean":"2024-05-08T18:09:28.581262+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:09:28.581262+0000","last_undegraded":"2024-05-08T18:09:28.581262+0000","last_fullsized":"2024-05-08T18:09:28.581262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:25.290543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.494426+0000","last_change":"2024-05-08T18:08:57.564941+0000","last_active":"2024-05-08T18:11:01.494426+0000","last_peered":"2024-05-08T18:11:01.494426+0000","last_clean":"2024-05-08T18:11:01.494426+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:11:01.494426+0000","last_undegraded":"2024-05-08T18:11:01.494426+0000","last_fullsized":"2024-05-08T18:11:01.494426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:55.289619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597441+0000","last_change":"2024-05-08T18:08:49.519773+0000","last_active":"2024-05-08T18:12:02.597441+0000","last_peered":"2024-05-08T18:12:02.597441+0000","last_clean":"2024-05-08T18:12:02.597441+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:02.597441+0000","last_undegraded":"2024-05-08T18:12:02.597441+0000","last_fullsized":"2024-05-08T18:12:02.597441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583257+0000","last_change":"2024-05-08T18:08:47.517709+0000","last_active":"2024-05-08T18:09:28.583257+0000","last_peered":"2024-05-08T18:09:28.583257+0000","last_clean":"2024-05-08T18:09:28.583257+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:09:28.583257+0000","last_undegraded":"2024-05-08T18:09:28.583257+0000","last_fullsized":"2024-05-08T18:09:28.583257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598381+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:09:28.598381+0000","last_peered":"2024-05-08T18:09:28.598381+0000","last_clean":"2024-05-08T18:09:28.598381+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:09:28.598381+0000","last_undegraded":"2024-05-08T18:09:28.598381+0000","last_fullsized":"2024-05-08T18:09:28.598381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:21.080378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592808+0000","last_change":"2024-05-08T18:08:51.505864+0000","last_active":"2024-05-08T18:09:28.592808+0000","last_peered":"2024-05-08T18:09:28.592808+0000","last_clean":"2024-05-08T18:09:28.592808+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:09:28.592808+0000","last_undegraded":"2024-05-08T18:09:28.592808+0000","last_fullsized":"2024-05-08T18:09:28.592808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:06.233890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572702+0000","last_change":"2024-05-08T18:08:53.553633+0000","last_active":"2024-05-08T18:09:28.572702+0000","last_peered":"2024-05-08T18:09:28.572702+0000","last_clean":"2024-05-08T18:09:28.572702+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:09:28.572702+0000","last_undegraded":"2024-05-08T18:09:28.572702+0000","last_fullsized":"2024-05-08T18:09:28.572702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:23.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'282","reported_seq":375,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.768768+0000","last_change":"2024-05-08T18:08:55.556466+0000","last_active":"2024-05-08T18:12:02.768768+0000","last_peered":"2024-05-08T18:12:02.768768+0000","last_clean":"2024-05-08T18:12:02.768768+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:02.768768+0000","last_undegraded":"2024-05-08T18:12:02.768768+0000","last_fullsized":"2024-05-08T18:12:02.768768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598317+0000","last_change":"2024-05-08T18:08:57.559589+0000","last_active":"2024-05-08T18:09:28.598317+0000","last_peered":"2024-05-08T18:09:28.598317+0000","last_clean":"2024-05-08T18:09:28.598317+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:09:28.598317+0000","last_undegraded":"2024-05-08T18:09:28.598317+0000","last_fullsized":"2024-05-08T18:09:28.598317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:44.469070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270592+0000","last_change":"2024-05-08T18:08:49.510615+0000","last_active":"2024-05-08T18:12:02.270592+0000","last_peered":"2024-05-08T18:12:02.270592+0000","last_clean":"2024-05-08T18:12:02.270592+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:02.270592+0000","last_undegraded":"2024-05-08T18:12:02.270592+0000","last_fullsized":"2024-05-08T18:12:02.270592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:03.732312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892852+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:09:31.892852+0000","last_peered":"2024-05-08T18:09:31.892852+0000","last_clean":"2024-05-08T18:09:31.892852+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:09:31.892852+0000","last_undegraded":"2024-05-08T18:09:31.892852+0000","last_fullsized":"2024-05-08T18:09:31.892852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:57.257231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580836+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:09:28.580836+0000","last_peered":"2024-05-08T18:09:28.580836+0000","last_clean":"2024-05-08T18:09:28.580836+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:09:28.580836+0000","last_undegraded":"2024-05-08T18:09:28.580836+0000","last_fullsized":"2024-05-08T18:09:28.580836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:37.747046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603006+0000","last_change":"2024-05-08T18:08:51.513370+0000","last_active":"2024-05-08T18:09:28.603006+0000","last_peered":"2024-05-08T18:09:28.603006+0000","last_clean":"2024-05-08T18:09:28.603006+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:09:28.603006+0000","last_undegraded":"2024-05-08T18:09:28.603006+0000","last_fullsized":"2024-05-08T18:09:28.603006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:16.244827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602730+0000","last_change":"2024-05-08T18:08:53.549741+0000","last_active":"2024-05-08T18:09:28.602730+0000","last_peered":"2024-05-08T18:09:28.602730+0000","last_clean":"2024-05-08T18:09:28.602730+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:09:28.602730+0000","last_undegraded":"2024-05-08T18:09:28.602730+0000","last_fullsized":"2024-05-08T18:09:28.602730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:21.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'282","reported_seq":390,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.924485+0000","last_change":"2024-05-08T18:08:55.543586+0000","last_active":"2024-05-08T18:12:02.924485+0000","last_peered":"2024-05-08T18:12:02.924485+0000","last_clean":"2024-05-08T18:12:02.924485+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:02.924485+0000","last_undegraded":"2024-05-08T18:12:02.924485+0000","last_fullsized":"2024-05-08T18:12:02.924485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.633075+0000","last_change":"2024-05-08T18:08:57.573590+0000","last_active":"2024-05-08T18:11:01.633075+0000","last_peered":"2024-05-08T18:11:01.633075+0000","last_clean":"2024-05-08T18:11:01.633075+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:11:01.633075+0000","last_undegraded":"2024-05-08T18:11:01.633075+0000","last_fullsized":"2024-05-08T18:11:01.633075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425042+0000","last_change":"2024-05-08T18:09:28.589121+0000","last_active":"2024-05-08T18:10:56.425042+0000","last_peered":"2024-05-08T18:10:56.425042+0000","last_clean":"2024-05-08T18:10:56.425042+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:10:56.425042+0000","last_undegraded":"2024-05-08T18:10:56.425042+0000","last_fullsized":"2024-05-08T18:10:56.425042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:55.349405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584979+0000","last_change":"2024-05-08T18:08:47.512221+0000","last_active":"2024-05-08T18:09:28.584979+0000","last_peered":"2024-05-08T18:09:28.584979+0000","last_clean":"2024-05-08T18:09:28.584979+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:09:28.584979+0000","last_undegraded":"2024-05-08T18:09:28.584979+0000","last_fullsized":"2024-05-08T18:09:28.584979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599261+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:09:28.599261+0000","last_peered":"2024-05-08T18:09:28.599261+0000","last_clean":"2024-05-08T18:09:28.599261+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:09:28.599261+0000","last_undegraded":"2024-05-08T18:09:28.599261+0000","last_fullsized":"2024-05-08T18:09:28.599261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:13.321704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589247+0000","last_change":"2024-05-08T18:08:51.510230+0000","last_active":"2024-05-08T18:09:28.589247+0000","last_peered":"2024-05-08T18:09:28.589247+0000","last_clean":"2024-05-08T18:09:28.589247+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:09:28.589247+0000","last_undegraded":"2024-05-08T18:09:28.589247+0000","last_fullsized":"2024-05-08T18:09:28.589247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:26.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":158,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.426469+0000","last_change":"2024-05-08T18:08:53.550482+0000","last_active":"2024-05-08T18:11:01.426469+0000","last_peered":"2024-05-08T18:11:01.426469+0000","last_clean":"2024-05-08T18:11:01.426469+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:11:01.426469+0000","last_undegraded":"2024-05-08T18:11:01.426469+0000","last_fullsized":"2024-05-08T18:11:01.426469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:48.461545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7721,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":87,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579744+0000","last_change":"2024-05-08T18:08:55.554634+0000","last_active":"2024-05-08T18:09:28.579744+0000","last_peered":"2024-05-08T18:09:28.579744+0000","last_clean":"2024-05-08T18:09:28.579744+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:09:28.579744+0000","last_undegraded":"2024-05-08T18:09:28.579744+0000","last_fullsized":"2024-05-08T18:09:28.579744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586328+0000","last_change":"2024-05-08T18:08:57.564366+0000","last_active":"2024-05-08T18:09:28.586328+0000","last_peered":"2024-05-08T18:09:28.586328+0000","last_clean":"2024-05-08T18:09:28.586328+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:09:28.586328+0000","last_undegraded":"2024-05-08T18:09:28.586328+0000","last_fullsized":"2024-05-08T18:09:28.586328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:12.274417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.585033+0000","last_change":"2024-05-08T18:08:57.586231+0000","last_active":"2024-05-08T18:09:28.585033+0000","last_peered":"2024-05-08T18:09:28.585033+0000","last_clean":"2024-05-08T18:09:28.585033+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:09:28.585033+0000","last_undegraded":"2024-05-08T18:09:28.585033+0000","last_fullsized":"2024-05-08T18:09:28.585033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:26.309299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391896+0000","last_change":"2024-05-08T18:08:49.517973+0000","last_active":"2024-05-08T18:12:02.391896+0000","last_peered":"2024-05-08T18:12:02.391896+0000","last_clean":"2024-05-08T18:12:02.391896+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:12:02.391896+0000","last_undegraded":"2024-05-08T18:12:02.391896+0000","last_fullsized":"2024-05-08T18:12:02.391896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593683+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:09:28.593683+0000","last_peered":"2024-05-08T18:09:28.593683+0000","last_clean":"2024-05-08T18:09:28.593683+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:09:28.593683+0000","last_undegraded":"2024-05-08T18:09:28.593683+0000","last_fullsized":"2024-05-08T18:09:28.593683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:09.399882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576250+0000","last_change":"2024-05-08T18:08:51.517003+0000","last_active":"2024-05-08T18:09:28.576250+0000","last_peered":"2024-05-08T18:09:28.576250+0000","last_clean":"2024-05-08T18:09:28.576250+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:09:28.576250+0000","last_undegraded":"2024-05-08T18:09:28.576250+0000","last_fullsized":"2024-05-08T18:09:28.576250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.213274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'32","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.587556+0000","last_change":"2024-05-08T18:08:53.546900+0000","last_active":"2024-05-08T18:10:59.587556+0000","last_peered":"2024-05-08T18:10:59.587556+0000","last_clean":"2024-05-08T18:10:59.587556+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:10:59.587556+0000","last_undegraded":"2024-05-08T18:10:59.587556+0000","last_fullsized":"2024-05-08T18:10:59.587556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:31.873538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588783+0000","last_change":"2024-05-08T18:08:55.558807+0000","last_active":"2024-05-08T18:09:28.588783+0000","last_peered":"2024-05-08T18:09:28.588783+0000","last_clean":"2024-05-08T18:09:28.588783+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:09:28.588783+0000","last_undegraded":"2024-05-08T18:09:28.588783+0000","last_fullsized":"2024-05-08T18:09:28.588783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:28.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.395796+0000","last_change":"2024-05-08T18:08:57.554621+0000","last_active":"2024-05-08T18:12:02.395796+0000","last_peered":"2024-05-08T18:12:02.395796+0000","last_clean":"2024-05-08T18:12:02.395796+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:02.395796+0000","last_undegraded":"2024-05-08T18:12:02.395796+0000","last_fullsized":"2024-05-08T18:12:02.395796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:36.523989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392595+0000","last_change":"2024-05-08T18:08:49.515316+0000","last_active":"2024-05-08T18:12:02.392595+0000","last_peered":"2024-05-08T18:12:02.392595+0000","last_clean":"2024-05-08T18:12:02.392595+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:02.392595+0000","last_undegraded":"2024-05-08T18:12:02.392595+0000","last_fullsized":"2024-05-08T18:12:02.392595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430491+0000","last_change":"2024-05-08T18:08:47.514514+0000","last_active":"2024-05-08T18:11:16.430491+0000","last_peered":"2024-05-08T18:11:16.430491+0000","last_clean":"2024-05-08T18:11:16.430491+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:11:16.430491+0000","last_undegraded":"2024-05-08T18:11:16.430491+0000","last_fullsized":"2024-05-08T18:11:16.430491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603376+0000","last_change":"2024-05-08T18:08:51.510753+0000","last_active":"2024-05-08T18:09:28.603376+0000","last_peered":"2024-05-08T18:09:28.603376+0000","last_clean":"2024-05-08T18:09:28.603376+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:09:28.603376+0000","last_undegraded":"2024-05-08T18:09:28.603376+0000","last_fullsized":"2024-05-08T18:09:28.603376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:41.695717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.670842+0000","last_change":"2024-05-08T18:08:53.524878+0000","last_active":"2024-05-08T18:12:01.670842+0000","last_peered":"2024-05-08T18:12:01.670842+0000","last_clean":"2024-05-08T18:12:01.670842+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:01.670842+0000","last_undegraded":"2024-05-08T18:12:01.670842+0000","last_fullsized":"2024-05-08T18:12:01.670842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:40.829168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580812+0000","last_change":"2024-05-08T18:08:55.565178+0000","last_active":"2024-05-08T18:09:28.580812+0000","last_peered":"2024-05-08T18:09:28.580812+0000","last_clean":"2024-05-08T18:09:28.580812+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:09:28.580812+0000","last_undegraded":"2024-05-08T18:09:28.580812+0000","last_fullsized":"2024-05-08T18:09:28.580812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:05.564412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578264+0000","last_change":"2024-05-08T18:08:57.565323+0000","last_active":"2024-05-08T18:09:28.578264+0000","last_peered":"2024-05-08T18:09:28.578264+0000","last_clean":"2024-05-08T18:09:28.578264+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:09:28.578264+0000","last_undegraded":"2024-05-08T18:09:28.578264+0000","last_fullsized":"2024-05-08T18:09:28.578264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:04.648587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755243+0000","last_change":"2024-05-08T18:08:49.506944+0000","last_active":"2024-05-08T18:12:02.755243+0000","last_peered":"2024-05-08T18:12:02.755243+0000","last_clean":"2024-05-08T18:12:02.755243+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:02.755243+0000","last_undegraded":"2024-05-08T18:12:02.755243+0000","last_fullsized":"2024-05-08T18:12:02.755243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591593+0000","last_change":"2024-05-08T18:08:47.513365+0000","last_active":"2024-05-08T18:09:28.591593+0000","last_peered":"2024-05-08T18:09:28.591593+0000","last_clean":"2024-05-08T18:09:28.591593+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:09:28.591593+0000","last_undegraded":"2024-05-08T18:09:28.591593+0000","last_fullsized":"2024-05-08T18:09:28.591593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578971+0000","last_change":"2024-05-08T18:08:51.521427+0000","last_active":"2024-05-08T18:09:28.578971+0000","last_peered":"2024-05-08T18:09:28.578971+0000","last_clean":"2024-05-08T18:09:28.578971+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:09:28.578971+0000","last_undegraded":"2024-05-08T18:09:28.578971+0000","last_fullsized":"2024-05-08T18:09:28.578971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:32.182561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'40","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.761960+0000","last_change":"2024-05-08T18:08:53.517027+0000","last_active":"2024-05-08T18:12:01.761960+0000","last_peered":"2024-05-08T18:12:01.761960+0000","last_clean":"2024-05-08T18:12:01.761960+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:01.761960+0000","last_undegraded":"2024-05-08T18:12:01.761960+0000","last_fullsized":"2024-05-08T18:12:01.761960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:22.586335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572557+0000","last_change":"2024-05-08T18:08:55.556729+0000","last_active":"2024-05-08T18:09:28.572557+0000","last_peered":"2024-05-08T18:09:28.572557+0000","last_clean":"2024-05-08T18:09:28.572557+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:09:28.572557+0000","last_undegraded":"2024-05-08T18:09:28.572557+0000","last_fullsized":"2024-05-08T18:09:28.572557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597437+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:09:28.597437+0000","last_peered":"2024-05-08T18:09:28.597437+0000","last_clean":"2024-05-08T18:09:28.597437+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:09:28.597437+0000","last_undegraded":"2024-05-08T18:09:28.597437+0000","last_fullsized":"2024-05-08T18:09:28.597437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:48.822666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'17","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.269318+0000","last_change":"2024-05-08T18:08:49.512382+0000","last_active":"2024-05-08T18:12:02.269318+0000","last_peered":"2024-05-08T18:12:02.269318+0000","last_clean":"2024-05-08T18:12:02.269318+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:02.269318+0000","last_undegraded":"2024-05-08T18:12:02.269318+0000","last_fullsized":"2024-05-08T18:12:02.269318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.812761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.742937+0000","last_change":"2024-05-08T18:08:47.495539+0000","last_active":"2024-05-08T18:12:02.742937+0000","last_peered":"2024-05-08T18:12:02.742937+0000","last_clean":"2024-05-08T18:12:02.742937+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:12:02.742937+0000","last_undegraded":"2024-05-08T18:12:02.742937+0000","last_fullsized":"2024-05-08T18:12:02.742937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592581+0000","last_change":"2024-05-08T18:08:51.502037+0000","last_active":"2024-05-08T18:09:28.592581+0000","last_peered":"2024-05-08T18:09:28.592581+0000","last_clean":"2024-05-08T18:09:28.592581+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:09:28.592581+0000","last_undegraded":"2024-05-08T18:09:28.592581+0000","last_fullsized":"2024-05-08T18:09:28.592581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:20.268773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.567089+0000","last_change":"2024-05-08T18:08:53.521376+0000","last_active":"2024-05-08T18:10:59.567089+0000","last_peered":"2024-05-08T18:10:59.567089+0000","last_clean":"2024-05-08T18:10:59.567089+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:10:59.567089+0000","last_undegraded":"2024-05-08T18:10:59.567089+0000","last_fullsized":"2024-05-08T18:10:59.567089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:32.004417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580450+0000","last_change":"2024-05-08T18:08:55.546548+0000","last_active":"2024-05-08T18:09:28.580450+0000","last_peered":"2024-05-08T18:09:28.580450+0000","last_clean":"2024-05-08T18:09:28.580450+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:09:28.580450+0000","last_undegraded":"2024-05-08T18:09:28.580450+0000","last_fullsized":"2024-05-08T18:09:28.580450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:18.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.491598+0000","last_change":"2024-05-08T18:08:49.510714+0000","last_active":"2024-05-08T18:10:16.491598+0000","last_peered":"2024-05-08T18:10:16.491598+0000","last_clean":"2024-05-08T18:10:16.491598+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:10:16.491598+0000","last_undegraded":"2024-05-08T18:10:16.491598+0000","last_fullsized":"2024-05-08T18:10:16.491598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:41.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.893083+0000","last_change":"2024-05-08T18:08:47.516678+0000","last_active":"2024-05-08T18:09:31.893083+0000","last_peered":"2024-05-08T18:09:31.893083+0000","last_clean":"2024-05-08T18:09:31.893083+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:09:31.893083+0000","last_undegraded":"2024-05-08T18:09:31.893083+0000","last_fullsized":"2024-05-08T18:09:31.893083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:38.680445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584360+0000","last_change":"2024-05-08T18:08:51.511759+0000","last_active":"2024-05-08T18:09:28.584360+0000","last_peered":"2024-05-08T18:09:28.584360+0000","last_clean":"2024-05-08T18:09:28.584360+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:09:28.584360+0000","last_undegraded":"2024-05-08T18:09:28.584360+0000","last_fullsized":"2024-05-08T18:09:28.584360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'54","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.597073+0000","last_change":"2024-05-08T18:08:53.525502+0000","last_active":"2024-05-08T18:10:59.597073+0000","last_peered":"2024-05-08T18:10:59.597073+0000","last_clean":"2024-05-08T18:10:59.597073+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:10:59.597073+0000","last_undegraded":"2024-05-08T18:10:59.597073+0000","last_fullsized":"2024-05-08T18:10:59.597073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:21.841040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584718+0000","last_change":"2024-05-08T18:08:55.547190+0000","last_active":"2024-05-08T18:09:28.584718+0000","last_peered":"2024-05-08T18:09:28.584718+0000","last_clean":"2024-05-08T18:09:28.584718+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:09:28.584718+0000","last_undegraded":"2024-05-08T18:09:28.584718+0000","last_fullsized":"2024-05-08T18:09:28.584718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:41.115717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.484509+0000","last_change":"2024-05-08T18:08:57.565259+0000","last_active":"2024-05-08T18:11:01.484509+0000","last_peered":"2024-05-08T18:11:01.484509+0000","last_clean":"2024-05-08T18:11:01.484509+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:11:01.484509+0000","last_undegraded":"2024-05-08T18:11:01.484509+0000","last_fullsized":"2024-05-08T18:11:01.484509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.143663+0000","last_change":"2024-05-08T18:08:49.500137+0000","last_active":"2024-05-08T18:09:34.143663+0000","last_peered":"2024-05-08T18:09:34.143663+0000","last_clean":"2024-05-08T18:09:34.143663+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:09:34.143663+0000","last_undegraded":"2024-05-08T18:09:34.143663+0000","last_fullsized":"2024-05-08T18:09:34.143663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571914+0000","last_change":"2024-05-08T18:08:47.514529+0000","last_active":"2024-05-08T18:09:28.571914+0000","last_peered":"2024-05-08T18:09:28.571914+0000","last_clean":"2024-05-08T18:09:28.571914+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:09:28.571914+0000","last_undegraded":"2024-05-08T18:09:28.571914+0000","last_fullsized":"2024-05-08T18:09:28.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589371+0000","last_change":"2024-05-08T18:08:51.508583+0000","last_active":"2024-05-08T18:09:28.589371+0000","last_peered":"2024-05-08T18:09:28.589371+0000","last_clean":"2024-05-08T18:09:28.589371+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:09:28.589371+0000","last_undegraded":"2024-05-08T18:09:28.589371+0000","last_fullsized":"2024-05-08T18:09:28.589371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:08.838007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.568180+0000","last_change":"2024-05-08T18:08:53.547333+0000","last_active":"2024-05-08T18:10:59.568180+0000","last_peered":"2024-05-08T18:10:59.568180+0000","last_clean":"2024-05-08T18:10:59.568180+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:10:59.568180+0000","last_undegraded":"2024-05-08T18:10:59.568180+0000","last_fullsized":"2024-05-08T18:10:59.568180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:19.951491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574072+0000","last_change":"2024-05-08T18:08:55.565939+0000","last_active":"2024-05-08T18:09:28.574072+0000","last_peered":"2024-05-08T18:09:28.574072+0000","last_clean":"2024-05-08T18:09:28.574072+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:09:28.574072+0000","last_undegraded":"2024-05-08T18:09:28.574072+0000","last_fullsized":"2024-05-08T18:09:28.574072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592447+0000","last_change":"2024-05-08T18:08:57.553775+0000","last_active":"2024-05-08T18:09:28.592447+0000","last_peered":"2024-05-08T18:09:28.592447+0000","last_clean":"2024-05-08T18:09:28.592447+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:09:28.592447+0000","last_undegraded":"2024-05-08T18:09:28.592447+0000","last_fullsized":"2024-05-08T18:09:28.592447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:06.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597284+0000","last_change":"2024-05-08T18:08:49.514883+0000","last_active":"2024-05-08T18:12:02.597284+0000","last_peered":"2024-05-08T18:12:02.597284+0000","last_clean":"2024-05-08T18:12:02.597284+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:02.597284+0000","last_undegraded":"2024-05-08T18:12:02.597284+0000","last_fullsized":"2024-05-08T18:12:02.597284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:37.616434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572752+0000","last_change":"2024-05-08T18:08:47.519395+0000","last_active":"2024-05-08T18:09:28.572752+0000","last_peered":"2024-05-08T18:09:28.572752+0000","last_clean":"2024-05-08T18:09:28.572752+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:09:28.572752+0000","last_undegraded":"2024-05-08T18:09:28.572752+0000","last_fullsized":"2024-05-08T18:09:28.572752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.596279+0000","last_change":"2024-05-08T18:09:28.594515+0000","last_active":"2024-05-08T18:09:28.596279+0000","last_peered":"2024-05-08T18:09:28.596279+0000","last_clean":"2024-05-08T18:09:28.596279+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:09:28.596279+0000","last_undegraded":"2024-05-08T18:09:28.596279+0000","last_fullsized":"2024-05-08T18:09:28.596279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:46.308954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'34","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.593776+0000","last_change":"2024-05-08T18:08:53.515915+0000","last_active":"2024-05-08T18:10:59.593776+0000","last_peered":"2024-05-08T18:10:59.593776+0000","last_clean":"2024-05-08T18:10:59.593776+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:10:59.593776+0000","last_undegraded":"2024-05-08T18:10:59.593776+0000","last_fullsized":"2024-05-08T18:10:59.593776+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:06.840324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578824+0000","last_change":"2024-05-08T18:08:55.554524+0000","last_active":"2024-05-08T18:09:28.578824+0000","last_peered":"2024-05-08T18:09:28.578824+0000","last_clean":"2024-05-08T18:09:28.578824+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:09:28.578824+0000","last_undegraded":"2024-05-08T18:09:28.578824+0000","last_fullsized":"2024-05-08T18:09:28.578824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.628108+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:01.628108+0000","last_peered":"2024-05-08T18:11:01.628108+0000","last_clean":"2024-05-08T18:11:01.628108+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:01.628108+0000","last_undegraded":"2024-05-08T18:11:01.628108+0000","last_fullsized":"2024-05-08T18:11:01.628108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:07.709412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755239+0000","last_change":"2024-05-08T18:08:49.494211+0000","last_active":"2024-05-08T18:12:02.755239+0000","last_peered":"2024-05-08T18:12:02.755239+0000","last_clean":"2024-05-08T18:12:02.755239+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:02.755239+0000","last_undegraded":"2024-05-08T18:12:02.755239+0000","last_fullsized":"2024-05-08T18:12:02.755239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.435190+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:09:33.435190+0000","last_peered":"2024-05-08T18:09:33.435190+0000","last_clean":"2024-05-08T18:09:33.435190+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:09:33.435190+0000","last_undegraded":"2024-05-08T18:09:33.435190+0000","last_fullsized":"2024-05-08T18:09:33.435190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:44.062312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'4","reported_seq":226,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.108918+0000","last_change":"2024-05-08T18:08:51.520425+0000","last_active":"2024-05-08T18:11:01.108918+0000","last_peered":"2024-05-08T18:11:01.108918+0000","last_clean":"2024-05-08T18:11:01.108918+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:11:01.108918+0000","last_undegraded":"2024-05-08T18:11:01.108918+0000","last_fullsized":"2024-05-08T18:11:01.108918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:44.630963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602335+0000","last_change":"2024-05-08T18:08:53.555586+0000","last_active":"2024-05-08T18:09:28.602335+0000","last_peered":"2024-05-08T18:09:28.602335+0000","last_clean":"2024-05-08T18:09:28.602335+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:09:28.602335+0000","last_undegraded":"2024-05-08T18:09:28.602335+0000","last_fullsized":"2024-05-08T18:09:28.602335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:12.189650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'282","reported_seq":407,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754623+0000","last_change":"2024-05-08T18:08:55.549323+0000","last_active":"2024-05-08T18:12:01.754623+0000","last_peered":"2024-05-08T18:12:01.754623+0000","last_clean":"2024-05-08T18:12:01.754623+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:01.754623+0000","last_undegraded":"2024-05-08T18:12:01.754623+0000","last_fullsized":"2024-05-08T18:12:01.754623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:43.656689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.446010+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:10:57.446010+0000","last_peered":"2024-05-08T18:10:57.446010+0000","last_clean":"2024-05-08T18:10:57.446010+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:10:57.446010+0000","last_undegraded":"2024-05-08T18:10:57.446010+0000","last_fullsized":"2024-05-08T18:10:57.446010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:56.783174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755627+0000","last_change":"2024-05-08T18:08:49.492567+0000","last_active":"2024-05-08T18:12:02.755627+0000","last_peered":"2024-05-08T18:12:02.755627+0000","last_clean":"2024-05-08T18:12:02.755627+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:02.755627+0000","last_undegraded":"2024-05-08T18:12:02.755627+0000","last_fullsized":"2024-05-08T18:12:02.755627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:32.167217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576478+0000","last_change":"2024-05-08T18:08:47.491784+0000","last_active":"2024-05-08T18:09:28.576478+0000","last_peered":"2024-05-08T18:09:28.576478+0000","last_clean":"2024-05-08T18:09:28.576478+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:09:28.576478+0000","last_undegraded":"2024-05-08T18:09:28.576478+0000","last_fullsized":"2024-05-08T18:09:28.576478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575218+0000","last_change":"2024-05-08T18:08:51.521020+0000","last_active":"2024-05-08T18:09:28.575218+0000","last_peered":"2024-05-08T18:09:28.575218+0000","last_clean":"2024-05-08T18:09:28.575218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:09:28.575218+0000","last_undegraded":"2024-05-08T18:09:28.575218+0000","last_fullsized":"2024-05-08T18:09:28.575218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:46.447955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.554181+0000","last_change":"2024-05-08T18:08:53.521741+0000","last_active":"2024-05-08T18:10:59.554181+0000","last_peered":"2024-05-08T18:10:59.554181+0000","last_clean":"2024-05-08T18:10:59.554181+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:10:59.554181+0000","last_undegraded":"2024-05-08T18:10:59.554181+0000","last_fullsized":"2024-05-08T18:10:59.554181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:03.551719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576295+0000","last_change":"2024-05-08T18:08:55.542837+0000","last_active":"2024-05-08T18:09:28.576295+0000","last_peered":"2024-05-08T18:09:28.576295+0000","last_clean":"2024-05-08T18:09:28.576295+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:09:28.576295+0000","last_undegraded":"2024-05-08T18:09:28.576295+0000","last_fullsized":"2024-05-08T18:09:28.576295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:11.110077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.653210+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:09:32.653210+0000","last_peered":"2024-05-08T18:09:32.653210+0000","last_clean":"2024-05-08T18:09:32.653210+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:09:32.653210+0000","last_undegraded":"2024-05-08T18:09:32.653210+0000","last_fullsized":"2024-05-08T18:09:32.653210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106581+0000","last_change":"2024-05-08T18:08:49.493842+0000","last_active":"2024-05-08T18:09:33.106581+0000","last_peered":"2024-05-08T18:09:33.106581+0000","last_clean":"2024-05-08T18:09:33.106581+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:09:33.106581+0000","last_undegraded":"2024-05-08T18:09:33.106581+0000","last_fullsized":"2024-05-08T18:09:33.106581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.575041+0000","last_change":"2024-05-08T18:08:47.528745+0000","last_active":"2024-05-08T18:11:01.575041+0000","last_peered":"2024-05-08T18:11:01.575041+0000","last_clean":"2024-05-08T18:11:01.575041+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:11:01.575041+0000","last_undegraded":"2024-05-08T18:11:01.575041+0000","last_fullsized":"2024-05-08T18:11:01.575041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:48.149891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583711+0000","last_change":"2024-05-08T18:08:51.507416+0000","last_active":"2024-05-08T18:09:28.583711+0000","last_peered":"2024-05-08T18:09:28.583711+0000","last_clean":"2024-05-08T18:09:28.583711+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:09:28.583711+0000","last_undegraded":"2024-05-08T18:09:28.583711+0000","last_fullsized":"2024-05-08T18:09:28.583711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:22.734601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.557316+0000","last_change":"2024-05-08T18:08:53.539793+0000","last_active":"2024-05-08T18:10:59.557316+0000","last_peered":"2024-05-08T18:10:59.557316+0000","last_clean":"2024-05-08T18:10:59.557316+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:10:59.557316+0000","last_undegraded":"2024-05-08T18:10:59.557316+0000","last_fullsized":"2024-05-08T18:10:59.557316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:09.466170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591164+0000","last_change":"2024-05-08T18:08:55.558593+0000","last_active":"2024-05-08T18:09:28.591164+0000","last_peered":"2024-05-08T18:09:28.591164+0000","last_clean":"2024-05-08T18:09:28.591164+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:09:28.591164+0000","last_undegraded":"2024-05-08T18:09:28.591164+0000","last_fullsized":"2024-05-08T18:09:28.591164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:20.041348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597627+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:09:28.597627+0000","last_peered":"2024-05-08T18:09:28.597627+0000","last_clean":"2024-05-08T18:09:28.597627+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:09:28.597627+0000","last_undegraded":"2024-05-08T18:09:28.597627+0000","last_fullsized":"2024-05-08T18:09:28.597627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:45.231457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391535+0000","last_change":"2024-05-08T18:08:49.512357+0000","last_active":"2024-05-08T18:12:02.391535+0000","last_peered":"2024-05-08T18:12:02.391535+0000","last_clean":"2024-05-08T18:12:02.391535+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:02.391535+0000","last_undegraded":"2024-05-08T18:12:02.391535+0000","last_fullsized":"2024-05-08T18:12:02.391535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.801605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.616390+0000","last_change":"2024-05-08T18:08:47.517076+0000","last_active":"2024-05-08T18:09:32.616390+0000","last_peered":"2024-05-08T18:09:32.616390+0000","last_clean":"2024-05-08T18:09:32.616390+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:09:32.616390+0000","last_undegraded":"2024-05-08T18:09:32.616390+0000","last_fullsized":"2024-05-08T18:09:32.616390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:16.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573625+0000","last_change":"2024-05-08T18:08:51.522287+0000","last_active":"2024-05-08T18:09:28.573625+0000","last_peered":"2024-05-08T18:09:28.573625+0000","last_clean":"2024-05-08T18:09:28.573625+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:09:28.573625+0000","last_undegraded":"2024-05-08T18:09:28.573625+0000","last_fullsized":"2024-05-08T18:09:28.573625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'26","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.590133+0000","last_change":"2024-05-08T18:08:53.555489+0000","last_active":"2024-05-08T18:10:59.590133+0000","last_peered":"2024-05-08T18:10:59.590133+0000","last_clean":"2024-05-08T18:10:59.590133+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:10:59.590133+0000","last_undegraded":"2024-05-08T18:10:59.590133+0000","last_fullsized":"2024-05-08T18:10:59.590133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.464298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593054+0000","last_change":"2024-05-08T18:08:55.564029+0000","last_active":"2024-05-08T18:09:28.593054+0000","last_peered":"2024-05-08T18:09:28.593054+0000","last_clean":"2024-05-08T18:09:28.593054+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:09:28.593054+0000","last_undegraded":"2024-05-08T18:09:28.593054+0000","last_fullsized":"2024-05-08T18:09:28.593054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:00.158035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.605714+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:10:59.605714+0000","last_peered":"2024-05-08T18:10:59.605714+0000","last_clean":"2024-05-08T18:10:59.605714+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:10:59.605714+0000","last_undegraded":"2024-05-08T18:10:59.605714+0000","last_fullsized":"2024-05-08T18:10:59.605714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:41:06.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658006+0000","last_change":"2024-05-08T18:08:49.492218+0000","last_active":"2024-05-08T18:09:32.658006+0000","last_peered":"2024-05-08T18:09:32.658006+0000","last_clean":"2024-05-08T18:09:32.658006+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:09:32.658006+0000","last_undegraded":"2024-05-08T18:09:32.658006+0000","last_fullsized":"2024-05-08T18:09:32.658006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:46.076624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.576608+0000","last_change":"2024-05-08T18:08:47.498035+0000","last_active":"2024-05-08T18:12:02.576608+0000","last_peered":"2024-05-08T18:12:02.576608+0000","last_clean":"2024-05-08T18:12:02.576608+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:12:02.576608+0000","last_undegraded":"2024-05-08T18:12:02.576608+0000","last_fullsized":"2024-05-08T18:12:02.576608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":220,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.122142+0000","last_change":"2024-05-08T18:08:51.513601+0000","last_active":"2024-05-08T18:11:01.122142+0000","last_peered":"2024-05-08T18:11:01.122142+0000","last_clean":"2024-05-08T18:11:01.122142+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:11:01.122142+0000","last_undegraded":"2024-05-08T18:11:01.122142+0000","last_fullsized":"2024-05-08T18:11:01.122142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:52.312237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.672936+0000","last_change":"2024-05-08T18:08:53.547362+0000","last_active":"2024-05-08T18:12:01.672936+0000","last_peered":"2024-05-08T18:12:01.672936+0000","last_clean":"2024-05-08T18:12:01.672936+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:01.672936+0000","last_undegraded":"2024-05-08T18:12:01.672936+0000","last_fullsized":"2024-05-08T18:12:01.672936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:18.076232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580054+0000","last_change":"2024-05-08T18:08:55.546216+0000","last_active":"2024-05-08T18:09:28.580054+0000","last_peered":"2024-05-08T18:09:28.580054+0000","last_clean":"2024-05-08T18:09:28.580054+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:09:28.580054+0000","last_undegraded":"2024-05-08T18:09:28.580054+0000","last_fullsized":"2024-05-08T18:09:28.580054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.609546+0000","last_change":"2024-05-08T18:08:57.560370+0000","last_active":"2024-05-08T18:10:59.609546+0000","last_peered":"2024-05-08T18:10:59.609546+0000","last_clean":"2024-05-08T18:10:59.609546+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:10:59.609546+0000","last_undegraded":"2024-05-08T18:10:59.609546+0000","last_fullsized":"2024-05-08T18:10:59.609546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:35.794410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490224+0000","last_change":"2024-05-08T18:08:49.513755+0000","last_active":"2024-05-08T18:10:16.490224+0000","last_peered":"2024-05-08T18:10:16.490224+0000","last_clean":"2024-05-08T18:10:16.490224+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:10:16.490224+0000","last_undegraded":"2024-05-08T18:10:16.490224+0000","last_fullsized":"2024-05-08T18:10:16.490224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:12.911502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576973+0000","last_change":"2024-05-08T18:08:47.510817+0000","last_active":"2024-05-08T18:09:28.576973+0000","last_peered":"2024-05-08T18:09:28.576973+0000","last_clean":"2024-05-08T18:09:28.576973+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:09:28.576973+0000","last_undegraded":"2024-05-08T18:09:28.576973+0000","last_fullsized":"2024-05-08T18:09:28.576973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.419152+0000","last_change":"2024-05-08T18:08:49.494065+0000","last_active":"2024-05-08T18:11:01.419152+0000","last_peered":"2024-05-08T18:11:01.419152+0000","last_clean":"2024-05-08T18:11:01.419152+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:11:01.419152+0000","last_undegraded":"2024-05-08T18:11:01.419152+0000","last_fullsized":"2024-05-08T18:11:01.419152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417623+0000","last_change":"2024-05-08T18:08:47.496722+0000","last_active":"2024-05-08T18:10:56.417623+0000","last_peered":"2024-05-08T18:10:56.417623+0000","last_clean":"2024-05-08T18:10:56.417623+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:10:56.417623+0000","last_undegraded":"2024-05-08T18:10:56.417623+0000","last_fullsized":"2024-05-08T18:10:56.417623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689939+0000","last_change":"2024-05-08T18:08:49.513141+0000","last_active":"2024-05-08T18:12:02.689939+0000","last_peered":"2024-05-08T18:12:02.689939+0000","last_clean":"2024-05-08T18:12:02.689939+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:02.689939+0000","last_undegraded":"2024-05-08T18:12:02.689939+0000","last_fullsized":"2024-05-08T18:12:02.689939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:05.438608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593736+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:09:28.593736+0000","last_peered":"2024-05-08T18:09:28.593736+0000","last_clean":"2024-05-08T18:09:28.593736+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:09:28.593736+0000","last_undegraded":"2024-05-08T18:09:28.593736+0000","last_fullsized":"2024-05-08T18:09:28.593736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:49.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.268349+0000","last_change":"2024-05-08T18:08:49.494261+0000","last_active":"2024-05-08T18:12:02.268349+0000","last_peered":"2024-05-08T18:12:02.268349+0000","last_clean":"2024-05-08T18:12:02.268349+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:02.268349+0000","last_undegraded":"2024-05-08T18:12:02.268349+0000","last_fullsized":"2024-05-08T18:12:02.268349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.584121+0000","last_change":"2024-05-08T18:08:47.515649+0000","last_active":"2024-05-08T18:12:02.584121+0000","last_peered":"2024-05-08T18:12:02.584121+0000","last_clean":"2024-05-08T18:12:02.584121+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:02.584121+0000","last_undegraded":"2024-05-08T18:12:02.584121+0000","last_fullsized":"2024-05-08T18:12:02.584121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'3","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270740+0000","last_change":"2024-05-08T18:08:49.519128+0000","last_active":"2024-05-08T18:12:02.270740+0000","last_peered":"2024-05-08T18:12:02.270740+0000","last_clean":"2024-05-08T18:12:02.270740+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:02.270740+0000","last_undegraded":"2024-05-08T18:12:02.270740+0000","last_fullsized":"2024-05-08T18:12:02.270740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.190876+0000","last_change":"2024-05-08T18:08:47.497513+0000","last_active":"2024-05-08T18:12:02.190876+0000","last_peered":"2024-05-08T18:12:02.190876+0000","last_clean":"2024-05-08T18:12:02.190876+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:12:02.190876+0000","last_undegraded":"2024-05-08T18:12:02.190876+0000","last_fullsized":"2024-05-08T18:12:02.190876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706315+0000","last_change":"2024-05-08T18:08:49.518071+0000","last_active":"2024-05-08T18:12:02.706315+0000","last_peered":"2024-05-08T18:12:02.706315+0000","last_clean":"2024-05-08T18:12:02.706315+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:02.706315+0000","last_undegraded":"2024-05-08T18:12:02.706315+0000","last_fullsized":"2024-05-08T18:12:02.706315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:20.720628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574630+0000","last_change":"2024-05-08T18:08:47.512086+0000","last_active":"2024-05-08T18:09:28.574630+0000","last_peered":"2024-05-08T18:09:28.574630+0000","last_clean":"2024-05-08T18:09:28.574630+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:09:28.574630+0000","last_undegraded":"2024-05-08T18:09:28.574630+0000","last_fullsized":"2024-05-08T18:09:28.574630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390792+0000","last_change":"2024-05-08T18:08:49.497455+0000","last_active":"2024-05-08T18:12:02.390792+0000","last_peered":"2024-05-08T18:12:02.390792+0000","last_clean":"2024-05-08T18:12:02.390792+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:02.390792+0000","last_undegraded":"2024-05-08T18:12:02.390792+0000","last_fullsized":"2024-05-08T18:12:02.390792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594186+0000","last_change":"2024-05-08T18:08:47.514190+0000","last_active":"2024-05-08T18:09:28.594186+0000","last_peered":"2024-05-08T18:09:28.594186+0000","last_clean":"2024-05-08T18:09:28.594186+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:09:28.594186+0000","last_undegraded":"2024-05-08T18:09:28.594186+0000","last_fullsized":"2024-05-08T18:09:28.594186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599228+0000","last_change":"2024-05-08T18:08:49.495860+0000","last_active":"2024-05-08T18:12:02.599228+0000","last_peered":"2024-05-08T18:12:02.599228+0000","last_clean":"2024-05-08T18:12:02.599228+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:02.599228+0000","last_undegraded":"2024-05-08T18:12:02.599228+0000","last_fullsized":"2024-05-08T18:12:02.599228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580203+0000","last_change":"2024-05-08T18:08:47.515080+0000","last_active":"2024-05-08T18:09:28.580203+0000","last_peered":"2024-05-08T18:09:28.580203+0000","last_clean":"2024-05-08T18:09:28.580203+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:09:28.580203+0000","last_undegraded":"2024-05-08T18:09:28.580203+0000","last_fullsized":"2024-05-08T18:09:28.580203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.479725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640668+0000","last_change":"2024-05-08T18:08:49.498817+0000","last_active":"2024-05-08T18:11:01.640668+0000","last_peered":"2024-05-08T18:11:01.640668+0000","last_clean":"2024-05-08T18:11:01.640668+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:11:01.640668+0000","last_undegraded":"2024-05-08T18:11:01.640668+0000","last_fullsized":"2024-05-08T18:11:01.640668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:19.437499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587366+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:09:28.587366+0000","last_peered":"2024-05-08T18:09:28.587366+0000","last_clean":"2024-05-08T18:09:28.587366+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:09:28.587366+0000","last_undegraded":"2024-05-08T18:09:28.587366+0000","last_fullsized":"2024-05-08T18:09:28.587366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:29.150400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.690148+0000","last_change":"2024-05-08T18:08:49.514593+0000","last_active":"2024-05-08T18:12:02.690148+0000","last_peered":"2024-05-08T18:12:02.690148+0000","last_clean":"2024-05-08T18:12:02.690148+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:02.690148+0000","last_undegraded":"2024-05-08T18:12:02.690148+0000","last_fullsized":"2024-05-08T18:12:02.690148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:59.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576899+0000","last_change":"2024-05-08T18:08:47.515074+0000","last_active":"2024-05-08T18:09:28.576899+0000","last_peered":"2024-05-08T18:09:28.576899+0000","last_clean":"2024-05-08T18:09:28.576899+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:09:28.576899+0000","last_undegraded":"2024-05-08T18:09:28.576899+0000","last_fullsized":"2024-05-08T18:09:28.576899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391996+0000","last_change":"2024-05-08T18:08:49.516189+0000","last_active":"2024-05-08T18:12:02.391996+0000","last_peered":"2024-05-08T18:12:02.391996+0000","last_clean":"2024-05-08T18:12:02.391996+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:02.391996+0000","last_undegraded":"2024-05-08T18:12:02.391996+0000","last_fullsized":"2024-05-08T18:12:02.391996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573546+0000","last_change":"2024-05-08T18:08:47.525612+0000","last_active":"2024-05-08T18:09:28.573546+0000","last_peered":"2024-05-08T18:09:28.573546+0000","last_clean":"2024-05-08T18:09:28.573546+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:09:28.573546+0000","last_undegraded":"2024-05-08T18:09:28.573546+0000","last_fullsized":"2024-05-08T18:09:28.573546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390438+0000","last_change":"2024-05-08T18:08:49.496733+0000","last_active":"2024-05-08T18:12:02.390438+0000","last_peered":"2024-05-08T18:12:02.390438+0000","last_clean":"2024-05-08T18:12:02.390438+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:02.390438+0000","last_undegraded":"2024-05-08T18:12:02.390438+0000","last_fullsized":"2024-05-08T18:12:02.390438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573307+0000","last_change":"2024-05-08T18:08:47.513204+0000","last_active":"2024-05-08T18:09:28.573307+0000","last_peered":"2024-05-08T18:09:28.573307+0000","last_clean":"2024-05-08T18:09:28.573307+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:09:28.573307+0000","last_undegraded":"2024-05-08T18:09:28.573307+0000","last_fullsized":"2024-05-08T18:09:28.573307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490742+0000","last_change":"2024-05-08T18:08:49.519642+0000","last_active":"2024-05-08T18:10:16.490742+0000","last_peered":"2024-05-08T18:10:16.490742+0000","last_clean":"2024-05-08T18:10:16.490742+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:10:16.490742+0000","last_undegraded":"2024-05-08T18:10:16.490742+0000","last_fullsized":"2024-05-08T18:10:16.490742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.551432+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.551432+0000","last_peered":"2024-05-08T18:12:02.551432+0000","last_clean":"2024-05-08T18:12:02.551432+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.551432+0000","last_undegraded":"2024-05-08T18:12:02.551432+0000","last_fullsized":"2024-05-08T18:12:02.551432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:15.066942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640294+0000","last_change":"2024-05-08T18:08:49.499082+0000","last_active":"2024-05-08T18:11:01.640294+0000","last_peered":"2024-05-08T18:11:01.640294+0000","last_clean":"2024-05-08T18:11:01.640294+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:11:01.640294+0000","last_undegraded":"2024-05-08T18:11:01.640294+0000","last_fullsized":"2024-05-08T18:11:01.640294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:02.112670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599094+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:09:28.599094+0000","last_peered":"2024-05-08T18:09:28.599094+0000","last_clean":"2024-05-08T18:09:28.599094+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:09:28.599094+0000","last_undegraded":"2024-05-08T18:09:28.599094+0000","last_fullsized":"2024-05-08T18:09:28.599094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.626603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602483+0000","last_change":"2024-05-08T18:08:49.507865+0000","last_active":"2024-05-08T18:09:28.602483+0000","last_peered":"2024-05-08T18:09:28.602483+0000","last_clean":"2024-05-08T18:09:28.602483+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:09:28.602483+0000","last_undegraded":"2024-05-08T18:09:28.602483+0000","last_fullsized":"2024-05-08T18:09:28.602483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:42.616990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.559608+0000","last_change":"2024-05-08T18:08:47.519469+0000","last_active":"2024-05-08T18:12:02.559608+0000","last_peered":"2024-05-08T18:12:02.559608+0000","last_clean":"2024-05-08T18:12:02.559608+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:02.559608+0000","last_undegraded":"2024-05-08T18:12:02.559608+0000","last_fullsized":"2024-05-08T18:12:02.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.142579+0000","last_change":"2024-05-08T18:08:49.497950+0000","last_active":"2024-05-08T18:09:34.142579+0000","last_peered":"2024-05-08T18:09:34.142579+0000","last_clean":"2024-05-08T18:09:34.142579+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:09:34.142579+0000","last_undegraded":"2024-05-08T18:09:34.142579+0000","last_fullsized":"2024-05-08T18:09:34.142579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:30.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432525+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:11:11.432525+0000","last_peered":"2024-05-08T18:11:11.432525+0000","last_clean":"2024-05-08T18:11:11.432525+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:11:11.432525+0000","last_undegraded":"2024-05-08T18:11:11.432525+0000","last_fullsized":"2024-05-08T18:11:11.432525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:03.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588195+0000","last_change":"2024-05-08T18:08:47.516126+0000","last_active":"2024-05-08T18:09:28.588195+0000","last_peered":"2024-05-08T18:09:28.588195+0000","last_clean":"2024-05-08T18:09:28.588195+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:09:28.588195+0000","last_undegraded":"2024-05-08T18:09:28.588195+0000","last_fullsized":"2024-05-08T18:09:28.588195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:27.835638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.450829+0000","last_change":"2024-05-08T18:08:49.501282+0000","last_active":"2024-05-08T18:10:57.450829+0000","last_peered":"2024-05-08T18:10:57.450829+0000","last_clean":"2024-05-08T18:10:57.450829+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:10:57.450829+0000","last_undegraded":"2024-05-08T18:10:57.450829+0000","last_fullsized":"2024-05-08T18:10:57.450829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:32.711877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.577094+0000","last_change":"2024-05-08T18:08:47.515944+0000","last_active":"2024-05-08T18:09:28.577094+0000","last_peered":"2024-05-08T18:09:28.577094+0000","last_clean":"2024-05-08T18:09:28.577094+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:09:28.577094+0000","last_undegraded":"2024-05-08T18:09:28.577094+0000","last_fullsized":"2024-05-08T18:09:28.577094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106837+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:09:33.106837+0000","last_peered":"2024-05-08T18:09:33.106837+0000","last_clean":"2024-05-08T18:09:33.106837+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:09:33.106837+0000","last_undegraded":"2024-05-08T18:09:33.106837+0000","last_fullsized":"2024-05-08T18:09:33.106837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.519711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11093,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1191,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38719488,"data_stored":38719488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705711,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46348,"kb_used_data":11012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94325492,"statfs":{"total":96636764160,"available":96589303808,"internally_reserved":0,"allocated":11276288,"data_stored":10956261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705711,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42452,"kb_used_data":7116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329388,"statfs":{"total":96636764160,"available":96593293312,"internally_reserved":0,"allocated":7286784,"data_stored":7026447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705710,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48940,"kb_used_data":13604,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94322900,"statfs":{"total":96636764160,"available":96586649600,"internally_reserved":0,"allocated":13930496,"data_stored":13641551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40104,"kb_used_data":8928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331736,"statfs":{"total":96636764160,"available":96595697664,"internally_reserved":0,"allocated":9142272,"data_stored":8856953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8712192,"data_stored":8712192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12906496,"data_stored":12906496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10809344,"data_stored":10809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:12:10.942 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T18:12:11.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f89911d3640 1 Processor -- start 2024-05-08T18:12:11.101 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f89911d3640 1 -- start start 2024-05-08T18:12:11.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f89911d3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f898c070220 0x7f898c070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:11.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f89911d3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898c071290 con 0x7f898c070b40 2024-05-08T18:12:11.102 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f89911d3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f898c073ae0 con 0x7f898c070220 2024-05-08T18:12:11.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f898ad9d640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f898c070220 0x7f898c070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:11.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f898a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f898c070b40 0x7f898c12f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33846/0 (socket says 172.21.15.53:33846) 2024-05-08T18:12:11.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.098+0000 7f898a59c640 1 -- 172.21.15.53:0/3108370225 learned_addr learned my addr 172.21.15.53:0/3108370225 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:11.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f898ad9d640 1 -- 172.21.15.53:0/3108370225 >> v1:172.21.15.53:6789/0 conn(0x7f898c070b40 legacy=0x7f898c12f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:11.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f898ad9d640 1 -- 172.21.15.53:0/3108370225 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c073330 con 0x7f898c070220 2024-05-08T18:12:11.103 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f8989d9b640 1 -- 172.21.15.53:0/3108370225 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831933628 0 0) 0x7f8980001120 con 0x7f898c070b40 2024-05-08T18:12:11.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f898ad9d640 1 --2- 172.21.15.53:0/3108370225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c070600 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f897c009740 tx=0x7f897c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21efa30f6fb6758 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:11.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f8989d9b640 1 -- 172.21.15.53:0/3108370225 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c0b0070 con 0x7f898c070220 2024-05-08T18:12:11.104 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f8989d9b640 1 -- 172.21.15.53:0/3108370225 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c0ab530 con 0x7f898c070220 2024-05-08T18:12:11.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f8989d9b640 1 -- 172.21.15.53:0/3108370225 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c0ab830 con 0x7f898c070220 2024-05-08T18:12:11.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 -- 172.21.15.53:0/3108370225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 msgr2=0x7f898c070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:11.105 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 --2- 172.21.15.53:0/3108370225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c070600 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f897c009740 tx=0x7f897c01c370 comp rx=0 tx=0).stop 2024-05-08T18:12:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 -- 172.21.15.53:0/3108370225 shutdown_connections 2024-05-08T18:12:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 --2- 172.21.15.53:0/3108370225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c070600 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 -- 172.21.15.53:0/3108370225 >> 172.21.15.53:0/3108370225 conn(0x7f898c0a1c20 msgr2=0x7f898c0a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 -- 172.21.15.53:0/3108370225 shutdown_connections 2024-05-08T18:12:11.106 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.102+0000 7f89911d3640 1 -- 172.21.15.53:0/3108370225 wait complete. 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 Processor -- start 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 -- start start 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c11c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f898c138100 con 0x7f898c070220 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c11c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898ad9d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c11c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58216/0 (socket says 172.21.15.53:58216) 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898ad9d640 1 -- 172.21.15.53:0/2353120158 learned_addr learned my addr 172.21.15.53:0/2353120158 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898ad9d640 1 -- 172.21.15.53:0/2353120158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c11eef0 con 0x7f898c070220 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898ad9d640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c11c0e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f897c0ae040 tx=0x7f897c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:11.108 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c0b0050 con 0x7f898c070220 2024-05-08T18:12:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c0b1040 con 0x7f898c070220 2024-05-08T18:12:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c11e750 con 0x7f898c070220 2024-05-08T18:12:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f897c0b5930 con 0x7f898c070220 2024-05-08T18:12:11.109 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c11c620 con 0x7f898c070220 2024-05-08T18:12:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c064150 con 0x7f898c070220 2024-05-08T18:12:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f897c0be030 con 0x7f898c070220 2024-05-08T18:12:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89737fe640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8978039b50 0x7f897803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f897c0bc070 con 0x7f898c070220 2024-05-08T18:12:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898a59c640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8978039b50 0x7f897803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:11.110 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.106+0000 7f898a59c640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8978039b50 0x7f897803c010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c10 tx=0x7f8980001320 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:11.113 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.110+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f897c0c5020 con 0x7f898c070220 2024-05-08T18:12:11.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.274+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f898c11dae0 con 0x7f898c070220 2024-05-08T18:12:11.280 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89737fe640 1 -- 172.21.15.53:0/2353120158 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+20958 (secure 0 0 0) 0x7f897c015ff0 con 0x7f898c070220 2024-05-08T18:12:11.280 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:11.280 INFO:teuthology.orchestra.run.smithi053.stdout:{"epoch":32,"fsid":"a49ba316-612d-4e74-b7c0-c89e2b4be23c","created":"2024-05-08T18:08:22.482224+0000","modified":"2024-05-08T18:09:28.566960+0000","last_up_change":"2024-05-08T18:08:31.326207+0000","last_in_change":"2024-05-08T18:08:23.733990+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T18:08:31.348047+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T18:08:38.372481+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T18:08:45.454262+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T18:08:47.831725+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T18:08:49.726858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T18:08:51.639447+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T18:08:53.566828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T18:08:55.702986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9fc8bff0-a944-457e-8d30-69424c1dddd2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6801","nonce":803213352}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6803","nonce":803213352}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6807","nonce":803213352}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":803213352},{"type":"v1","addr":"172.21.15.53:6805","nonce":803213352}]},"public_addr":"172.21.15.53:6801/803213352","cluster_addr":"172.21.15.53:6803/803213352","heartbeat_back_addr":"172.21.15.53:6807/803213352","heartbeat_front_addr":"172.21.15.53:6805/803213352","state":["exists","up"]},{"osd":1,"uuid":"b391052e-bf22-4b53-a6d1-ea15b159812a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6801","nonce":1559856467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6803","nonce":1559856467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6807","nonce":1559856467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":1559856467},{"type":"v1","addr":"172.21.15.114:6805","nonce":1559856467}]},"public_addr":"172.21.15.114:6801/1559856467","cluster_addr":"172.21.15.114:6803/1559856467","heartbeat_back_addr":"172.21.15.114:6807/1559856467","heartbeat_front_addr":"172.21.15.114:6805/1559856467","state":["exists","up"]},{"osd":2,"uuid":"f30bc26d-7677-4fe9-a0bb-fe3c27e63079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6811","nonce":2279342404}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6813","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6815","nonce":2279342404}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6819","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6821","nonce":2279342404}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":2279342404},{"type":"v1","addr":"172.21.15.114:6818","nonce":2279342404}]},"public_addr":"172.21.15.114:6811/2279342404","cluster_addr":"172.21.15.114:6815/2279342404","heartbeat_back_addr":"172.21.15.114:6821/2279342404","heartbeat_front_addr":"172.21.15.114:6818/2279342404","state":["exists","up"]},{"osd":3,"uuid":"68ac195b-11be-4780-bf64-166127513b1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6809","nonce":3988457904}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6814","nonce":3988457904}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6823","nonce":3988457904}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6817","nonce":3988457904},{"type":"v1","addr":"172.21.15.114:6820","nonce":3988457904}]},"public_addr":"172.21.15.114:6809/3988457904","cluster_addr":"172.21.15.114:6814/3988457904","heartbeat_back_addr":"172.21.15.114:6823/3988457904","heartbeat_front_addr":"172.21.15.114:6820/3988457904","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.014179+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.335559+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.226745+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T18:08:29.273527+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1","mappings":[{"from":3,"to":0}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":2}]},{"pgid":"5.8","mappings":[{"from":0,"to":2}]},{"pgid":"5.a","mappings":[{"from":0,"to":2}]},{"pgid":"5.1c","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8978039b50 msgr2=0x7f897803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8978039b50 0x7f897803c010 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8980000c10 tx=0x7f8980001320 comp rx=0 tx=0).stop 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 msgr2=0x7f898c11c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c11c0e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f897c0ae040 tx=0x7f897c01abb0 comp rx=0 tx=0).stop 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 shutdown_connections 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f8978039b50 0x7f897803c010 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 --2- 172.21.15.53:0/2353120158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f898c070220 0x7f898c11c0e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 >> 172.21.15.53:0/2353120158 conn(0x7f898c0a1c20 msgr2=0x7f898c1321d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:11.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 shutdown_connections 2024-05-08T18:12:11.283 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:11.278+0000 7f89911d3640 1 -- 172.21.15.53:0/2353120158 wait complete. 2024-05-08T18:12:12.300 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T18:12:12.300 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:12:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff3014d5640 1 Processor -- start 2024-05-08T18:12:12.440 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff3014d5640 1 -- start start 2024-05-08T18:12:12.441 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff3014d5640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7ff2fc071e00 0x7ff2fc132820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff3014d5640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2fc09bfa0 con 0x7ff2fc071310 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff3014d5640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7ff2fc073260 con 0x7ff2fc071e00 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2faffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7ff2fc071310 0x7ff2fc0716f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33852/0 (socket says 172.21.15.53:33852) 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2faffd640 1 -- 172.21.15.53:0/241304950 learned_addr learned my addr 172.21.15.53:0/241304950 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2fa7fc640 1 --2- 172.21.15.53:0/241304950 >> v2:172.21.15.53:3300/0 conn(0x7ff2fc071e00 0x7ff2fc132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/241304950 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543310085 0 0) 0x7ff2fc09bfa0 con 0x7ff2fc071310 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/241304950 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e4003530 con 0x7ff2fc071310 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2fa7fc640 1 -- 172.21.15.53:0/241304950 >> v1:172.21.15.53:6789/0 conn(0x7ff2fc071310 legacy=0x7ff2fc0716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.442 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.438+0000 7ff2fa7fc640 1 -- 172.21.15.53:0/241304950 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc09b550 con 0x7ff2fc071e00 2024-05-08T18:12:12.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff2fa7fc640 1 --2- 172.21.15.53:0/241304950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071e00 0x7ff2fc132820 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009d90 tx=0x7ff2f001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d437d5d3ea92b574 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/241304950 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f00a6640 con 0x7ff2fc071e00 2024-05-08T18:12:12.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/241304950 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f00a67e0 con 0x7ff2fc071e00 2024-05-08T18:12:12.444 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff2f9ffb640 1 -- 172.21.15.53:0/241304950 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f00a6ae0 con 0x7ff2fc071e00 2024-05-08T18:12:12.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- 172.21.15.53:0/241304950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071e00 msgr2=0x7ff2fc132820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 --2- 172.21.15.53:0/241304950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071e00 0x7ff2fc132820 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009d90 tx=0x7ff2f001c8c0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- 172.21.15.53:0/241304950 shutdown_connections 2024-05-08T18:12:12.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 --2- 172.21.15.53:0/241304950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071e00 0x7ff2fc132820 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.445 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- 172.21.15.53:0/241304950 >> 172.21.15.53:0/241304950 conn(0x7ff2fc09c3e0 msgr2=0x7ff2fc09c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:12.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- 172.21.15.53:0/241304950 shutdown_connections 2024-05-08T18:12:12.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- 172.21.15.53:0/241304950 wait complete. 2024-05-08T18:12:12.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 Processor -- start 2024-05-08T18:12:12.446 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- start start 2024-05-08T18:12:12.448 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 0x7ff2fc06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff3014d5640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7ff2fc135910 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.442+0000 7ff2faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 0x7ff2fc06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2faffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 0x7ff2fc06f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58232/0 (socket says 172.21.15.53:58232) 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2faffd640 1 -- 172.21.15.53:0/4253726460 learned_addr learned my addr 172.21.15.53:0/4253726460 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2faffd640 1 -- 172.21.15.53:0/4253726460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2fc070cb0 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2faffd640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 0x7ff2fc06f130 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c450 tx=0x7ff2f400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f4017070 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f4005ce0 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2fc1200c0 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2f4007200 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2fc06f670 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2fc064150 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7ff2f401a070 con 0x7ff2fc071310 2024-05-08T18:12:12.449 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff2e8039b50 0x7ff2e803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7ff2f404d020 con 0x7ff2fc071310 2024-05-08T18:12:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff2e8045f50 0x7ff2e80483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2e8048ac0 con 0x7ff2e8045f50 2024-05-08T18:12:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff2f404f610 con 0x7ff2fc071310 2024-05-08T18:12:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2fa7fc640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff2e8039b50 0x7ff2e803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.450 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2fb7fe640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff2e8045f50 0x7ff2e80483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2fb7fe640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff2e8045f50 0x7ff2e80483f0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2fa7fc640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff2e8039b50 0x7ff2e803c010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00af000 tx=0x7ff2f00a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.451 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.446+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== osd.0 v2:172.21.15.53:6800/803213352 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2e8048ac0 con 0x7ff2e8045f50 2024-05-08T18:12:12.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 --> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff2fc071e00 con 0x7ff2e8045f50 2024-05-08T18:12:12.463 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff2e37fe640 1 -- 172.21.15.53:0/4253726460 <== osd.0 v2:172.21.15.53:6800/803213352 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff2fc071e00 con 0x7ff2e8045f50 2024-05-08T18:12:12.463 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:12:12.464 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:12:12.464 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:12:12.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff2e8045f50 msgr2=0x7ff2e80483f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff2e8045f50 0x7ff2e80483f0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff2e8039b50 msgr2=0x7ff2e803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.465 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff2e8039b50 0x7ff2e803c010 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff2f00af000 tx=0x7ff2f00a7000 comp rx=0 tx=0).stop 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 msgr2=0x7ff2fc06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 0x7ff2fc06f130 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400c450 tx=0x7ff2f400c910 comp rx=0 tx=0).stop 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 shutdown_connections 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:6800/803213352,v1:172.21.15.53:6801/803213352] conn(0x7ff2e8045f50 0x7ff2e80483f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7ff2e8039b50 0x7ff2e803c010 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 --2- 172.21.15.53:0/4253726460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff2fc071310 0x7ff2fc06f130 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 >> 172.21.15.53:0/4253726460 conn(0x7ff2fc09c3e0 msgr2=0x7ff2fc12ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 shutdown_connections 2024-05-08T18:12:12.466 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.462+0000 7ff3014d5640 1 -- 172.21.15.53:0/4253726460 wait complete. 2024-05-08T18:12:12.480 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T18:12:12.596 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f319a640 1 Processor -- start 2024-05-08T18:12:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f319a640 1 -- start start 2024-05-08T18:12:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f319a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f59ec12f450 0x7f59ec12f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f319a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec071610 con 0x7f59ec12fd70 2024-05-08T18:12:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f319a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec071a10 con 0x7f59ec12f450 2024-05-08T18:12:12.597 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59ebfff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f59ec12fd70 0x7f59ec12bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33856/0 (socket says 172.21.15.53:33856) 2024-05-08T18:12:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f0f36640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f59ec12f450 0x7f59ec12f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59ebfff640 1 -- 172.21.15.53:0/1859169965 learned_addr learned my addr 172.21.15.53:0/1859169965 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f0f36640 1 -- 172.21.15.53:0/1859169965 >> v1:172.21.15.53:6789/0 conn(0x7f59ec12fd70 legacy=0x7f59ec12bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.598 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.594+0000 7f59f0f36640 1 -- 172.21.15.53:0/1859169965 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec1301e0 con 0x7f59ec12f450 2024-05-08T18:12:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f0f36640 1 --2- 172.21.15.53:0/1859169965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec12f830 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009740 tx=0x7f59e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3d06f7fa384ca6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59eb7fe640 1 -- 172.21.15.53:0/1859169965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e00b0070 con 0x7f59ec12f450 2024-05-08T18:12:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59eb7fe640 1 -- 172.21.15.53:0/1859169965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00ab530 con 0x7f59ec12f450 2024-05-08T18:12:12.600 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59eb7fe640 1 -- 172.21.15.53:0/1859169965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e00ab830 con 0x7f59ec12f450 2024-05-08T18:12:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 -- 172.21.15.53:0/1859169965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 msgr2=0x7f59ec12f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 --2- 172.21.15.53:0/1859169965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec12f830 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f59e0009740 tx=0x7f59e001c370 comp rx=0 tx=0).stop 2024-05-08T18:12:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 -- 172.21.15.53:0/1859169965 shutdown_connections 2024-05-08T18:12:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 --2- 172.21.15.53:0/1859169965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec12f830 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.601 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 -- 172.21.15.53:0/1859169965 >> 172.21.15.53:0/1859169965 conn(0x7f59ec09ea50 msgr2=0x7f59ec09ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:12.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 -- 172.21.15.53:0/1859169965 shutdown_connections 2024-05-08T18:12:12.602 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 -- 172.21.15.53:0/1859169965 wait complete. 2024-05-08T18:12:12.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 Processor -- start 2024-05-08T18:12:12.603 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.598+0000 7f59f319a640 1 -- start start 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f319a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec09b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f319a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec138330 con 0x7f59ec12f450 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f0f36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec09b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f0f36640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec09b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58240/0 (socket says 172.21.15.53:58240) 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f0f36640 1 -- 172.21.15.53:0/230843991 learned_addr learned my addr 172.21.15.53:0/230843991 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f0f36640 1 -- 172.21.15.53:0/230843991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec0735d0 con 0x7f59ec12f450 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f0f36640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec09b710 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f59e0019fa0 tx=0x7f59e001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e00b0050 con 0x7f59ec12f450 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59e00b1040 con 0x7f59ec12f450 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec12b4b0 con 0x7f59ec12f450 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59e00aab40 con 0x7f59ec12f450 2024-05-08T18:12:12.604 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec09bc50 con 0x7f59ec12f450 2024-05-08T18:12:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec12a130 con 0x7f59ec12f450 2024-05-08T18:12:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f59e00be030 con 0x7f59ec12f450 2024-05-08T18:12:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59e97fa640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f59d0039b50 0x7f59d003c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.605 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f59e00bc070 con 0x7f59ec12f450 2024-05-08T18:12:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59ebfff640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f59d0039b50 0x7f59d003c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.606 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.602+0000 7f59ebfff640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f59d0039b50 0x7f59d003c010 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f59d8005890 tx=0x7f59d8007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.609 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.606+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f59e00c5020 con 0x7f59ec12f450 2024-05-08T18:12:12.768 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.766+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f59ec0508b0 con 0x7f59d0039b50 2024-05-08T18:12:12.769 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.766+0000 7f59e97fa640 1 -- 172.21.15.53:0/230843991 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f59d80058c0 con 0x7f59d0039b50 2024-05-08T18:12:12.770 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f59d0039b50 msgr2=0x7f59d003c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f59d0039b50 0x7f59d003c010 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f59d8005890 tx=0x7f59d8007ab0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 msgr2=0x7f59ec09b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec09b710 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f59e0019fa0 tx=0x7f59e001abb0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 shutdown_connections 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f59d0039b50 0x7f59d003c010 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 --2- 172.21.15.53:0/230843991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59ec12f450 0x7f59ec09b710 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 >> 172.21.15.53:0/230843991 conn(0x7f59ec09ea50 msgr2=0x7f59ec09d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:12.773 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 shutdown_connections 2024-05-08T18:12:12.774 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.770+0000 7f59f319a640 1 -- 172.21.15.53:0/230843991 wait complete. 2024-05-08T18:12:12.788 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T18:12:12.788 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:12:12.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.898+0000 7f4a70b87640 1 Processor -- start 2024-05-08T18:12:12.901 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.898+0000 7f4a70b87640 1 -- start start 2024-05-08T18:12:12.902 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.898+0000 7f4a70b87640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4a6c12fe80 0x7f4a6c070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.898+0000 7f4a70b87640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a6c071980 con 0x7f4a6c12faa0 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.898+0000 7f4a70b87640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f4a6c072ec0 con 0x7f4a6c12fe80 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a6a59c640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4a6c12faa0 0x7f4a6c070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33858/0 (socket says 172.21.15.53:33858) 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a6a59c640 1 -- 172.21.15.53:0/1596866965 learned_addr learned my addr 172.21.15.53:0/1596866965 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a63fff640 1 --2- 172.21.15.53:0/1596866965 >> v2:172.21.15.53:3300/0 conn(0x7f4a6c12fe80 0x7f4a6c070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a69d9b640 1 -- 172.21.15.53:0/1596866965 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268386913 0 0) 0x7f4a6c071980 con 0x7f4a6c12faa0 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a69d9b640 1 -- 172.21.15.53:0/1596866965 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a58003530 con 0x7f4a6c12faa0 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a63fff640 1 -- 172.21.15.53:0/1596866965 >> v1:172.21.15.53:6789/0 conn(0x7f4a6c12faa0 legacy=0x7f4a6c070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.903 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a63fff640 1 -- 172.21.15.53:0/1596866965 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c1302d0 con 0x7f4a6c12fe80 2024-05-08T18:12:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a63fff640 1 --2- 172.21.15.53:0/1596866965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12fe80 0x7f4a6c070a40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009740 tx=0x7f4a5401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff494e4d4e4622e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a69d9b640 1 -- 172.21.15.53:0/1596866965 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a540b0070 con 0x7f4a6c12fe80 2024-05-08T18:12:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a69d9b640 1 -- 172.21.15.53:0/1596866965 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a540ab530 con 0x7f4a6c12fe80 2024-05-08T18:12:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a69d9b640 1 -- 172.21.15.53:0/1596866965 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a540ab810 con 0x7f4a6c12fe80 2024-05-08T18:12:12.905 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 -- 172.21.15.53:0/1596866965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12fe80 msgr2=0x7f4a6c070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 --2- 172.21.15.53:0/1596866965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12fe80 0x7f4a6c070a40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009740 tx=0x7f4a5401c370 comp rx=0 tx=0).stop 2024-05-08T18:12:12.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 -- 172.21.15.53:0/1596866965 shutdown_connections 2024-05-08T18:12:12.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 --2- 172.21.15.53:0/1596866965 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12fe80 0x7f4a6c070a40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 -- 172.21.15.53:0/1596866965 >> 172.21.15.53:0/1596866965 conn(0x7f4a6c0a1e50 msgr2=0x7f4a6c0a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:12.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 -- 172.21.15.53:0/1596866965 shutdown_connections 2024-05-08T18:12:12.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.902+0000 7f4a70b87640 1 -- 172.21.15.53:0/1596866965 wait complete. 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 Processor -- start 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 -- start start 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 0x7f4a6c12dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6c1380c0 con 0x7f4a6c12faa0 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 0x7f4a6c12dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6a59c640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 0x7f4a6c12dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58260/0 (socket says 172.21.15.53:58260) 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6a59c640 1 -- 172.21.15.53:0/2700138606 learned_addr learned my addr 172.21.15.53:0/2700138606 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6a59c640 1 -- 172.21.15.53:0/2700138606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6c11fdb0 con 0x7f4a6c12faa0 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6a59c640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 0x7f4a6c12dd40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00c450 tx=0x7f4a5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c017070 con 0x7f4a6c12faa0 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a5c005ce0 con 0x7f4a6c12faa0 2024-05-08T18:12:12.908 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6c11f910 con 0x7f4a6c12faa0 2024-05-08T18:12:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5c007200 con 0x7f4a6c12faa0 2024-05-08T18:12:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a6c12e280 con 0x7f4a6c12faa0 2024-05-08T18:12:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4a6c064150 con 0x7f4a6c12faa0 2024-05-08T18:12:12.909 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f4a5c01a070 con 0x7f4a6c12faa0 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4a4c039b80 0x7f4a4c03c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f4a5c04cf80 con 0x7f4a6c12faa0 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f4a4c045f80 0x7f4a4c048420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a4c048af0 con 0x7f4a4c045f80 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f4a5c04f5d0 con 0x7f4a6c12faa0 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a63fff640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4a4c039b80 0x7f4a4c03c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6ad9d640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f4a4c045f80 0x7f4a4c048420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a6ad9d640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f4a4c045f80 0x7f4a4c048420 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.910 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.906+0000 7f4a63fff640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4a4c039b80 0x7f4a4c03c040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4a540ad000 tx=0x7f4a54008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:12.911 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.910+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== osd.1 v2:172.21.15.114:6800/1559856467 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4a4c048af0 con 0x7f4a4c045f80 2024-05-08T18:12:12.924 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 --> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4a6c0741b0 con 0x7f4a4c045f80 2024-05-08T18:12:12.925 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a62ffd640 1 -- 172.21.15.53:0/2700138606 <== osd.1 v2:172.21.15.114:6800/1559856467 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4a6c0741b0 con 0x7f4a4c045f80 2024-05-08T18:12:12.925 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:12:12.925 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:12:12.925 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:12:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f4a4c045f80 msgr2=0x7f4a4c048420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f4a4c045f80 0x7f4a4c048420 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.926 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4a4c039b80 msgr2=0x7f4a4c03c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4a4c039b80 0x7f4a4c03c040 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f4a540ad000 tx=0x7f4a54008040 comp rx=0 tx=0).stop 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 msgr2=0x7f4a6c12dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 0x7f4a6c12dd40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c00c450 tx=0x7f4a5c00c910 comp rx=0 tx=0).stop 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 shutdown_connections 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6800/1559856467,v1:172.21.15.114:6801/1559856467] conn(0x7f4a4c045f80 0x7f4a4c048420 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4a4c039b80 0x7f4a4c03c040 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 --2- 172.21.15.53:0/2700138606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a6c12faa0 0x7f4a6c12dd40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 >> 172.21.15.53:0/2700138606 conn(0x7f4a6c0a1e50 msgr2=0x7f4a6c1337b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 shutdown_connections 2024-05-08T18:12:12.927 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:12.922+0000 7f4a70b87640 1 -- 172.21.15.53:0/2700138606 wait complete. 2024-05-08T18:12:12.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T18:12:13.049 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f434bad9640 1 Processor -- start 2024-05-08T18:12:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f434bad9640 1 -- start start 2024-05-08T18:12:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f434bad9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4344124370 0x7f4344132810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f434bad9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f434406eee0 con 0x7f4344123880 2024-05-08T18:12:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f434bad9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f434406e520 con 0x7f4344124370 2024-05-08T18:12:13.050 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f4349074640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f4344124370 0x7f4344132810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f4349875640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f4344123880 0x7f4344123c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33862/0 (socket says 172.21.15.53:33862) 2024-05-08T18:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.046+0000 7f4349875640 1 -- 172.21.15.53:0/2535724825 learned_addr learned my addr 172.21.15.53:0/2535724825 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f4349074640 1 -- 172.21.15.53:0/2535724825 >> v1:172.21.15.53:6789/0 conn(0x7f4344123880 legacy=0x7f4344123c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.051 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f4349074640 1 -- 172.21.15.53:0/2535724825 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f434406e250 con 0x7f4344124370 2024-05-08T18:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f4349074640 1 --2- 172.21.15.53:0/2535724825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344124370 0x7f4344132810 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4334009740 tx=0x7f433401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcbef15f84dcbc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f4348873640 1 -- 172.21.15.53:0/2535724825 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43340b0070 con 0x7f4344124370 2024-05-08T18:12:13.053 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f4348873640 1 -- 172.21.15.53:0/2535724825 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43340ab530 con 0x7f4344124370 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f4348873640 1 -- 172.21.15.53:0/2535724825 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43340ab830 con 0x7f4344124370 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 -- 172.21.15.53:0/2535724825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344124370 msgr2=0x7f4344132810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 --2- 172.21.15.53:0/2535724825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344124370 0x7f4344132810 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4334009740 tx=0x7f433401c370 comp rx=0 tx=0).stop 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 -- 172.21.15.53:0/2535724825 shutdown_connections 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 --2- 172.21.15.53:0/2535724825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344124370 0x7f4344132810 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 -- 172.21.15.53:0/2535724825 >> 172.21.15.53:0/2535724825 conn(0x7f434409b2c0 msgr2=0x7f434409b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 -- 172.21.15.53:0/2535724825 shutdown_connections 2024-05-08T18:12:13.054 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.050+0000 7f434bad9640 1 -- 172.21.15.53:0/2535724825 wait complete. 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 Processor -- start 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 -- start start 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 0x7f434412f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f4344135900 con 0x7f4344123880 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 0x7f434412f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349875640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 0x7f434412f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58276/0 (socket says 172.21.15.53:58276) 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349875640 1 -- 172.21.15.53:0/2320164317 learned_addr learned my addr 172.21.15.53:0/2320164317 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349875640 1 -- 172.21.15.53:0/2320164317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4344131680 con 0x7f4344123880 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349875640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 0x7f434412f260 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f434000c450 tx=0x7f434000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.056 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4340017070 con 0x7f4344123880 2024-05-08T18:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4340005c20 con 0x7f4344123880 2024-05-08T18:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4344130ac0 con 0x7f4344123880 2024-05-08T18:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43400070d0 con 0x7f4344123880 2024-05-08T18:12:13.057 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4344131360 con 0x7f4344123880 2024-05-08T18:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f434001a070 con 0x7f4344123880 2024-05-08T18:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4344064150 con 0x7f4344123880 2024-05-08T18:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f433a7fc640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4328039bd0 0x7f432803c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f434004d060 con 0x7f4344123880 2024-05-08T18:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349074640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4328039bd0 0x7f432803c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.058 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.054+0000 7f4349074640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4328039bd0 0x7f432803c090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4334009740 tx=0x7f4334008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.061 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.058+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f434004b3a0 con 0x7f4344123880 2024-05-08T18:12:13.220 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.218+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f434408b5d0 con 0x7f4328039bd0 2024-05-08T18:12:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.218+0000 7f433a7fc640 1 -- 172.21.15.53:0/2320164317 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f434408b5d0 con 0x7f4328039bd0 2024-05-08T18:12:13.222 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4328039bd0 msgr2=0x7f432803c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4328039bd0 0x7f432803c090 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4334009740 tx=0x7f4334008040 comp rx=0 tx=0).stop 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 msgr2=0x7f434412f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 0x7f434412f260 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f434000c450 tx=0x7f434000c910 comp rx=0 tx=0).stop 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 shutdown_connections 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f4328039bd0 0x7f432803c090 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.224 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 --2- 172.21.15.53:0/2320164317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4344123880 0x7f434412f260 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 >> 172.21.15.53:0/2320164317 conn(0x7f434409b2c0 msgr2=0x7f43441276d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 shutdown_connections 2024-05-08T18:12:13.225 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.222+0000 7f434bad9640 1 -- 172.21.15.53:0/2320164317 wait complete. 2024-05-08T18:12:13.239 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T18:12:13.239 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:12:13.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.362+0000 7f96a6575640 1 Processor -- start 2024-05-08T18:12:13.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.362+0000 7f96a6575640 1 -- start start 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96a012faa0 0x7f96a012fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a0071980 con 0x7f96a0070330 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f96a0072ec0 con 0x7f96a012faa0 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969ffff640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f96a012faa0 0x7f96a012fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969f7fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f96a0070330 0x7f96a0070780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33876/0 (socket says 172.21.15.53:33876) 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969f7fe640 1 -- 172.21.15.53:0/3553792528 learned_addr learned my addr 172.21.15.53:0/3553792528 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969ffff640 1 -- 172.21.15.53:0/3553792528 >> v1:172.21.15.53:6789/0 conn(0x7f96a0070330 legacy=0x7f96a0070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969ffff640 1 -- 172.21.15.53:0/3553792528 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a012f650 con 0x7f96a012faa0 2024-05-08T18:12:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969ffff640 1 --2- 172.21.15.53:0/3553792528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a012faa0 0x7f96a012fe80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9690009740 tx=0x7f969001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e397c33276bb79 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969effd640 1 -- 172.21.15.53:0/3553792528 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96900b1070 con 0x7f96a012faa0 2024-05-08T18:12:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969effd640 1 -- 172.21.15.53:0/3553792528 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96900ac570 con 0x7f96a012faa0 2024-05-08T18:12:13.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f969effd640 1 -- 172.21.15.53:0/3553792528 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96900ac870 con 0x7f96a012faa0 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- 172.21.15.53:0/3553792528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a012faa0 msgr2=0x7f96a012fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 --2- 172.21.15.53:0/3553792528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a012faa0 0x7f96a012fe80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9690009740 tx=0x7f969001c400 comp rx=0 tx=0).stop 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- 172.21.15.53:0/3553792528 shutdown_connections 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 --2- 172.21.15.53:0/3553792528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a012faa0 0x7f96a012fe80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- 172.21.15.53:0/3553792528 >> 172.21.15.53:0/3553792528 conn(0x7f96a00a1e50 msgr2=0x7f96a00a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- 172.21.15.53:0/3553792528 shutdown_connections 2024-05-08T18:12:13.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.366+0000 7f96a6575640 1 -- 172.21.15.53:0/3553792528 wait complete. 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 Processor -- start 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 -- start start 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 0x7f96a011e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f96a0072750 con 0x7f96a0070330 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 0x7f96a011e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969ffff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 0x7f96a011e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58290/0 (socket says 172.21.15.53:58290) 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969ffff640 1 -- 172.21.15.53:0/2290243592 learned_addr learned my addr 172.21.15.53:0/2290243592 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:13.372 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969ffff640 1 -- 172.21.15.53:0/2290243592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a009f2d0 con 0x7f96a0070330 2024-05-08T18:12:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969ffff640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 0x7f96a011e150 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f969001a030 tx=0x7f969001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96900b1050 con 0x7f96a0070330 2024-05-08T18:12:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96900b2040 con 0x7f96a0070330 2024-05-08T18:12:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a0135060 con 0x7f96a0070330 2024-05-08T18:12:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96900b6780 con 0x7f96a0070330 2024-05-08T18:12:13.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a0120770 con 0x7f96a0070330 2024-05-08T18:12:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96a0064150 con 0x7f96a0070330 2024-05-08T18:12:13.374 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f96900bf030 con 0x7f96a0070330 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f968c039b50 0x7f968c03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f96900bd070 con 0x7f96a0070330 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f968c045f50 0x7f968c0483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96900a8ec0 con 0x7f968c045f50 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f96900ec2a0 con 0x7f96a0070330 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f969f7fe640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f968c039b50 0x7f968c03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.370+0000 7f96a4b12640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f968c045f50 0x7f968c0483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.374+0000 7f96a4b12640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f968c045f50 0x7f968c0483f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.375 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.374+0000 7f969f7fe640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f968c039b50 0x7f968c03c010 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96940015f0 tx=0x7f9694007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.376 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.374+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== osd.2 v2:172.21.15.114:6810/2279342404 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96900a8ec0 con 0x7f968c045f50 2024-05-08T18:12:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.386+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 --> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f96a00741b0 con 0x7f968c045f50 2024-05-08T18:12:13.390 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.386+0000 7f969cff9640 1 -- 172.21.15.53:0/2290243592 <== osd.2 v2:172.21.15.114:6810/2279342404 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f96a00741b0 con 0x7f968c045f50 2024-05-08T18:12:13.391 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:12:13.391 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:12:13.391 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f968c045f50 msgr2=0x7f968c0483f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f968c045f50 0x7f968c0483f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f968c039b50 msgr2=0x7f968c03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f968c039b50 0x7f968c03c010 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f96940015f0 tx=0x7f9694007ab0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 msgr2=0x7f96a011e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 0x7f96a011e150 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f969001a030 tx=0x7f969001ac40 comp rx=0 tx=0).stop 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 shutdown_connections 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6810/2279342404,v1:172.21.15.114:6811/2279342404] conn(0x7f968c045f50 0x7f968c0483f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.392 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f968c039b50 0x7f968c03c010 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 --2- 172.21.15.53:0/2290243592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96a0070330 0x7f96a011e150 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 >> 172.21.15.53:0/2290243592 conn(0x7f96a00a1e50 msgr2=0x7f96a0133950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 shutdown_connections 2024-05-08T18:12:13.393 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.390+0000 7f96a6575640 1 -- 172.21.15.53:0/2290243592 wait complete. 2024-05-08T18:12:13.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T18:12:13.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 Processor -- start 2024-05-08T18:12:13.510 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- start start 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb7441305d0 0x7fb7441329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb744129df0 con 0x7fb744129ff0 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fb744114d80 con 0x7fb7441305d0 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb748a5e640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fb7441305d0 0x7fb7441329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74925f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fb744129ff0 0x7fb74412a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33890/0 (socket says 172.21.15.53:33890) 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74925f640 1 -- 172.21.15.53:0/1542061384 learned_addr learned my addr 172.21.15.53:0/1542061384 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:13.511 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb748a5e640 1 -- 172.21.15.53:0/1542061384 >> v1:172.21.15.53:6789/0 conn(0x7fb744129ff0 legacy=0x7fb74412a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb748a5e640 1 -- 172.21.15.53:0/1542061384 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74409e250 con 0x7fb7441305d0 2024-05-08T18:12:13.512 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb73bfff640 1 -- 172.21.15.53:0/1542061384 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744697660 0 0) 0x7fb744129df0 con 0x7fb744129ff0 2024-05-08T18:12:13.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb748a5e640 1 --2- 172.21.15.53:0/1542061384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7441305d0 0x7fb7441329c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb734009740 tx=0x7fb73401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906feaa1056c953d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb73bfff640 1 -- 172.21.15.53:0/1542061384 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7340b1070 con 0x7fb7441305d0 2024-05-08T18:12:13.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb73bfff640 1 -- 172.21.15.53:0/1542061384 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7340ac520 con 0x7fb7441305d0 2024-05-08T18:12:13.513 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb73bfff640 1 -- 172.21.15.53:0/1542061384 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7340ac820 con 0x7fb7441305d0 2024-05-08T18:12:13.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- 172.21.15.53:0/1542061384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7441305d0 msgr2=0x7fb7441329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.514 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 --2- 172.21.15.53:0/1542061384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7441305d0 0x7fb7441329c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb734009740 tx=0x7fb73401c370 comp rx=0 tx=0).stop 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- 172.21.15.53:0/1542061384 shutdown_connections 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 --2- 172.21.15.53:0/1542061384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7441305d0 0x7fb7441329c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- 172.21.15.53:0/1542061384 >> 172.21.15.53:0/1542061384 conn(0x7fb74409be10 msgr2=0x7fb74409d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- 172.21.15.53:0/1542061384 shutdown_connections 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.510+0000 7fb74b4c3640 1 -- 172.21.15.53:0/1542061384 wait complete. 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 Processor -- start 2024-05-08T18:12:13.515 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 -- start start 2024-05-08T18:12:13.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 0x7fb744125cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fb7441358a0 con 0x7fb744129ff0 2024-05-08T18:12:13.516 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74925f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 0x7fb744125cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74925f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 0x7fb744125cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58314/0 (socket says 172.21.15.53:58314) 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74925f640 1 -- 172.21.15.53:0/3366736869 learned_addr learned my addr 172.21.15.53:0/3366736869 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74925f640 1 -- 172.21.15.53:0/3366736869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb744127460 con 0x7fb744129ff0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74925f640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 0x7fb744125cf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb74000c3d0 tx=0x7fb74000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740007410 con 0x7fb744129ff0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7400075d0 con 0x7fb744129ff0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb744116300 con 0x7fb744129ff0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740004960 con 0x7fb744129ff0 2024-05-08T18:12:13.517 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb744126400 con 0x7fb744129ff0 2024-05-08T18:12:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb744064150 con 0x7fb744129ff0 2024-05-08T18:12:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fb740011070 con 0x7fb744129ff0 2024-05-08T18:12:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb739ffb640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb728039b50 0x7fb72803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fb74004d800 con 0x7fb744129ff0 2024-05-08T18:12:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.514+0000 7fb748a5e640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb728039b50 0x7fb72803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.518 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.518+0000 7fb748a5e640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb728039b50 0x7fb72803c010 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb7340ae000 tx=0x7fb7340a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.521 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.518+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb740004d90 con 0x7fb744129ff0 2024-05-08T18:12:13.683 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.682+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fb744116530 con 0x7fb728039b50 2024-05-08T18:12:13.684 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.682+0000 7fb739ffb640 1 -- 172.21.15.53:0/3366736869 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb744116530 con 0x7fb728039b50 2024-05-08T18:12:13.684 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T18:12:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb728039b50 msgr2=0x7fb72803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.687 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb728039b50 0x7fb72803c010 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb7340ae000 tx=0x7fb7340a7000 comp rx=0 tx=0).stop 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 msgr2=0x7fb744125cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 0x7fb744125cf0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb74000c3d0 tx=0x7fb74000c890 comp rx=0 tx=0).stop 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 shutdown_connections 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fb728039b50 0x7fb72803c010 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 --2- 172.21.15.53:0/3366736869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb744129ff0 0x7fb744125cf0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 >> 172.21.15.53:0/3366736869 conn(0x7fb74409be10 msgr2=0x7fb74406e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 shutdown_connections 2024-05-08T18:12:13.688 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.686+0000 7fb74b4c3640 1 -- 172.21.15.53:0/3366736869 wait complete. 2024-05-08T18:12:13.704 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T18:12:13.704 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T18:12:13.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a782f9640 1 Processor -- start 2024-05-08T18:12:13.820 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a782f9640 1 -- start start 2024-05-08T18:12:13.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a782f9640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f6a7012fe80 0x7f6a70070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a782f9640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a70071980 con 0x7f6a7012faa0 2024-05-08T18:12:13.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a782f9640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f6a70072ec0 con 0x7f6a7012fe80 2024-05-08T18:12:13.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a76095640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f6a7012faa0 0x7f6a70070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33906/0 (socket says 172.21.15.53:33906) 2024-05-08T18:12:13.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a76095640 1 -- 172.21.15.53:0/1728227865 learned_addr learned my addr 172.21.15.53:0/1728227865 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:13.821 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a75894640 1 --2- 172.21.15.53:0/1728227865 >> v2:172.21.15.53:3300/0 conn(0x7f6a7012fe80 0x7f6a70070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a75894640 1 -- 172.21.15.53:0/1728227865 >> v1:172.21.15.53:6789/0 conn(0x7f6a7012faa0 legacy=0x7f6a70070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.822 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.818+0000 7f6a75894640 1 -- 172.21.15.53:0/1728227865 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a701302d0 con 0x7f6a7012fe80 2024-05-08T18:12:13.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a75894640 1 --2- 172.21.15.53:0/1728227865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012fe80 0x7f6a70070a40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009740 tx=0x7f6a6401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974613d0166790d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a75093640 1 -- 172.21.15.53:0/1728227865 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a640b0070 con 0x7f6a7012fe80 2024-05-08T18:12:13.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a75093640 1 -- 172.21.15.53:0/1728227865 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a640ab530 con 0x7f6a7012fe80 2024-05-08T18:12:13.823 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a75093640 1 -- 172.21.15.53:0/1728227865 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a640ab830 con 0x7f6a7012fe80 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- 172.21.15.53:0/1728227865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012fe80 msgr2=0x7f6a70070a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 --2- 172.21.15.53:0/1728227865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012fe80 0x7f6a70070a40 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6a64009740 tx=0x7f6a6401c370 comp rx=0 tx=0).stop 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- 172.21.15.53:0/1728227865 shutdown_connections 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 --2- 172.21.15.53:0/1728227865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012fe80 0x7f6a70070a40 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- 172.21.15.53:0/1728227865 >> 172.21.15.53:0/1728227865 conn(0x7f6a700a1e50 msgr2=0x7f6a700a2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- 172.21.15.53:0/1728227865 shutdown_connections 2024-05-08T18:12:13.824 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- 172.21.15.53:0/1728227865 wait complete. 2024-05-08T18:12:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 Processor -- start 2024-05-08T18:12:13.825 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- start start 2024-05-08T18:12:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 0x7f6a7012ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a782f9640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f6a701380c0 con 0x7f6a7012faa0 2024-05-08T18:12:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a76095640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 0x7f6a7012ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a76095640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 0x7f6a7012ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58332/0 (socket says 172.21.15.53:58332) 2024-05-08T18:12:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.822+0000 7f6a76095640 1 -- 172.21.15.53:0/790741582 learned_addr learned my addr 172.21.15.53:0/790741582 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:13.826 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a76095640 1 -- 172.21.15.53:0/790741582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a701209e0 con 0x7f6a7012faa0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a76095640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 0x7f6a7012ddc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800cbd0 tx=0x7f6a6800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a68017070 con 0x7f6a7012faa0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a6800abc0 con 0x7f6a7012faa0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a70120c70 con 0x7f6a7012faa0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a68012400 con 0x7f6a7012faa0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a7012e4d0 con 0x7f6a7012faa0 2024-05-08T18:12:13.828 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a7011fda0 con 0x7f6a7012faa0 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f6a6801a070 con 0x7f6a7012faa0 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6a5c039b50 0x7f6a5c03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f6a6804db50 con 0x7f6a7012faa0 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6a5c045f50 0x7f6a5c0483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a68013e50 con 0x7f6a5c045f50 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f6a68052220 con 0x7f6a7012faa0 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a75894640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6a5c039b50 0x7f6a5c03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.829 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a76896640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6a5c045f50 0x7f6a5c0483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a75894640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6a5c039b50 0x7f6a5c03c010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a640ad000 tx=0x7f6a64008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.830 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.826+0000 7f6a76896640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6a5c045f50 0x7f6a5c0483f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.831 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.830+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== osd.3 v2:172.21.15.114:6808/3988457904 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6a68013e50 con 0x7f6a5c045f50 2024-05-08T18:12:13.843 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 --> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6a70064150 con 0x7f6a5c045f50 2024-05-08T18:12:13.844 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a6effd640 1 -- 172.21.15.53:0/790741582 <== osd.3 v2:172.21.15.114:6808/3988457904 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6a70064150 con 0x7f6a5c045f50 2024-05-08T18:12:13.844 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2024-05-08T18:12:13.844 INFO:teuthology.orchestra.run.smithi053.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T18:12:13.844 INFO:teuthology.orchestra.run.smithi053.stdout:} 2024-05-08T18:12:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6a5c045f50 msgr2=0x7f6a5c0483f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.845 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6a5c045f50 0x7f6a5c0483f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6a5c039b50 msgr2=0x7f6a5c03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6a5c039b50 0x7f6a5c03c010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6a640ad000 tx=0x7f6a64008040 comp rx=0 tx=0).stop 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 msgr2=0x7f6a7012ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 0x7f6a7012ddc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f6a6800cbd0 tx=0x7f6a6800a430 comp rx=0 tx=0).stop 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 shutdown_connections 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6808/3988457904,v1:172.21.15.114:6809/3988457904] conn(0x7f6a5c045f50 0x7f6a5c0483f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f6a5c039b50 0x7f6a5c03c010 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 --2- 172.21.15.53:0/790741582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a7012faa0 0x7f6a7012ddc0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 >> 172.21.15.53:0/790741582 conn(0x7f6a700a1e50 msgr2=0x7f6a7006dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 shutdown_connections 2024-05-08T18:12:13.846 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.842+0000 7f6a782f9640 1 -- 172.21.15.53:0/790741582 wait complete. 2024-05-08T18:12:13.859 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T18:12:13.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87fe6ac640 1 Processor -- start 2024-05-08T18:12:13.975 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87fe6ac640 1 -- start start 2024-05-08T18:12:13.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87fe6ac640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87f81305d0 0x7f87f81329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87fe6ac640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f8129df0 con 0x7f87f8129ff0 2024-05-08T18:12:13.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87fe6ac640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f87f8114d80 con 0x7f87f81305d0 2024-05-08T18:12:13.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87f77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f87f81305d0 0x7f87f81329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.976 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87f7fff640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f87f8129ff0 0x7f87f812a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33914/0 (socket says 172.21.15.53:33914) 2024-05-08T18:12:13.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87f77fe640 1 --2- 172.21.15.53:0/3416325446 >> v2:172.21.15.53:3300/0 conn(0x7f87f81305d0 0x7f87f81329c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58346/0 (socket says 172.21.15.53:58346) 2024-05-08T18:12:13.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87f7fff640 1 -- 172.21.15.53:0/3416325446 learned_addr learned my addr 172.21.15.53:0/3416325446 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:13.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87f77fe640 1 -- 172.21.15.53:0/3416325446 >> v1:172.21.15.53:6789/0 conn(0x7f87f8129ff0 legacy=0x7f87f812a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.977 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.974+0000 7f87f77fe640 1 -- 172.21.15.53:0/3416325446 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f809e250 con 0x7f87f81305d0 2024-05-08T18:12:13.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f77fe640 1 --2- 172.21.15.53:0/3416325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f81305d0 0x7f87f81329c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009740 tx=0x7f87e801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78bff26b20b7fbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f6ffd640 1 -- 172.21.15.53:0/3416325446 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e80b1070 con 0x7f87f81305d0 2024-05-08T18:12:13.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f6ffd640 1 -- 172.21.15.53:0/3416325446 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e80ac520 con 0x7f87f81305d0 2024-05-08T18:12:13.978 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f6ffd640 1 -- 172.21.15.53:0/3416325446 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87e80ac820 con 0x7f87f81305d0 2024-05-08T18:12:13.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/3416325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f81305d0 msgr2=0x7f87f81329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:13.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 --2- 172.21.15.53:0/3416325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f81305d0 0x7f87f81329c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009740 tx=0x7f87e801c370 comp rx=0 tx=0).stop 2024-05-08T18:12:13.979 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/3416325446 shutdown_connections 2024-05-08T18:12:13.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 --2- 172.21.15.53:0/3416325446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f81305d0 0x7f87f81329c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:13.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/3416325446 >> 172.21.15.53:0/3416325446 conn(0x7f87f809be10 msgr2=0x7f87f809d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:13.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/3416325446 shutdown_connections 2024-05-08T18:12:13.980 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/3416325446 wait complete. 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 Processor -- start 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- start start 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 0x7f87f81239f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f87f81358a0 con 0x7f87f8129ff0 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 0x7f87f81239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f7fff640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 0x7f87f81239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58358/0 (socket says 172.21.15.53:58358) 2024-05-08T18:12:13.981 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f7fff640 1 -- 172.21.15.53:0/2273505156 learned_addr learned my addr 172.21.15.53:0/2273505156 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:13.982 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f7fff640 1 -- 172.21.15.53:0/2273505156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f8072b30 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f7fff640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 0x7f87f81239f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c480 tx=0x7f87ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87ec017070 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ec005c20 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87ec0070d0 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f812d0a0 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.978+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f81260d0 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.982+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f8064150 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.982+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f87ec01a070 con 0x7f87f8129ff0 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.982+0000 7f87f4ff9640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f87e4039b50 0x7f87e403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:13.983 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.982+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f87ec04d0d0 con 0x7f87f8129ff0 2024-05-08T18:12:13.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.982+0000 7f87f77fe640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f87e4039b50 0x7f87e403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:13.984 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.982+0000 7f87f77fe640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f87e4039b50 0x7f87e403c010 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87e80ae000 tx=0x7f87e80a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:13.987 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:13.986+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f87ec01adb0 con 0x7f87f8129ff0 2024-05-08T18:12:14.142 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.138+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f87f81263c0 con 0x7f87e4039b50 2024-05-08T18:12:14.143 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87f4ff9640 1 -- 172.21.15.53:0/2273505156 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f87e80093e0 con 0x7f87e4039b50 2024-05-08T18:12:14.144 INFO:teuthology.orchestra.run.smithi053.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T18:12:14.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f87e4039b50 msgr2=0x7f87e403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:14.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87fe6ac640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f87e4039b50 0x7f87e403c010 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f87e80ae000 tx=0x7f87e80a7000 comp rx=0 tx=0).stop 2024-05-08T18:12:14.146 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 msgr2=0x7f87f81239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87fe6ac640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 0x7f87f81239f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c480 tx=0x7f87ec00c940 comp rx=0 tx=0).stop 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 shutdown_connections 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.142+0000 7f87fe6ac640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f87e4039b50 0x7f87e403c010 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.146+0000 7f87fe6ac640 1 --2- 172.21.15.53:0/2273505156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87f8129ff0 0x7f87f81239f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.146+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 >> 172.21.15.53:0/2273505156 conn(0x7f87f809be10 msgr2=0x7f87f812e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.146+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 shutdown_connections 2024-05-08T18:12:14.147 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.146+0000 7f87fe6ac640 1 -- 172.21.15.53:0/2273505156 wait complete. 2024-05-08T18:12:14.161 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:12:14.271 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe90d3d8640 1 Processor -- start 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe90d3d8640 1 -- start start 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe90d3d8640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe908070220 0x7fe908070600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe90d3d8640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe908071290 con 0x7fe908070b40 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe90d3d8640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe908073ae0 con 0x7fe908070220 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe906ffd640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe908070220 0x7fe908070600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe9067fc640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe908070b40 0x7fe90812f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:33922/0 (socket says 172.21.15.53:33922) 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe9067fc640 1 -- 172.21.15.53:0/2422874136 learned_addr learned my addr 172.21.15.53:0/2422874136 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe906ffd640 1 -- 172.21.15.53:0/2422874136 >> v1:172.21.15.53:6789/0 conn(0x7fe908070b40 legacy=0x7fe90812f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:14.272 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe906ffd640 1 -- 172.21.15.53:0/2422874136 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe908073330 con 0x7fe908070220 2024-05-08T18:12:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe906ffd640 1 --2- 172.21.15.53:0/2422874136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe908070600 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009740 tx=0x7fe8f801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d35e8e5c7c4cd2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.270+0000 7fe905ffb640 1 -- 172.21.15.53:0/2422874136 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80b0070 con 0x7fe908070220 2024-05-08T18:12:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe905ffb640 1 -- 172.21.15.53:0/2422874136 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f80ab530 con 0x7fe908070220 2024-05-08T18:12:14.274 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe905ffb640 1 -- 172.21.15.53:0/2422874136 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80ab830 con 0x7fe908070220 2024-05-08T18:12:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/2422874136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 msgr2=0x7fe908070600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 --2- 172.21.15.53:0/2422874136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe908070600 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8009740 tx=0x7fe8f801c370 comp rx=0 tx=0).stop 2024-05-08T18:12:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/2422874136 shutdown_connections 2024-05-08T18:12:14.275 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 --2- 172.21.15.53:0/2422874136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe908070600 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/2422874136 >> 172.21.15.53:0/2422874136 conn(0x7fe9080a1c20 msgr2=0x7fe9080a2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/2422874136 shutdown_connections 2024-05-08T18:12:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/2422874136 wait complete. 2024-05-08T18:12:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 Processor -- start 2024-05-08T18:12:14.276 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- start start 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe90811c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe908138100 con 0x7fe908070220 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe906ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe90811c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe906ffd640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe90811c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:58378/0 (socket says 172.21.15.53:58378) 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe906ffd640 1 -- 172.21.15.53:0/3383092169 learned_addr learned my addr 172.21.15.53:0/3383092169 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe906ffd640 1 -- 172.21.15.53:0/3383092169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90812d310 con 0x7fe908070220 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe906ffd640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe90811c050 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80ae040 tx=0x7fe8f801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80b0050 con 0x7fe908070220 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8f80b1040 con 0x7fe908070220 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe90811ee10 con 0x7fe908070220 2024-05-08T18:12:14.278 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8f80b5930 con 0x7fe908070220 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe90811f2a0 con 0x7fe908070220 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe8f80be030 con 0x7fe908070220 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe908064150 con 0x7fe908070220 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe8ef7fe640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe8f4039b50 0x7fe8f403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.274+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe8f80bc070 con 0x7fe908070220 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.278+0000 7fe9067fc640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe8f4039b50 0x7fe8f403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:14.279 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.278+0000 7fe9067fc640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe8f4039b50 0x7fe8f403c010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc005890 tx=0x7fe8fc007ab0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:14.282 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.282+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe8f80c5020 con 0x7fe908070220 2024-05-08T18:12:14.437 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.434+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe90811da00 con 0x7fe8f4039b50 2024-05-08T18:12:14.482 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.482+0000 7fe8ef7fe640 1 -- 172.21.15.53:0/3383092169 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665521 (secure 0 0 0) 0x7fe90811da00 con 0x7fe8f4039b50 2024-05-08T18:12:14.490 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:14.495 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:12:14.496 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe8f4039b50 msgr2=0x7fe8f403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe8f4039b50 0x7fe8f403c010 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc005890 tx=0x7fe8fc007ab0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 msgr2=0x7fe90811c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe90811c050 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80ae040 tx=0x7fe8f801abb0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 shutdown_connections 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe8f4039b50 0x7fe8f403c010 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 --2- 172.21.15.53:0/3383092169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe908070220 0x7fe90811c050 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 >> 172.21.15.53:0/3383092169 conn(0x7fe9080a1c20 msgr2=0x7fe908132200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 shutdown_connections 2024-05-08T18:12:14.497 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:14.490+0000 7fe90d3d8640 1 -- 172.21.15.53:0/3383092169 wait complete. 2024-05-08T18:12:14.512 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-05-08T18:12:13.411488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603093,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5068,"num_read_kb":4654,"num_write":2121,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4562,"ondisk_log_size":4562,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144192,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343168,"statfs":{"total":386547056640,"available":386399404032,"internally_reserved":0,"allocated":2908160,"data_stored":1758306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1991,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":726,"num_read_kb":685,"num_write":459,"num_write_kb":29373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005725"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589617+0000","last_change":"2024-05-08T18:08:47.510504+0000","last_active":"2024-05-08T18:09:28.589617+0000","last_peered":"2024-05-08T18:09:28.589617+0000","last_clean":"2024-05-08T18:09:28.589617+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:09:28.589617+0000","last_undegraded":"2024-05-08T18:09:28.589617+0000","last_fullsized":"2024-05-08T18:09:28.589617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755613+0000","last_change":"2024-05-08T18:08:49.501074+0000","last_active":"2024-05-08T18:12:02.755613+0000","last_peered":"2024-05-08T18:12:02.755613+0000","last_clean":"2024-05-08T18:12:02.755613+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:12:02.755613+0000","last_undegraded":"2024-05-08T18:12:02.755613+0000","last_fullsized":"2024-05-08T18:12:02.755613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583198+0000","last_change":"2024-05-08T18:08:47.517769+0000","last_active":"2024-05-08T18:09:28.583198+0000","last_peered":"2024-05-08T18:09:28.583198+0000","last_clean":"2024-05-08T18:09:28.583198+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:09:28.583198+0000","last_undegraded":"2024-05-08T18:09:28.583198+0000","last_fullsized":"2024-05-08T18:09:28.583198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688121+0000","last_change":"2024-05-08T18:08:49.505238+0000","last_active":"2024-05-08T18:12:02.688121+0000","last_peered":"2024-05-08T18:12:02.688121+0000","last_clean":"2024-05-08T18:12:02.688121+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:12:02.688121+0000","last_undegraded":"2024-05-08T18:12:02.688121+0000","last_fullsized":"2024-05-08T18:12:02.688121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:44.433982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602848+0000","last_change":"2024-05-08T18:08:47.529012+0000","last_active":"2024-05-08T18:09:28.602848+0000","last_peered":"2024-05-08T18:09:28.602848+0000","last_clean":"2024-05-08T18:09:28.602848+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:09:28.602848+0000","last_undegraded":"2024-05-08T18:09:28.602848+0000","last_fullsized":"2024-05-08T18:09:28.602848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:59.877643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.243439+0000","last_change":"2024-05-08T18:08:49.512376+0000","last_active":"2024-05-08T18:12:02.243439+0000","last_peered":"2024-05-08T18:12:02.243439+0000","last_clean":"2024-05-08T18:12:02.243439+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:02.243439+0000","last_undegraded":"2024-05-08T18:12:02.243439+0000","last_fullsized":"2024-05-08T18:12:02.243439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:50.199302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584975+0000","last_change":"2024-05-08T18:08:47.506602+0000","last_active":"2024-05-08T18:09:28.584975+0000","last_peered":"2024-05-08T18:09:28.584975+0000","last_clean":"2024-05-08T18:09:28.584975+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:09:28.584975+0000","last_undegraded":"2024-05-08T18:09:28.584975+0000","last_fullsized":"2024-05-08T18:09:28.584975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603042+0000","last_change":"2024-05-08T18:08:49.514808+0000","last_active":"2024-05-08T18:09:28.603042+0000","last_peered":"2024-05-08T18:09:28.603042+0000","last_clean":"2024-05-08T18:09:28.603042+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:09:28.603042+0000","last_undegraded":"2024-05-08T18:09:28.603042+0000","last_fullsized":"2024-05-08T18:09:28.603042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:07.745157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594223+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:09:28.594223+0000","last_peered":"2024-05-08T18:09:28.594223+0000","last_clean":"2024-05-08T18:09:28.594223+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:09:28.594223+0000","last_undegraded":"2024-05-08T18:09:28.594223+0000","last_fullsized":"2024-05-08T18:09:28.594223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:19.036791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.621110+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:11:01.621110+0000","last_peered":"2024-05-08T18:11:01.621110+0000","last_clean":"2024-05-08T18:11:01.621110+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:11:01.621110+0000","last_undegraded":"2024-05-08T18:11:01.621110+0000","last_fullsized":"2024-05-08T18:11:01.621110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.476707+0000","last_change":"2024-05-08T18:08:47.517680+0000","last_active":"2024-05-08T18:10:16.476707+0000","last_peered":"2024-05-08T18:10:16.476707+0000","last_clean":"2024-05-08T18:10:16.476707+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:10:16.476707+0000","last_undegraded":"2024-05-08T18:10:16.476707+0000","last_fullsized":"2024-05-08T18:10:16.476707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.598289+0000","last_change":"2024-05-08T18:08:49.512339+0000","last_active":"2024-05-08T18:12:02.598289+0000","last_peered":"2024-05-08T18:12:02.598289+0000","last_clean":"2024-05-08T18:12:02.598289+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:02.598289+0000","last_undegraded":"2024-05-08T18:12:02.598289+0000","last_fullsized":"2024-05-08T18:12:02.598289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:17.813477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597200+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:09:28.597200+0000","last_peered":"2024-05-08T18:09:28.597200+0000","last_clean":"2024-05-08T18:09:28.597200+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:09:28.597200+0000","last_undegraded":"2024-05-08T18:09:28.597200+0000","last_fullsized":"2024-05-08T18:09:28.597200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:58.240945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755650+0000","last_change":"2024-05-08T18:08:49.497230+0000","last_active":"2024-05-08T18:12:02.755650+0000","last_peered":"2024-05-08T18:12:02.755650+0000","last_clean":"2024-05-08T18:12:02.755650+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:02.755650+0000","last_undegraded":"2024-05-08T18:12:02.755650+0000","last_fullsized":"2024-05-08T18:12:02.755650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.419603+0000","last_change":"2024-05-08T18:08:47.511982+0000","last_active":"2024-05-08T18:09:33.419603+0000","last_peered":"2024-05-08T18:09:33.419603+0000","last_clean":"2024-05-08T18:09:33.419603+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:09:33.419603+0000","last_undegraded":"2024-05-08T18:09:33.419603+0000","last_fullsized":"2024-05-08T18:09:33.419603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755669+0000","last_change":"2024-05-08T18:08:49.515516+0000","last_active":"2024-05-08T18:12:02.755669+0000","last_peered":"2024-05-08T18:12:02.755669+0000","last_clean":"2024-05-08T18:12:02.755669+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:02.755669+0000","last_undegraded":"2024-05-08T18:12:02.755669+0000","last_fullsized":"2024-05-08T18:12:02.755669+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391545+0000","last_change":"2024-05-08T18:08:49.508214+0000","last_active":"2024-05-08T18:12:02.391545+0000","last_peered":"2024-05-08T18:12:02.391545+0000","last_clean":"2024-05-08T18:12:02.391545+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:12:02.391545+0000","last_undegraded":"2024-05-08T18:12:02.391545+0000","last_fullsized":"2024-05-08T18:12:02.391545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:02.344619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582645+0000","last_change":"2024-05-08T18:08:47.511822+0000","last_active":"2024-05-08T18:09:28.582645+0000","last_peered":"2024-05-08T18:09:28.582645+0000","last_clean":"2024-05-08T18:09:28.582645+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:09:28.582645+0000","last_undegraded":"2024-05-08T18:09:28.582645+0000","last_fullsized":"2024-05-08T18:09:28.582645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755519+0000","last_change":"2024-05-08T18:08:49.500178+0000","last_active":"2024-05-08T18:12:02.755519+0000","last_peered":"2024-05-08T18:12:02.755519+0000","last_clean":"2024-05-08T18:12:02.755519+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:02.755519+0000","last_undegraded":"2024-05-08T18:12:02.755519+0000","last_fullsized":"2024-05-08T18:12:02.755519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:01.891956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594972+0000","last_change":"2024-05-08T18:08:47.513087+0000","last_active":"2024-05-08T18:09:28.594972+0000","last_peered":"2024-05-08T18:09:28.594972+0000","last_clean":"2024-05-08T18:09:28.594972+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:09:28.594972+0000","last_undegraded":"2024-05-08T18:09:28.594972+0000","last_fullsized":"2024-05-08T18:09:28.594972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575992+0000","last_change":"2024-05-08T18:08:49.500044+0000","last_active":"2024-05-08T18:09:28.575992+0000","last_peered":"2024-05-08T18:09:28.575992+0000","last_clean":"2024-05-08T18:09:28.575992+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:09:28.575992+0000","last_undegraded":"2024-05-08T18:09:28.575992+0000","last_fullsized":"2024-05-08T18:09:28.575992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:30.168588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575062+0000","last_change":"2024-05-08T18:08:47.513484+0000","last_active":"2024-05-08T18:09:28.575062+0000","last_peered":"2024-05-08T18:09:28.575062+0000","last_clean":"2024-05-08T18:09:28.575062+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:09:28.575062+0000","last_undegraded":"2024-05-08T18:09:28.575062+0000","last_fullsized":"2024-05-08T18:09:28.575062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640685+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:01.640685+0000","last_peered":"2024-05-08T18:11:01.640685+0000","last_clean":"2024-05-08T18:11:01.640685+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:01.640685+0000","last_undegraded":"2024-05-08T18:11:01.640685+0000","last_fullsized":"2024-05-08T18:11:01.640685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:31.685937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'6","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.046830+0000","last_change":"2024-05-08T18:08:47.496959+0000","last_active":"2024-05-08T18:12:02.046830+0000","last_peered":"2024-05-08T18:12:02.046830+0000","last_clean":"2024-05-08T18:12:02.046830+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:12:02.046830+0000","last_undegraded":"2024-05-08T18:12:02.046830+0000","last_fullsized":"2024-05-08T18:12:02.046830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755450+0000","last_change":"2024-05-08T18:08:49.511519+0000","last_active":"2024-05-08T18:12:02.755450+0000","last_peered":"2024-05-08T18:12:02.755450+0000","last_clean":"2024-05-08T18:12:02.755450+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:02.755450+0000","last_undegraded":"2024-05-08T18:12:02.755450+0000","last_fullsized":"2024-05-08T18:12:02.755450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:07.067518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.995598+0000","last_change":"2024-05-08T18:08:47.513517+0000","last_active":"2024-05-08T18:12:01.995598+0000","last_peered":"2024-05-08T18:12:01.995598+0000","last_clean":"2024-05-08T18:12:01.995598+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:12:01.995598+0000","last_undegraded":"2024-05-08T18:12:01.995598+0000","last_fullsized":"2024-05-08T18:12:01.995598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:00:33.270853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.105302+0000","last_change":"2024-05-08T18:08:49.496030+0000","last_active":"2024-05-08T18:09:33.105302+0000","last_peered":"2024-05-08T18:09:33.105302+0000","last_clean":"2024-05-08T18:09:33.105302+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:09:33.105302+0000","last_undegraded":"2024-05-08T18:09:33.105302+0000","last_fullsized":"2024-05-08T18:09:33.105302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.116298+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:12:02.116298+0000","last_peered":"2024-05-08T18:12:02.116298+0000","last_clean":"2024-05-08T18:12:02.116298+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:12:02.116298+0000","last_undegraded":"2024-05-08T18:12:02.116298+0000","last_fullsized":"2024-05-08T18:12:02.116298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:03.768445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":99,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.646508+0000","last_change":"2024-05-08T18:08:57.567982+0000","last_active":"2024-05-08T18:12:02.646508+0000","last_peered":"2024-05-08T18:12:02.646508+0000","last_clean":"2024-05-08T18:12:02.646508+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:12:02.646508+0000","last_undegraded":"2024-05-08T18:12:02.646508+0000","last_fullsized":"2024-05-08T18:12:02.646508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:52.349480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.756078+0000","last_change":"2024-05-08T18:08:49.512724+0000","last_active":"2024-05-08T18:12:02.756078+0000","last_peered":"2024-05-08T18:12:02.756078+0000","last_clean":"2024-05-08T18:12:02.756078+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:02.756078+0000","last_undegraded":"2024-05-08T18:12:02.756078+0000","last_fullsized":"2024-05-08T18:12:02.756078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:36.090445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593298+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:09:28.593298+0000","last_peered":"2024-05-08T18:09:28.593298+0000","last_clean":"2024-05-08T18:09:28.593298+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:09:28.593298+0000","last_undegraded":"2024-05-08T18:09:28.593298+0000","last_fullsized":"2024-05-08T18:09:28.593298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:34.298278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597381+0000","last_change":"2024-05-08T18:08:51.505825+0000","last_active":"2024-05-08T18:09:28.597381+0000","last_peered":"2024-05-08T18:09:28.597381+0000","last_clean":"2024-05-08T18:09:28.597381+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:09:28.597381+0000","last_undegraded":"2024-05-08T18:09:28.597381+0000","last_fullsized":"2024-05-08T18:09:28.597381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:07.975264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.628370+0000","last_change":"2024-05-08T18:08:53.550245+0000","last_active":"2024-05-08T18:12:09.628370+0000","last_peered":"2024-05-08T18:12:09.628370+0000","last_clean":"2024-05-08T18:12:09.628370+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:12:09.628370+0000","last_undegraded":"2024-05-08T18:12:09.628370+0000","last_fullsized":"2024-05-08T18:12:09.628370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:20:46.416684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582464+0000","last_change":"2024-05-08T18:08:55.544376+0000","last_active":"2024-05-08T18:09:28.582464+0000","last_peered":"2024-05-08T18:09:28.582464+0000","last_clean":"2024-05-08T18:09:28.582464+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:09:28.582464+0000","last_undegraded":"2024-05-08T18:09:28.582464+0000","last_fullsized":"2024-05-08T18:09:28.582464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.499404+0000","last_change":"2024-05-08T18:08:57.562642+0000","last_active":"2024-05-08T18:10:16.499404+0000","last_peered":"2024-05-08T18:10:16.499404+0000","last_clean":"2024-05-08T18:10:16.499404+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:10:16.499404+0000","last_undegraded":"2024-05-08T18:10:16.499404+0000","last_fullsized":"2024-05-08T18:10:16.499404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:17.758737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597657+0000","last_change":"2024-05-08T18:08:49.513376+0000","last_active":"2024-05-08T18:12:02.597657+0000","last_peered":"2024-05-08T18:12:02.597657+0000","last_clean":"2024-05-08T18:12:02.597657+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:02.597657+0000","last_undegraded":"2024-05-08T18:12:02.597657+0000","last_fullsized":"2024-05-08T18:12:02.597657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:18.558772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579314+0000","last_change":"2024-05-08T18:08:47.514599+0000","last_active":"2024-05-08T18:09:28.579314+0000","last_peered":"2024-05-08T18:09:28.579314+0000","last_clean":"2024-05-08T18:09:28.579314+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:09:28.579314+0000","last_undegraded":"2024-05-08T18:09:28.579314+0000","last_fullsized":"2024-05-08T18:09:28.579314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:36.921377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578587+0000","last_change":"2024-05-08T18:08:51.510019+0000","last_active":"2024-05-08T18:09:28.578587+0000","last_peered":"2024-05-08T18:09:28.578587+0000","last_clean":"2024-05-08T18:09:28.578587+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:09:28.578587+0000","last_undegraded":"2024-05-08T18:09:28.578587+0000","last_fullsized":"2024-05-08T18:09:28.578587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:08.155776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581714+0000","last_change":"2024-05-08T18:08:53.529258+0000","last_active":"2024-05-08T18:09:28.581714+0000","last_peered":"2024-05-08T18:09:28.581714+0000","last_clean":"2024-05-08T18:09:28.581714+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:09:28.581714+0000","last_undegraded":"2024-05-08T18:09:28.581714+0000","last_fullsized":"2024-05-08T18:09:28.581714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:41.643997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574807+0000","last_change":"2024-05-08T18:08:55.556181+0000","last_active":"2024-05-08T18:09:28.574807+0000","last_peered":"2024-05-08T18:09:28.574807+0000","last_clean":"2024-05-08T18:09:28.574807+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:09:28.574807+0000","last_undegraded":"2024-05-08T18:09:28.574807+0000","last_fullsized":"2024-05-08T18:09:28.574807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.792229+0000","last_change":"2024-05-08T18:08:57.565097+0000","last_active":"2024-05-08T18:12:01.792229+0000","last_peered":"2024-05-08T18:12:01.792229+0000","last_clean":"2024-05-08T18:12:01.792229+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:12:01.792229+0000","last_undegraded":"2024-05-08T18:12:01.792229+0000","last_fullsized":"2024-05-08T18:12:01.792229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392228+0000","last_change":"2024-05-08T18:08:49.515508+0000","last_active":"2024-05-08T18:12:02.392228+0000","last_peered":"2024-05-08T18:12:02.392228+0000","last_clean":"2024-05-08T18:12:02.392228+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:02.392228+0000","last_undegraded":"2024-05-08T18:12:02.392228+0000","last_fullsized":"2024-05-08T18:12:02.392228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:35.075462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.423730+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:09:33.423730+0000","last_peered":"2024-05-08T18:09:33.423730+0000","last_clean":"2024-05-08T18:09:33.423730+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:09:33.423730+0000","last_undegraded":"2024-05-08T18:09:33.423730+0000","last_fullsized":"2024-05-08T18:09:33.423730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:39.673917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581355+0000","last_change":"2024-05-08T18:08:51.512103+0000","last_active":"2024-05-08T18:09:28.581355+0000","last_peered":"2024-05-08T18:09:28.581355+0000","last_clean":"2024-05-08T18:09:28.581355+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:09:28.581355+0000","last_undegraded":"2024-05-08T18:09:28.581355+0000","last_fullsized":"2024-05-08T18:09:28.581355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:29.355971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'11","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.644505+0000","last_change":"2024-05-08T18:08:53.547887+0000","last_active":"2024-05-08T18:11:01.644505+0000","last_peered":"2024-05-08T18:11:01.644505+0000","last_clean":"2024-05-08T18:11:01.644505+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:11:01.644505+0000","last_undegraded":"2024-05-08T18:11:01.644505+0000","last_fullsized":"2024-05-08T18:11:01.644505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:37.748836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":394,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.355293+0000","last_change":"2024-05-08T18:08:55.569300+0000","last_active":"2024-05-08T18:12:09.355293+0000","last_peered":"2024-05-08T18:12:09.355293+0000","last_clean":"2024-05-08T18:12:09.355293+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:09.355293+0000","last_undegraded":"2024-05-08T18:12:09.355293+0000","last_fullsized":"2024-05-08T18:12:09.355293+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:40:39.688576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.867775+0000","last_change":"2024-05-08T18:08:57.564089+0000","last_active":"2024-05-08T18:12:02.867775+0000","last_peered":"2024-05-08T18:12:02.867775+0000","last_clean":"2024-05-08T18:12:02.867775+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:02.867775+0000","last_undegraded":"2024-05-08T18:12:02.867775+0000","last_fullsized":"2024-05-08T18:12:02.867775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:58.387686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785001+0000","last_change":"2024-05-08T18:08:49.502184+0000","last_active":"2024-05-08T18:10:16.785001+0000","last_peered":"2024-05-08T18:10:16.785001+0000","last_clean":"2024-05-08T18:10:16.785001+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:10:16.785001+0000","last_undegraded":"2024-05-08T18:10:16.785001+0000","last_fullsized":"2024-05-08T18:10:16.785001+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.897867+0000","last_change":"2024-05-08T18:08:47.498742+0000","last_active":"2024-05-08T18:09:31.897867+0000","last_peered":"2024-05-08T18:09:31.897867+0000","last_clean":"2024-05-08T18:09:31.897867+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:09:31.897867+0000","last_undegraded":"2024-05-08T18:09:31.897867+0000","last_fullsized":"2024-05-08T18:09:31.897867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:17:17.448245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607265+0000","last_change":"2024-05-08T18:08:51.513252+0000","last_active":"2024-05-08T18:09:28.607265+0000","last_peered":"2024-05-08T18:09:28.607265+0000","last_clean":"2024-05-08T18:09:28.607265+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:09:28.607265+0000","last_undegraded":"2024-05-08T18:09:28.607265+0000","last_fullsized":"2024-05-08T18:09:28.607265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:26:27.262513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.584524+0000","last_change":"2024-05-08T18:08:53.550029+0000","last_active":"2024-05-08T18:12:09.584524+0000","last_peered":"2024-05-08T18:12:09.584524+0000","last_clean":"2024-05-08T18:12:09.584524+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:12:09.584524+0000","last_undegraded":"2024-05-08T18:12:09.584524+0000","last_fullsized":"2024-05-08T18:12:09.584524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:25:31.369561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.363736+0000","last_change":"2024-05-08T18:08:55.559384+0000","last_active":"2024-05-08T18:12:09.363736+0000","last_peered":"2024-05-08T18:12:09.363736+0000","last_clean":"2024-05-08T18:12:09.363736+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:09.363736+0000","last_undegraded":"2024-05-08T18:12:09.363736+0000","last_fullsized":"2024-05-08T18:12:09.363736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:45:12.001547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'11","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706714+0000","last_change":"2024-05-08T18:08:49.510841+0000","last_active":"2024-05-08T18:12:02.706714+0000","last_peered":"2024-05-08T18:12:02.706714+0000","last_clean":"2024-05-08T18:12:02.706714+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:02.706714+0000","last_undegraded":"2024-05-08T18:12:02.706714+0000","last_fullsized":"2024-05-08T18:12:02.706714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:50.298264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590076+0000","last_change":"2024-05-08T18:08:47.512906+0000","last_active":"2024-05-08T18:09:28.590076+0000","last_peered":"2024-05-08T18:09:28.590076+0000","last_clean":"2024-05-08T18:09:28.590076+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:09:28.590076+0000","last_undegraded":"2024-05-08T18:09:28.590076+0000","last_fullsized":"2024-05-08T18:09:28.590076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572207+0000","last_change":"2024-05-08T18:08:51.514762+0000","last_active":"2024-05-08T18:09:28.572207+0000","last_peered":"2024-05-08T18:09:28.572207+0000","last_clean":"2024-05-08T18:09:28.572207+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:09:28.572207+0000","last_undegraded":"2024-05-08T18:09:28.572207+0000","last_fullsized":"2024-05-08T18:09:28.572207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:04.358592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'43","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.658941+0000","last_change":"2024-05-08T18:08:53.535349+0000","last_active":"2024-05-08T18:12:09.658941+0000","last_peered":"2024-05-08T18:12:09.658941+0000","last_clean":"2024-05-08T18:12:09.658941+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:12:09.658941+0000","last_undegraded":"2024-05-08T18:12:09.658941+0000","last_fullsized":"2024-05-08T18:12:09.658941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:54.325827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583740+0000","last_change":"2024-05-08T18:08:55.543395+0000","last_active":"2024-05-08T18:09:28.583740+0000","last_peered":"2024-05-08T18:09:28.583740+0000","last_clean":"2024-05-08T18:09:28.583740+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:09:28.583740+0000","last_undegraded":"2024-05-08T18:09:28.583740+0000","last_fullsized":"2024-05-08T18:09:28.583740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:20.271109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.502622+0000","last_change":"2024-05-08T18:08:57.563745+0000","last_active":"2024-05-08T18:10:16.502622+0000","last_peered":"2024-05-08T18:10:16.502622+0000","last_clean":"2024-05-08T18:10:16.502622+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:10:16.502622+0000","last_undegraded":"2024-05-08T18:10:16.502622+0000","last_fullsized":"2024-05-08T18:10:16.502622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:30.621504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.785596+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:10:16.785596+0000","last_peered":"2024-05-08T18:10:16.785596+0000","last_clean":"2024-05-08T18:10:16.785596+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:10:16.785596+0000","last_undegraded":"2024-05-08T18:10:16.785596+0000","last_fullsized":"2024-05-08T18:10:16.785596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:25.048994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591192+0000","last_change":"2024-05-08T18:08:47.513909+0000","last_active":"2024-05-08T18:09:28.591192+0000","last_peered":"2024-05-08T18:09:28.591192+0000","last_clean":"2024-05-08T18:09:28.591192+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:09:28.591192+0000","last_undegraded":"2024-05-08T18:09:28.591192+0000","last_fullsized":"2024-05-08T18:09:28.591192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:19:52.382864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407203+0000","last_change":"2024-05-08T18:09:28.594816+0000","last_active":"2024-05-08T18:09:31.407203+0000","last_peered":"2024-05-08T18:09:31.407203+0000","last_clean":"2024-05-08T18:09:31.407203+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:09:31.407203+0000","last_undegraded":"2024-05-08T18:09:31.407203+0000","last_fullsized":"2024-05-08T18:09:31.407203+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:28.103174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.503305+0000","last_change":"2024-05-08T18:08:53.558331+0000","last_active":"2024-05-08T18:12:09.503305+0000","last_peered":"2024-05-08T18:12:09.503305+0000","last_clean":"2024-05-08T18:12:09.503305+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:12:09.503305+0000","last_undegraded":"2024-05-08T18:12:09.503305+0000","last_fullsized":"2024-05-08T18:12:09.503305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:18:26.213210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576613+0000","last_change":"2024-05-08T18:08:55.546287+0000","last_active":"2024-05-08T18:09:28.576613+0000","last_peered":"2024-05-08T18:09:28.576613+0000","last_clean":"2024-05-08T18:09:28.576613+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:09:28.576613+0000","last_undegraded":"2024-05-08T18:09:28.576613+0000","last_fullsized":"2024-05-08T18:09:28.576613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:10.826721+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:10:10.826721+0000","last_peered":"2024-05-08T18:10:10.826721+0000","last_clean":"2024-05-08T18:10:10.826721+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:10:10.826721+0000","last_undegraded":"2024-05-08T18:10:10.826721+0000","last_fullsized":"2024-05-08T18:10:10.826721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:47.365483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620354+0000","last_change":"2024-05-08T18:08:49.508936+0000","last_active":"2024-05-08T18:12:02.620354+0000","last_peered":"2024-05-08T18:12:02.620354+0000","last_clean":"2024-05-08T18:12:02.620354+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:02.620354+0000","last_undegraded":"2024-05-08T18:12:02.620354+0000","last_fullsized":"2024-05-08T18:12:02.620354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:20:21.051104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599345+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:09:28.599345+0000","last_peered":"2024-05-08T18:09:28.599345+0000","last_clean":"2024-05-08T18:09:28.599345+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:09:28.599345+0000","last_undegraded":"2024-05-08T18:09:28.599345+0000","last_fullsized":"2024-05-08T18:09:28.599345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:40.628230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584773+0000","last_change":"2024-05-08T18:08:51.511856+0000","last_active":"2024-05-08T18:09:28.584773+0000","last_peered":"2024-05-08T18:09:28.584773+0000","last_clean":"2024-05-08T18:09:28.584773+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:09:28.584773+0000","last_undegraded":"2024-05-08T18:09:28.584773+0000","last_fullsized":"2024-05-08T18:09:28.584773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:46.281518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.432881+0000","last_change":"2024-05-08T18:08:53.543547+0000","last_active":"2024-05-08T18:12:09.432881+0000","last_peered":"2024-05-08T18:12:09.432881+0000","last_clean":"2024-05-08T18:12:09.432881+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:12:09.432881+0000","last_undegraded":"2024-05-08T18:12:09.432881+0000","last_fullsized":"2024-05-08T18:12:09.432881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:16.619812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":358,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.366195+0000","last_change":"2024-05-08T18:08:55.546405+0000","last_active":"2024-05-08T18:12:09.366195+0000","last_peered":"2024-05-08T18:12:09.366195+0000","last_clean":"2024-05-08T18:12:09.366195+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:09.366195+0000","last_undegraded":"2024-05-08T18:12:09.366195+0000","last_fullsized":"2024-05-08T18:12:09.366195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578554+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:09:28.578554+0000","last_peered":"2024-05-08T18:09:28.578554+0000","last_clean":"2024-05-08T18:09:28.578554+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:09:28.578554+0000","last_undegraded":"2024-05-08T18:09:28.578554+0000","last_fullsized":"2024-05-08T18:09:28.578554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:35.900474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.451117+0000","last_change":"2024-05-08T18:08:49.491239+0000","last_active":"2024-05-08T18:10:57.451117+0000","last_peered":"2024-05-08T18:10:57.451117+0000","last_clean":"2024-05-08T18:10:57.451117+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:10:57.451117+0000","last_undegraded":"2024-05-08T18:10:57.451117+0000","last_fullsized":"2024-05-08T18:10:57.451117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.412627+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:09:33.412627+0000","last_peered":"2024-05-08T18:09:33.412627+0000","last_clean":"2024-05-08T18:09:33.412627+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:09:33.412627+0000","last_undegraded":"2024-05-08T18:09:33.412627+0000","last_fullsized":"2024-05-08T18:09:33.412627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:02.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.407275+0000","last_change":"2024-05-08T18:09:28.599715+0000","last_active":"2024-05-08T18:09:31.407275+0000","last_peered":"2024-05-08T18:09:31.407275+0000","last_clean":"2024-05-08T18:09:31.407275+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:09:31.407275+0000","last_undegraded":"2024-05-08T18:09:31.407275+0000","last_fullsized":"2024-05-08T18:09:31.407275+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:11.718211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'60","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.536160+0000","last_change":"2024-05-08T18:08:53.550420+0000","last_active":"2024-05-08T18:12:09.536160+0000","last_peered":"2024-05-08T18:12:09.536160+0000","last_clean":"2024-05-08T18:12:09.536160+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:12:09.536160+0000","last_undegraded":"2024-05-08T18:12:09.536160+0000","last_fullsized":"2024-05-08T18:12:09.536160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:26.341867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576602+0000","last_change":"2024-05-08T18:08:55.554490+0000","last_active":"2024-05-08T18:09:28.576602+0000","last_peered":"2024-05-08T18:09:28.576602+0000","last_clean":"2024-05-08T18:09:28.576602+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:09:28.576602+0000","last_undegraded":"2024-05-08T18:09:28.576602+0000","last_fullsized":"2024-05-08T18:09:28.576602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.922608+0000","last_change":"2024-05-08T18:08:57.554614+0000","last_active":"2024-05-08T18:12:02.922608+0000","last_peered":"2024-05-08T18:12:02.922608+0000","last_clean":"2024-05-08T18:12:02.922608+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:02.922608+0000","last_undegraded":"2024-05-08T18:12:02.922608+0000","last_fullsized":"2024-05-08T18:12:02.922608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:05.491234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658994+0000","last_change":"2024-05-08T18:08:49.519440+0000","last_active":"2024-05-08T18:09:32.658994+0000","last_peered":"2024-05-08T18:09:32.658994+0000","last_clean":"2024-05-08T18:09:32.658994+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:09:32.658994+0000","last_undegraded":"2024-05-08T18:09:32.658994+0000","last_fullsized":"2024-05-08T18:09:32.658994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581363+0000","last_change":"2024-05-08T18:08:47.496893+0000","last_active":"2024-05-08T18:09:28.581363+0000","last_peered":"2024-05-08T18:09:28.581363+0000","last_clean":"2024-05-08T18:09:28.581363+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:09:28.581363+0000","last_undegraded":"2024-05-08T18:09:28.581363+0000","last_fullsized":"2024-05-08T18:09:28.581363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:29:34.452347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584821+0000","last_change":"2024-05-08T18:08:51.507807+0000","last_active":"2024-05-08T18:09:28.584821+0000","last_peered":"2024-05-08T18:09:28.584821+0000","last_clean":"2024-05-08T18:09:28.584821+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:09:28.584821+0000","last_undegraded":"2024-05-08T18:09:28.584821+0000","last_fullsized":"2024-05-08T18:09:28.584821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:57.040658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'36","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.542172+0000","last_change":"2024-05-08T18:08:53.519537+0000","last_active":"2024-05-08T18:12:09.542172+0000","last_peered":"2024-05-08T18:12:09.542172+0000","last_clean":"2024-05-08T18:12:09.542172+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:12:09.542172+0000","last_undegraded":"2024-05-08T18:12:09.542172+0000","last_fullsized":"2024-05-08T18:12:09.542172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:52.757767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598872+0000","last_change":"2024-05-08T18:08:55.570542+0000","last_active":"2024-05-08T18:09:28.598872+0000","last_peered":"2024-05-08T18:09:28.598872+0000","last_clean":"2024-05-08T18:09:28.598872+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:09:28.598872+0000","last_undegraded":"2024-05-08T18:09:28.598872+0000","last_fullsized":"2024-05-08T18:09:28.598872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:32:08.738890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429230+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:11:01.429230+0000","last_peered":"2024-05-08T18:11:01.429230+0000","last_clean":"2024-05-08T18:11:01.429230+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:11:01.429230+0000","last_undegraded":"2024-05-08T18:11:01.429230+0000","last_fullsized":"2024-05-08T18:11:01.429230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:44:49.482320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.688757+0000","last_change":"2024-05-08T18:08:49.515298+0000","last_active":"2024-05-08T18:12:02.688757+0000","last_peered":"2024-05-08T18:12:02.688757+0000","last_clean":"2024-05-08T18:12:02.688757+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:02.688757+0000","last_undegraded":"2024-05-08T18:12:02.688757+0000","last_fullsized":"2024-05-08T18:12:02.688757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:48.730204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.113571+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:12:02.113571+0000","last_peered":"2024-05-08T18:12:02.113571+0000","last_clean":"2024-05-08T18:12:02.113571+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:12:02.113571+0000","last_undegraded":"2024-05-08T18:12:02.113571+0000","last_fullsized":"2024-05-08T18:12:02.113571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:05.053205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.582954+0000","last_change":"2024-05-08T18:08:51.522113+0000","last_active":"2024-05-08T18:09:28.582954+0000","last_peered":"2024-05-08T18:09:28.582954+0000","last_clean":"2024-05-08T18:09:28.582954+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:09:28.582954+0000","last_undegraded":"2024-05-08T18:09:28.582954+0000","last_fullsized":"2024-05-08T18:09:28.582954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:46:38.116549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.481241+0000","last_change":"2024-05-08T18:08:53.521466+0000","last_active":"2024-05-08T18:12:09.481241+0000","last_peered":"2024-05-08T18:12:09.481241+0000","last_clean":"2024-05-08T18:12:09.481241+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:12:09.481241+0000","last_undegraded":"2024-05-08T18:12:09.481241+0000","last_fullsized":"2024-05-08T18:12:09.481241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:54.226864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":434,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.355984+0000","last_change":"2024-05-08T18:08:55.551517+0000","last_active":"2024-05-08T18:12:09.355984+0000","last_peered":"2024-05-08T18:12:09.355984+0000","last_clean":"2024-05-08T18:12:09.355984+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:09.355984+0000","last_undegraded":"2024-05-08T18:12:09.355984+0000","last_fullsized":"2024-05-08T18:12:09.355984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:35:54.770459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420148+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:11:06.420148+0000","last_peered":"2024-05-08T18:11:06.420148+0000","last_clean":"2024-05-08T18:11:06.420148+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:11:06.420148+0000","last_undegraded":"2024-05-08T18:11:06.420148+0000","last_fullsized":"2024-05-08T18:11:06.420148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.783846+0000","last_change":"2024-05-08T18:08:49.511424+0000","last_active":"2024-05-08T18:10:16.783846+0000","last_peered":"2024-05-08T18:10:16.783846+0000","last_clean":"2024-05-08T18:10:16.783846+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:10:16.783846+0000","last_undegraded":"2024-05-08T18:10:16.783846+0000","last_fullsized":"2024-05-08T18:10:16.783846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.346107+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:11:01.346107+0000","last_peered":"2024-05-08T18:11:01.346107+0000","last_clean":"2024-05-08T18:11:01.346107+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:11:01.346107+0000","last_undegraded":"2024-05-08T18:11:01.346107+0000","last_fullsized":"2024-05-08T18:11:01.346107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:07.886229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":417,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.328845+0000","last_change":"2024-05-08T18:08:51.518382+0000","last_active":"2024-05-08T18:12:09.328845+0000","last_peered":"2024-05-08T18:12:09.328845+0000","last_clean":"2024-05-08T18:12:09.328845+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:12:09.328845+0000","last_undegraded":"2024-05-08T18:12:09.328845+0000","last_fullsized":"2024-05-08T18:12:09.328845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:09.759130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597807+0000","last_change":"2024-05-08T18:08:53.558518+0000","last_active":"2024-05-08T18:09:28.597807+0000","last_peered":"2024-05-08T18:09:28.597807+0000","last_clean":"2024-05-08T18:09:28.597807+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:09:28.597807+0000","last_undegraded":"2024-05-08T18:09:28.597807+0000","last_fullsized":"2024-05-08T18:09:28.597807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:55.547274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":463,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.359181+0000","last_change":"2024-05-08T18:08:55.557075+0000","last_active":"2024-05-08T18:12:09.359181+0000","last_peered":"2024-05-08T18:12:09.359181+0000","last_clean":"2024-05-08T18:12:09.359181+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:09.359181+0000","last_undegraded":"2024-05-08T18:12:09.359181+0000","last_fullsized":"2024-05-08T18:12:09.359181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:44.776129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.278025+0000","last_change":"2024-05-08T18:08:57.569509+0000","last_active":"2024-05-08T18:11:01.278025+0000","last_peered":"2024-05-08T18:11:01.278025+0000","last_clean":"2024-05-08T18:11:01.278025+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:11:01.278025+0000","last_undegraded":"2024-05-08T18:11:01.278025+0000","last_fullsized":"2024-05-08T18:11:01.278025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:46.790373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862531+0000","last_change":"2024-05-08T18:08:49.518367+0000","last_active":"2024-05-08T18:12:02.862531+0000","last_peered":"2024-05-08T18:12:02.862531+0000","last_clean":"2024-05-08T18:12:02.862531+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:02.862531+0000","last_undegraded":"2024-05-08T18:12:02.862531+0000","last_fullsized":"2024-05-08T18:12:02.862531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:06.824034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587763+0000","last_change":"2024-05-08T18:08:47.529160+0000","last_active":"2024-05-08T18:09:28.587763+0000","last_peered":"2024-05-08T18:09:28.587763+0000","last_clean":"2024-05-08T18:09:28.587763+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:09:28.587763+0000","last_undegraded":"2024-05-08T18:09:28.587763+0000","last_fullsized":"2024-05-08T18:09:28.587763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:54.279504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607171+0000","last_change":"2024-05-08T18:08:51.511533+0000","last_active":"2024-05-08T18:09:28.607171+0000","last_peered":"2024-05-08T18:09:28.607171+0000","last_clean":"2024-05-08T18:09:28.607171+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:09:28.607171+0000","last_undegraded":"2024-05-08T18:09:28.607171+0000","last_fullsized":"2024-05-08T18:09:28.607171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:10.403888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.636419+0000","last_change":"2024-05-08T18:08:53.517418+0000","last_active":"2024-05-08T18:12:09.636419+0000","last_peered":"2024-05-08T18:12:09.636419+0000","last_clean":"2024-05-08T18:12:09.636419+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:12:09.636419+0000","last_undegraded":"2024-05-08T18:12:09.636419+0000","last_fullsized":"2024-05-08T18:12:09.636419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:45.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586484+0000","last_change":"2024-05-08T18:08:55.541260+0000","last_active":"2024-05-08T18:09:28.586484+0000","last_peered":"2024-05-08T18:09:28.586484+0000","last_clean":"2024-05-08T18:09:28.586484+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:09:28.586484+0000","last_undegraded":"2024-05-08T18:09:28.586484+0000","last_fullsized":"2024-05-08T18:09:28.586484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:47.311202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.828028+0000","last_change":"2024-05-08T18:08:57.568017+0000","last_active":"2024-05-08T18:12:02.828028+0000","last_peered":"2024-05-08T18:12:02.828028+0000","last_clean":"2024-05-08T18:12:02.828028+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:12:02.828028+0000","last_undegraded":"2024-05-08T18:12:02.828028+0000","last_fullsized":"2024-05-08T18:12:02.828028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.143701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'11","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.707182+0000","last_change":"2024-05-08T18:08:49.510311+0000","last_active":"2024-05-08T18:12:02.707182+0000","last_peered":"2024-05-08T18:12:02.707182+0000","last_clean":"2024-05-08T18:12:02.707182+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:02.707182+0000","last_undegraded":"2024-05-08T18:12:02.707182+0000","last_fullsized":"2024-05-08T18:12:02.707182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:19.250288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":142,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571588+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:09:28.571588+0000","last_peered":"2024-05-08T18:09:28.571588+0000","last_clean":"2024-05-08T18:09:28.571588+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:09:28.571588+0000","last_undegraded":"2024-05-08T18:09:28.571588+0000","last_fullsized":"2024-05-08T18:09:28.571588+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:28:09.321105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602411+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:09:28.602411+0000","last_peered":"2024-05-08T18:09:28.602411+0000","last_clean":"2024-05-08T18:09:28.602411+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:09:28.602411+0000","last_undegraded":"2024-05-08T18:09:28.602411+0000","last_fullsized":"2024-05-08T18:09:28.602411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:48.933240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.429157+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:09:33.429157+0000","last_peered":"2024-05-08T18:09:33.429157+0000","last_clean":"2024-05-08T18:09:33.429157+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:09:33.429157+0000","last_undegraded":"2024-05-08T18:09:33.429157+0000","last_fullsized":"2024-05-08T18:09:33.429157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:30.152904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575232+0000","last_change":"2024-05-08T18:08:51.520538+0000","last_active":"2024-05-08T18:09:28.575232+0000","last_peered":"2024-05-08T18:09:28.575232+0000","last_clean":"2024-05-08T18:09:28.575232+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:09:28.575232+0000","last_undegraded":"2024-05-08T18:09:28.575232+0000","last_fullsized":"2024-05-08T18:09:28.575232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:05.746284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'88","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.651990+0000","last_change":"2024-05-08T18:08:53.552241+0000","last_active":"2024-05-08T18:12:09.651990+0000","last_peered":"2024-05-08T18:12:09.651990+0000","last_clean":"2024-05-08T18:12:09.651990+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:09.651990+0000","last_undegraded":"2024-05-08T18:12:09.651990+0000","last_fullsized":"2024-05-08T18:12:09.651990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:04:31.496707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580217+0000","last_change":"2024-05-08T18:08:55.565611+0000","last_active":"2024-05-08T18:09:28.580217+0000","last_peered":"2024-05-08T18:09:28.580217+0000","last_clean":"2024-05-08T18:09:28.580217+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:09:28.580217+0000","last_undegraded":"2024-05-08T18:09:28.580217+0000","last_fullsized":"2024-05-08T18:09:28.580217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:14.430171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":163,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.781603+0000","last_change":"2024-05-08T18:08:57.567916+0000","last_active":"2024-05-08T18:12:02.781603+0000","last_peered":"2024-05-08T18:12:02.781603+0000","last_clean":"2024-05-08T18:12:02.781603+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:02.781603+0000","last_undegraded":"2024-05-08T18:12:02.781603+0000","last_fullsized":"2024-05-08T18:12:02.781603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:51.737414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599193+0000","last_change":"2024-05-08T18:08:49.510047+0000","last_active":"2024-05-08T18:12:02.599193+0000","last_peered":"2024-05-08T18:12:02.599193+0000","last_clean":"2024-05-08T18:12:02.599193+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:12:02.599193+0000","last_undegraded":"2024-05-08T18:12:02.599193+0000","last_fullsized":"2024-05-08T18:12:02.599193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:12.681511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586341+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:09:28.586341+0000","last_peered":"2024-05-08T18:09:28.586341+0000","last_clean":"2024-05-08T18:09:28.586341+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:09:28.586341+0000","last_undegraded":"2024-05-08T18:09:28.586341+0000","last_fullsized":"2024-05-08T18:09:28.586341+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:08:48.054967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576589+0000","last_change":"2024-05-08T18:08:47.515311+0000","last_active":"2024-05-08T18:09:28.576589+0000","last_peered":"2024-05-08T18:09:28.576589+0000","last_clean":"2024-05-08T18:09:28.576589+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:09:28.576589+0000","last_undegraded":"2024-05-08T18:09:28.576589+0000","last_fullsized":"2024-05-08T18:09:28.576589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.607650+0000","last_change":"2024-05-08T18:08:51.512536+0000","last_active":"2024-05-08T18:09:28.607650+0000","last_peered":"2024-05-08T18:09:28.607650+0000","last_clean":"2024-05-08T18:09:28.607650+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:09:28.607650+0000","last_undegraded":"2024-05-08T18:09:28.607650+0000","last_fullsized":"2024-05-08T18:09:28.607650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:58.676437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'284","reported_seq":501,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.646942+0000","last_change":"2024-05-08T18:08:53.530304+0000","last_active":"2024-05-08T18:12:09.646942+0000","last_peered":"2024-05-08T18:12:09.646942+0000","last_clean":"2024-05-08T18:12:09.646942+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:09.646942+0000","last_undegraded":"2024-05-08T18:12:09.646942+0000","last_fullsized":"2024-05-08T18:12:09.646942+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:39.103025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592749+0000","last_change":"2024-05-08T18:08:55.568400+0000","last_active":"2024-05-08T18:09:28.592749+0000","last_peered":"2024-05-08T18:09:28.592749+0000","last_clean":"2024-05-08T18:09:28.592749+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:09:28.592749+0000","last_undegraded":"2024-05-08T18:09:28.592749+0000","last_fullsized":"2024-05-08T18:09:28.592749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:24:48.835521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.496391+0000","last_change":"2024-05-08T18:08:57.579069+0000","last_active":"2024-05-08T18:10:16.496391+0000","last_peered":"2024-05-08T18:10:16.496391+0000","last_clean":"2024-05-08T18:10:16.496391+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:10:16.496391+0000","last_undegraded":"2024-05-08T18:10:16.496391+0000","last_fullsized":"2024-05-08T18:10:16.496391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:49:45.209949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755355+0000","last_change":"2024-05-08T18:08:49.501820+0000","last_active":"2024-05-08T18:12:02.755355+0000","last_peered":"2024-05-08T18:12:02.755355+0000","last_clean":"2024-05-08T18:12:02.755355+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:02.755355+0000","last_undegraded":"2024-05-08T18:12:02.755355+0000","last_fullsized":"2024-05-08T18:12:02.755355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:29.469800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579628+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:09:28.579628+0000","last_peered":"2024-05-08T18:09:28.579628+0000","last_clean":"2024-05-08T18:09:28.579628+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:09:28.579628+0000","last_undegraded":"2024-05-08T18:09:28.579628+0000","last_fullsized":"2024-05-08T18:09:28.579628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:10:52.978101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576151+0000","last_change":"2024-05-08T18:08:47.513124+0000","last_active":"2024-05-08T18:09:28.576151+0000","last_peered":"2024-05-08T18:09:28.576151+0000","last_clean":"2024-05-08T18:09:28.576151+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:09:28.576151+0000","last_undegraded":"2024-05-08T18:09:28.576151+0000","last_fullsized":"2024-05-08T18:09:28.576151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.590814+0000","last_change":"2024-05-08T18:08:51.508831+0000","last_active":"2024-05-08T18:09:28.590814+0000","last_peered":"2024-05-08T18:09:28.590814+0000","last_clean":"2024-05-08T18:09:28.590814+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:09:28.590814+0000","last_undegraded":"2024-05-08T18:09:28.590814+0000","last_fullsized":"2024-05-08T18:09:28.590814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:04.126643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.754979+0000","last_change":"2024-05-08T18:08:53.525229+0000","last_active":"2024-05-08T18:12:01.754979+0000","last_peered":"2024-05-08T18:12:01.754979+0000","last_clean":"2024-05-08T18:12:01.754979+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:01.754979+0000","last_undegraded":"2024-05-08T18:12:01.754979+0000","last_fullsized":"2024-05-08T18:12:01.754979+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:06.372182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581183+0000","last_change":"2024-05-08T18:08:55.567310+0000","last_active":"2024-05-08T18:09:28.581183+0000","last_peered":"2024-05-08T18:09:28.581183+0000","last_clean":"2024-05-08T18:09:28.581183+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:09:28.581183+0000","last_undegraded":"2024-05-08T18:09:28.581183+0000","last_fullsized":"2024-05-08T18:09:28.581183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:30.447596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.450125+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:09:33.450125+0000","last_peered":"2024-05-08T18:09:33.450125+0000","last_clean":"2024-05-08T18:09:33.450125+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:09:33.450125+0000","last_undegraded":"2024-05-08T18:09:33.450125+0000","last_fullsized":"2024-05-08T18:09:33.450125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:09.186479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774957+0000","last_change":"2024-05-08T18:08:49.493587+0000","last_active":"2024-05-08T18:12:02.774957+0000","last_peered":"2024-05-08T18:12:02.774957+0000","last_clean":"2024-05-08T18:12:02.774957+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:02.774957+0000","last_undegraded":"2024-05-08T18:12:02.774957+0000","last_fullsized":"2024-05-08T18:12:02.774957+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:50.164204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593308+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:09:28.593308+0000","last_peered":"2024-05-08T18:09:28.593308+0000","last_clean":"2024-05-08T18:09:28.593308+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:09:28.593308+0000","last_undegraded":"2024-05-08T18:09:28.593308+0000","last_fullsized":"2024-05-08T18:09:28.593308+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:57:14.342510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581432+0000","last_change":"2024-05-08T18:08:47.507237+0000","last_active":"2024-05-08T18:09:28.581432+0000","last_peered":"2024-05-08T18:09:28.581432+0000","last_clean":"2024-05-08T18:09:28.581432+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:09:28.581432+0000","last_undegraded":"2024-05-08T18:09:28.581432+0000","last_fullsized":"2024-05-08T18:09:28.581432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579952+0000","last_change":"2024-05-08T18:08:51.510525+0000","last_active":"2024-05-08T18:09:28.579952+0000","last_peered":"2024-05-08T18:09:28.579952+0000","last_clean":"2024-05-08T18:09:28.579952+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:09:28.579952+0000","last_undegraded":"2024-05-08T18:09:28.579952+0000","last_fullsized":"2024-05-08T18:09:28.579952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:54:35.735245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.660422+0000","last_change":"2024-05-08T18:08:53.551086+0000","last_active":"2024-05-08T18:12:01.660422+0000","last_peered":"2024-05-08T18:12:01.660422+0000","last_clean":"2024-05-08T18:12:01.660422+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:01.660422+0000","last_undegraded":"2024-05-08T18:12:01.660422+0000","last_fullsized":"2024-05-08T18:12:01.660422+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:35.713500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602251+0000","last_change":"2024-05-08T18:08:55.569487+0000","last_active":"2024-05-08T18:09:28.602251+0000","last_peered":"2024-05-08T18:09:28.602251+0000","last_clean":"2024-05-08T18:09:28.602251+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:09:28.602251+0000","last_undegraded":"2024-05-08T18:09:28.602251+0000","last_fullsized":"2024-05-08T18:09:28.602251+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:04:08.021899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.257052+0000","last_change":"2024-05-08T18:08:57.567414+0000","last_active":"2024-05-08T18:11:01.257052+0000","last_peered":"2024-05-08T18:11:01.257052+0000","last_clean":"2024-05-08T18:11:01.257052+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:11:01.257052+0000","last_undegraded":"2024-05-08T18:11:01.257052+0000","last_fullsized":"2024-05-08T18:11:01.257052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:16.573083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689283+0000","last_change":"2024-05-08T18:09:28.612611+0000","last_active":"2024-05-08T18:12:02.689283+0000","last_peered":"2024-05-08T18:12:02.689283+0000","last_clean":"2024-05-08T18:12:02.689283+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:12:02.689283+0000","last_undegraded":"2024-05-08T18:12:02.689283+0000","last_fullsized":"2024-05-08T18:12:02.689283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:08.518584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892803+0000","last_change":"2024-05-08T18:08:47.517520+0000","last_active":"2024-05-08T18:09:31.892803+0000","last_peered":"2024-05-08T18:09:31.892803+0000","last_clean":"2024-05-08T18:09:31.892803+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:09:31.892803+0000","last_undegraded":"2024-05-08T18:09:31.892803+0000","last_fullsized":"2024-05-08T18:09:31.892803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580404+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:09:28.580404+0000","last_peered":"2024-05-08T18:09:28.580404+0000","last_clean":"2024-05-08T18:09:28.580404+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:09:28.580404+0000","last_undegraded":"2024-05-08T18:09:28.580404+0000","last_fullsized":"2024-05-08T18:09:28.580404+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:22:02.448146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.961044+0000","last_change":"2024-05-08T18:08:51.511005+0000","last_active":"2024-05-08T18:12:02.961044+0000","last_peered":"2024-05-08T18:12:02.961044+0000","last_clean":"2024-05-08T18:12:02.961044+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:12:02.961044+0000","last_undegraded":"2024-05-08T18:12:02.961044+0000","last_fullsized":"2024-05-08T18:12:02.961044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:10.746341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'67","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.593858+0000","last_change":"2024-05-08T18:08:53.554240+0000","last_active":"2024-05-08T18:12:09.593858+0000","last_peered":"2024-05-08T18:12:09.593858+0000","last_clean":"2024-05-08T18:12:09.593858+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:12:09.593858+0000","last_undegraded":"2024-05-08T18:12:09.593858+0000","last_fullsized":"2024-05-08T18:12:09.593858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:34:40.118008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.581262+0000","last_change":"2024-05-08T18:08:55.551427+0000","last_active":"2024-05-08T18:09:28.581262+0000","last_peered":"2024-05-08T18:09:28.581262+0000","last_clean":"2024-05-08T18:09:28.581262+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:09:28.581262+0000","last_undegraded":"2024-05-08T18:09:28.581262+0000","last_fullsized":"2024-05-08T18:09:28.581262+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:25.290543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.494426+0000","last_change":"2024-05-08T18:08:57.564941+0000","last_active":"2024-05-08T18:11:01.494426+0000","last_peered":"2024-05-08T18:11:01.494426+0000","last_clean":"2024-05-08T18:11:01.494426+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:11:01.494426+0000","last_undegraded":"2024-05-08T18:11:01.494426+0000","last_fullsized":"2024-05-08T18:11:01.494426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:28:55.289619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597441+0000","last_change":"2024-05-08T18:08:49.519773+0000","last_active":"2024-05-08T18:12:02.597441+0000","last_peered":"2024-05-08T18:12:02.597441+0000","last_clean":"2024-05-08T18:12:02.597441+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:02.597441+0000","last_undegraded":"2024-05-08T18:12:02.597441+0000","last_fullsized":"2024-05-08T18:12:02.597441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583257+0000","last_change":"2024-05-08T18:08:47.517709+0000","last_active":"2024-05-08T18:09:28.583257+0000","last_peered":"2024-05-08T18:09:28.583257+0000","last_clean":"2024-05-08T18:09:28.583257+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:09:28.583257+0000","last_undegraded":"2024-05-08T18:09:28.583257+0000","last_fullsized":"2024-05-08T18:09:28.583257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598381+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:09:28.598381+0000","last_peered":"2024-05-08T18:09:28.598381+0000","last_clean":"2024-05-08T18:09:28.598381+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:09:28.598381+0000","last_undegraded":"2024-05-08T18:09:28.598381+0000","last_fullsized":"2024-05-08T18:09:28.598381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:21.080378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592808+0000","last_change":"2024-05-08T18:08:51.505864+0000","last_active":"2024-05-08T18:09:28.592808+0000","last_peered":"2024-05-08T18:09:28.592808+0000","last_clean":"2024-05-08T18:09:28.592808+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:09:28.592808+0000","last_undegraded":"2024-05-08T18:09:28.592808+0000","last_fullsized":"2024-05-08T18:09:28.592808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:06.233890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572702+0000","last_change":"2024-05-08T18:08:53.553633+0000","last_active":"2024-05-08T18:09:28.572702+0000","last_peered":"2024-05-08T18:09:28.572702+0000","last_clean":"2024-05-08T18:09:28.572702+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:09:28.572702+0000","last_undegraded":"2024-05-08T18:09:28.572702+0000","last_fullsized":"2024-05-08T18:09:28.572702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:18:23.277850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":378,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.353084+0000","last_change":"2024-05-08T18:08:55.556466+0000","last_active":"2024-05-08T18:12:09.353084+0000","last_peered":"2024-05-08T18:12:09.353084+0000","last_clean":"2024-05-08T18:12:09.353084+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:09.353084+0000","last_undegraded":"2024-05-08T18:12:09.353084+0000","last_fullsized":"2024-05-08T18:12:09.353084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:56.373442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.598317+0000","last_change":"2024-05-08T18:08:57.559589+0000","last_active":"2024-05-08T18:09:28.598317+0000","last_peered":"2024-05-08T18:09:28.598317+0000","last_clean":"2024-05-08T18:09:28.598317+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:09:28.598317+0000","last_undegraded":"2024-05-08T18:09:28.598317+0000","last_fullsized":"2024-05-08T18:09:28.598317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:19:44.469070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270592+0000","last_change":"2024-05-08T18:08:49.510615+0000","last_active":"2024-05-08T18:12:02.270592+0000","last_peered":"2024-05-08T18:12:02.270592+0000","last_clean":"2024-05-08T18:12:02.270592+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:02.270592+0000","last_undegraded":"2024-05-08T18:12:02.270592+0000","last_fullsized":"2024-05-08T18:12:02.270592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:29:03.732312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.892852+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:09:31.892852+0000","last_peered":"2024-05-08T18:09:31.892852+0000","last_clean":"2024-05-08T18:09:31.892852+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:09:31.892852+0000","last_undegraded":"2024-05-08T18:09:31.892852+0000","last_fullsized":"2024-05-08T18:09:31.892852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:57.257231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580836+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:09:28.580836+0000","last_peered":"2024-05-08T18:09:28.580836+0000","last_clean":"2024-05-08T18:09:28.580836+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:09:28.580836+0000","last_undegraded":"2024-05-08T18:09:28.580836+0000","last_fullsized":"2024-05-08T18:09:28.580836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:37.747046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603006+0000","last_change":"2024-05-08T18:08:51.513370+0000","last_active":"2024-05-08T18:09:28.603006+0000","last_peered":"2024-05-08T18:09:28.603006+0000","last_clean":"2024-05-08T18:09:28.603006+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:09:28.603006+0000","last_undegraded":"2024-05-08T18:09:28.603006+0000","last_fullsized":"2024-05-08T18:09:28.603006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:16.244827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602730+0000","last_change":"2024-05-08T18:08:53.549741+0000","last_active":"2024-05-08T18:09:28.602730+0000","last_peered":"2024-05-08T18:09:28.602730+0000","last_clean":"2024-05-08T18:09:28.602730+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:09:28.602730+0000","last_undegraded":"2024-05-08T18:09:28.602730+0000","last_fullsized":"2024-05-08T18:09:28.602730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:21.438197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":393,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.361416+0000","last_change":"2024-05-08T18:08:55.543586+0000","last_active":"2024-05-08T18:12:09.361416+0000","last_peered":"2024-05-08T18:12:09.361416+0000","last_clean":"2024-05-08T18:12:09.361416+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:09.361416+0000","last_undegraded":"2024-05-08T18:12:09.361416+0000","last_fullsized":"2024-05-08T18:12:09.361416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:01:28.607260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.633075+0000","last_change":"2024-05-08T18:08:57.573590+0000","last_active":"2024-05-08T18:11:01.633075+0000","last_peered":"2024-05-08T18:11:01.633075+0000","last_clean":"2024-05-08T18:11:01.633075+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:11:01.633075+0000","last_undegraded":"2024-05-08T18:11:01.633075+0000","last_fullsized":"2024-05-08T18:11:01.633075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:48:04.376291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'1","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425042+0000","last_change":"2024-05-08T18:09:28.589121+0000","last_active":"2024-05-08T18:10:56.425042+0000","last_peered":"2024-05-08T18:10:56.425042+0000","last_clean":"2024-05-08T18:10:56.425042+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:10:56.425042+0000","last_undegraded":"2024-05-08T18:10:56.425042+0000","last_fullsized":"2024-05-08T18:10:56.425042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:17:55.349405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584979+0000","last_change":"2024-05-08T18:08:47.512221+0000","last_active":"2024-05-08T18:09:28.584979+0000","last_peered":"2024-05-08T18:09:28.584979+0000","last_clean":"2024-05-08T18:09:28.584979+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:09:28.584979+0000","last_undegraded":"2024-05-08T18:09:28.584979+0000","last_fullsized":"2024-05-08T18:09:28.584979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599261+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:09:28.599261+0000","last_peered":"2024-05-08T18:09:28.599261+0000","last_clean":"2024-05-08T18:09:28.599261+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:09:28.599261+0000","last_undegraded":"2024-05-08T18:09:28.599261+0000","last_fullsized":"2024-05-08T18:09:28.599261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:13.321704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589247+0000","last_change":"2024-05-08T18:08:51.510230+0000","last_active":"2024-05-08T18:09:28.589247+0000","last_peered":"2024-05-08T18:09:28.589247+0000","last_clean":"2024-05-08T18:09:28.589247+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:09:28.589247+0000","last_undegraded":"2024-05-08T18:09:28.589247+0000","last_fullsized":"2024-05-08T18:09:28.589247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:26:26.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'96","reported_seq":180,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.620398+0000","last_change":"2024-05-08T18:08:53.550482+0000","last_active":"2024-05-08T18:12:09.620398+0000","last_peered":"2024-05-08T18:12:09.620398+0000","last_clean":"2024-05-08T18:12:09.620398+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:12:09.620398+0000","last_undegraded":"2024-05-08T18:12:09.620398+0000","last_fullsized":"2024-05-08T18:12:09.620398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:48.461545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":104,"num_read_kb":116,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.579744+0000","last_change":"2024-05-08T18:08:55.554634+0000","last_active":"2024-05-08T18:09:28.579744+0000","last_peered":"2024-05-08T18:09:28.579744+0000","last_clean":"2024-05-08T18:09:28.579744+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:09:28.579744+0000","last_undegraded":"2024-05-08T18:09:28.579744+0000","last_fullsized":"2024-05-08T18:09:28.579744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.586328+0000","last_change":"2024-05-08T18:08:57.564366+0000","last_active":"2024-05-08T18:09:28.586328+0000","last_peered":"2024-05-08T18:09:28.586328+0000","last_clean":"2024-05-08T18:09:28.586328+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:09:28.586328+0000","last_undegraded":"2024-05-08T18:09:28.586328+0000","last_fullsized":"2024-05-08T18:09:28.586328+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:12.274417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.585033+0000","last_change":"2024-05-08T18:08:57.586231+0000","last_active":"2024-05-08T18:09:28.585033+0000","last_peered":"2024-05-08T18:09:28.585033+0000","last_clean":"2024-05-08T18:09:28.585033+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:09:28.585033+0000","last_undegraded":"2024-05-08T18:09:28.585033+0000","last_fullsized":"2024-05-08T18:09:28.585033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:26.309299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391896+0000","last_change":"2024-05-08T18:08:49.517973+0000","last_active":"2024-05-08T18:12:02.391896+0000","last_peered":"2024-05-08T18:12:02.391896+0000","last_clean":"2024-05-08T18:12:02.391896+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:12:02.391896+0000","last_undegraded":"2024-05-08T18:12:02.391896+0000","last_fullsized":"2024-05-08T18:12:02.391896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593683+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:09:28.593683+0000","last_peered":"2024-05-08T18:09:28.593683+0000","last_clean":"2024-05-08T18:09:28.593683+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:09:28.593683+0000","last_undegraded":"2024-05-08T18:09:28.593683+0000","last_fullsized":"2024-05-08T18:09:28.593683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:09.399882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576250+0000","last_change":"2024-05-08T18:08:51.517003+0000","last_active":"2024-05-08T18:09:28.576250+0000","last_peered":"2024-05-08T18:09:28.576250+0000","last_clean":"2024-05-08T18:09:28.576250+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:09:28.576250+0000","last_undegraded":"2024-05-08T18:09:28.576250+0000","last_fullsized":"2024-05-08T18:09:28.576250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:27:52.213274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'35","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.666136+0000","last_change":"2024-05-08T18:08:53.546900+0000","last_active":"2024-05-08T18:12:09.666136+0000","last_peered":"2024-05-08T18:12:09.666136+0000","last_clean":"2024-05-08T18:12:09.666136+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:12:09.666136+0000","last_undegraded":"2024-05-08T18:12:09.666136+0000","last_fullsized":"2024-05-08T18:12:09.666136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:15:31.873538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588783+0000","last_change":"2024-05-08T18:08:55.558807+0000","last_active":"2024-05-08T18:09:28.588783+0000","last_peered":"2024-05-08T18:09:28.588783+0000","last_clean":"2024-05-08T18:09:28.588783+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:09:28.588783+0000","last_undegraded":"2024-05-08T18:09:28.588783+0000","last_fullsized":"2024-05-08T18:09:28.588783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:18:28.774845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.395796+0000","last_change":"2024-05-08T18:08:57.554621+0000","last_active":"2024-05-08T18:12:02.395796+0000","last_peered":"2024-05-08T18:12:02.395796+0000","last_clean":"2024-05-08T18:12:02.395796+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:02.395796+0000","last_undegraded":"2024-05-08T18:12:02.395796+0000","last_fullsized":"2024-05-08T18:12:02.395796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:59:36.523989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.392595+0000","last_change":"2024-05-08T18:08:49.515316+0000","last_active":"2024-05-08T18:12:02.392595+0000","last_peered":"2024-05-08T18:12:02.392595+0000","last_clean":"2024-05-08T18:12:02.392595+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:02.392595+0000","last_undegraded":"2024-05-08T18:12:02.392595+0000","last_fullsized":"2024-05-08T18:12:02.392595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.098768+0000","last_change":"2024-05-08T18:08:47.514514+0000","last_active":"2024-05-08T18:12:02.098768+0000","last_peered":"2024-05-08T18:12:02.098768+0000","last_clean":"2024-05-08T18:12:02.098768+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:12:02.098768+0000","last_undegraded":"2024-05-08T18:12:02.098768+0000","last_fullsized":"2024-05-08T18:12:02.098768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:09:05.674932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.603376+0000","last_change":"2024-05-08T18:08:51.510753+0000","last_active":"2024-05-08T18:09:28.603376+0000","last_peered":"2024-05-08T18:09:28.603376+0000","last_clean":"2024-05-08T18:09:28.603376+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:09:28.603376+0000","last_undegraded":"2024-05-08T18:09:28.603376+0000","last_fullsized":"2024-05-08T18:09:28.603376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:41.695717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.670842+0000","last_change":"2024-05-08T18:08:53.524878+0000","last_active":"2024-05-08T18:12:01.670842+0000","last_peered":"2024-05-08T18:12:01.670842+0000","last_clean":"2024-05-08T18:12:01.670842+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:01.670842+0000","last_undegraded":"2024-05-08T18:12:01.670842+0000","last_fullsized":"2024-05-08T18:12:01.670842+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:40.829168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580812+0000","last_change":"2024-05-08T18:08:55.565178+0000","last_active":"2024-05-08T18:09:28.580812+0000","last_peered":"2024-05-08T18:09:28.580812+0000","last_clean":"2024-05-08T18:09:28.580812+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:09:28.580812+0000","last_undegraded":"2024-05-08T18:09:28.580812+0000","last_fullsized":"2024-05-08T18:09:28.580812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:05.564412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578264+0000","last_change":"2024-05-08T18:08:57.565323+0000","last_active":"2024-05-08T18:09:28.578264+0000","last_peered":"2024-05-08T18:09:28.578264+0000","last_clean":"2024-05-08T18:09:28.578264+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:09:28.578264+0000","last_undegraded":"2024-05-08T18:09:28.578264+0000","last_fullsized":"2024-05-08T18:09:28.578264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:15:04.648587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755243+0000","last_change":"2024-05-08T18:08:49.506944+0000","last_active":"2024-05-08T18:12:02.755243+0000","last_peered":"2024-05-08T18:12:02.755243+0000","last_clean":"2024-05-08T18:12:02.755243+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:02.755243+0000","last_undegraded":"2024-05-08T18:12:02.755243+0000","last_fullsized":"2024-05-08T18:12:02.755243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591593+0000","last_change":"2024-05-08T18:08:47.513365+0000","last_active":"2024-05-08T18:09:28.591593+0000","last_peered":"2024-05-08T18:09:28.591593+0000","last_clean":"2024-05-08T18:09:28.591593+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:09:28.591593+0000","last_undegraded":"2024-05-08T18:09:28.591593+0000","last_fullsized":"2024-05-08T18:09:28.591593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578971+0000","last_change":"2024-05-08T18:08:51.521427+0000","last_active":"2024-05-08T18:09:28.578971+0000","last_peered":"2024-05-08T18:09:28.578971+0000","last_clean":"2024-05-08T18:09:28.578971+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:09:28.578971+0000","last_undegraded":"2024-05-08T18:09:28.578971+0000","last_fullsized":"2024-05-08T18:09:28.578971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:32.182561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'43","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.576805+0000","last_change":"2024-05-08T18:08:53.517027+0000","last_active":"2024-05-08T18:12:09.576805+0000","last_peered":"2024-05-08T18:12:09.576805+0000","last_clean":"2024-05-08T18:12:09.576805+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:09.576805+0000","last_undegraded":"2024-05-08T18:12:09.576805+0000","last_fullsized":"2024-05-08T18:12:09.576805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:00:22.586335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572557+0000","last_change":"2024-05-08T18:08:55.556729+0000","last_active":"2024-05-08T18:09:28.572557+0000","last_peered":"2024-05-08T18:09:28.572557+0000","last_clean":"2024-05-08T18:09:28.572557+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:09:28.572557+0000","last_undegraded":"2024-05-08T18:09:28.572557+0000","last_fullsized":"2024-05-08T18:09:28.572557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:10.260173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597437+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:09:28.597437+0000","last_peered":"2024-05-08T18:09:28.597437+0000","last_clean":"2024-05-08T18:09:28.597437+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:09:28.597437+0000","last_undegraded":"2024-05-08T18:09:28.597437+0000","last_fullsized":"2024-05-08T18:09:28.597437+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:48.822666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'17","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.269318+0000","last_change":"2024-05-08T18:08:49.512382+0000","last_active":"2024-05-08T18:12:02.269318+0000","last_peered":"2024-05-08T18:12:02.269318+0000","last_clean":"2024-05-08T18:12:02.269318+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:02.269318+0000","last_undegraded":"2024-05-08T18:12:02.269318+0000","last_fullsized":"2024-05-08T18:12:02.269318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:02.812761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.742937+0000","last_change":"2024-05-08T18:08:47.495539+0000","last_active":"2024-05-08T18:12:02.742937+0000","last_peered":"2024-05-08T18:12:02.742937+0000","last_clean":"2024-05-08T18:12:02.742937+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:12:02.742937+0000","last_undegraded":"2024-05-08T18:12:02.742937+0000","last_fullsized":"2024-05-08T18:12:02.742937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592581+0000","last_change":"2024-05-08T18:08:51.502037+0000","last_active":"2024-05-08T18:09:28.592581+0000","last_peered":"2024-05-08T18:09:28.592581+0000","last_clean":"2024-05-08T18:09:28.592581+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:09:28.592581+0000","last_undegraded":"2024-05-08T18:09:28.592581+0000","last_fullsized":"2024-05-08T18:09:28.592581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:20.268773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.556131+0000","last_change":"2024-05-08T18:08:53.521376+0000","last_active":"2024-05-08T18:12:09.556131+0000","last_peered":"2024-05-08T18:12:09.556131+0000","last_clean":"2024-05-08T18:12:09.556131+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:12:09.556131+0000","last_undegraded":"2024-05-08T18:12:09.556131+0000","last_fullsized":"2024-05-08T18:12:09.556131+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:32.004417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580450+0000","last_change":"2024-05-08T18:08:55.546548+0000","last_active":"2024-05-08T18:09:28.580450+0000","last_peered":"2024-05-08T18:09:28.580450+0000","last_clean":"2024-05-08T18:09:28.580450+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:09:28.580450+0000","last_undegraded":"2024-05-08T18:09:28.580450+0000","last_fullsized":"2024-05-08T18:09:28.580450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:44:18.721766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.491598+0000","last_change":"2024-05-08T18:08:49.510714+0000","last_active":"2024-05-08T18:10:16.491598+0000","last_peered":"2024-05-08T18:10:16.491598+0000","last_clean":"2024-05-08T18:10:16.491598+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:10:16.491598+0000","last_undegraded":"2024-05-08T18:10:16.491598+0000","last_fullsized":"2024-05-08T18:10:16.491598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:14:41.270946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:31.893083+0000","last_change":"2024-05-08T18:08:47.516678+0000","last_active":"2024-05-08T18:09:31.893083+0000","last_peered":"2024-05-08T18:09:31.893083+0000","last_clean":"2024-05-08T18:09:31.893083+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:09:31.893083+0000","last_undegraded":"2024-05-08T18:09:31.893083+0000","last_fullsized":"2024-05-08T18:09:31.893083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:47:38.680445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584360+0000","last_change":"2024-05-08T18:08:51.511759+0000","last_active":"2024-05-08T18:09:28.584360+0000","last_peered":"2024-05-08T18:09:28.584360+0000","last_clean":"2024-05-08T18:09:28.584360+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:09:28.584360+0000","last_undegraded":"2024-05-08T18:09:28.584360+0000","last_fullsized":"2024-05-08T18:09:28.584360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'60","reported_seq":124,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.549465+0000","last_change":"2024-05-08T18:08:53.525502+0000","last_active":"2024-05-08T18:12:09.549465+0000","last_peered":"2024-05-08T18:12:09.549465+0000","last_clean":"2024-05-08T18:12:09.549465+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:12:09.549465+0000","last_undegraded":"2024-05-08T18:12:09.549465+0000","last_fullsized":"2024-05-08T18:12:09.549465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:01:21.841040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.584718+0000","last_change":"2024-05-08T18:08:55.547190+0000","last_active":"2024-05-08T18:09:28.584718+0000","last_peered":"2024-05-08T18:09:28.584718+0000","last_clean":"2024-05-08T18:09:28.584718+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:09:28.584718+0000","last_undegraded":"2024-05-08T18:09:28.584718+0000","last_fullsized":"2024-05-08T18:09:28.584718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:18:41.115717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.484509+0000","last_change":"2024-05-08T18:08:57.565259+0000","last_active":"2024-05-08T18:11:01.484509+0000","last_peered":"2024-05-08T18:11:01.484509+0000","last_clean":"2024-05-08T18:11:01.484509+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:11:01.484509+0000","last_undegraded":"2024-05-08T18:11:01.484509+0000","last_fullsized":"2024-05-08T18:11:01.484509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.143663+0000","last_change":"2024-05-08T18:08:49.500137+0000","last_active":"2024-05-08T18:09:34.143663+0000","last_peered":"2024-05-08T18:09:34.143663+0000","last_clean":"2024-05-08T18:09:34.143663+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:09:34.143663+0000","last_undegraded":"2024-05-08T18:09:34.143663+0000","last_fullsized":"2024-05-08T18:09:34.143663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:54:42.642543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.571914+0000","last_change":"2024-05-08T18:08:47.514529+0000","last_active":"2024-05-08T18:09:28.571914+0000","last_peered":"2024-05-08T18:09:28.571914+0000","last_clean":"2024-05-08T18:09:28.571914+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:09:28.571914+0000","last_undegraded":"2024-05-08T18:09:28.571914+0000","last_fullsized":"2024-05-08T18:09:28.571914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:19.883949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.589371+0000","last_change":"2024-05-08T18:08:51.508583+0000","last_active":"2024-05-08T18:09:28.589371+0000","last_peered":"2024-05-08T18:09:28.589371+0000","last_clean":"2024-05-08T18:09:28.589371+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:09:28.589371+0000","last_undegraded":"2024-05-08T18:09:28.589371+0000","last_fullsized":"2024-05-08T18:09:28.589371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:08.838007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'40","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.562910+0000","last_change":"2024-05-08T18:08:53.547333+0000","last_active":"2024-05-08T18:12:09.562910+0000","last_peered":"2024-05-08T18:12:09.562910+0000","last_clean":"2024-05-08T18:12:09.562910+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:12:09.562910+0000","last_undegraded":"2024-05-08T18:12:09.562910+0000","last_fullsized":"2024-05-08T18:12:09.562910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:19.951491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574072+0000","last_change":"2024-05-08T18:08:55.565939+0000","last_active":"2024-05-08T18:09:28.574072+0000","last_peered":"2024-05-08T18:09:28.574072+0000","last_clean":"2024-05-08T18:09:28.574072+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:09:28.574072+0000","last_undegraded":"2024-05-08T18:09:28.574072+0000","last_fullsized":"2024-05-08T18:09:28.574072+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:44:49.723170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.592447+0000","last_change":"2024-05-08T18:08:57.553775+0000","last_active":"2024-05-08T18:09:28.592447+0000","last_peered":"2024-05-08T18:09:28.592447+0000","last_clean":"2024-05-08T18:09:28.592447+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:09:28.592447+0000","last_undegraded":"2024-05-08T18:09:28.592447+0000","last_fullsized":"2024-05-08T18:09:28.592447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:35:06.977999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.597284+0000","last_change":"2024-05-08T18:08:49.514883+0000","last_active":"2024-05-08T18:12:02.597284+0000","last_peered":"2024-05-08T18:12:02.597284+0000","last_clean":"2024-05-08T18:12:02.597284+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:02.597284+0000","last_undegraded":"2024-05-08T18:12:02.597284+0000","last_fullsized":"2024-05-08T18:12:02.597284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:37.616434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.572752+0000","last_change":"2024-05-08T18:08:47.519395+0000","last_active":"2024-05-08T18:09:28.572752+0000","last_peered":"2024-05-08T18:09:28.572752+0000","last_clean":"2024-05-08T18:09:28.572752+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:09:28.572752+0000","last_undegraded":"2024-05-08T18:09:28.572752+0000","last_fullsized":"2024-05-08T18:09:28.572752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:25:19.191435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.596279+0000","last_change":"2024-05-08T18:09:28.594515+0000","last_active":"2024-05-08T18:09:28.596279+0000","last_peered":"2024-05-08T18:09:28.596279+0000","last_clean":"2024-05-08T18:09:28.596279+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:09:28.596279+0000","last_undegraded":"2024-05-08T18:09:28.596279+0000","last_fullsized":"2024-05-08T18:09:28.596279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:39:46.308954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'37","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.448642+0000","last_change":"2024-05-08T18:08:53.515915+0000","last_active":"2024-05-08T18:12:09.448642+0000","last_peered":"2024-05-08T18:12:09.448642+0000","last_clean":"2024-05-08T18:12:09.448642+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:12:09.448642+0000","last_undegraded":"2024-05-08T18:12:09.448642+0000","last_fullsized":"2024-05-08T18:12:09.448642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:29:06.840324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.578824+0000","last_change":"2024-05-08T18:08:55.554524+0000","last_active":"2024-05-08T18:09:28.578824+0000","last_peered":"2024-05-08T18:09:28.578824+0000","last_clean":"2024-05-08T18:09:28.578824+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:09:28.578824+0000","last_undegraded":"2024-05-08T18:09:28.578824+0000","last_fullsized":"2024-05-08T18:09:28.578824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:45.722000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.628108+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:01.628108+0000","last_peered":"2024-05-08T18:11:01.628108+0000","last_clean":"2024-05-08T18:11:01.628108+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:01.628108+0000","last_undegraded":"2024-05-08T18:11:01.628108+0000","last_fullsized":"2024-05-08T18:11:01.628108+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:07.709412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755239+0000","last_change":"2024-05-08T18:08:49.494211+0000","last_active":"2024-05-08T18:12:02.755239+0000","last_peered":"2024-05-08T18:12:02.755239+0000","last_clean":"2024-05-08T18:12:02.755239+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:02.755239+0000","last_undegraded":"2024-05-08T18:12:02.755239+0000","last_fullsized":"2024-05-08T18:12:02.755239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.435190+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:09:33.435190+0000","last_peered":"2024-05-08T18:09:33.435190+0000","last_clean":"2024-05-08T18:09:33.435190+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:09:33.435190+0000","last_undegraded":"2024-05-08T18:09:33.435190+0000","last_fullsized":"2024-05-08T18:09:33.435190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:44.062312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'4","reported_seq":228,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.314331+0000","last_change":"2024-05-08T18:08:51.520425+0000","last_active":"2024-05-08T18:12:09.314331+0000","last_peered":"2024-05-08T18:12:09.314331+0000","last_clean":"2024-05-08T18:12:09.314331+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:12:09.314331+0000","last_undegraded":"2024-05-08T18:12:09.314331+0000","last_fullsized":"2024-05-08T18:12:09.314331+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:44.630963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602335+0000","last_change":"2024-05-08T18:08:53.555586+0000","last_active":"2024-05-08T18:09:28.602335+0000","last_peered":"2024-05-08T18:09:28.602335+0000","last_clean":"2024-05-08T18:09:28.602335+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:09:28.602335+0000","last_undegraded":"2024-05-08T18:09:28.602335+0000","last_fullsized":"2024-05-08T18:09:28.602335+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:46:12.189650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":410,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.349661+0000","last_change":"2024-05-08T18:08:55.549323+0000","last_active":"2024-05-08T18:12:09.349661+0000","last_peered":"2024-05-08T18:12:09.349661+0000","last_clean":"2024-05-08T18:12:09.349661+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:09.349661+0000","last_undegraded":"2024-05-08T18:12:09.349661+0000","last_fullsized":"2024-05-08T18:12:09.349661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:43.656689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.446010+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:10:57.446010+0000","last_peered":"2024-05-08T18:10:57.446010+0000","last_clean":"2024-05-08T18:10:57.446010+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:10:57.446010+0000","last_undegraded":"2024-05-08T18:10:57.446010+0000","last_fullsized":"2024-05-08T18:10:57.446010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:11:56.783174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.755627+0000","last_change":"2024-05-08T18:08:49.492567+0000","last_active":"2024-05-08T18:12:02.755627+0000","last_peered":"2024-05-08T18:12:02.755627+0000","last_clean":"2024-05-08T18:12:02.755627+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:02.755627+0000","last_undegraded":"2024-05-08T18:12:02.755627+0000","last_fullsized":"2024-05-08T18:12:02.755627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:23:32.167217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576478+0000","last_change":"2024-05-08T18:08:47.491784+0000","last_active":"2024-05-08T18:09:28.576478+0000","last_peered":"2024-05-08T18:09:28.576478+0000","last_clean":"2024-05-08T18:09:28.576478+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:09:28.576478+0000","last_undegraded":"2024-05-08T18:09:28.576478+0000","last_fullsized":"2024-05-08T18:09:28.576478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.575218+0000","last_change":"2024-05-08T18:08:51.521020+0000","last_active":"2024-05-08T18:09:28.575218+0000","last_peered":"2024-05-08T18:09:28.575218+0000","last_clean":"2024-05-08T18:09:28.575218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:09:28.575218+0000","last_undegraded":"2024-05-08T18:09:28.575218+0000","last_fullsized":"2024-05-08T18:09:28.575218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:46.447955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.487165+0000","last_change":"2024-05-08T18:08:53.521741+0000","last_active":"2024-05-08T18:12:09.487165+0000","last_peered":"2024-05-08T18:12:09.487165+0000","last_clean":"2024-05-08T18:12:09.487165+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:12:09.487165+0000","last_undegraded":"2024-05-08T18:12:09.487165+0000","last_fullsized":"2024-05-08T18:12:09.487165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:03.551719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576295+0000","last_change":"2024-05-08T18:08:55.542837+0000","last_active":"2024-05-08T18:09:28.576295+0000","last_peered":"2024-05-08T18:09:28.576295+0000","last_clean":"2024-05-08T18:09:28.576295+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:09:28.576295+0000","last_undegraded":"2024-05-08T18:09:28.576295+0000","last_fullsized":"2024-05-08T18:09:28.576295+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:11.110077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.653210+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:09:32.653210+0000","last_peered":"2024-05-08T18:09:32.653210+0000","last_clean":"2024-05-08T18:09:32.653210+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:09:32.653210+0000","last_undegraded":"2024-05-08T18:09:32.653210+0000","last_fullsized":"2024-05-08T18:09:32.653210+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:55:38.022987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106581+0000","last_change":"2024-05-08T18:08:49.493842+0000","last_active":"2024-05-08T18:09:33.106581+0000","last_peered":"2024-05-08T18:09:33.106581+0000","last_clean":"2024-05-08T18:09:33.106581+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:09:33.106581+0000","last_undegraded":"2024-05-08T18:09:33.106581+0000","last_fullsized":"2024-05-08T18:09:33.106581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:06.003763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.575041+0000","last_change":"2024-05-08T18:08:47.528745+0000","last_active":"2024-05-08T18:11:01.575041+0000","last_peered":"2024-05-08T18:11:01.575041+0000","last_clean":"2024-05-08T18:11:01.575041+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:11:01.575041+0000","last_undegraded":"2024-05-08T18:11:01.575041+0000","last_fullsized":"2024-05-08T18:11:01.575041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:15:48.149891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.583711+0000","last_change":"2024-05-08T18:08:51.507416+0000","last_active":"2024-05-08T18:09:28.583711+0000","last_peered":"2024-05-08T18:09:28.583711+0000","last_clean":"2024-05-08T18:09:28.583711+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:09:28.583711+0000","last_undegraded":"2024-05-08T18:09:28.583711+0000","last_fullsized":"2024-05-08T18:09:28.583711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:22.734601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.495467+0000","last_change":"2024-05-08T18:08:53.539793+0000","last_active":"2024-05-08T18:12:09.495467+0000","last_peered":"2024-05-08T18:12:09.495467+0000","last_clean":"2024-05-08T18:12:09.495467+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:12:09.495467+0000","last_undegraded":"2024-05-08T18:12:09.495467+0000","last_fullsized":"2024-05-08T18:12:09.495467+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:09.466170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.591164+0000","last_change":"2024-05-08T18:08:55.558593+0000","last_active":"2024-05-08T18:09:28.591164+0000","last_peered":"2024-05-08T18:09:28.591164+0000","last_clean":"2024-05-08T18:09:28.591164+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:09:28.591164+0000","last_undegraded":"2024-05-08T18:09:28.591164+0000","last_fullsized":"2024-05-08T18:09:28.591164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:20.041348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.597627+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:09:28.597627+0000","last_peered":"2024-05-08T18:09:28.597627+0000","last_clean":"2024-05-08T18:09:28.597627+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:09:28.597627+0000","last_undegraded":"2024-05-08T18:09:28.597627+0000","last_fullsized":"2024-05-08T18:09:28.597627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:32:45.231457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391535+0000","last_change":"2024-05-08T18:08:49.512357+0000","last_active":"2024-05-08T18:12:02.391535+0000","last_peered":"2024-05-08T18:12:02.391535+0000","last_clean":"2024-05-08T18:12:02.391535+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:02.391535+0000","last_undegraded":"2024-05-08T18:12:02.391535+0000","last_fullsized":"2024-05-08T18:12:02.391535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:23:36.801605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.616390+0000","last_change":"2024-05-08T18:08:47.517076+0000","last_active":"2024-05-08T18:09:32.616390+0000","last_peered":"2024-05-08T18:09:32.616390+0000","last_clean":"2024-05-08T18:09:32.616390+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:09:32.616390+0000","last_undegraded":"2024-05-08T18:09:32.616390+0000","last_fullsized":"2024-05-08T18:09:32.616390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:33:16.421286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573625+0000","last_change":"2024-05-08T18:08:51.522287+0000","last_active":"2024-05-08T18:09:28.573625+0000","last_peered":"2024-05-08T18:09:28.573625+0000","last_clean":"2024-05-08T18:09:28.573625+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:09:28.573625+0000","last_undegraded":"2024-05-08T18:09:28.573625+0000","last_fullsized":"2024-05-08T18:09:28.573625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:47:29.990827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.436802+0000","last_change":"2024-05-08T18:08:53.555489+0000","last_active":"2024-05-08T18:12:09.436802+0000","last_peered":"2024-05-08T18:12:09.436802+0000","last_clean":"2024-05-08T18:12:09.436802+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:12:09.436802+0000","last_undegraded":"2024-05-08T18:12:09.436802+0000","last_fullsized":"2024-05-08T18:12:09.436802+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:51:01.464298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593054+0000","last_change":"2024-05-08T18:08:55.564029+0000","last_active":"2024-05-08T18:09:28.593054+0000","last_peered":"2024-05-08T18:09:28.593054+0000","last_clean":"2024-05-08T18:09:28.593054+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:09:28.593054+0000","last_undegraded":"2024-05-08T18:09:28.593054+0000","last_fullsized":"2024-05-08T18:09:28.593054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:00.158035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.605714+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:10:59.605714+0000","last_peered":"2024-05-08T18:10:59.605714+0000","last_clean":"2024-05-08T18:10:59.605714+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:10:59.605714+0000","last_undegraded":"2024-05-08T18:10:59.605714+0000","last_fullsized":"2024-05-08T18:10:59.605714+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:41:06.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:32.658006+0000","last_change":"2024-05-08T18:08:49.492218+0000","last_active":"2024-05-08T18:09:32.658006+0000","last_peered":"2024-05-08T18:09:32.658006+0000","last_clean":"2024-05-08T18:09:32.658006+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:09:32.658006+0000","last_undegraded":"2024-05-08T18:09:32.658006+0000","last_fullsized":"2024-05-08T18:09:32.658006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:16:46.076624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.576608+0000","last_change":"2024-05-08T18:08:47.498035+0000","last_active":"2024-05-08T18:12:02.576608+0000","last_peered":"2024-05-08T18:12:02.576608+0000","last_clean":"2024-05-08T18:12:02.576608+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:12:02.576608+0000","last_undegraded":"2024-05-08T18:12:02.576608+0000","last_fullsized":"2024-05-08T18:12:02.576608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":222,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.315107+0000","last_change":"2024-05-08T18:08:51.513601+0000","last_active":"2024-05-08T18:12:09.315107+0000","last_peered":"2024-05-08T18:12:09.315107+0000","last_clean":"2024-05-08T18:12:09.315107+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:12:09.315107+0000","last_undegraded":"2024-05-08T18:12:09.315107+0000","last_fullsized":"2024-05-08T18:12:09.315107+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:52.312237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.454179+0000","last_change":"2024-05-08T18:08:53.547362+0000","last_active":"2024-05-08T18:12:09.454179+0000","last_peered":"2024-05-08T18:12:09.454179+0000","last_clean":"2024-05-08T18:12:09.454179+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:09.454179+0000","last_undegraded":"2024-05-08T18:12:09.454179+0000","last_fullsized":"2024-05-08T18:12:09.454179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:20:18.076232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580054+0000","last_change":"2024-05-08T18:08:55.546216+0000","last_active":"2024-05-08T18:09:28.580054+0000","last_peered":"2024-05-08T18:09:28.580054+0000","last_clean":"2024-05-08T18:09:28.580054+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:09:28.580054+0000","last_undegraded":"2024-05-08T18:09:28.580054+0000","last_fullsized":"2024-05-08T18:09:28.580054+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:24:24.295055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:59.609546+0000","last_change":"2024-05-08T18:08:57.560370+0000","last_active":"2024-05-08T18:10:59.609546+0000","last_peered":"2024-05-08T18:10:59.609546+0000","last_clean":"2024-05-08T18:10:59.609546+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:10:59.609546+0000","last_undegraded":"2024-05-08T18:10:59.609546+0000","last_fullsized":"2024-05-08T18:10:59.609546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:35.794410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490224+0000","last_change":"2024-05-08T18:08:49.513755+0000","last_active":"2024-05-08T18:10:16.490224+0000","last_peered":"2024-05-08T18:10:16.490224+0000","last_clean":"2024-05-08T18:10:16.490224+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:10:16.490224+0000","last_undegraded":"2024-05-08T18:10:16.490224+0000","last_fullsized":"2024-05-08T18:10:16.490224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:36:12.911502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576973+0000","last_change":"2024-05-08T18:08:47.510817+0000","last_active":"2024-05-08T18:09:28.576973+0000","last_peered":"2024-05-08T18:09:28.576973+0000","last_clean":"2024-05-08T18:09:28.576973+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:09:28.576973+0000","last_undegraded":"2024-05-08T18:09:28.576973+0000","last_fullsized":"2024-05-08T18:09:28.576973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.419152+0000","last_change":"2024-05-08T18:08:49.494065+0000","last_active":"2024-05-08T18:11:01.419152+0000","last_peered":"2024-05-08T18:11:01.419152+0000","last_clean":"2024-05-08T18:11:01.419152+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:11:01.419152+0000","last_undegraded":"2024-05-08T18:11:01.419152+0000","last_fullsized":"2024-05-08T18:11:01.419152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.023737+0000","last_change":"2024-05-08T18:08:47.496722+0000","last_active":"2024-05-08T18:12:02.023737+0000","last_peered":"2024-05-08T18:12:02.023737+0000","last_clean":"2024-05-08T18:12:02.023737+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:12:02.023737+0000","last_undegraded":"2024-05-08T18:12:02.023737+0000","last_fullsized":"2024-05-08T18:12:02.023737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:35:42.445243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.689939+0000","last_change":"2024-05-08T18:08:49.513141+0000","last_active":"2024-05-08T18:12:02.689939+0000","last_peered":"2024-05-08T18:12:02.689939+0000","last_clean":"2024-05-08T18:12:02.689939+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:02.689939+0000","last_undegraded":"2024-05-08T18:12:02.689939+0000","last_fullsized":"2024-05-08T18:12:02.689939+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:36:05.438608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.593736+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:09:28.593736+0000","last_peered":"2024-05-08T18:09:28.593736+0000","last_clean":"2024-05-08T18:09:28.593736+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:09:28.593736+0000","last_undegraded":"2024-05-08T18:09:28.593736+0000","last_fullsized":"2024-05-08T18:09:28.593736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:38:49.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.268349+0000","last_change":"2024-05-08T18:08:49.494261+0000","last_active":"2024-05-08T18:12:02.268349+0000","last_peered":"2024-05-08T18:12:02.268349+0000","last_clean":"2024-05-08T18:12:02.268349+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:02.268349+0000","last_undegraded":"2024-05-08T18:12:02.268349+0000","last_fullsized":"2024-05-08T18:12:02.268349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:36.312591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.584121+0000","last_change":"2024-05-08T18:08:47.515649+0000","last_active":"2024-05-08T18:12:02.584121+0000","last_peered":"2024-05-08T18:12:02.584121+0000","last_clean":"2024-05-08T18:12:02.584121+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:02.584121+0000","last_undegraded":"2024-05-08T18:12:02.584121+0000","last_fullsized":"2024-05-08T18:12:02.584121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:17:47.142403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'3","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270740+0000","last_change":"2024-05-08T18:08:49.519128+0000","last_active":"2024-05-08T18:12:02.270740+0000","last_peered":"2024-05-08T18:12:02.270740+0000","last_clean":"2024-05-08T18:12:02.270740+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:02.270740+0000","last_undegraded":"2024-05-08T18:12:02.270740+0000","last_fullsized":"2024-05-08T18:12:02.270740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:11.414194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.190876+0000","last_change":"2024-05-08T18:08:47.497513+0000","last_active":"2024-05-08T18:12:02.190876+0000","last_peered":"2024-05-08T18:12:02.190876+0000","last_clean":"2024-05-08T18:12:02.190876+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:12:02.190876+0000","last_undegraded":"2024-05-08T18:12:02.190876+0000","last_fullsized":"2024-05-08T18:12:02.190876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706315+0000","last_change":"2024-05-08T18:08:49.518071+0000","last_active":"2024-05-08T18:12:02.706315+0000","last_peered":"2024-05-08T18:12:02.706315+0000","last_clean":"2024-05-08T18:12:02.706315+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:02.706315+0000","last_undegraded":"2024-05-08T18:12:02.706315+0000","last_fullsized":"2024-05-08T18:12:02.706315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:58:20.720628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.574630+0000","last_change":"2024-05-08T18:08:47.512086+0000","last_active":"2024-05-08T18:09:28.574630+0000","last_peered":"2024-05-08T18:09:28.574630+0000","last_clean":"2024-05-08T18:09:28.574630+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:09:28.574630+0000","last_undegraded":"2024-05-08T18:09:28.574630+0000","last_fullsized":"2024-05-08T18:09:28.574630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:28.169455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390792+0000","last_change":"2024-05-08T18:08:49.497455+0000","last_active":"2024-05-08T18:12:02.390792+0000","last_peered":"2024-05-08T18:12:02.390792+0000","last_clean":"2024-05-08T18:12:02.390792+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:02.390792+0000","last_undegraded":"2024-05-08T18:12:02.390792+0000","last_fullsized":"2024-05-08T18:12:02.390792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:17.081254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.594186+0000","last_change":"2024-05-08T18:08:47.514190+0000","last_active":"2024-05-08T18:09:28.594186+0000","last_peered":"2024-05-08T18:09:28.594186+0000","last_clean":"2024-05-08T18:09:28.594186+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:09:28.594186+0000","last_undegraded":"2024-05-08T18:09:28.594186+0000","last_fullsized":"2024-05-08T18:09:28.594186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:00:15.389137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.599228+0000","last_change":"2024-05-08T18:08:49.495860+0000","last_active":"2024-05-08T18:12:02.599228+0000","last_peered":"2024-05-08T18:12:02.599228+0000","last_clean":"2024-05-08T18:12:02.599228+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:02.599228+0000","last_undegraded":"2024-05-08T18:12:02.599228+0000","last_fullsized":"2024-05-08T18:12:02.599228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:59.271543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.580203+0000","last_change":"2024-05-08T18:08:47.515080+0000","last_active":"2024-05-08T18:09:28.580203+0000","last_peered":"2024-05-08T18:09:28.580203+0000","last_clean":"2024-05-08T18:09:28.580203+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:09:28.580203+0000","last_undegraded":"2024-05-08T18:09:28.580203+0000","last_fullsized":"2024-05-08T18:09:28.580203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:46.479725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640668+0000","last_change":"2024-05-08T18:08:49.498817+0000","last_active":"2024-05-08T18:11:01.640668+0000","last_peered":"2024-05-08T18:11:01.640668+0000","last_clean":"2024-05-08T18:11:01.640668+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:11:01.640668+0000","last_undegraded":"2024-05-08T18:11:01.640668+0000","last_fullsized":"2024-05-08T18:11:01.640668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:19.437499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.587366+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:09:28.587366+0000","last_peered":"2024-05-08T18:09:28.587366+0000","last_clean":"2024-05-08T18:09:28.587366+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:09:28.587366+0000","last_undegraded":"2024-05-08T18:09:28.587366+0000","last_fullsized":"2024-05-08T18:09:28.587366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:29.150400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.690148+0000","last_change":"2024-05-08T18:08:49.514593+0000","last_active":"2024-05-08T18:12:02.690148+0000","last_peered":"2024-05-08T18:12:02.690148+0000","last_clean":"2024-05-08T18:12:02.690148+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:02.690148+0000","last_undegraded":"2024-05-08T18:12:02.690148+0000","last_fullsized":"2024-05-08T18:12:02.690148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:47:59.524157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.576899+0000","last_change":"2024-05-08T18:08:47.515074+0000","last_active":"2024-05-08T18:09:28.576899+0000","last_peered":"2024-05-08T18:09:28.576899+0000","last_clean":"2024-05-08T18:09:28.576899+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:09:28.576899+0000","last_undegraded":"2024-05-08T18:09:28.576899+0000","last_fullsized":"2024-05-08T18:09:28.576899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:20:34.715824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.391996+0000","last_change":"2024-05-08T18:08:49.516189+0000","last_active":"2024-05-08T18:12:02.391996+0000","last_peered":"2024-05-08T18:12:02.391996+0000","last_clean":"2024-05-08T18:12:02.391996+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:02.391996+0000","last_undegraded":"2024-05-08T18:12:02.391996+0000","last_fullsized":"2024-05-08T18:12:02.391996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:46.640916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573546+0000","last_change":"2024-05-08T18:08:47.525612+0000","last_active":"2024-05-08T18:09:28.573546+0000","last_peered":"2024-05-08T18:09:28.573546+0000","last_clean":"2024-05-08T18:09:28.573546+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:09:28.573546+0000","last_undegraded":"2024-05-08T18:09:28.573546+0000","last_fullsized":"2024-05-08T18:09:28.573546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:46:50.790252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.390438+0000","last_change":"2024-05-08T18:08:49.496733+0000","last_active":"2024-05-08T18:12:02.390438+0000","last_peered":"2024-05-08T18:12:02.390438+0000","last_clean":"2024-05-08T18:12:02.390438+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:02.390438+0000","last_undegraded":"2024-05-08T18:12:02.390438+0000","last_fullsized":"2024-05-08T18:12:02.390438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:19.109745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.573307+0000","last_change":"2024-05-08T18:08:47.513204+0000","last_active":"2024-05-08T18:09:28.573307+0000","last_peered":"2024-05-08T18:09:28.573307+0000","last_clean":"2024-05-08T18:09:28.573307+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:09:28.573307+0000","last_undegraded":"2024-05-08T18:09:28.573307+0000","last_fullsized":"2024-05-08T18:09:28.573307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:16.490742+0000","last_change":"2024-05-08T18:08:49.519642+0000","last_active":"2024-05-08T18:10:16.490742+0000","last_peered":"2024-05-08T18:10:16.490742+0000","last_clean":"2024-05-08T18:10:16.490742+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:10:16.490742+0000","last_undegraded":"2024-05-08T18:10:16.490742+0000","last_fullsized":"2024-05-08T18:10:16.490742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:40:04.915056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.551432+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.551432+0000","last_peered":"2024-05-08T18:12:02.551432+0000","last_clean":"2024-05-08T18:12:02.551432+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.551432+0000","last_undegraded":"2024-05-08T18:12:02.551432+0000","last_fullsized":"2024-05-08T18:12:02.551432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:25:15.066942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.640294+0000","last_change":"2024-05-08T18:08:49.499082+0000","last_active":"2024-05-08T18:11:01.640294+0000","last_peered":"2024-05-08T18:11:01.640294+0000","last_clean":"2024-05-08T18:11:01.640294+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:11:01.640294+0000","last_undegraded":"2024-05-08T18:11:01.640294+0000","last_fullsized":"2024-05-08T18:11:01.640294+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:26:02.112670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.599094+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:09:28.599094+0000","last_peered":"2024-05-08T18:09:28.599094+0000","last_clean":"2024-05-08T18:09:28.599094+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:09:28.599094+0000","last_undegraded":"2024-05-08T18:09:28.599094+0000","last_fullsized":"2024-05-08T18:09:28.599094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:27:44.626603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.602483+0000","last_change":"2024-05-08T18:08:49.507865+0000","last_active":"2024-05-08T18:09:28.602483+0000","last_peered":"2024-05-08T18:09:28.602483+0000","last_clean":"2024-05-08T18:09:28.602483+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:09:28.602483+0000","last_undegraded":"2024-05-08T18:09:28.602483+0000","last_fullsized":"2024-05-08T18:09:28.602483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:37:42.616990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.559608+0000","last_change":"2024-05-08T18:08:47.519469+0000","last_active":"2024-05-08T18:12:02.559608+0000","last_peered":"2024-05-08T18:12:02.559608+0000","last_clean":"2024-05-08T18:12:02.559608+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:02.559608+0000","last_undegraded":"2024-05-08T18:12:02.559608+0000","last_fullsized":"2024-05-08T18:12:02.559608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:56:39.711376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:34.142579+0000","last_change":"2024-05-08T18:08:49.497950+0000","last_active":"2024-05-08T18:09:34.142579+0000","last_peered":"2024-05-08T18:09:34.142579+0000","last_clean":"2024-05-08T18:09:34.142579+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:09:34.142579+0000","last_undegraded":"2024-05-08T18:09:34.142579+0000","last_fullsized":"2024-05-08T18:09:34.142579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:35:30.204718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.073988+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:12:02.073988+0000","last_peered":"2024-05-08T18:12:02.073988+0000","last_clean":"2024-05-08T18:12:02.073988+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:12:02.073988+0000","last_undegraded":"2024-05-08T18:12:02.073988+0000","last_fullsized":"2024-05-08T18:12:02.073988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:03.989451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.588195+0000","last_change":"2024-05-08T18:08:47.516126+0000","last_active":"2024-05-08T18:09:28.588195+0000","last_peered":"2024-05-08T18:09:28.588195+0000","last_clean":"2024-05-08T18:09:28.588195+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:09:28.588195+0000","last_undegraded":"2024-05-08T18:09:28.588195+0000","last_fullsized":"2024-05-08T18:09:28.588195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:27.835638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:57.450829+0000","last_change":"2024-05-08T18:08:49.501282+0000","last_active":"2024-05-08T18:10:57.450829+0000","last_peered":"2024-05-08T18:10:57.450829+0000","last_clean":"2024-05-08T18:10:57.450829+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:10:57.450829+0000","last_undegraded":"2024-05-08T18:10:57.450829+0000","last_fullsized":"2024-05-08T18:10:57.450829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:37:32.711877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:28.577094+0000","last_change":"2024-05-08T18:08:47.515944+0000","last_active":"2024-05-08T18:09:28.577094+0000","last_peered":"2024-05-08T18:09:28.577094+0000","last_clean":"2024-05-08T18:09:28.577094+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:09:28.577094+0000","last_undegraded":"2024-05-08T18:09:28.577094+0000","last_fullsized":"2024-05-08T18:09:28.577094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:16.134768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:09:33.106837+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:09:33.106837+0000","last_peered":"2024-05-08T18:09:33.106837+0000","last_clean":"2024-05-08T18:09:33.106837+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:09:33.106837+0000","last_undegraded":"2024-05-08T18:09:33.106837+0000","last_fullsized":"2024-05-08T18:09:33.106837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:46:51.519711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1374,"ondisk_log_size":1374,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705712,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39952,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331888,"statfs":{"total":96636764160,"available":96595853312,"internally_reserved":0,"allocated":462848,"data_stored":145208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":991232,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705711,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":735055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":144761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:12:14.523 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.523 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.524 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.525 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.526 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.527 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.528 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.529 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.530 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.531 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.532 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.533 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.534 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:08:32.327398+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=32, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.535 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.536 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.537 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.538 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.539 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.540 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.541 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.542 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.543 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.544 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.545 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.546 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.547 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.548 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.549 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.550 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.551 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.552 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.553 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.553 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:14.553 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:12:34.553 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:12:34.689 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.686+0000 7fe7ce092640 1 Processor -- start 2024-05-08T18:12:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.686+0000 7fe7ce092640 1 -- start start 2024-05-08T18:12:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.686+0000 7fe7ce092640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7c812a0b0 0x7fe7c812a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7ce092640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7c809e250 con 0x7fe7c812d1e0 2024-05-08T18:12:34.690 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7ce092640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7fe7c8129c60 con 0x7fe7c812a0b0 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c77fe640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7fe7c812a0b0 0x7fe7c812a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c6ffd640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7fe7c812d1e0 0x7fe7c812d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:60478/0 (socket says 172.21.15.53:60478) 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c6ffd640 1 -- 172.21.15.53:0/329093176 learned_addr learned my addr 172.21.15.53:0/329093176 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c67fc640 1 -- 172.21.15.53:0/329093176 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227594246 0 0) 0x7fe7c809e250 con 0x7fe7c812d1e0 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c67fc640 1 -- 172.21.15.53:0/329093176 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7b0003530 con 0x7fe7c812d1e0 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c77fe640 1 -- 172.21.15.53:0/329093176 >> v1:172.21.15.53:6789/0 conn(0x7fe7c812d1e0 legacy=0x7fe7c812d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:34.691 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.690+0000 7fe7c77fe640 1 -- 172.21.15.53:0/329093176 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c8129e90 con 0x7fe7c812a0b0 2024-05-08T18:12:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c77fe640 1 --2- 172.21.15.53:0/329093176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c812a490 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009770 tx=0x7fe7b801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fde026bd1724cb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:34.694 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c67fc640 1 -- 172.21.15.53:0/329093176 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80b0070 con 0x7fe7c812a0b0 2024-05-08T18:12:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c67fc640 1 -- 172.21.15.53:0/329093176 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b80ab530 con 0x7fe7c812a0b0 2024-05-08T18:12:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c67fc640 1 -- 172.21.15.53:0/329093176 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80ab830 con 0x7fe7c812a0b0 2024-05-08T18:12:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/329093176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 msgr2=0x7fe7c812a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:34.695 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 --2- 172.21.15.53:0/329093176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c812a490 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009770 tx=0x7fe7b801c370 comp rx=0 tx=0).stop 2024-05-08T18:12:34.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/329093176 shutdown_connections 2024-05-08T18:12:34.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 --2- 172.21.15.53:0/329093176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c812a490 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:34.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/329093176 >> 172.21.15.53:0/329093176 conn(0x7fe7c809be60 msgr2=0x7fe7c809d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:34.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/329093176 shutdown_connections 2024-05-08T18:12:34.696 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/329093176 wait complete. 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 Processor -- start 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- start start 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c8131610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8135f10 con 0x7fe7c812a0b0 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c8131610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c77fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c8131610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60020/0 (socket says 172.21.15.53:60020) 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c77fe640 1 -- 172.21.15.53:0/3233337647 learned_addr learned my addr 172.21.15.53:0/3233337647 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c77fe640 1 -- 172.21.15.53:0/3233337647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c81161b0 con 0x7fe7c812a0b0 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7c77fe640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c8131610 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80ae040 tx=0x7fe7b801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80b0050 con 0x7fe7c812a0b0 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7b80b1040 con 0x7fe7c812a0b0 2024-05-08T18:12:34.698 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7b80b75a0 con 0x7fe7c812a0b0 2024-05-08T18:12:34.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c8115a10 con 0x7fe7c812a0b0 2024-05-08T18:12:34.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.694+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c8131b50 con 0x7fe7c812a0b0 2024-05-08T18:12:34.699 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.698+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7c8064150 con 0x7fe7c812a0b0 2024-05-08T18:12:34.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.698+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7fe7b80be030 con 0x7fe7c812a0b0 2024-05-08T18:12:34.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.698+0000 7fe7affff640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7b4039b50 0x7fe7b403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:34.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.698+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7fe7b80bc070 con 0x7fe7c812a0b0 2024-05-08T18:12:34.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.698+0000 7fe7c6ffd640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7b4039b50 0x7fe7b403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:34.700 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.698+0000 7fe7c6ffd640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7b4039b50 0x7fe7b403c010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007fd0 tx=0x7fe7bc007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:34.703 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.702+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe7b80c5060 con 0x7fe7c812a0b0 2024-05-08T18:12:34.861 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.858+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7c812ccb0 con 0x7fe7b4039b50 2024-05-08T18:12:34.906 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.906+0000 7fe7affff640 1 -- 172.21.15.53:0/3233337647 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658570 (secure 0 0 0) 0x7fe7c812ccb0 con 0x7fe7b4039b50 2024-05-08T18:12:34.913 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:34.919 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7b4039b50 msgr2=0x7fe7b403c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7b4039b50 0x7fe7b403c010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc007fd0 tx=0x7fe7bc007900 comp rx=0 tx=0).stop 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 msgr2=0x7fe7c8131610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c8131610 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80ae040 tx=0x7fe7b801abb0 comp rx=0 tx=0).stop 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 shutdown_connections 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7fe7b4039b50 0x7fe7b403c010 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 --2- 172.21.15.53:0/3233337647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7c812a0b0 0x7fe7c8131610 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 >> 172.21.15.53:0/3233337647 conn(0x7fe7c809be60 msgr2=0x7fe7c8070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 shutdown_connections 2024-05-08T18:12:34.920 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:34.914+0000 7fe7ce092640 1 -- 172.21.15.53:0/3233337647 wait complete. 2024-05-08T18:12:34.935 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-05-08T18:12:33.422134+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603093,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5068,"num_read_kb":4654,"num_write":2121,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2606,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4678,"ondisk_log_size":4678,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144184,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343176,"statfs":{"total":386547056640,"available":386399412224,"internally_reserved":0,"allocated":2908160,"data_stored":1758306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":144697110},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2606,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006077"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425387+0000","last_change":"2024-05-08T18:08:47.510504+0000","last_active":"2024-05-08T18:10:56.425387+0000","last_peered":"2024-05-08T18:10:56.425387+0000","last_clean":"2024-05-08T18:10:56.425387+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:10:56.425387+0000","last_undegraded":"2024-05-08T18:10:56.425387+0000","last_fullsized":"2024-05-08T18:10:56.425387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774072+0000","last_change":"2024-05-08T18:08:49.501074+0000","last_active":"2024-05-08T18:12:02.774072+0000","last_peered":"2024-05-08T18:12:02.774072+0000","last_clean":"2024-05-08T18:12:02.774072+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:12:02.774072+0000","last_undegraded":"2024-05-08T18:12:02.774072+0000","last_fullsized":"2024-05-08T18:12:02.774072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417927+0000","last_change":"2024-05-08T18:08:47.517769+0000","last_active":"2024-05-08T18:10:56.417927+0000","last_peered":"2024-05-08T18:10:56.417927+0000","last_clean":"2024-05-08T18:10:56.417927+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:10:56.417927+0000","last_undegraded":"2024-05-08T18:10:56.417927+0000","last_fullsized":"2024-05-08T18:10:56.417927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706009+0000","last_change":"2024-05-08T18:08:49.505238+0000","last_active":"2024-05-08T18:12:02.706009+0000","last_peered":"2024-05-08T18:12:02.706009+0000","last_clean":"2024-05-08T18:12:02.706009+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:12:02.706009+0000","last_undegraded":"2024-05-08T18:12:02.706009+0000","last_fullsized":"2024-05-08T18:12:02.706009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428368+0000","last_change":"2024-05-08T18:08:47.529012+0000","last_active":"2024-05-08T18:10:56.428368+0000","last_peered":"2024-05-08T18:10:56.428368+0000","last_clean":"2024-05-08T18:10:56.428368+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:10:56.428368+0000","last_undegraded":"2024-05-08T18:10:56.428368+0000","last_fullsized":"2024-05-08T18:10:56.428368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270413+0000","last_change":"2024-05-08T18:08:49.512376+0000","last_active":"2024-05-08T18:12:02.270413+0000","last_peered":"2024-05-08T18:12:02.270413+0000","last_clean":"2024-05-08T18:12:02.270413+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:02.270413+0000","last_undegraded":"2024-05-08T18:12:02.270413+0000","last_fullsized":"2024-05-08T18:12:02.270413+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.423951+0000","last_change":"2024-05-08T18:08:47.506602+0000","last_active":"2024-05-08T18:10:51.423951+0000","last_peered":"2024-05-08T18:10:51.423951+0000","last_clean":"2024-05-08T18:10:51.423951+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:10:51.423951+0000","last_undegraded":"2024-05-08T18:10:51.423951+0000","last_fullsized":"2024-05-08T18:10:51.423951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.207777+0000","last_change":"2024-05-08T18:12:31.207848+0000","last_active":"2024-05-08T18:12:31.207777+0000","last_peered":"2024-05-08T18:12:31.207777+0000","last_clean":"2024-05-08T18:12:31.207777+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:12:31.207777+0000","last_undegraded":"2024-05-08T18:12:31.207777+0000","last_fullsized":"2024-05-08T18:12:31.207777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.207573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:31.053515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434887+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:11:21.434887+0000","last_peered":"2024-05-08T18:11:21.434887+0000","last_clean":"2024-05-08T18:11:21.434887+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:11:21.434887+0000","last_undegraded":"2024-05-08T18:11:21.434887+0000","last_fullsized":"2024-05-08T18:11:21.434887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.638319+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:11:01.638319+0000","last_peered":"2024-05-08T18:11:01.638319+0000","last_clean":"2024-05-08T18:11:01.638319+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:11:01.638319+0000","last_undegraded":"2024-05-08T18:11:01.638319+0000","last_fullsized":"2024-05-08T18:11:01.638319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431461+0000","last_change":"2024-05-08T18:08:47.517680+0000","last_active":"2024-05-08T18:11:21.431461+0000","last_peered":"2024-05-08T18:11:21.431461+0000","last_clean":"2024-05-08T18:11:21.431461+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:11:21.431461+0000","last_undegraded":"2024-05-08T18:11:21.431461+0000","last_fullsized":"2024-05-08T18:11:21.431461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620019+0000","last_change":"2024-05-08T18:08:49.512339+0000","last_active":"2024-05-08T18:12:02.620019+0000","last_peered":"2024-05-08T18:12:02.620019+0000","last_clean":"2024-05-08T18:12:02.620019+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:02.620019+0000","last_undegraded":"2024-05-08T18:12:02.620019+0000","last_fullsized":"2024-05-08T18:12:02.620019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434699+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:11:21.434699+0000","last_peered":"2024-05-08T18:11:21.434699+0000","last_clean":"2024-05-08T18:11:21.434699+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:11:21.434699+0000","last_undegraded":"2024-05-08T18:11:21.434699+0000","last_fullsized":"2024-05-08T18:11:21.434699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774994+0000","last_change":"2024-05-08T18:08:49.497230+0000","last_active":"2024-05-08T18:12:02.774994+0000","last_peered":"2024-05-08T18:12:02.774994+0000","last_clean":"2024-05-08T18:12:02.774994+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:02.774994+0000","last_undegraded":"2024-05-08T18:12:02.774994+0000","last_fullsized":"2024-05-08T18:12:02.774994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.423816+0000","last_change":"2024-05-08T18:08:47.511982+0000","last_active":"2024-05-08T18:11:21.423816+0000","last_peered":"2024-05-08T18:11:21.423816+0000","last_clean":"2024-05-08T18:11:21.423816+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:11:21.423816+0000","last_undegraded":"2024-05-08T18:11:21.423816+0000","last_fullsized":"2024-05-08T18:11:21.423816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774322+0000","last_change":"2024-05-08T18:08:49.515516+0000","last_active":"2024-05-08T18:12:02.774322+0000","last_peered":"2024-05-08T18:12:02.774322+0000","last_clean":"2024-05-08T18:12:02.774322+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:02.774322+0000","last_undegraded":"2024-05-08T18:12:02.774322+0000","last_fullsized":"2024-05-08T18:12:02.774322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.407311+0000","last_change":"2024-05-08T18:08:49.508214+0000","last_active":"2024-05-08T18:12:02.407311+0000","last_peered":"2024-05-08T18:12:02.407311+0000","last_clean":"2024-05-08T18:12:02.407311+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:12:02.407311+0000","last_undegraded":"2024-05-08T18:12:02.407311+0000","last_fullsized":"2024-05-08T18:12:02.407311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431817+0000","last_change":"2024-05-08T18:08:47.511822+0000","last_active":"2024-05-08T18:11:16.431817+0000","last_peered":"2024-05-08T18:11:16.431817+0000","last_clean":"2024-05-08T18:11:16.431817+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:11:16.431817+0000","last_undegraded":"2024-05-08T18:11:16.431817+0000","last_fullsized":"2024-05-08T18:11:16.431817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.775047+0000","last_change":"2024-05-08T18:08:49.500178+0000","last_active":"2024-05-08T18:12:02.775047+0000","last_peered":"2024-05-08T18:12:02.775047+0000","last_clean":"2024-05-08T18:12:02.775047+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:02.775047+0000","last_undegraded":"2024-05-08T18:12:02.775047+0000","last_fullsized":"2024-05-08T18:12:02.775047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430575+0000","last_change":"2024-05-08T18:08:47.513087+0000","last_active":"2024-05-08T18:11:16.430575+0000","last_peered":"2024-05-08T18:11:16.430575+0000","last_clean":"2024-05-08T18:11:16.430575+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:11:16.430575+0000","last_undegraded":"2024-05-08T18:11:16.430575+0000","last_fullsized":"2024-05-08T18:11:16.430575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.430250+0000","last_change":"2024-05-08T18:08:49.500044+0000","last_active":"2024-05-08T18:11:11.430250+0000","last_peered":"2024-05-08T18:11:11.430250+0000","last_clean":"2024-05-08T18:11:11.430250+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:11:11.430250+0000","last_undegraded":"2024-05-08T18:11:11.430250+0000","last_fullsized":"2024-05-08T18:11:11.430250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431708+0000","last_change":"2024-05-08T18:08:47.513484+0000","last_active":"2024-05-08T18:11:16.431708+0000","last_peered":"2024-05-08T18:11:16.431708+0000","last_clean":"2024-05-08T18:11:16.431708+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:11:16.431708+0000","last_undegraded":"2024-05-08T18:11:16.431708+0000","last_fullsized":"2024-05-08T18:11:16.431708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422714+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:16.422714+0000","last_peered":"2024-05-08T18:11:16.422714+0000","last_clean":"2024-05-08T18:11:16.422714+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:16.422714+0000","last_undegraded":"2024-05-08T18:11:16.422714+0000","last_fullsized":"2024-05-08T18:11:16.422714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521907+0000","last_change":"2024-05-08T18:08:47.496959+0000","last_active":"2024-05-08T18:12:09.521907+0000","last_peered":"2024-05-08T18:12:09.521907+0000","last_clean":"2024-05-08T18:12:09.521907+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:12:09.521907+0000","last_undegraded":"2024-05-08T18:12:09.521907+0000","last_fullsized":"2024-05-08T18:12:09.521907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774115+0000","last_change":"2024-05-08T18:08:49.511519+0000","last_active":"2024-05-08T18:12:02.774115+0000","last_peered":"2024-05-08T18:12:02.774115+0000","last_clean":"2024-05-08T18:12:02.774115+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:02.774115+0000","last_undegraded":"2024-05-08T18:12:02.774115+0000","last_fullsized":"2024-05-08T18:12:02.774115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521296+0000","last_change":"2024-05-08T18:08:47.513517+0000","last_active":"2024-05-08T18:12:09.521296+0000","last_peered":"2024-05-08T18:12:09.521296+0000","last_clean":"2024-05-08T18:12:09.521296+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:12:09.521296+0000","last_undegraded":"2024-05-08T18:12:09.521296+0000","last_fullsized":"2024-05-08T18:12:09.521296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431732+0000","last_change":"2024-05-08T18:08:49.496030+0000","last_active":"2024-05-08T18:11:16.431732+0000","last_peered":"2024-05-08T18:11:16.431732+0000","last_clean":"2024-05-08T18:11:16.431732+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:11:16.431732+0000","last_undegraded":"2024-05-08T18:11:16.431732+0000","last_fullsized":"2024-05-08T18:11:16.431732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522345+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:12:09.522345+0000","last_peered":"2024-05-08T18:12:09.522345+0000","last_clean":"2024-05-08T18:12:09.522345+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:12:09.522345+0000","last_undegraded":"2024-05-08T18:12:09.522345+0000","last_fullsized":"2024-05-08T18:12:09.522345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.798965+0000","last_change":"2024-05-08T18:08:57.567982+0000","last_active":"2024-05-08T18:12:02.798965+0000","last_peered":"2024-05-08T18:12:02.798965+0000","last_clean":"2024-05-08T18:12:02.798965+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:12:02.798965+0000","last_undegraded":"2024-05-08T18:12:02.798965+0000","last_fullsized":"2024-05-08T18:12:02.798965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.773539+0000","last_change":"2024-05-08T18:08:49.512724+0000","last_active":"2024-05-08T18:12:02.773539+0000","last_peered":"2024-05-08T18:12:02.773539+0000","last_clean":"2024-05-08T18:12:02.773539+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:02.773539+0000","last_undegraded":"2024-05-08T18:12:02.773539+0000","last_fullsized":"2024-05-08T18:12:02.773539+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432270+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:11:11.432270+0000","last_peered":"2024-05-08T18:11:11.432270+0000","last_clean":"2024-05-08T18:11:11.432270+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:11:11.432270+0000","last_undegraded":"2024-05-08T18:11:11.432270+0000","last_fullsized":"2024-05-08T18:11:11.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.174115+0000","last_change":"2024-05-08T18:12:23.174172+0000","last_active":"2024-05-08T18:12:23.174115+0000","last_peered":"2024-05-08T18:12:23.174115+0000","last_clean":"2024-05-08T18:12:23.174115+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:12:23.174115+0000","last_undegraded":"2024-05-08T18:12:23.174115+0000","last_fullsized":"2024-05-08T18:12:23.174115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.173919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:15.795305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.630819+0000","last_change":"2024-05-08T18:08:53.550245+0000","last_active":"2024-05-08T18:12:09.630819+0000","last_peered":"2024-05-08T18:12:09.630819+0000","last_clean":"2024-05-08T18:12:09.630819+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:12:09.630819+0000","last_undegraded":"2024-05-08T18:12:09.630819+0000","last_fullsized":"2024-05-08T18:12:09.630819+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.877627+0000","last_change":"2024-05-08T18:12:13.877680+0000","last_active":"2024-05-08T18:12:13.877627+0000","last_peered":"2024-05-08T18:12:13.877627+0000","last_clean":"2024-05-08T18:12:13.877627+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:12:13.877627+0000","last_undegraded":"2024-05-08T18:12:13.877627+0000","last_fullsized":"2024-05-08T18:12:13.877627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.877412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:24.163300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.434119+0000","last_change":"2024-05-08T18:08:57.562642+0000","last_active":"2024-05-08T18:11:26.434119+0000","last_peered":"2024-05-08T18:11:26.434119+0000","last_clean":"2024-05-08T18:11:26.434119+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:11:26.434119+0000","last_undegraded":"2024-05-08T18:11:26.434119+0000","last_fullsized":"2024-05-08T18:11:26.434119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.618528+0000","last_change":"2024-05-08T18:08:49.513376+0000","last_active":"2024-05-08T18:12:02.618528+0000","last_peered":"2024-05-08T18:12:02.618528+0000","last_clean":"2024-05-08T18:12:02.618528+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:02.618528+0000","last_undegraded":"2024-05-08T18:12:02.618528+0000","last_fullsized":"2024-05-08T18:12:02.618528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.429192+0000","last_change":"2024-05-08T18:08:47.514599+0000","last_active":"2024-05-08T18:11:11.429192+0000","last_peered":"2024-05-08T18:11:11.429192+0000","last_clean":"2024-05-08T18:11:11.429192+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:11:11.429192+0000","last_undegraded":"2024-05-08T18:11:11.429192+0000","last_fullsized":"2024-05-08T18:11:11.429192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.421523+0000","last_change":"2024-05-08T18:08:51.510019+0000","last_active":"2024-05-08T18:11:11.421523+0000","last_peered":"2024-05-08T18:11:11.421523+0000","last_clean":"2024-05-08T18:11:11.421523+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:11:11.421523+0000","last_undegraded":"2024-05-08T18:11:11.421523+0000","last_fullsized":"2024-05-08T18:11:11.421523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.937689+0000","last_change":"2024-05-08T18:12:17.937761+0000","last_active":"2024-05-08T18:12:17.937689+0000","last_peered":"2024-05-08T18:12:17.937689+0000","last_clean":"2024-05-08T18:12:17.937689+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:12:17.937689+0000","last_undegraded":"2024-05-08T18:12:17.937689+0000","last_fullsized":"2024-05-08T18:12:17.937689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.937441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:59.874450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.894100+0000","last_change":"2024-05-08T18:12:16.894205+0000","last_active":"2024-05-08T18:12:16.894100+0000","last_peered":"2024-05-08T18:12:16.894100+0000","last_clean":"2024-05-08T18:12:16.894100+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:12:16.894100+0000","last_undegraded":"2024-05-08T18:12:16.894100+0000","last_fullsized":"2024-05-08T18:12:16.894100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.893872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:45.046890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.261929+0000","last_change":"2024-05-08T18:08:57.565097+0000","last_active":"2024-05-08T18:12:02.261929+0000","last_peered":"2024-05-08T18:12:02.261929+0000","last_clean":"2024-05-08T18:12:02.261929+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:12:02.261929+0000","last_undegraded":"2024-05-08T18:12:02.261929+0000","last_fullsized":"2024-05-08T18:12:02.261929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.214586+0000","last_change":"2024-05-08T18:12:26.214649+0000","last_active":"2024-05-08T18:12:26.214586+0000","last_peered":"2024-05-08T18:12:26.214586+0000","last_clean":"2024-05-08T18:12:26.214586+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:26.214586+0000","last_undegraded":"2024-05-08T18:12:26.214586+0000","last_fullsized":"2024-05-08T18:12:26.214586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.214403+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:05.554391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432135+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:11:11.432135+0000","last_peered":"2024-05-08T18:11:11.432135+0000","last_clean":"2024-05-08T18:11:11.432135+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:11:11.432135+0000","last_undegraded":"2024-05-08T18:11:11.432135+0000","last_fullsized":"2024-05-08T18:11:11.432135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.023222+0000","last_change":"2024-05-08T18:12:31.023275+0000","last_active":"2024-05-08T18:12:31.023222+0000","last_peered":"2024-05-08T18:12:31.023222+0000","last_clean":"2024-05-08T18:12:31.023222+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:12:31.023222+0000","last_undegraded":"2024-05-08T18:12:31.023222+0000","last_fullsized":"2024-05-08T18:12:31.023222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.023023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:20.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.430136+0000","last_change":"2024-05-08T18:12:24.430290+0000","last_active":"2024-05-08T18:12:24.430136+0000","last_peered":"2024-05-08T18:12:24.430136+0000","last_clean":"2024-05-08T18:12:24.430136+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:12:24.430136+0000","last_undegraded":"2024-05-08T18:12:24.430136+0000","last_fullsized":"2024-05-08T18:12:24.430136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.429852+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:02.971977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'285","reported_seq":395,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.679652+0000","last_change":"2024-05-08T18:08:55.569300+0000","last_active":"2024-05-08T18:12:09.679652+0000","last_peered":"2024-05-08T18:12:09.679652+0000","last_clean":"2024-05-08T18:12:09.679652+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:09.679652+0000","last_undegraded":"2024-05-08T18:12:09.679652+0000","last_fullsized":"2024-05-08T18:12:09.679652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.434500+0000","last_change":"2024-05-08T18:12:27.434651+0000","last_active":"2024-05-08T18:12:27.434500+0000","last_peered":"2024-05-08T18:12:27.434500+0000","last_clean":"2024-05-08T18:12:27.434500+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:27.434500+0000","last_undegraded":"2024-05-08T18:12:27.434500+0000","last_fullsized":"2024-05-08T18:12:27.434500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.434279+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:06.052889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422915+0000","last_change":"2024-05-08T18:08:49.502184+0000","last_active":"2024-05-08T18:11:16.422915+0000","last_peered":"2024-05-08T18:11:16.422915+0000","last_clean":"2024-05-08T18:11:16.422915+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:11:16.422915+0000","last_undegraded":"2024-05-08T18:11:16.422915+0000","last_fullsized":"2024-05-08T18:11:16.422915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.429969+0000","last_change":"2024-05-08T18:08:47.498742+0000","last_active":"2024-05-08T18:11:11.429969+0000","last_peered":"2024-05-08T18:11:11.429969+0000","last_clean":"2024-05-08T18:11:11.429969+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:11:11.429969+0000","last_undegraded":"2024-05-08T18:11:11.429969+0000","last_fullsized":"2024-05-08T18:11:11.429969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.120514+0000","last_change":"2024-05-08T18:12:16.120572+0000","last_active":"2024-05-08T18:12:16.120514+0000","last_peered":"2024-05-08T18:12:16.120514+0000","last_clean":"2024-05-08T18:12:16.120514+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:12:16.120514+0000","last_undegraded":"2024-05-08T18:12:16.120514+0000","last_fullsized":"2024-05-08T18:12:16.120514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.120296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:25.274533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.373809+0000","last_change":"2024-05-08T18:12:22.373889+0000","last_active":"2024-05-08T18:12:22.373809+0000","last_peered":"2024-05-08T18:12:22.373809+0000","last_clean":"2024-05-08T18:12:22.373809+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:12:22.373809+0000","last_undegraded":"2024-05-08T18:12:22.373809+0000","last_fullsized":"2024-05-08T18:12:22.373809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.373620+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:49.336729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.917276+0000","last_change":"2024-05-08T18:12:24.917353+0000","last_active":"2024-05-08T18:12:24.917276+0000","last_peered":"2024-05-08T18:12:24.917276+0000","last_clean":"2024-05-08T18:12:24.917276+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:24.917276+0000","last_undegraded":"2024-05-08T18:12:24.917276+0000","last_fullsized":"2024-05-08T18:12:24.917276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.917056+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:36.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'11","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862159+0000","last_change":"2024-05-08T18:08:49.510841+0000","last_active":"2024-05-08T18:12:02.862159+0000","last_peered":"2024-05-08T18:12:02.862159+0000","last_clean":"2024-05-08T18:12:02.862159+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:02.862159+0000","last_undegraded":"2024-05-08T18:12:02.862159+0000","last_fullsized":"2024-05-08T18:12:02.862159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428139+0000","last_change":"2024-05-08T18:08:47.512906+0000","last_active":"2024-05-08T18:11:06.428139+0000","last_peered":"2024-05-08T18:11:06.428139+0000","last_clean":"2024-05-08T18:11:06.428139+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:11:06.428139+0000","last_undegraded":"2024-05-08T18:11:06.428139+0000","last_fullsized":"2024-05-08T18:11:06.428139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.808661+0000","last_change":"2024-05-08T18:12:30.808713+0000","last_active":"2024-05-08T18:12:30.808661+0000","last_peered":"2024-05-08T18:12:30.808661+0000","last_clean":"2024-05-08T18:12:30.808661+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:12:30.808661+0000","last_undegraded":"2024-05-08T18:12:30.808661+0000","last_fullsized":"2024-05-08T18:12:30.808661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.808460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:40.081671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.443782+0000","last_change":"2024-05-08T18:12:25.443964+0000","last_active":"2024-05-08T18:12:25.443782+0000","last_peered":"2024-05-08T18:12:25.443782+0000","last_clean":"2024-05-08T18:12:25.443782+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:12:25.443782+0000","last_undegraded":"2024-05-08T18:12:25.443782+0000","last_fullsized":"2024-05-08T18:12:25.443782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.443551+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:01.194660+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.977085+0000","last_change":"2024-05-08T18:12:18.977194+0000","last_active":"2024-05-08T18:12:18.977085+0000","last_peered":"2024-05-08T18:12:18.977085+0000","last_clean":"2024-05-08T18:12:18.977085+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:12:18.977085+0000","last_undegraded":"2024-05-08T18:12:18.977085+0000","last_fullsized":"2024-05-08T18:12:18.977085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.976803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:31.754400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.404468+0000","last_change":"2024-05-08T18:12:23.404620+0000","last_active":"2024-05-08T18:12:23.404468+0000","last_peered":"2024-05-08T18:12:23.404468+0000","last_clean":"2024-05-08T18:12:23.404468+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:12:23.404468+0000","last_undegraded":"2024-05-08T18:12:23.404468+0000","last_fullsized":"2024-05-08T18:12:23.404468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.404248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:38.428265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427426+0000","last_change":"2024-05-08T18:08:49.497616+0000","last_active":"2024-05-08T18:11:01.427426+0000","last_peered":"2024-05-08T18:11:01.427426+0000","last_clean":"2024-05-08T18:11:01.427426+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:11:01.427426+0000","last_undegraded":"2024-05-08T18:11:01.427426+0000","last_fullsized":"2024-05-08T18:11:01.427426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.427982+0000","last_change":"2024-05-08T18:08:47.513909+0000","last_active":"2024-05-08T18:11:06.427982+0000","last_peered":"2024-05-08T18:11:06.427982+0000","last_clean":"2024-05-08T18:11:06.427982+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:11:06.427982+0000","last_undegraded":"2024-05-08T18:11:06.427982+0000","last_fullsized":"2024-05-08T18:11:06.427982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:41.435868+0000","last_change":"2024-05-08T18:09:28.594816+0000","last_active":"2024-05-08T18:11:41.435868+0000","last_peered":"2024-05-08T18:11:41.435868+0000","last_clean":"2024-05-08T18:11:41.435868+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:11:41.435868+0000","last_undegraded":"2024-05-08T18:11:41.435868+0000","last_fullsized":"2024-05-08T18:11:41.435868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.505598+0000","last_change":"2024-05-08T18:08:53.558331+0000","last_active":"2024-05-08T18:12:09.505598+0000","last_peered":"2024-05-08T18:12:09.505598+0000","last_clean":"2024-05-08T18:12:09.505598+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:12:09.505598+0000","last_undegraded":"2024-05-08T18:12:09.505598+0000","last_fullsized":"2024-05-08T18:12:09.505598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.889035+0000","last_change":"2024-05-08T18:12:14.889091+0000","last_active":"2024-05-08T18:12:14.889035+0000","last_peered":"2024-05-08T18:12:14.889035+0000","last_clean":"2024-05-08T18:12:14.889035+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:12:14.889035+0000","last_undegraded":"2024-05-08T18:12:14.889035+0000","last_fullsized":"2024-05-08T18:12:14.889035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.888837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:43.041854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.429052+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:11:06.429052+0000","last_peered":"2024-05-08T18:11:06.429052+0000","last_clean":"2024-05-08T18:11:06.429052+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:11:06.429052+0000","last_undegraded":"2024-05-08T18:11:06.429052+0000","last_fullsized":"2024-05-08T18:11:06.429052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620867+0000","last_change":"2024-05-08T18:08:49.508936+0000","last_active":"2024-05-08T18:12:02.620867+0000","last_peered":"2024-05-08T18:12:02.620867+0000","last_clean":"2024-05-08T18:12:02.620867+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:02.620867+0000","last_undegraded":"2024-05-08T18:12:02.620867+0000","last_fullsized":"2024-05-08T18:12:02.620867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430943+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:11:06.430943+0000","last_peered":"2024-05-08T18:11:06.430943+0000","last_clean":"2024-05-08T18:11:06.430943+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:11:06.430943+0000","last_undegraded":"2024-05-08T18:11:06.430943+0000","last_fullsized":"2024-05-08T18:11:06.430943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420356+0000","last_change":"2024-05-08T18:08:51.511856+0000","last_active":"2024-05-08T18:11:06.420356+0000","last_peered":"2024-05-08T18:11:06.420356+0000","last_clean":"2024-05-08T18:11:06.420356+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:11:06.420356+0000","last_undegraded":"2024-05-08T18:11:06.420356+0000","last_fullsized":"2024-05-08T18:11:06.420356+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.137274+0000","last_change":"2024-05-08T18:12:22.137373+0000","last_active":"2024-05-08T18:12:22.137274+0000","last_peered":"2024-05-08T18:12:22.137274+0000","last_clean":"2024-05-08T18:12:22.137274+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:12:22.137274+0000","last_undegraded":"2024-05-08T18:12:22.137274+0000","last_fullsized":"2024-05-08T18:12:22.137274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.137072+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.003539+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":367,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.931110+0000","last_change":"2024-05-08T18:12:13.931134+0000","last_active":"2024-05-08T18:12:13.931110+0000","last_peered":"2024-05-08T18:12:13.931110+0000","last_clean":"2024-05-08T18:12:13.931110+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:13.931110+0000","last_undegraded":"2024-05-08T18:12:13.931110+0000","last_fullsized":"2024-05-08T18:12:13.931110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.931028+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:49.682137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.421644+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:11:11.421644+0000","last_peered":"2024-05-08T18:11:11.421644+0000","last_clean":"2024-05-08T18:11:11.421644+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:11:11.421644+0000","last_undegraded":"2024-05-08T18:11:11.421644+0000","last_fullsized":"2024-05-08T18:11:11.421644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.427784+0000","last_change":"2024-05-08T18:08:49.491239+0000","last_active":"2024-05-08T18:11:06.427784+0000","last_peered":"2024-05-08T18:11:06.427784+0000","last_clean":"2024-05-08T18:11:06.427784+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:11:06.427784+0000","last_undegraded":"2024-05-08T18:11:06.427784+0000","last_fullsized":"2024-05-08T18:11:06.427784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430833+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:11:06.430833+0000","last_peered":"2024-05-08T18:11:06.430833+0000","last_clean":"2024-05-08T18:11:06.430833+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:11:06.430833+0000","last_undegraded":"2024-05-08T18:11:06.430833+0000","last_fullsized":"2024-05-08T18:11:06.430833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:41.435953+0000","last_change":"2024-05-08T18:09:28.599715+0000","last_active":"2024-05-08T18:11:41.435953+0000","last_peered":"2024-05-08T18:11:41.435953+0000","last_clean":"2024-05-08T18:11:41.435953+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:11:41.435953+0000","last_undegraded":"2024-05-08T18:11:41.435953+0000","last_fullsized":"2024-05-08T18:11:41.435953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'60","reported_seq":125,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.538081+0000","last_change":"2024-05-08T18:08:53.550420+0000","last_active":"2024-05-08T18:12:09.538081+0000","last_peered":"2024-05-08T18:12:09.538081+0000","last_clean":"2024-05-08T18:12:09.538081+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:12:09.538081+0000","last_undegraded":"2024-05-08T18:12:09.538081+0000","last_fullsized":"2024-05-08T18:12:09.538081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.918065+0000","last_change":"2024-05-08T18:12:16.918122+0000","last_active":"2024-05-08T18:12:16.918065+0000","last_peered":"2024-05-08T18:12:16.918065+0000","last_clean":"2024-05-08T18:12:16.918065+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:12:16.918065+0000","last_undegraded":"2024-05-08T18:12:16.918065+0000","last_fullsized":"2024-05-08T18:12:16.918065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.917861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:11.528942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'20","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.932515+0000","last_change":"2024-05-08T18:08:57.554614+0000","last_active":"2024-05-08T18:12:02.932515+0000","last_peered":"2024-05-08T18:12:02.932515+0000","last_clean":"2024-05-08T18:12:02.932515+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:02.932515+0000","last_undegraded":"2024-05-08T18:12:02.932515+0000","last_fullsized":"2024-05-08T18:12:02.932515+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428973+0000","last_change":"2024-05-08T18:08:49.519440+0000","last_active":"2024-05-08T18:11:06.428973+0000","last_peered":"2024-05-08T18:11:06.428973+0000","last_clean":"2024-05-08T18:11:06.428973+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:11:06.428973+0000","last_undegraded":"2024-05-08T18:11:06.428973+0000","last_fullsized":"2024-05-08T18:11:06.428973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420286+0000","last_change":"2024-05-08T18:08:47.496893+0000","last_active":"2024-05-08T18:11:06.420286+0000","last_peered":"2024-05-08T18:11:06.420286+0000","last_clean":"2024-05-08T18:11:06.420286+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:11:06.420286+0000","last_undegraded":"2024-05-08T18:11:06.420286+0000","last_fullsized":"2024-05-08T18:11:06.420286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.427924+0000","last_change":"2024-05-08T18:08:51.507807+0000","last_active":"2024-05-08T18:11:06.427924+0000","last_peered":"2024-05-08T18:11:06.427924+0000","last_clean":"2024-05-08T18:11:06.427924+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:11:06.427924+0000","last_undegraded":"2024-05-08T18:11:06.427924+0000","last_fullsized":"2024-05-08T18:11:06.427924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.976359+0000","last_change":"2024-05-08T18:12:19.976447+0000","last_active":"2024-05-08T18:12:19.976359+0000","last_peered":"2024-05-08T18:12:19.976359+0000","last_clean":"2024-05-08T18:12:19.976359+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:12:19.976359+0000","last_undegraded":"2024-05-08T18:12:19.976359+0000","last_fullsized":"2024-05-08T18:12:19.976359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.976156+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:44.797089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432501+0000","last_change":"2024-05-08T18:08:55.570542+0000","last_active":"2024-05-08T18:11:11.432501+0000","last_peered":"2024-05-08T18:11:11.432501+0000","last_clean":"2024-05-08T18:11:11.432501+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:11:11.432501+0000","last_undegraded":"2024-05-08T18:11:11.432501+0000","last_fullsized":"2024-05-08T18:11:11.432501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.872710+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:12:02.872710+0000","last_peered":"2024-05-08T18:12:02.872710+0000","last_clean":"2024-05-08T18:12:02.872710+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:12:02.872710+0000","last_undegraded":"2024-05-08T18:12:02.872710+0000","last_fullsized":"2024-05-08T18:12:02.872710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.246328+0000","last_change":"2024-05-08T18:12:27.246550+0000","last_active":"2024-05-08T18:12:27.246328+0000","last_peered":"2024-05-08T18:12:27.246328+0000","last_clean":"2024-05-08T18:12:27.246328+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:27.246328+0000","last_undegraded":"2024-05-08T18:12:27.246328+0000","last_fullsized":"2024-05-08T18:12:27.246328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.246102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:55.984072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522172+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:12:09.522172+0000","last_peered":"2024-05-08T18:12:09.522172+0000","last_clean":"2024-05-08T18:12:09.522172+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:12:09.522172+0000","last_undegraded":"2024-05-08T18:12:09.522172+0000","last_fullsized":"2024-05-08T18:12:09.522172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.057420+0000","last_change":"2024-05-08T18:12:30.057479+0000","last_active":"2024-05-08T18:12:30.057420+0000","last_peered":"2024-05-08T18:12:30.057420+0000","last_clean":"2024-05-08T18:12:30.057420+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:12:30.057420+0000","last_undegraded":"2024-05-08T18:12:30.057420+0000","last_fullsized":"2024-05-08T18:12:30.057420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:54.634269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.405643+0000","last_change":"2024-05-08T18:12:28.405733+0000","last_active":"2024-05-08T18:12:28.405643+0000","last_peered":"2024-05-08T18:12:28.405643+0000","last_clean":"2024-05-08T18:12:28.405643+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:12:28.405643+0000","last_undegraded":"2024-05-08T18:12:28.405643+0000","last_fullsized":"2024-05-08T18:12:28.405643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.405516+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:23.016597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.441147+0000","last_change":"2024-05-08T18:12:15.441218+0000","last_active":"2024-05-08T18:12:15.441147+0000","last_peered":"2024-05-08T18:12:15.441147+0000","last_clean":"2024-05-08T18:12:15.441147+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:15.441147+0000","last_undegraded":"2024-05-08T18:12:15.441147+0000","last_fullsized":"2024-05-08T18:12:15.441147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.440939+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:26.637944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.876900+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:12:02.876900+0000","last_peered":"2024-05-08T18:12:02.876900+0000","last_clean":"2024-05-08T18:12:02.876900+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:12:02.876900+0000","last_undegraded":"2024-05-08T18:12:02.876900+0000","last_fullsized":"2024-05-08T18:12:02.876900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428026+0000","last_change":"2024-05-08T18:08:49.511424+0000","last_active":"2024-05-08T18:11:06.428026+0000","last_peered":"2024-05-08T18:11:06.428026+0000","last_clean":"2024-05-08T18:11:06.428026+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:11:06.428026+0000","last_undegraded":"2024-05-08T18:11:06.428026+0000","last_fullsized":"2024-05-08T18:11:06.428026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429448+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:11:01.429448+0000","last_peered":"2024-05-08T18:11:01.429448+0000","last_clean":"2024-05-08T18:11:01.429448+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:11:01.429448+0000","last_undegraded":"2024-05-08T18:11:01.429448+0000","last_fullsized":"2024-05-08T18:11:01.429448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.895983+0000","last_change":"2024-05-08T18:12:27.896053+0000","last_active":"2024-05-08T18:12:27.895983+0000","last_peered":"2024-05-08T18:12:27.895983+0000","last_clean":"2024-05-08T18:12:27.895983+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:12:27.895983+0000","last_undegraded":"2024-05-08T18:12:27.895983+0000","last_fullsized":"2024-05-08T18:12:27.895983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.895781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:25.396027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432360+0000","last_change":"2024-05-08T18:08:53.558518+0000","last_active":"2024-05-08T18:11:11.432360+0000","last_peered":"2024-05-08T18:11:11.432360+0000","last_clean":"2024-05-08T18:11:11.432360+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:11:11.432360+0000","last_undegraded":"2024-05-08T18:11:11.432360+0000","last_fullsized":"2024-05-08T18:11:11.432360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.876484+0000","last_change":"2024-05-08T18:12:28.876546+0000","last_active":"2024-05-08T18:12:28.876484+0000","last_peered":"2024-05-08T18:12:28.876484+0000","last_clean":"2024-05-08T18:12:28.876484+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:28.876484+0000","last_undegraded":"2024-05-08T18:12:28.876484+0000","last_fullsized":"2024-05-08T18:12:28.876484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.876292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:13:51.241466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.427672+0000","last_change":"2024-05-08T18:08:57.569509+0000","last_active":"2024-05-08T18:11:06.427672+0000","last_peered":"2024-05-08T18:11:06.427672+0000","last_clean":"2024-05-08T18:11:06.427672+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:11:06.427672+0000","last_undegraded":"2024-05-08T18:11:06.427672+0000","last_fullsized":"2024-05-08T18:11:06.427672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.864519+0000","last_change":"2024-05-08T18:08:49.518367+0000","last_active":"2024-05-08T18:12:02.864519+0000","last_peered":"2024-05-08T18:12:02.864519+0000","last_clean":"2024-05-08T18:12:02.864519+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:02.864519+0000","last_undegraded":"2024-05-08T18:12:02.864519+0000","last_fullsized":"2024-05-08T18:12:02.864519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429318+0000","last_change":"2024-05-08T18:08:47.529160+0000","last_active":"2024-05-08T18:11:01.429318+0000","last_peered":"2024-05-08T18:11:01.429318+0000","last_clean":"2024-05-08T18:11:01.429318+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:11:01.429318+0000","last_undegraded":"2024-05-08T18:11:01.429318+0000","last_fullsized":"2024-05-08T18:11:01.429318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.106333+0000","last_change":"2024-05-08T18:12:17.106450+0000","last_active":"2024-05-08T18:12:17.106333+0000","last_peered":"2024-05-08T18:12:17.106333+0000","last_clean":"2024-05-08T18:12:17.106333+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:12:17.106333+0000","last_undegraded":"2024-05-08T18:12:17.106333+0000","last_fullsized":"2024-05-08T18:12:17.106333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.106103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:31.299089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.947238+0000","last_change":"2024-05-08T18:12:21.947331+0000","last_active":"2024-05-08T18:12:21.947238+0000","last_peered":"2024-05-08T18:12:21.947238+0000","last_clean":"2024-05-08T18:12:21.947238+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:12:21.947238+0000","last_undegraded":"2024-05-08T18:12:21.947238+0000","last_fullsized":"2024-05-08T18:12:21.947238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.947022+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:33.614218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.369594+0000","last_change":"2024-05-08T18:12:20.369656+0000","last_active":"2024-05-08T18:12:20.369594+0000","last_peered":"2024-05-08T18:12:20.369594+0000","last_clean":"2024-05-08T18:12:20.369594+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:12:20.369594+0000","last_undegraded":"2024-05-08T18:12:20.369594+0000","last_fullsized":"2024-05-08T18:12:20.369594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.369368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:12.685507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.927769+0000","last_change":"2024-05-08T18:08:57.568017+0000","last_active":"2024-05-08T18:12:02.927769+0000","last_peered":"2024-05-08T18:12:02.927769+0000","last_clean":"2024-05-08T18:12:02.927769+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:12:02.927769+0000","last_undegraded":"2024-05-08T18:12:02.927769+0000","last_fullsized":"2024-05-08T18:12:02.927769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862192+0000","last_change":"2024-05-08T18:08:49.510311+0000","last_active":"2024-05-08T18:12:02.862192+0000","last_peered":"2024-05-08T18:12:02.862192+0000","last_clean":"2024-05-08T18:12:02.862192+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:02.862192+0000","last_undegraded":"2024-05-08T18:12:02.862192+0000","last_fullsized":"2024-05-08T18:12:02.862192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:36.421917+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:10:36.421917+0000","last_peered":"2024-05-08T18:10:36.421917+0000","last_clean":"2024-05-08T18:10:36.421917+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:10:36.421917+0000","last_undegraded":"2024-05-08T18:10:36.421917+0000","last_fullsized":"2024-05-08T18:10:36.421917+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.425951+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:10:46.425951+0000","last_peered":"2024-05-08T18:10:46.425951+0000","last_clean":"2024-05-08T18:10:46.425951+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:10:46.425951+0000","last_undegraded":"2024-05-08T18:10:46.425951+0000","last_fullsized":"2024-05-08T18:10:46.425951+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428195+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:10:56.428195+0000","last_peered":"2024-05-08T18:10:56.428195+0000","last_clean":"2024-05-08T18:10:56.428195+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:10:56.428195+0000","last_undegraded":"2024-05-08T18:10:56.428195+0000","last_fullsized":"2024-05-08T18:10:56.428195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.832102+0000","last_change":"2024-05-08T18:12:25.832156+0000","last_active":"2024-05-08T18:12:25.832102+0000","last_peered":"2024-05-08T18:12:25.832102+0000","last_clean":"2024-05-08T18:12:25.832102+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:12:25.832102+0000","last_undegraded":"2024-05-08T18:12:25.832102+0000","last_fullsized":"2024-05-08T18:12:25.832102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.831900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:22.583694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'88","reported_seq":170,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.654220+0000","last_change":"2024-05-08T18:08:53.552241+0000","last_active":"2024-05-08T18:12:09.654220+0000","last_peered":"2024-05-08T18:12:09.654220+0000","last_clean":"2024-05-08T18:12:09.654220+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:09.654220+0000","last_undegraded":"2024-05-08T18:12:09.654220+0000","last_fullsized":"2024-05-08T18:12:09.654220+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.052555+0000","last_change":"2024-05-08T18:12:29.052679+0000","last_active":"2024-05-08T18:12:29.052555+0000","last_peered":"2024-05-08T18:12:29.052555+0000","last_clean":"2024-05-08T18:12:29.052555+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:12:29.052555+0000","last_undegraded":"2024-05-08T18:12:29.052555+0000","last_fullsized":"2024-05-08T18:12:29.052555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.052326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:01.660597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":164,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.793622+0000","last_change":"2024-05-08T18:08:57.567916+0000","last_active":"2024-05-08T18:12:02.793622+0000","last_peered":"2024-05-08T18:12:02.793622+0000","last_clean":"2024-05-08T18:12:02.793622+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:02.793622+0000","last_undegraded":"2024-05-08T18:12:02.793622+0000","last_fullsized":"2024-05-08T18:12:02.793622+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.619896+0000","last_change":"2024-05-08T18:08:49.510047+0000","last_active":"2024-05-08T18:12:02.619896+0000","last_peered":"2024-05-08T18:12:02.619896+0000","last_clean":"2024-05-08T18:12:02.619896+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:12:02.619896+0000","last_undegraded":"2024-05-08T18:12:02.619896+0000","last_fullsized":"2024-05-08T18:12:02.619896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:41.424584+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:10:41.424584+0000","last_peered":"2024-05-08T18:10:41.424584+0000","last_clean":"2024-05-08T18:10:41.424584+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:10:41.424584+0000","last_undegraded":"2024-05-08T18:10:41.424584+0000","last_fullsized":"2024-05-08T18:10:41.424584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417643+0000","last_change":"2024-05-08T18:08:47.515311+0000","last_active":"2024-05-08T18:10:56.417643+0000","last_peered":"2024-05-08T18:10:56.417643+0000","last_clean":"2024-05-08T18:10:56.417643+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:10:56.417643+0000","last_undegraded":"2024-05-08T18:10:56.417643+0000","last_fullsized":"2024-05-08T18:10:56.417643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.110792+0000","last_change":"2024-05-08T18:12:15.110947+0000","last_active":"2024-05-08T18:12:15.110792+0000","last_peered":"2024-05-08T18:12:15.110792+0000","last_clean":"2024-05-08T18:12:15.110792+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:12:15.110792+0000","last_undegraded":"2024-05-08T18:12:15.110792+0000","last_fullsized":"2024-05-08T18:12:15.110792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.110542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:17.286120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":516,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.874535+0000","last_change":"2024-05-08T18:12:15.874681+0000","last_active":"2024-05-08T18:12:15.874535+0000","last_peered":"2024-05-08T18:12:15.874535+0000","last_clean":"2024-05-08T18:12:15.874535+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:15.874535+0000","last_undegraded":"2024-05-08T18:12:15.874535+0000","last_fullsized":"2024-05-08T18:12:15.874535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.874266+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:16.789721+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429616+0000","last_change":"2024-05-08T18:08:55.568400+0000","last_active":"2024-05-08T18:11:01.429616+0000","last_peered":"2024-05-08T18:11:01.429616+0000","last_clean":"2024-05-08T18:11:01.429616+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:11:01.429616+0000","last_undegraded":"2024-05-08T18:11:01.429616+0000","last_fullsized":"2024-05-08T18:11:01.429616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.430283+0000","last_change":"2024-05-08T18:08:57.579069+0000","last_active":"2024-05-08T18:11:11.430283+0000","last_peered":"2024-05-08T18:11:11.430283+0000","last_clean":"2024-05-08T18:11:11.430283+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:11:11.430283+0000","last_undegraded":"2024-05-08T18:11:11.430283+0000","last_fullsized":"2024-05-08T18:11:11.430283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774822+0000","last_change":"2024-05-08T18:08:49.501820+0000","last_active":"2024-05-08T18:12:02.774822+0000","last_peered":"2024-05-08T18:12:02.774822+0000","last_clean":"2024-05-08T18:12:02.774822+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:02.774822+0000","last_undegraded":"2024-05-08T18:12:02.774822+0000","last_fullsized":"2024-05-08T18:12:02.774822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.422715+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:10:46.422715+0000","last_peered":"2024-05-08T18:10:46.422715+0000","last_clean":"2024-05-08T18:10:46.422715+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:10:46.422715+0000","last_undegraded":"2024-05-08T18:10:46.422715+0000","last_fullsized":"2024-05-08T18:10:46.422715+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.416269+0000","last_change":"2024-05-08T18:08:47.513124+0000","last_active":"2024-05-08T18:10:51.416269+0000","last_peered":"2024-05-08T18:10:51.416269+0000","last_clean":"2024-05-08T18:10:51.416269+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:10:51.416269+0000","last_undegraded":"2024-05-08T18:10:51.416269+0000","last_fullsized":"2024-05-08T18:10:51.416269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.426624+0000","last_change":"2024-05-08T18:08:51.508831+0000","last_active":"2024-05-08T18:11:01.426624+0000","last_peered":"2024-05-08T18:11:01.426624+0000","last_clean":"2024-05-08T18:11:01.426624+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:11:01.426624+0000","last_undegraded":"2024-05-08T18:11:01.426624+0000","last_fullsized":"2024-05-08T18:11:01.426624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.405760+0000","last_change":"2024-05-08T18:12:26.405846+0000","last_active":"2024-05-08T18:12:26.405760+0000","last_peered":"2024-05-08T18:12:26.405760+0000","last_clean":"2024-05-08T18:12:26.405760+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:26.405760+0000","last_undegraded":"2024-05-08T18:12:26.405760+0000","last_fullsized":"2024-05-08T18:12:26.405760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.405548+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:54.558566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.419022+0000","last_change":"2024-05-08T18:08:55.567310+0000","last_active":"2024-05-08T18:11:01.419022+0000","last_peered":"2024-05-08T18:11:01.419022+0000","last_clean":"2024-05-08T18:11:01.419022+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:11:01.419022+0000","last_undegraded":"2024-05-08T18:11:01.419022+0000","last_fullsized":"2024-05-08T18:11:01.419022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433565+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:11:16.433565+0000","last_peered":"2024-05-08T18:11:16.433565+0000","last_clean":"2024-05-08T18:11:16.433565+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:11:16.433565+0000","last_undegraded":"2024-05-08T18:11:16.433565+0000","last_fullsized":"2024-05-08T18:11:16.433565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'17","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.861662+0000","last_change":"2024-05-08T18:08:49.493587+0000","last_active":"2024-05-08T18:12:02.861662+0000","last_peered":"2024-05-08T18:12:02.861662+0000","last_clean":"2024-05-08T18:12:02.861662+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:02.861662+0000","last_undegraded":"2024-05-08T18:12:02.861662+0000","last_fullsized":"2024-05-08T18:12:02.861662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.425835+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:10:46.425835+0000","last_peered":"2024-05-08T18:10:46.425835+0000","last_clean":"2024-05-08T18:10:46.425835+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:10:46.425835+0000","last_undegraded":"2024-05-08T18:10:46.425835+0000","last_fullsized":"2024-05-08T18:10:46.425835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425133+0000","last_change":"2024-05-08T18:08:47.507237+0000","last_active":"2024-05-08T18:10:56.425133+0000","last_peered":"2024-05-08T18:10:56.425133+0000","last_clean":"2024-05-08T18:10:56.425133+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:10:56.425133+0000","last_undegraded":"2024-05-08T18:10:56.425133+0000","last_fullsized":"2024-05-08T18:10:56.425133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417867+0000","last_change":"2024-05-08T18:08:51.510525+0000","last_active":"2024-05-08T18:10:56.417867+0000","last_peered":"2024-05-08T18:10:56.417867+0000","last_clean":"2024-05-08T18:10:56.417867+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:10:56.417867+0000","last_undegraded":"2024-05-08T18:10:56.417867+0000","last_fullsized":"2024-05-08T18:10:56.417867+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:01.692721+0000","last_change":"2024-05-08T18:08:53.551086+0000","last_active":"2024-05-08T18:12:01.692721+0000","last_peered":"2024-05-08T18:12:01.692721+0000","last_clean":"2024-05-08T18:12:01.692721+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:01.692721+0000","last_undegraded":"2024-05-08T18:12:01.692721+0000","last_fullsized":"2024-05-08T18:12:01.692721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.431075+0000","last_change":"2024-05-08T18:08:55.569487+0000","last_active":"2024-05-08T18:11:06.431075+0000","last_peered":"2024-05-08T18:11:06.431075+0000","last_clean":"2024-05-08T18:11:06.431075+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:11:06.431075+0000","last_undegraded":"2024-05-08T18:11:06.431075+0000","last_fullsized":"2024-05-08T18:11:06.431075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.430054+0000","last_change":"2024-05-08T18:08:57.567414+0000","last_active":"2024-05-08T18:11:11.430054+0000","last_peered":"2024-05-08T18:11:11.430054+0000","last_clean":"2024-05-08T18:11:11.430054+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:11:11.430054+0000","last_undegraded":"2024-05-08T18:11:11.430054+0000","last_fullsized":"2024-05-08T18:11:11.430054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706210+0000","last_change":"2024-05-08T18:09:28.612611+0000","last_active":"2024-05-08T18:12:02.706210+0000","last_peered":"2024-05-08T18:12:02.706210+0000","last_clean":"2024-05-08T18:12:02.706210+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:12:02.706210+0000","last_undegraded":"2024-05-08T18:12:02.706210+0000","last_fullsized":"2024-05-08T18:12:02.706210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425199+0000","last_change":"2024-05-08T18:08:47.517520+0000","last_active":"2024-05-08T18:10:56.425199+0000","last_peered":"2024-05-08T18:10:56.425199+0000","last_clean":"2024-05-08T18:10:56.425199+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:10:56.425199+0000","last_undegraded":"2024-05-08T18:10:56.425199+0000","last_fullsized":"2024-05-08T18:10:56.425199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.415197+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:10:46.415197+0000","last_peered":"2024-05-08T18:10:46.415197+0000","last_clean":"2024-05-08T18:10:46.415197+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:10:46.415197+0000","last_undegraded":"2024-05-08T18:10:46.415197+0000","last_fullsized":"2024-05-08T18:10:46.415197+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'1","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.345689+0000","last_change":"2024-05-08T18:08:51.511005+0000","last_active":"2024-05-08T18:12:09.345689+0000","last_peered":"2024-05-08T18:12:09.345689+0000","last_clean":"2024-05-08T18:12:09.345689+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:12:09.345689+0000","last_undegraded":"2024-05-08T18:12:09.345689+0000","last_fullsized":"2024-05-08T18:12:09.345689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.946400+0000","last_change":"2024-05-08T18:12:21.946482+0000","last_active":"2024-05-08T18:12:21.946400+0000","last_peered":"2024-05-08T18:12:21.946400+0000","last_clean":"2024-05-08T18:12:21.946400+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:12:21.946400+0000","last_undegraded":"2024-05-08T18:12:21.946400+0000","last_fullsized":"2024-05-08T18:12:21.946400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.946183+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:14.861048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.480982+0000","last_change":"2024-05-08T18:12:14.481040+0000","last_active":"2024-05-08T18:12:14.480982+0000","last_peered":"2024-05-08T18:12:14.480982+0000","last_clean":"2024-05-08T18:12:14.480982+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:12:14.480982+0000","last_undegraded":"2024-05-08T18:12:14.480982+0000","last_fullsized":"2024-05-08T18:12:14.480982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.480775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:53.762778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422810+0000","last_change":"2024-05-08T18:08:57.564941+0000","last_active":"2024-05-08T18:11:16.422810+0000","last_peered":"2024-05-08T18:11:16.422810+0000","last_clean":"2024-05-08T18:11:16.422810+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:11:16.422810+0000","last_undegraded":"2024-05-08T18:11:16.422810+0000","last_fullsized":"2024-05-08T18:11:16.422810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.618981+0000","last_change":"2024-05-08T18:08:49.519773+0000","last_active":"2024-05-08T18:12:02.618981+0000","last_peered":"2024-05-08T18:12:02.618981+0000","last_clean":"2024-05-08T18:12:02.618981+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:02.618981+0000","last_undegraded":"2024-05-08T18:12:02.618981+0000","last_fullsized":"2024-05-08T18:12:02.618981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417811+0000","last_change":"2024-05-08T18:08:47.517709+0000","last_active":"2024-05-08T18:10:56.417811+0000","last_peered":"2024-05-08T18:10:56.417811+0000","last_clean":"2024-05-08T18:10:56.417811+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:10:56.417811+0000","last_undegraded":"2024-05-08T18:10:56.417811+0000","last_fullsized":"2024-05-08T18:10:56.417811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:46.426023+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:10:46.426023+0000","last_peered":"2024-05-08T18:10:46.426023+0000","last_clean":"2024-05-08T18:10:46.426023+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:10:46.426023+0000","last_undegraded":"2024-05-08T18:10:46.426023+0000","last_fullsized":"2024-05-08T18:10:46.426023+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.141960+0000","last_change":"2024-05-08T18:12:21.142014+0000","last_active":"2024-05-08T18:12:21.141960+0000","last_peered":"2024-05-08T18:12:21.141960+0000","last_clean":"2024-05-08T18:12:21.141960+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:12:21.141960+0000","last_undegraded":"2024-05-08T18:12:21.141960+0000","last_fullsized":"2024-05-08T18:12:21.141960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.141767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:55.879953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.861799+0000","last_change":"2024-05-08T18:12:14.861893+0000","last_active":"2024-05-08T18:12:14.861799+0000","last_peered":"2024-05-08T18:12:14.861799+0000","last_clean":"2024-05-08T18:12:14.861799+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:12:14.861799+0000","last_undegraded":"2024-05-08T18:12:14.861799+0000","last_fullsized":"2024-05-08T18:12:14.861799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.861606+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:16.005518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.950811+0000","last_change":"2024-05-08T18:12:20.950874+0000","last_active":"2024-05-08T18:12:20.950811+0000","last_peered":"2024-05-08T18:12:20.950811+0000","last_clean":"2024-05-08T18:12:20.950811+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:20.950811+0000","last_undegraded":"2024-05-08T18:12:20.950811+0000","last_fullsized":"2024-05-08T18:12:20.950811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.950610+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:59.485254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433778+0000","last_change":"2024-05-08T18:08:57.559589+0000","last_active":"2024-05-08T18:11:16.433778+0000","last_peered":"2024-05-08T18:11:16.433778+0000","last_clean":"2024-05-08T18:11:16.433778+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:11:16.433778+0000","last_undegraded":"2024-05-08T18:11:16.433778+0000","last_fullsized":"2024-05-08T18:11:16.433778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.863078+0000","last_change":"2024-05-08T18:08:49.510615+0000","last_active":"2024-05-08T18:12:02.863078+0000","last_peered":"2024-05-08T18:12:02.863078+0000","last_clean":"2024-05-08T18:12:02.863078+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:02.863078+0000","last_undegraded":"2024-05-08T18:12:02.863078+0000","last_fullsized":"2024-05-08T18:12:02.863078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429761+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:11:01.429761+0000","last_peered":"2024-05-08T18:11:01.429761+0000","last_clean":"2024-05-08T18:11:01.429761+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:11:01.429761+0000","last_undegraded":"2024-05-08T18:11:01.429761+0000","last_fullsized":"2024-05-08T18:11:01.429761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.416485+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:10:51.416485+0000","last_peered":"2024-05-08T18:10:51.416485+0000","last_clean":"2024-05-08T18:10:51.416485+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:10:51.416485+0000","last_undegraded":"2024-05-08T18:10:51.416485+0000","last_fullsized":"2024-05-08T18:10:51.416485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.151532+0000","last_change":"2024-05-08T18:12:20.151592+0000","last_active":"2024-05-08T18:12:20.151532+0000","last_peered":"2024-05-08T18:12:20.151532+0000","last_clean":"2024-05-08T18:12:20.151532+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:12:20.151532+0000","last_undegraded":"2024-05-08T18:12:20.151532+0000","last_fullsized":"2024-05-08T18:12:20.151532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.151323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:59.292712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429521+0000","last_change":"2024-05-08T18:08:53.549741+0000","last_active":"2024-05-08T18:11:01.429521+0000","last_peered":"2024-05-08T18:11:01.429521+0000","last_clean":"2024-05-08T18:11:01.429521+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:11:01.429521+0000","last_undegraded":"2024-05-08T18:11:01.429521+0000","last_fullsized":"2024-05-08T18:11:01.429521+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.928638+0000","last_change":"2024-05-08T18:12:17.928706+0000","last_active":"2024-05-08T18:12:17.928638+0000","last_peered":"2024-05-08T18:12:17.928638+0000","last_clean":"2024-05-08T18:12:17.928638+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:17.928638+0000","last_undegraded":"2024-05-08T18:12:17.928638+0000","last_fullsized":"2024-05-08T18:12:17.928638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.928438+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:04.849778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431641+0000","last_change":"2024-05-08T18:08:57.573590+0000","last_active":"2024-05-08T18:11:16.431641+0000","last_peered":"2024-05-08T18:11:16.431641+0000","last_clean":"2024-05-08T18:11:16.431641+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:11:16.431641+0000","last_undegraded":"2024-05-08T18:11:16.431641+0000","last_fullsized":"2024-05-08T18:11:16.431641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.860422+0000","last_change":"2024-05-08T18:09:28.589121+0000","last_active":"2024-05-08T18:12:02.860422+0000","last_peered":"2024-05-08T18:12:02.860422+0000","last_clean":"2024-05-08T18:12:02.860422+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:12:02.860422+0000","last_undegraded":"2024-05-08T18:12:02.860422+0000","last_fullsized":"2024-05-08T18:12:02.860422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427710+0000","last_change":"2024-05-08T18:08:47.512221+0000","last_active":"2024-05-08T18:11:01.427710+0000","last_peered":"2024-05-08T18:11:01.427710+0000","last_clean":"2024-05-08T18:11:01.427710+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:11:01.427710+0000","last_undegraded":"2024-05-08T18:11:01.427710+0000","last_fullsized":"2024-05-08T18:11:01.427710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.427193+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:10:51.427193+0000","last_peered":"2024-05-08T18:10:51.427193+0000","last_clean":"2024-05-08T18:10:51.427193+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:10:51.427193+0000","last_undegraded":"2024-05-08T18:10:51.427193+0000","last_fullsized":"2024-05-08T18:10:51.427193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.124258+0000","last_change":"2024-05-08T18:12:19.124317+0000","last_active":"2024-05-08T18:12:19.124258+0000","last_peered":"2024-05-08T18:12:19.124258+0000","last_clean":"2024-05-08T18:12:19.124258+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:12:19.124258+0000","last_undegraded":"2024-05-08T18:12:19.124258+0000","last_fullsized":"2024-05-08T18:12:19.124258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.124051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.234930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.388737+0000","last_change":"2024-05-08T18:12:21.388830+0000","last_active":"2024-05-08T18:12:21.388737+0000","last_peered":"2024-05-08T18:12:21.388737+0000","last_clean":"2024-05-08T18:12:21.388737+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:12:21.388737+0000","last_undegraded":"2024-05-08T18:12:21.388737+0000","last_fullsized":"2024-05-08T18:12:21.388737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.388548+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:37.145916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":104,"num_read_kb":116,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.926185+0000","last_change":"2024-05-08T18:12:20.926349+0000","last_active":"2024-05-08T18:12:20.926185+0000","last_peered":"2024-05-08T18:12:20.926185+0000","last_clean":"2024-05-08T18:12:20.926185+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:12:20.926185+0000","last_undegraded":"2024-05-08T18:12:20.926185+0000","last_fullsized":"2024-05-08T18:12:20.926185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.925962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:11.385561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.400546+0000","last_change":"2024-05-08T18:12:31.400598+0000","last_active":"2024-05-08T18:12:31.400546+0000","last_peered":"2024-05-08T18:12:31.400546+0000","last_clean":"2024-05-08T18:12:31.400546+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:12:31.400546+0000","last_undegraded":"2024-05-08T18:12:31.400546+0000","last_fullsized":"2024-05-08T18:12:31.400546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.400333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428083+0000","last_change":"2024-05-08T18:08:57.586231+0000","last_active":"2024-05-08T18:11:06.428083+0000","last_peered":"2024-05-08T18:11:06.428083+0000","last_clean":"2024-05-08T18:11:06.428083+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:11:06.428083+0000","last_undegraded":"2024-05-08T18:11:06.428083+0000","last_fullsized":"2024-05-08T18:11:06.428083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.407512+0000","last_change":"2024-05-08T18:08:49.517973+0000","last_active":"2024-05-08T18:12:02.407512+0000","last_peered":"2024-05-08T18:12:02.407512+0000","last_clean":"2024-05-08T18:12:02.407512+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:12:02.407512+0000","last_undegraded":"2024-05-08T18:12:02.407512+0000","last_fullsized":"2024-05-08T18:12:02.407512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432328+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:11:11.432328+0000","last_peered":"2024-05-08T18:11:11.432328+0000","last_clean":"2024-05-08T18:11:11.432328+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:11:11.432328+0000","last_undegraded":"2024-05-08T18:11:11.432328+0000","last_fullsized":"2024-05-08T18:11:11.432328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.851096+0000","last_change":"2024-05-08T18:12:29.851149+0000","last_active":"2024-05-08T18:12:29.851096+0000","last_peered":"2024-05-08T18:12:29.851096+0000","last_clean":"2024-05-08T18:12:29.851096+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:12:29.851096+0000","last_undegraded":"2024-05-08T18:12:29.851096+0000","last_fullsized":"2024-05-08T18:12:29.851096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.850896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:20.522178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.217183+0000","last_change":"2024-05-08T18:12:30.217266+0000","last_active":"2024-05-08T18:12:30.217183+0000","last_peered":"2024-05-08T18:12:30.217183+0000","last_clean":"2024-05-08T18:12:30.217183+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:12:30.217183+0000","last_undegraded":"2024-05-08T18:12:30.217183+0000","last_fullsized":"2024-05-08T18:12:30.217183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.216965+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:38.316991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433403+0000","last_change":"2024-05-08T18:08:55.558807+0000","last_active":"2024-05-08T18:11:16.433403+0000","last_peered":"2024-05-08T18:11:16.433403+0000","last_clean":"2024-05-08T18:11:16.433403+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:11:16.433403+0000","last_undegraded":"2024-05-08T18:11:16.433403+0000","last_fullsized":"2024-05-08T18:11:16.433403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.410924+0000","last_change":"2024-05-08T18:08:57.554621+0000","last_active":"2024-05-08T18:12:02.410924+0000","last_peered":"2024-05-08T18:12:02.410924+0000","last_clean":"2024-05-08T18:12:02.410924+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:02.410924+0000","last_undegraded":"2024-05-08T18:12:02.410924+0000","last_fullsized":"2024-05-08T18:12:02.410924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.408368+0000","last_change":"2024-05-08T18:08:49.515316+0000","last_active":"2024-05-08T18:12:02.408368+0000","last_peered":"2024-05-08T18:12:02.408368+0000","last_clean":"2024-05-08T18:12:02.408368+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:02.408368+0000","last_undegraded":"2024-05-08T18:12:02.408368+0000","last_fullsized":"2024-05-08T18:12:02.408368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.526340+0000","last_change":"2024-05-08T18:08:47.514514+0000","last_active":"2024-05-08T18:12:09.526340+0000","last_peered":"2024-05-08T18:12:09.526340+0000","last_clean":"2024-05-08T18:12:09.526340+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:12:09.526340+0000","last_undegraded":"2024-05-08T18:12:09.526340+0000","last_fullsized":"2024-05-08T18:12:09.526340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.087419+0000","last_change":"2024-05-08T18:12:18.087520+0000","last_active":"2024-05-08T18:12:18.087419+0000","last_peered":"2024-05-08T18:12:18.087419+0000","last_clean":"2024-05-08T18:12:18.087419+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:12:18.087419+0000","last_undegraded":"2024-05-08T18:12:18.087419+0000","last_fullsized":"2024-05-08T18:12:18.087419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.087194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:46.855336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.937017+0000","last_change":"2024-05-08T18:12:25.937087+0000","last_active":"2024-05-08T18:12:25.937017+0000","last_peered":"2024-05-08T18:12:25.937017+0000","last_clean":"2024-05-08T18:12:25.937017+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:25.937017+0000","last_undegraded":"2024-05-08T18:12:25.937017+0000","last_fullsized":"2024-05-08T18:12:25.937017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.936822+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:27.641008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.381154+0000","last_change":"2024-05-08T18:12:19.381207+0000","last_active":"2024-05-08T18:12:19.381154+0000","last_peered":"2024-05-08T18:12:19.381154+0000","last_clean":"2024-05-08T18:12:19.381154+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:12:19.381154+0000","last_undegraded":"2024-05-08T18:12:19.381154+0000","last_fullsized":"2024-05-08T18:12:19.381154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.380953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:58.173357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:31.426146+0000","last_change":"2024-05-08T18:08:57.565323+0000","last_active":"2024-05-08T18:11:31.426146+0000","last_peered":"2024-05-08T18:11:31.426146+0000","last_clean":"2024-05-08T18:11:31.426146+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:11:31.426146+0000","last_undegraded":"2024-05-08T18:11:31.426146+0000","last_fullsized":"2024-05-08T18:11:31.426146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.773937+0000","last_change":"2024-05-08T18:08:49.506944+0000","last_active":"2024-05-08T18:12:02.773937+0000","last_peered":"2024-05-08T18:12:02.773937+0000","last_clean":"2024-05-08T18:12:02.773937+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:02.773937+0000","last_undegraded":"2024-05-08T18:12:02.773937+0000","last_fullsized":"2024-05-08T18:12:02.773937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430548+0000","last_change":"2024-05-08T18:08:47.513365+0000","last_active":"2024-05-08T18:11:16.430548+0000","last_peered":"2024-05-08T18:11:16.430548+0000","last_clean":"2024-05-08T18:11:16.430548+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:11:16.430548+0000","last_undegraded":"2024-05-08T18:11:16.430548+0000","last_fullsized":"2024-05-08T18:11:16.430548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.402610+0000","last_change":"2024-05-08T18:12:30.402667+0000","last_active":"2024-05-08T18:12:30.402610+0000","last_peered":"2024-05-08T18:12:30.402610+0000","last_clean":"2024-05-08T18:12:30.402610+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:12:30.402610+0000","last_undegraded":"2024-05-08T18:12:30.402610+0000","last_fullsized":"2024-05-08T18:12:30.402610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.402404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:43.180000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.966072+0000","last_change":"2024-05-08T18:12:26.966151+0000","last_active":"2024-05-08T18:12:26.966072+0000","last_peered":"2024-05-08T18:12:26.966072+0000","last_clean":"2024-05-08T18:12:26.966072+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:26.966072+0000","last_undegraded":"2024-05-08T18:12:26.966072+0000","last_fullsized":"2024-05-08T18:12:26.966072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.965884+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:00.217219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.875467+0000","last_change":"2024-05-08T18:12:24.875520+0000","last_active":"2024-05-08T18:12:24.875467+0000","last_peered":"2024-05-08T18:12:24.875467+0000","last_clean":"2024-05-08T18:12:24.875467+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:12:24.875467+0000","last_undegraded":"2024-05-08T18:12:24.875467+0000","last_fullsized":"2024-05-08T18:12:24.875467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.875266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:18.218024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:31.437590+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:11:31.437590+0000","last_peered":"2024-05-08T18:11:31.437590+0000","last_clean":"2024-05-08T18:11:31.437590+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:11:31.437590+0000","last_undegraded":"2024-05-08T18:11:31.437590+0000","last_fullsized":"2024-05-08T18:11:31.437590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'17","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862524+0000","last_change":"2024-05-08T18:08:49.512382+0000","last_active":"2024-05-08T18:12:02.862524+0000","last_peered":"2024-05-08T18:12:02.862524+0000","last_clean":"2024-05-08T18:12:02.862524+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:02.862524+0000","last_undegraded":"2024-05-08T18:12:02.862524+0000","last_fullsized":"2024-05-08T18:12:02.862524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.749496+0000","last_change":"2024-05-08T18:08:47.495539+0000","last_active":"2024-05-08T18:12:02.749496+0000","last_peered":"2024-05-08T18:12:02.749496+0000","last_clean":"2024-05-08T18:12:02.749496+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:12:02.749496+0000","last_undegraded":"2024-05-08T18:12:02.749496+0000","last_fullsized":"2024-05-08T18:12:02.749496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.236640+0000","last_change":"2024-05-08T18:12:25.236698+0000","last_active":"2024-05-08T18:12:25.236640+0000","last_peered":"2024-05-08T18:12:25.236640+0000","last_clean":"2024-05-08T18:12:25.236640+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:12:25.236640+0000","last_undegraded":"2024-05-08T18:12:25.236640+0000","last_fullsized":"2024-05-08T18:12:25.236640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.236418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:39.999356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.379139+0000","last_change":"2024-05-08T18:12:29.379206+0000","last_active":"2024-05-08T18:12:29.379139+0000","last_peered":"2024-05-08T18:12:29.379139+0000","last_clean":"2024-05-08T18:12:29.379139+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:12:29.379139+0000","last_undegraded":"2024-05-08T18:12:29.379139+0000","last_fullsized":"2024-05-08T18:12:29.379139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.378957+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:54.199891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.349903+0000","last_change":"2024-05-08T18:12:18.349967+0000","last_active":"2024-05-08T18:12:18.349903+0000","last_peered":"2024-05-08T18:12:18.349903+0000","last_clean":"2024-05-08T18:12:18.349903+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:12:18.349903+0000","last_undegraded":"2024-05-08T18:12:18.349903+0000","last_fullsized":"2024-05-08T18:12:18.349903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.349704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:51.482256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428470+0000","last_change":"2024-05-08T18:08:49.510714+0000","last_active":"2024-05-08T18:10:56.428470+0000","last_peered":"2024-05-08T18:10:56.428470+0000","last_clean":"2024-05-08T18:10:56.428470+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:10:56.428470+0000","last_undegraded":"2024-05-08T18:10:56.428470+0000","last_fullsized":"2024-05-08T18:10:56.428470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433347+0000","last_change":"2024-05-08T18:08:47.516678+0000","last_active":"2024-05-08T18:11:16.433347+0000","last_peered":"2024-05-08T18:11:16.433347+0000","last_clean":"2024-05-08T18:11:16.433347+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:11:16.433347+0000","last_undegraded":"2024-05-08T18:11:16.433347+0000","last_fullsized":"2024-05-08T18:11:16.433347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.416623+0000","last_change":"2024-05-08T18:08:51.511759+0000","last_active":"2024-05-08T18:10:51.416623+0000","last_peered":"2024-05-08T18:10:51.416623+0000","last_clean":"2024-05-08T18:10:51.416623+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:10:51.416623+0000","last_undegraded":"2024-05-08T18:10:51.416623+0000","last_fullsized":"2024-05-08T18:10:51.416623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.921374+0000","last_change":"2024-05-08T18:12:23.921455+0000","last_active":"2024-05-08T18:12:23.921374+0000","last_peered":"2024-05-08T18:12:23.921374+0000","last_clean":"2024-05-08T18:12:23.921374+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:12:23.921374+0000","last_undegraded":"2024-05-08T18:12:23.921374+0000","last_fullsized":"2024-05-08T18:12:23.921374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.921184+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:20.672977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.376282+0000","last_change":"2024-05-08T18:12:17.376334+0000","last_active":"2024-05-08T18:12:17.376282+0000","last_peered":"2024-05-08T18:12:17.376282+0000","last_clean":"2024-05-08T18:12:17.376282+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:12:17.376282+0000","last_undegraded":"2024-05-08T18:12:17.376282+0000","last_fullsized":"2024-05-08T18:12:17.376282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.376083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:05.332746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.423897+0000","last_change":"2024-05-08T18:08:57.565259+0000","last_active":"2024-05-08T18:11:21.423897+0000","last_peered":"2024-05-08T18:11:21.423897+0000","last_clean":"2024-05-08T18:11:21.423897+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:11:21.423897+0000","last_undegraded":"2024-05-08T18:11:21.423897+0000","last_fullsized":"2024-05-08T18:11:21.423897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.416583+0000","last_change":"2024-05-08T18:08:49.500137+0000","last_active":"2024-05-08T18:10:51.416583+0000","last_peered":"2024-05-08T18:10:51.416583+0000","last_clean":"2024-05-08T18:10:51.416583+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:10:51.416583+0000","last_undegraded":"2024-05-08T18:10:51.416583+0000","last_fullsized":"2024-05-08T18:10:51.416583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431517+0000","last_change":"2024-05-08T18:08:47.514529+0000","last_active":"2024-05-08T18:11:16.431517+0000","last_peered":"2024-05-08T18:11:16.431517+0000","last_clean":"2024-05-08T18:11:16.431517+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:11:16.431517+0000","last_undegraded":"2024-05-08T18:11:16.431517+0000","last_fullsized":"2024-05-08T18:11:16.431517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425370+0000","last_change":"2024-05-08T18:08:51.508583+0000","last_active":"2024-05-08T18:10:56.425370+0000","last_peered":"2024-05-08T18:10:56.425370+0000","last_clean":"2024-05-08T18:10:56.425370+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:10:56.425370+0000","last_undegraded":"2024-05-08T18:10:56.425370+0000","last_fullsized":"2024-05-08T18:10:56.425370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.224869+0000","last_change":"2024-05-08T18:12:24.225048+0000","last_active":"2024-05-08T18:12:24.224869+0000","last_peered":"2024-05-08T18:12:24.224869+0000","last_clean":"2024-05-08T18:12:24.224869+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:12:24.224869+0000","last_undegraded":"2024-05-08T18:12:24.224869+0000","last_fullsized":"2024-05-08T18:12:24.224869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.224613+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:07.517261+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.434234+0000","last_change":"2024-05-08T18:08:55.565939+0000","last_active":"2024-05-08T18:11:26.434234+0000","last_peered":"2024-05-08T18:11:26.434234+0000","last_clean":"2024-05-08T18:11:26.434234+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:11:26.434234+0000","last_undegraded":"2024-05-08T18:11:26.434234+0000","last_fullsized":"2024-05-08T18:11:26.434234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434778+0000","last_change":"2024-05-08T18:08:57.553775+0000","last_active":"2024-05-08T18:11:21.434778+0000","last_peered":"2024-05-08T18:11:21.434778+0000","last_clean":"2024-05-08T18:11:21.434778+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:11:21.434778+0000","last_undegraded":"2024-05-08T18:11:21.434778+0000","last_fullsized":"2024-05-08T18:11:21.434778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.224908+0000","last_change":"2024-05-08T18:12:29.224975+0000","last_active":"2024-05-08T18:12:29.224908+0000","last_peered":"2024-05-08T18:12:29.224908+0000","last_clean":"2024-05-08T18:12:29.224908+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:29.224908+0000","last_undegraded":"2024-05-08T18:12:29.224908+0000","last_fullsized":"2024-05-08T18:12:29.224908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.224718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:07.769843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.432803+0000","last_change":"2024-05-08T18:08:47.519395+0000","last_active":"2024-05-08T18:11:21.432803+0000","last_peered":"2024-05-08T18:11:21.432803+0000","last_clean":"2024-05-08T18:11:21.432803+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:11:21.432803+0000","last_undegraded":"2024-05-08T18:11:21.432803+0000","last_fullsized":"2024-05-08T18:11:21.432803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431565+0000","last_change":"2024-05-08T18:09:28.594515+0000","last_active":"2024-05-08T18:11:21.431565+0000","last_peered":"2024-05-08T18:11:21.431565+0000","last_clean":"2024-05-08T18:11:21.431565+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:11:21.431565+0000","last_undegraded":"2024-05-08T18:11:21.431565+0000","last_fullsized":"2024-05-08T18:11:21.431565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.008992+0000","last_change":"2024-05-08T18:12:28.009169+0000","last_active":"2024-05-08T18:12:28.008992+0000","last_peered":"2024-05-08T18:12:28.008992+0000","last_clean":"2024-05-08T18:12:28.008992+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:12:28.008992+0000","last_undegraded":"2024-05-08T18:12:28.008992+0000","last_fullsized":"2024-05-08T18:12:28.008992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.008749+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:18.526961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.944164+0000","last_change":"2024-05-08T18:12:12.944203+0000","last_active":"2024-05-08T18:12:12.944164+0000","last_peered":"2024-05-08T18:12:12.944164+0000","last_clean":"2024-05-08T18:12:12.944164+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:12:12.944164+0000","last_undegraded":"2024-05-08T18:12:12.944164+0000","last_fullsized":"2024-05-08T18:12:12.944164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_clean_scrub_stamp":"2024-05-08T18:12:12.944077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:02.872453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434724+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:21.434724+0000","last_peered":"2024-05-08T18:11:21.434724+0000","last_clean":"2024-05-08T18:11:21.434724+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:21.434724+0000","last_undegraded":"2024-05-08T18:11:21.434724+0000","last_fullsized":"2024-05-08T18:11:21.434724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.773742+0000","last_change":"2024-05-08T18:08:49.494211+0000","last_active":"2024-05-08T18:12:02.773742+0000","last_peered":"2024-05-08T18:12:02.773742+0000","last_clean":"2024-05-08T18:12:02.773742+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:02.773742+0000","last_undegraded":"2024-05-08T18:12:02.773742+0000","last_fullsized":"2024-05-08T18:12:02.773742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434863+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:11:21.434863+0000","last_peered":"2024-05-08T18:11:21.434863+0000","last_clean":"2024-05-08T18:11:21.434863+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:11:21.434863+0000","last_undegraded":"2024-05-08T18:11:21.434863+0000","last_fullsized":"2024-05-08T18:11:21.434863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.880274+0000","last_change":"2024-05-08T18:12:26.880471+0000","last_active":"2024-05-08T18:12:26.880274+0000","last_peered":"2024-05-08T18:12:26.880274+0000","last_clean":"2024-05-08T18:12:26.880274+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:12:26.880274+0000","last_undegraded":"2024-05-08T18:12:26.880274+0000","last_fullsized":"2024-05-08T18:12:26.880274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.880045+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:45.838146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428417+0000","last_change":"2024-05-08T18:08:53.555586+0000","last_active":"2024-05-08T18:10:56.428417+0000","last_peered":"2024-05-08T18:10:56.428417+0000","last_clean":"2024-05-08T18:10:56.428417+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:10:56.428417+0000","last_undegraded":"2024-05-08T18:10:56.428417+0000","last_fullsized":"2024-05-08T18:10:56.428417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.415074+0000","last_change":"2024-05-08T18:12:16.415136+0000","last_active":"2024-05-08T18:12:16.415074+0000","last_peered":"2024-05-08T18:12:16.415074+0000","last_clean":"2024-05-08T18:12:16.415074+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:16.415074+0000","last_undegraded":"2024-05-08T18:12:16.415074+0000","last_fullsized":"2024-05-08T18:12:16.415074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.414863+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:08.725122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434563+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:11:21.434563+0000","last_peered":"2024-05-08T18:11:21.434563+0000","last_clean":"2024-05-08T18:11:21.434563+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:11:21.434563+0000","last_undegraded":"2024-05-08T18:11:21.434563+0000","last_fullsized":"2024-05-08T18:11:21.434563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.773192+0000","last_change":"2024-05-08T18:08:49.492567+0000","last_active":"2024-05-08T18:12:02.773192+0000","last_peered":"2024-05-08T18:12:02.773192+0000","last_clean":"2024-05-08T18:12:02.773192+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:02.773192+0000","last_undegraded":"2024-05-08T18:12:02.773192+0000","last_fullsized":"2024-05-08T18:12:02.773192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.432946+0000","last_change":"2024-05-08T18:08:47.491784+0000","last_active":"2024-05-08T18:11:21.432946+0000","last_peered":"2024-05-08T18:11:21.432946+0000","last_clean":"2024-05-08T18:11:21.432946+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:11:21.432946+0000","last_undegraded":"2024-05-08T18:11:21.432946+0000","last_fullsized":"2024-05-08T18:11:21.432946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.920218+0000","last_change":"2024-05-08T18:12:23.920309+0000","last_active":"2024-05-08T18:12:23.920218+0000","last_peered":"2024-05-08T18:12:23.920218+0000","last_clean":"2024-05-08T18:12:23.920218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:12:23.920218+0000","last_undegraded":"2024-05-08T18:12:23.920218+0000","last_fullsized":"2024-05-08T18:12:23.920218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.919920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:16.834786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.983706+0000","last_change":"2024-05-08T18:12:18.983908+0000","last_active":"2024-05-08T18:12:18.983706+0000","last_peered":"2024-05-08T18:12:18.983706+0000","last_clean":"2024-05-08T18:12:18.983706+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:12:18.983706+0000","last_undegraded":"2024-05-08T18:12:18.983706+0000","last_fullsized":"2024-05-08T18:12:18.983706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.983474+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:34.287333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.970884+0000","last_change":"2024-05-08T18:12:19.970940+0000","last_active":"2024-05-08T18:12:19.970884+0000","last_peered":"2024-05-08T18:12:19.970884+0000","last_clean":"2024-05-08T18:12:19.970884+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:12:19.970884+0000","last_undegraded":"2024-05-08T18:12:19.970884+0000","last_fullsized":"2024-05-08T18:12:19.970884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.970683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.981624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.434318+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:11:26.434318+0000","last_peered":"2024-05-08T18:11:26.434318+0000","last_clean":"2024-05-08T18:11:26.434318+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:11:26.434318+0000","last_undegraded":"2024-05-08T18:11:26.434318+0000","last_fullsized":"2024-05-08T18:11:26.434318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431420+0000","last_change":"2024-05-08T18:08:49.493842+0000","last_active":"2024-05-08T18:11:21.431420+0000","last_peered":"2024-05-08T18:11:21.431420+0000","last_clean":"2024-05-08T18:11:21.431420+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:11:21.431420+0000","last_undegraded":"2024-05-08T18:11:21.431420+0000","last_fullsized":"2024-05-08T18:11:21.431420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.435003+0000","last_change":"2024-05-08T18:08:47.528745+0000","last_active":"2024-05-08T18:11:21.435003+0000","last_peered":"2024-05-08T18:11:21.435003+0000","last_clean":"2024-05-08T18:11:21.435003+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:11:21.435003+0000","last_undegraded":"2024-05-08T18:11:21.435003+0000","last_fullsized":"2024-05-08T18:11:21.435003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431538+0000","last_change":"2024-05-08T18:08:51.507416+0000","last_active":"2024-05-08T18:11:21.431538+0000","last_peered":"2024-05-08T18:11:21.431538+0000","last_clean":"2024-05-08T18:11:21.431538+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:11:21.431538+0000","last_undegraded":"2024-05-08T18:11:21.431538+0000","last_fullsized":"2024-05-08T18:11:21.431538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.890367+0000","last_change":"2024-05-08T18:12:22.890449+0000","last_active":"2024-05-08T18:12:22.890367+0000","last_peered":"2024-05-08T18:12:22.890367+0000","last_clean":"2024-05-08T18:12:22.890367+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:12:22.890367+0000","last_undegraded":"2024-05-08T18:12:22.890367+0000","last_fullsized":"2024-05-08T18:12:22.890367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.890142+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:16.232900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434657+0000","last_change":"2024-05-08T18:08:55.558593+0000","last_active":"2024-05-08T18:11:21.434657+0000","last_peered":"2024-05-08T18:11:21.434657+0000","last_clean":"2024-05-08T18:11:21.434657+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:11:21.434657+0000","last_undegraded":"2024-05-08T18:11:21.434657+0000","last_fullsized":"2024-05-08T18:11:21.434657+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436379+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:11:26.436379+0000","last_peered":"2024-05-08T18:11:26.436379+0000","last_clean":"2024-05-08T18:11:26.436379+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:11:26.436379+0000","last_undegraded":"2024-05-08T18:11:26.436379+0000","last_fullsized":"2024-05-08T18:11:26.436379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.406974+0000","last_change":"2024-05-08T18:08:49.512357+0000","last_active":"2024-05-08T18:12:02.406974+0000","last_peered":"2024-05-08T18:12:02.406974+0000","last_clean":"2024-05-08T18:12:02.406974+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:02.406974+0000","last_undegraded":"2024-05-08T18:12:02.406974+0000","last_fullsized":"2024-05-08T18:12:02.406974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.416521+0000","last_change":"2024-05-08T18:08:47.517076+0000","last_active":"2024-05-08T18:10:51.416521+0000","last_peered":"2024-05-08T18:10:51.416521+0000","last_clean":"2024-05-08T18:10:51.416521+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:10:51.416521+0000","last_undegraded":"2024-05-08T18:10:51.416521+0000","last_fullsized":"2024-05-08T18:10:51.416521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.904352+0000","last_change":"2024-05-08T18:12:22.904406+0000","last_active":"2024-05-08T18:12:22.904352+0000","last_peered":"2024-05-08T18:12:22.904352+0000","last_clean":"2024-05-08T18:12:22.904352+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:12:22.904352+0000","last_undegraded":"2024-05-08T18:12:22.904352+0000","last_fullsized":"2024-05-08T18:12:22.904352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.904163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:55.812967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'29","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.438077+0000","last_change":"2024-05-08T18:08:53.555489+0000","last_active":"2024-05-08T18:12:09.438077+0000","last_peered":"2024-05-08T18:12:09.438077+0000","last_clean":"2024-05-08T18:12:09.438077+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:12:09.438077+0000","last_undegraded":"2024-05-08T18:12:09.438077+0000","last_fullsized":"2024-05-08T18:12:09.438077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:52.485471+0000","last_clean_scrub_stamp":"2024-05-08T18:08:52.485471+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436012+0000","last_change":"2024-05-08T18:08:55.564029+0000","last_active":"2024-05-08T18:11:26.436012+0000","last_peered":"2024-05-08T18:11:26.436012+0000","last_clean":"2024-05-08T18:11:26.436012+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:11:26.436012+0000","last_undegraded":"2024-05-08T18:11:26.436012+0000","last_fullsized":"2024-05-08T18:11:26.436012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436285+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:11:26.436285+0000","last_peered":"2024-05-08T18:11:26.436285+0000","last_clean":"2024-05-08T18:11:26.436285+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:11:26.436285+0000","last_undegraded":"2024-05-08T18:11:26.436285+0000","last_fullsized":"2024-05-08T18:11:26.436285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430269+0000","last_change":"2024-05-08T18:08:49.492218+0000","last_active":"2024-05-08T18:11:16.430269+0000","last_peered":"2024-05-08T18:11:16.430269+0000","last_clean":"2024-05-08T18:11:16.430269+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:11:16.430269+0000","last_undegraded":"2024-05-08T18:11:16.430269+0000","last_fullsized":"2024-05-08T18:11:16.430269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.583327+0000","last_change":"2024-05-08T18:08:47.498035+0000","last_active":"2024-05-08T18:12:02.583327+0000","last_peered":"2024-05-08T18:12:02.583327+0000","last_clean":"2024-05-08T18:12:02.583327+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:12:02.583327+0000","last_undegraded":"2024-05-08T18:12:02.583327+0000","last_fullsized":"2024-05-08T18:12:02.583327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":223,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.345100+0000","last_change":"2024-05-08T18:08:51.513601+0000","last_active":"2024-05-08T18:12:09.345100+0000","last_peered":"2024-05-08T18:12:09.345100+0000","last_clean":"2024-05-08T18:12:09.345100+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:12:09.345100+0000","last_undegraded":"2024-05-08T18:12:09.345100+0000","last_fullsized":"2024-05-08T18:12:09.345100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.253694+0000","last_change":"2024-05-08T18:12:28.253848+0000","last_active":"2024-05-08T18:12:28.253694+0000","last_peered":"2024-05-08T18:12:28.253694+0000","last_clean":"2024-05-08T18:12:28.253694+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:28.253694+0000","last_undegraded":"2024-05-08T18:12:28.253694+0000","last_fullsized":"2024-05-08T18:12:28.253694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.253447+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:30.579578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.869619+0000","last_change":"2024-05-08T18:12:15.869678+0000","last_active":"2024-05-08T18:12:15.869619+0000","last_peered":"2024-05-08T18:12:15.869619+0000","last_clean":"2024-05-08T18:12:15.869619+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:12:15.869619+0000","last_undegraded":"2024-05-08T18:12:15.869619+0000","last_fullsized":"2024-05-08T18:12:15.869619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.869387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:54.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434936+0000","last_change":"2024-05-08T18:08:57.560370+0000","last_active":"2024-05-08T18:11:21.434936+0000","last_peered":"2024-05-08T18:11:21.434936+0000","last_clean":"2024-05-08T18:11:21.434936+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:11:21.434936+0000","last_undegraded":"2024-05-08T18:11:21.434936+0000","last_fullsized":"2024-05-08T18:11:21.434936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427786+0000","last_change":"2024-05-08T18:08:49.513755+0000","last_active":"2024-05-08T18:11:01.427786+0000","last_peered":"2024-05-08T18:11:01.427786+0000","last_clean":"2024-05-08T18:11:01.427786+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:11:01.427786+0000","last_undegraded":"2024-05-08T18:11:01.427786+0000","last_fullsized":"2024-05-08T18:11:01.427786+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.424957+0000","last_change":"2024-05-08T18:08:47.510817+0000","last_active":"2024-05-08T18:10:56.424957+0000","last_peered":"2024-05-08T18:10:56.424957+0000","last_clean":"2024-05-08T18:10:56.424957+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:10:56.424957+0000","last_undegraded":"2024-05-08T18:10:56.424957+0000","last_fullsized":"2024-05-08T18:10:56.424957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.861551+0000","last_change":"2024-05-08T18:08:49.494065+0000","last_active":"2024-05-08T18:12:02.861551+0000","last_peered":"2024-05-08T18:12:02.861551+0000","last_clean":"2024-05-08T18:12:02.861551+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:12:02.861551+0000","last_undegraded":"2024-05-08T18:12:02.861551+0000","last_fullsized":"2024-05-08T18:12:02.861551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522644+0000","last_change":"2024-05-08T18:08:47.496722+0000","last_active":"2024-05-08T18:12:09.522644+0000","last_peered":"2024-05-08T18:12:09.522644+0000","last_clean":"2024-05-08T18:12:09.522644+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:12:09.522644+0000","last_undegraded":"2024-05-08T18:12:09.522644+0000","last_fullsized":"2024-05-08T18:12:09.522644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706284+0000","last_change":"2024-05-08T18:08:49.513141+0000","last_active":"2024-05-08T18:12:02.706284+0000","last_peered":"2024-05-08T18:12:02.706284+0000","last_clean":"2024-05-08T18:12:02.706284+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:02.706284+0000","last_undegraded":"2024-05-08T18:12:02.706284+0000","last_fullsized":"2024-05-08T18:12:02.706284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428171+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:10:56.428171+0000","last_peered":"2024-05-08T18:10:56.428171+0000","last_clean":"2024-05-08T18:10:56.428171+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:10:56.428171+0000","last_undegraded":"2024-05-08T18:10:56.428171+0000","last_fullsized":"2024-05-08T18:10:56.428171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.270041+0000","last_change":"2024-05-08T18:08:49.494261+0000","last_active":"2024-05-08T18:12:02.270041+0000","last_peered":"2024-05-08T18:12:02.270041+0000","last_clean":"2024-05-08T18:12:02.270041+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:02.270041+0000","last_undegraded":"2024-05-08T18:12:02.270041+0000","last_fullsized":"2024-05-08T18:12:02.270041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.591401+0000","last_change":"2024-05-08T18:08:47.515649+0000","last_active":"2024-05-08T18:12:02.591401+0000","last_peered":"2024-05-08T18:12:02.591401+0000","last_clean":"2024-05-08T18:12:02.591401+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:02.591401+0000","last_undegraded":"2024-05-08T18:12:02.591401+0000","last_fullsized":"2024-05-08T18:12:02.591401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'3","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.860982+0000","last_change":"2024-05-08T18:08:49.519128+0000","last_active":"2024-05-08T18:12:02.860982+0000","last_peered":"2024-05-08T18:12:02.860982+0000","last_clean":"2024-05-08T18:12:02.860982+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:02.860982+0000","last_undegraded":"2024-05-08T18:12:02.860982+0000","last_fullsized":"2024-05-08T18:12:02.860982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.199458+0000","last_change":"2024-05-08T18:08:47.497513+0000","last_active":"2024-05-08T18:12:02.199458+0000","last_peered":"2024-05-08T18:12:02.199458+0000","last_clean":"2024-05-08T18:12:02.199458+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:12:02.199458+0000","last_undegraded":"2024-05-08T18:12:02.199458+0000","last_fullsized":"2024-05-08T18:12:02.199458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'11","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862075+0000","last_change":"2024-05-08T18:08:49.518071+0000","last_active":"2024-05-08T18:12:02.862075+0000","last_peered":"2024-05-08T18:12:02.862075+0000","last_clean":"2024-05-08T18:12:02.862075+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:02.862075+0000","last_undegraded":"2024-05-08T18:12:02.862075+0000","last_fullsized":"2024-05-08T18:12:02.862075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427631+0000","last_change":"2024-05-08T18:08:47.512086+0000","last_active":"2024-05-08T18:11:01.427631+0000","last_peered":"2024-05-08T18:11:01.427631+0000","last_clean":"2024-05-08T18:11:01.427631+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:11:01.427631+0000","last_undegraded":"2024-05-08T18:11:01.427631+0000","last_fullsized":"2024-05-08T18:11:01.427631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.405883+0000","last_change":"2024-05-08T18:08:49.497455+0000","last_active":"2024-05-08T18:12:02.405883+0000","last_peered":"2024-05-08T18:12:02.405883+0000","last_clean":"2024-05-08T18:12:02.405883+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:02.405883+0000","last_undegraded":"2024-05-08T18:12:02.405883+0000","last_fullsized":"2024-05-08T18:12:02.405883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.426681+0000","last_change":"2024-05-08T18:08:47.514190+0000","last_active":"2024-05-08T18:11:01.426681+0000","last_peered":"2024-05-08T18:11:01.426681+0000","last_clean":"2024-05-08T18:11:01.426681+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:11:01.426681+0000","last_undegraded":"2024-05-08T18:11:01.426681+0000","last_fullsized":"2024-05-08T18:11:01.426681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.616993+0000","last_change":"2024-05-08T18:08:49.495860+0000","last_active":"2024-05-08T18:12:02.616993+0000","last_peered":"2024-05-08T18:12:02.616993+0000","last_clean":"2024-05-08T18:12:02.616993+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:02.616993+0000","last_undegraded":"2024-05-08T18:12:02.616993+0000","last_fullsized":"2024-05-08T18:12:02.616993+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.419227+0000","last_change":"2024-05-08T18:08:47.515080+0000","last_active":"2024-05-08T18:11:01.419227+0000","last_peered":"2024-05-08T18:11:01.419227+0000","last_clean":"2024-05-08T18:11:01.419227+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:11:01.419227+0000","last_undegraded":"2024-05-08T18:11:01.419227+0000","last_fullsized":"2024-05-08T18:11:01.419227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.430522+0000","last_change":"2024-05-08T18:08:49.498817+0000","last_active":"2024-05-08T18:11:11.430522+0000","last_peered":"2024-05-08T18:11:11.430522+0000","last_clean":"2024-05-08T18:11:11.430522+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:11:11.430522+0000","last_undegraded":"2024-05-08T18:11:11.430522+0000","last_fullsized":"2024-05-08T18:11:11.430522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429284+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:11:01.429284+0000","last_peered":"2024-05-08T18:11:01.429284+0000","last_clean":"2024-05-08T18:11:01.429284+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:11:01.429284+0000","last_undegraded":"2024-05-08T18:11:01.429284+0000","last_fullsized":"2024-05-08T18:11:01.429284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.705792+0000","last_change":"2024-05-08T18:08:49.514593+0000","last_active":"2024-05-08T18:12:02.705792+0000","last_peered":"2024-05-08T18:12:02.705792+0000","last_clean":"2024-05-08T18:12:02.705792+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:02.705792+0000","last_undegraded":"2024-05-08T18:12:02.705792+0000","last_fullsized":"2024-05-08T18:12:02.705792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420190+0000","last_change":"2024-05-08T18:08:47.515074+0000","last_active":"2024-05-08T18:11:06.420190+0000","last_peered":"2024-05-08T18:11:06.420190+0000","last_clean":"2024-05-08T18:11:06.420190+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:11:06.420190+0000","last_undegraded":"2024-05-08T18:11:06.420190+0000","last_fullsized":"2024-05-08T18:11:06.420190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.407256+0000","last_change":"2024-05-08T18:08:49.516189+0000","last_active":"2024-05-08T18:12:02.407256+0000","last_peered":"2024-05-08T18:12:02.407256+0000","last_clean":"2024-05-08T18:12:02.407256+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:02.407256+0000","last_undegraded":"2024-05-08T18:12:02.407256+0000","last_fullsized":"2024-05-08T18:12:02.407256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428706+0000","last_change":"2024-05-08T18:08:47.525612+0000","last_active":"2024-05-08T18:11:06.428706+0000","last_peered":"2024-05-08T18:11:06.428706+0000","last_clean":"2024-05-08T18:11:06.428706+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:11:06.428706+0000","last_undegraded":"2024-05-08T18:11:06.428706+0000","last_fullsized":"2024-05-08T18:11:06.428706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.407725+0000","last_change":"2024-05-08T18:08:49.496733+0000","last_active":"2024-05-08T18:12:02.407725+0000","last_peered":"2024-05-08T18:12:02.407725+0000","last_clean":"2024-05-08T18:12:02.407725+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:02.407725+0000","last_undegraded":"2024-05-08T18:12:02.407725+0000","last_fullsized":"2024-05-08T18:12:02.407725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428832+0000","last_change":"2024-05-08T18:08:47.513204+0000","last_active":"2024-05-08T18:11:06.428832+0000","last_peered":"2024-05-08T18:11:06.428832+0000","last_clean":"2024-05-08T18:11:06.428832+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:11:06.428832+0000","last_undegraded":"2024-05-08T18:11:06.428832+0000","last_fullsized":"2024-05-08T18:11:06.428832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428918+0000","last_change":"2024-05-08T18:08:49.519642+0000","last_active":"2024-05-08T18:11:06.428918+0000","last_peered":"2024-05-08T18:11:06.428918+0000","last_clean":"2024-05-08T18:11:06.428918+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:11:06.428918+0000","last_undegraded":"2024-05-08T18:11:06.428918+0000","last_fullsized":"2024-05-08T18:11:06.428918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.558269+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.558269+0000","last_peered":"2024-05-08T18:12:02.558269+0000","last_clean":"2024-05-08T18:12:02.558269+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.558269+0000","last_undegraded":"2024-05-08T18:12:02.558269+0000","last_fullsized":"2024-05-08T18:12:02.558269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428784+0000","last_change":"2024-05-08T18:08:49.499082+0000","last_active":"2024-05-08T18:11:06.428784+0000","last_peered":"2024-05-08T18:11:06.428784+0000","last_clean":"2024-05-08T18:11:06.428784+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:11:06.428784+0000","last_undegraded":"2024-05-08T18:11:06.428784+0000","last_fullsized":"2024-05-08T18:11:06.428784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430920+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:11:06.430920+0000","last_peered":"2024-05-08T18:11:06.430920+0000","last_clean":"2024-05-08T18:11:06.430920+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:11:06.430920+0000","last_undegraded":"2024-05-08T18:11:06.430920+0000","last_fullsized":"2024-05-08T18:11:06.430920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430721+0000","last_change":"2024-05-08T18:08:49.507865+0000","last_active":"2024-05-08T18:11:06.430721+0000","last_peered":"2024-05-08T18:11:06.430721+0000","last_clean":"2024-05-08T18:11:06.430721+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:11:06.430721+0000","last_undegraded":"2024-05-08T18:11:06.430721+0000","last_fullsized":"2024-05-08T18:11:06.430721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.567245+0000","last_change":"2024-05-08T18:08:47.519469+0000","last_active":"2024-05-08T18:12:02.567245+0000","last_peered":"2024-05-08T18:12:02.567245+0000","last_clean":"2024-05-08T18:12:02.567245+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:02.567245+0000","last_undegraded":"2024-05-08T18:12:02.567245+0000","last_fullsized":"2024-05-08T18:12:02.567245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427289+0000","last_change":"2024-05-08T18:08:49.497950+0000","last_active":"2024-05-08T18:11:01.427289+0000","last_peered":"2024-05-08T18:11:01.427289+0000","last_clean":"2024-05-08T18:11:01.427289+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:11:01.427289+0000","last_undegraded":"2024-05-08T18:11:01.427289+0000","last_fullsized":"2024-05-08T18:11:01.427289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521508+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:12:09.521508+0000","last_peered":"2024-05-08T18:12:09.521508+0000","last_clean":"2024-05-08T18:12:09.521508+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:12:09.521508+0000","last_undegraded":"2024-05-08T18:12:09.521508+0000","last_fullsized":"2024-05-08T18:12:09.521508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432043+0000","last_change":"2024-05-08T18:08:47.516126+0000","last_active":"2024-05-08T18:11:11.432043+0000","last_peered":"2024-05-08T18:11:11.432043+0000","last_clean":"2024-05-08T18:11:11.432043+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:11:11.432043+0000","last_undegraded":"2024-05-08T18:11:11.432043+0000","last_fullsized":"2024-05-08T18:11:11.432043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422870+0000","last_change":"2024-05-08T18:08:49.501282+0000","last_active":"2024-05-08T18:11:16.422870+0000","last_peered":"2024-05-08T18:11:16.422870+0000","last_clean":"2024-05-08T18:11:16.422870+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:11:16.422870+0000","last_undegraded":"2024-05-08T18:11:16.422870+0000","last_fullsized":"2024-05-08T18:11:16.422870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.421370+0000","last_change":"2024-05-08T18:08:47.515944+0000","last_active":"2024-05-08T18:11:11.421370+0000","last_peered":"2024-05-08T18:11:11.421370+0000","last_clean":"2024-05-08T18:11:11.421370+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:11:11.421370+0000","last_undegraded":"2024-05-08T18:11:11.421370+0000","last_fullsized":"2024-05-08T18:11:11.421370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431757+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:11:16.431757+0000","last_peered":"2024-05-08T18:11:16.431757+0000","last_clean":"2024-05-08T18:11:16.431757+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:11:16.431757+0000","last_undegraded":"2024-05-08T18:11:16.431757+0000","last_fullsized":"2024-05-08T18:11:16.431757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2606,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1487,"ondisk_log_size":1487,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705716,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":145208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335536,"statfs":{"total":96636764160,"available":96599588864,"internally_reserved":0,"allocated":991232,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705715,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":735055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705716,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":144761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:12:34.991 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.992 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.993 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.994 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.995 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.996 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.997 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.998 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:34.999 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.000 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.000 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.000 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:08:32.327398+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=32, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.000 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.000 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.000 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.001 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.002 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.003 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.004 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.005 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.006 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.007 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.008 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.009 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T18:08:52.485471+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=52, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.010 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.011 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.012 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.013 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:35.014 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:12:55.015 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:12:55.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.149+0000 7f45ec05a640 1 Processor -- start 2024-05-08T18:12:55.153 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.149+0000 7f45ec05a640 1 -- start start 2024-05-08T18:12:55.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45e412a0b0 0x7f45e412a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:55.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45e409e250 con 0x7f45e412d1e0 2024-05-08T18:12:55.154 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f45e4129c60 con 0x7f45e412a0b0 2024-05-08T18:12:55.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e9df6640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f45e412a0b0 0x7f45e412a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:55.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e95f5640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f45e412d1e0 0x7f45e412d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:54000/0 (socket says 172.21.15.53:54000) 2024-05-08T18:12:55.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e95f5640 1 -- 172.21.15.53:0/1390869559 learned_addr learned my addr 172.21.15.53:0/1390869559 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:12:55.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e9df6640 1 -- 172.21.15.53:0/1390869559 >> v1:172.21.15.53:6789/0 conn(0x7f45e412d1e0 legacy=0x7f45e412d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:55.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e8df4640 1 -- 172.21.15.53:0/1390869559 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889437307 0 0) 0x7f45e409e250 con 0x7f45e412d1e0 2024-05-08T18:12:55.155 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e9df6640 1 -- 172.21.15.53:0/1390869559 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e4129e90 con 0x7f45e412a0b0 2024-05-08T18:12:55.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e9df6640 1 --2- 172.21.15.53:0/1390869559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e412a490 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009770 tx=0x7f45e001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5aba733da4cac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:55.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e8df4640 1 -- 172.21.15.53:0/1390869559 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00b0070 con 0x7f45e412a0b0 2024-05-08T18:12:55.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e8df4640 1 -- 172.21.15.53:0/1390869559 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00ab530 con 0x7f45e412a0b0 2024-05-08T18:12:55.157 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45e8df4640 1 -- 172.21.15.53:0/1390869559 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00ab830 con 0x7f45e412a0b0 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 -- 172.21.15.53:0/1390869559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 msgr2=0x7f45e412a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 --2- 172.21.15.53:0/1390869559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e412a490 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f45e0009770 tx=0x7f45e001c370 comp rx=0 tx=0).stop 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 -- 172.21.15.53:0/1390869559 shutdown_connections 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 --2- 172.21.15.53:0/1390869559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e412a490 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.153+0000 7f45ec05a640 1 -- 172.21.15.53:0/1390869559 >> 172.21.15.53:0/1390869559 conn(0x7f45e409be60 msgr2=0x7f45e409d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- 172.21.15.53:0/1390869559 shutdown_connections 2024-05-08T18:12:55.158 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- 172.21.15.53:0/1390869559 wait complete. 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 Processor -- start 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- start start 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e4122ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f45e4135f10 con 0x7f45e412a0b0 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45e9df6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e4122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45e9df6640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e4122ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:56500/0 (socket says 172.21.15.53:56500) 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45e9df6640 1 -- 172.21.15.53:0/3229500704 learned_addr learned my addr 172.21.15.53:0/3229500704 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45e9df6640 1 -- 172.21.15.53:0/3229500704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e4115b40 con 0x7f45e412a0b0 2024-05-08T18:12:55.160 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45e9df6640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e4122ae0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f45e0019fa0 tx=0x7f45e001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00bb070 con 0x7f45e412a0b0 2024-05-08T18:12:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45e00abe40 con 0x7f45e412a0b0 2024-05-08T18:12:55.161 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e00b0040 con 0x7f45e412a0b0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e4123020 con 0x7f45e412a0b0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e4123480 con 0x7f45e412a0b0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f45e0004150 con 0x7f45e412a0b0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e41236b0 con 0x7f45e412a0b0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45da7fc640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f45c8039b50 0x7f45c803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.157+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f45e00e8320 con 0x7f45e412a0b0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.161+0000 7f45e95f5640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f45c8039b50 0x7f45c803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:12:55.162 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.161+0000 7f45e95f5640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f45c8039b50 0x7f45c803c010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45d4007fd0 tx=0x7f45d40078e0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:12:55.166 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.165+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f45e41236b0 con 0x7f45e412a0b0 2024-05-08T18:12:55.323 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.321+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45e4123900 con 0x7f45c8039b50 2024-05-08T18:12:55.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.365+0000 7f45da7fc640 1 -- 172.21.15.53:0/3229500704 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661697 (secure 0 0 0) 0x7f45e4123900 con 0x7f45c8039b50 2024-05-08T18:12:55.375 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:12:55.381 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f45c8039b50 msgr2=0x7f45c803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f45c8039b50 0x7f45c803c010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f45d4007fd0 tx=0x7f45d40078e0 comp rx=0 tx=0).stop 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 msgr2=0x7f45e4122ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e4122ae0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f45e0019fa0 tx=0x7f45e001abb0 comp rx=0 tx=0).stop 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 shutdown_connections 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f45c8039b50 0x7f45c803c010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 --2- 172.21.15.53:0/3229500704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45e412a0b0 0x7f45e4122ae0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 >> 172.21.15.53:0/3229500704 conn(0x7f45e409be60 msgr2=0x7f45e4070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:12:55.382 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 shutdown_connections 2024-05-08T18:12:55.383 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:12:55.373+0000 7f45ec05a640 1 -- 172.21.15.53:0/3229500704 wait complete. 2024-05-08T18:12:55.399 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-05-08T18:12:53.432505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603093,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5068,"num_read_kb":4654,"num_write":2121,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4734,"ondisk_log_size":4734,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148344,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339016,"statfs":{"total":386547056640,"available":386395152384,"internally_reserved":0,"allocated":2908160,"data_stored":1758306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005981"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425387+0000","last_change":"2024-05-08T18:08:47.510504+0000","last_active":"2024-05-08T18:10:56.425387+0000","last_peered":"2024-05-08T18:10:56.425387+0000","last_clean":"2024-05-08T18:10:56.425387+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:10:56.425387+0000","last_undegraded":"2024-05-08T18:10:56.425387+0000","last_fullsized":"2024-05-08T18:10:56.425387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774072+0000","last_change":"2024-05-08T18:08:49.501074+0000","last_active":"2024-05-08T18:12:02.774072+0000","last_peered":"2024-05-08T18:12:02.774072+0000","last_clean":"2024-05-08T18:12:02.774072+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:12:02.774072+0000","last_undegraded":"2024-05-08T18:12:02.774072+0000","last_fullsized":"2024-05-08T18:12:02.774072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.040431+0000","last_change":"2024-05-08T18:12:44.040493+0000","last_active":"2024-05-08T18:12:44.040431+0000","last_peered":"2024-05-08T18:12:44.040431+0000","last_clean":"2024-05-08T18:12:44.040431+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:12:44.040431+0000","last_undegraded":"2024-05-08T18:12:44.040431+0000","last_fullsized":"2024-05-08T18:12:44.040431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.040231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:27.160502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706009+0000","last_change":"2024-05-08T18:08:49.505238+0000","last_active":"2024-05-08T18:12:02.706009+0000","last_peered":"2024-05-08T18:12:02.706009+0000","last_clean":"2024-05-08T18:12:02.706009+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:12:02.706009+0000","last_undegraded":"2024-05-08T18:12:02.706009+0000","last_fullsized":"2024-05-08T18:12:02.706009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428368+0000","last_change":"2024-05-08T18:08:47.529012+0000","last_active":"2024-05-08T18:10:56.428368+0000","last_peered":"2024-05-08T18:10:56.428368+0000","last_clean":"2024-05-08T18:10:56.428368+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:10:56.428368+0000","last_undegraded":"2024-05-08T18:10:56.428368+0000","last_fullsized":"2024-05-08T18:10:56.428368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.399421+0000","last_change":"2024-05-08T18:12:50.399487+0000","last_active":"2024-05-08T18:12:50.399421+0000","last_peered":"2024-05-08T18:12:50.399421+0000","last_clean":"2024-05-08T18:12:50.399421+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:50.399421+0000","last_undegraded":"2024-05-08T18:12:50.399421+0000","last_fullsized":"2024-05-08T18:12:50.399421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.399205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:56.807281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.688424+0000","last_change":"2024-05-08T18:08:47.506602+0000","last_active":"2024-05-08T18:12:13.688424+0000","last_peered":"2024-05-08T18:12:13.688424+0000","last_clean":"2024-05-08T18:12:13.688424+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:12:13.688424+0000","last_undegraded":"2024-05-08T18:12:13.688424+0000","last_fullsized":"2024-05-08T18:12:13.688424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.207777+0000","last_change":"2024-05-08T18:12:31.207848+0000","last_active":"2024-05-08T18:12:31.207777+0000","last_peered":"2024-05-08T18:12:31.207777+0000","last_clean":"2024-05-08T18:12:31.207777+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:12:31.207777+0000","last_undegraded":"2024-05-08T18:12:31.207777+0000","last_fullsized":"2024-05-08T18:12:31.207777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.207573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:31.053515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434887+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:11:21.434887+0000","last_peered":"2024-05-08T18:11:21.434887+0000","last_clean":"2024-05-08T18:11:21.434887+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:11:21.434887+0000","last_undegraded":"2024-05-08T18:11:21.434887+0000","last_fullsized":"2024-05-08T18:11:21.434887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.850755+0000","last_change":"2024-05-08T18:12:48.850755+0000","last_active":"2024-05-08T18:12:48.850755+0000","last_peered":"2024-05-08T18:12:48.850755+0000","last_clean":"2024-05-08T18:12:48.850755+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:12:48.850755+0000","last_undegraded":"2024-05-08T18:12:48.850755+0000","last_fullsized":"2024-05-08T18:12:48.850755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.850265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:19.763792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.266763+0000","last_change":"2024-05-08T18:12:44.266831+0000","last_active":"2024-05-08T18:12:44.266763+0000","last_peered":"2024-05-08T18:12:44.266763+0000","last_clean":"2024-05-08T18:12:44.266763+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:12:44.266763+0000","last_undegraded":"2024-05-08T18:12:44.266763+0000","last_fullsized":"2024-05-08T18:12:44.266763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.266562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:46.442140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.620019+0000","last_change":"2024-05-08T18:08:49.512339+0000","last_active":"2024-05-08T18:12:02.620019+0000","last_peered":"2024-05-08T18:12:02.620019+0000","last_clean":"2024-05-08T18:12:02.620019+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:02.620019+0000","last_undegraded":"2024-05-08T18:12:02.620019+0000","last_fullsized":"2024-05-08T18:12:02.620019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434699+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:11:21.434699+0000","last_peered":"2024-05-08T18:11:21.434699+0000","last_clean":"2024-05-08T18:11:21.434699+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:11:21.434699+0000","last_undegraded":"2024-05-08T18:11:21.434699+0000","last_fullsized":"2024-05-08T18:11:21.434699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.309438+0000","last_change":"2024-05-08T18:12:43.309526+0000","last_active":"2024-05-08T18:12:43.309438+0000","last_peered":"2024-05-08T18:12:43.309438+0000","last_clean":"2024-05-08T18:12:43.309438+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:43.309438+0000","last_undegraded":"2024-05-08T18:12:43.309438+0000","last_fullsized":"2024-05-08T18:12:43.309438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.309244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:57.449936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.423816+0000","last_change":"2024-05-08T18:08:47.511982+0000","last_active":"2024-05-08T18:11:21.423816+0000","last_peered":"2024-05-08T18:11:21.423816+0000","last_clean":"2024-05-08T18:11:21.423816+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:11:21.423816+0000","last_undegraded":"2024-05-08T18:11:21.423816+0000","last_fullsized":"2024-05-08T18:11:21.423816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.193555+0000","last_change":"2024-05-08T18:12:51.193621+0000","last_active":"2024-05-08T18:12:51.193555+0000","last_peered":"2024-05-08T18:12:51.193555+0000","last_clean":"2024-05-08T18:12:51.193555+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:51.193555+0000","last_undegraded":"2024-05-08T18:12:51.193555+0000","last_fullsized":"2024-05-08T18:12:51.193555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.193346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:23.431759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.407311+0000","last_change":"2024-05-08T18:08:49.508214+0000","last_active":"2024-05-08T18:12:02.407311+0000","last_peered":"2024-05-08T18:12:02.407311+0000","last_clean":"2024-05-08T18:12:02.407311+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:12:02.407311+0000","last_undegraded":"2024-05-08T18:12:02.407311+0000","last_fullsized":"2024-05-08T18:12:02.407311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431817+0000","last_change":"2024-05-08T18:08:47.511822+0000","last_active":"2024-05-08T18:11:16.431817+0000","last_peered":"2024-05-08T18:11:16.431817+0000","last_clean":"2024-05-08T18:11:16.431817+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:11:16.431817+0000","last_undegraded":"2024-05-08T18:11:16.431817+0000","last_fullsized":"2024-05-08T18:11:16.431817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.775047+0000","last_change":"2024-05-08T18:08:49.500178+0000","last_active":"2024-05-08T18:12:02.775047+0000","last_peered":"2024-05-08T18:12:02.775047+0000","last_clean":"2024-05-08T18:12:02.775047+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:02.775047+0000","last_undegraded":"2024-05-08T18:12:02.775047+0000","last_fullsized":"2024-05-08T18:12:02.775047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430575+0000","last_change":"2024-05-08T18:08:47.513087+0000","last_active":"2024-05-08T18:11:16.430575+0000","last_peered":"2024-05-08T18:11:16.430575+0000","last_clean":"2024-05-08T18:11:16.430575+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:11:16.430575+0000","last_undegraded":"2024-05-08T18:11:16.430575+0000","last_fullsized":"2024-05-08T18:11:16.430575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.430250+0000","last_change":"2024-05-08T18:08:49.500044+0000","last_active":"2024-05-08T18:11:11.430250+0000","last_peered":"2024-05-08T18:11:11.430250+0000","last_clean":"2024-05-08T18:11:11.430250+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:11:11.430250+0000","last_undegraded":"2024-05-08T18:11:11.430250+0000","last_fullsized":"2024-05-08T18:11:11.430250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431708+0000","last_change":"2024-05-08T18:08:47.513484+0000","last_active":"2024-05-08T18:11:16.431708+0000","last_peered":"2024-05-08T18:11:16.431708+0000","last_clean":"2024-05-08T18:11:16.431708+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:11:16.431708+0000","last_undegraded":"2024-05-08T18:11:16.431708+0000","last_fullsized":"2024-05-08T18:11:16.431708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422714+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:16.422714+0000","last_peered":"2024-05-08T18:11:16.422714+0000","last_clean":"2024-05-08T18:11:16.422714+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:16.422714+0000","last_undegraded":"2024-05-08T18:11:16.422714+0000","last_fullsized":"2024-05-08T18:11:16.422714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'6","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521907+0000","last_change":"2024-05-08T18:08:47.496959+0000","last_active":"2024-05-08T18:12:09.521907+0000","last_peered":"2024-05-08T18:12:09.521907+0000","last_clean":"2024-05-08T18:12:09.521907+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:12:09.521907+0000","last_undegraded":"2024-05-08T18:12:09.521907+0000","last_fullsized":"2024-05-08T18:12:09.521907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.206865+0000","last_change":"2024-05-08T18:12:49.206927+0000","last_active":"2024-05-08T18:12:49.206865+0000","last_peered":"2024-05-08T18:12:49.206865+0000","last_clean":"2024-05-08T18:12:49.206865+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:49.206865+0000","last_undegraded":"2024-05-08T18:12:49.206865+0000","last_fullsized":"2024-05-08T18:12:49.206865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.206666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.348056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521296+0000","last_change":"2024-05-08T18:08:47.513517+0000","last_active":"2024-05-08T18:12:09.521296+0000","last_peered":"2024-05-08T18:12:09.521296+0000","last_clean":"2024-05-08T18:12:09.521296+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:12:09.521296+0000","last_undegraded":"2024-05-08T18:12:09.521296+0000","last_fullsized":"2024-05-08T18:12:09.521296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.820924+0000","last_change":"2024-05-08T18:12:43.820989+0000","last_active":"2024-05-08T18:12:43.820924+0000","last_peered":"2024-05-08T18:12:43.820924+0000","last_clean":"2024-05-08T18:12:43.820924+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:12:43.820924+0000","last_undegraded":"2024-05-08T18:12:43.820924+0000","last_fullsized":"2024-05-08T18:12:43.820924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.820707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:27.113355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522345+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:12:09.522345+0000","last_peered":"2024-05-08T18:12:09.522345+0000","last_clean":"2024-05-08T18:12:09.522345+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:12:09.522345+0000","last_undegraded":"2024-05-08T18:12:09.522345+0000","last_fullsized":"2024-05-08T18:12:09.522345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'35","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.798965+0000","last_change":"2024-05-08T18:08:57.567982+0000","last_active":"2024-05-08T18:12:02.798965+0000","last_peered":"2024-05-08T18:12:02.798965+0000","last_clean":"2024-05-08T18:12:02.798965+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:12:02.798965+0000","last_undegraded":"2024-05-08T18:12:02.798965+0000","last_fullsized":"2024-05-08T18:12:02.798965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.234796+0000","last_change":"2024-05-08T18:12:37.234862+0000","last_active":"2024-05-08T18:12:37.234796+0000","last_peered":"2024-05-08T18:12:37.234796+0000","last_clean":"2024-05-08T18:12:37.234796+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:37.234796+0000","last_undegraded":"2024-05-08T18:12:37.234796+0000","last_fullsized":"2024-05-08T18:12:37.234796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.234593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:20.089848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432270+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:11:11.432270+0000","last_peered":"2024-05-08T18:11:11.432270+0000","last_clean":"2024-05-08T18:11:11.432270+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:11:11.432270+0000","last_undegraded":"2024-05-08T18:11:11.432270+0000","last_fullsized":"2024-05-08T18:11:11.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.174115+0000","last_change":"2024-05-08T18:12:23.174172+0000","last_active":"2024-05-08T18:12:23.174115+0000","last_peered":"2024-05-08T18:12:23.174115+0000","last_clean":"2024-05-08T18:12:23.174115+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:12:23.174115+0000","last_undegraded":"2024-05-08T18:12:23.174115+0000","last_fullsized":"2024-05-08T18:12:23.174115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.173919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:15.795305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.265666+0000","last_change":"2024-05-08T18:12:36.265809+0000","last_active":"2024-05-08T18:12:36.265666+0000","last_peered":"2024-05-08T18:12:36.265666+0000","last_clean":"2024-05-08T18:12:36.265666+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:12:36.265666+0000","last_undegraded":"2024-05-08T18:12:36.265666+0000","last_fullsized":"2024-05-08T18:12:36.265666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.265414+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:04.357749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.877627+0000","last_change":"2024-05-08T18:12:13.877680+0000","last_active":"2024-05-08T18:12:13.877627+0000","last_peered":"2024-05-08T18:12:13.877627+0000","last_clean":"2024-05-08T18:12:13.877627+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:12:13.877627+0000","last_undegraded":"2024-05-08T18:12:13.877627+0000","last_fullsized":"2024-05-08T18:12:13.877627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.877412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:24.163300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.726142+0000","last_change":"2024-05-08T18:12:36.726229+0000","last_active":"2024-05-08T18:12:36.726142+0000","last_peered":"2024-05-08T18:12:36.726142+0000","last_clean":"2024-05-08T18:12:36.726142+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:12:36.726142+0000","last_undegraded":"2024-05-08T18:12:36.726142+0000","last_fullsized":"2024-05-08T18:12:36.726142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.725932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:50.918918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.242345+0000","last_change":"2024-05-08T18:12:34.242410+0000","last_active":"2024-05-08T18:12:34.242345+0000","last_peered":"2024-05-08T18:12:34.242345+0000","last_clean":"2024-05-08T18:12:34.242345+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:34.242345+0000","last_undegraded":"2024-05-08T18:12:34.242345+0000","last_fullsized":"2024-05-08T18:12:34.242345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.242141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:57.784530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.323223+0000","last_change":"2024-05-08T18:12:42.323322+0000","last_active":"2024-05-08T18:12:42.323223+0000","last_peered":"2024-05-08T18:12:42.323223+0000","last_clean":"2024-05-08T18:12:42.323223+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:12:42.323223+0000","last_undegraded":"2024-05-08T18:12:42.323223+0000","last_fullsized":"2024-05-08T18:12:42.323223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.322977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:09.542329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.020358+0000","last_change":"2024-05-08T18:12:38.020423+0000","last_active":"2024-05-08T18:12:38.020358+0000","last_peered":"2024-05-08T18:12:38.020358+0000","last_clean":"2024-05-08T18:12:38.020358+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:12:38.020358+0000","last_undegraded":"2024-05-08T18:12:38.020358+0000","last_fullsized":"2024-05-08T18:12:38.020358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.020159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:12.758346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.937689+0000","last_change":"2024-05-08T18:12:17.937761+0000","last_active":"2024-05-08T18:12:17.937689+0000","last_peered":"2024-05-08T18:12:17.937689+0000","last_clean":"2024-05-08T18:12:17.937689+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:12:17.937689+0000","last_undegraded":"2024-05-08T18:12:17.937689+0000","last_fullsized":"2024-05-08T18:12:17.937689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.937441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:59.874450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.894100+0000","last_change":"2024-05-08T18:12:16.894205+0000","last_active":"2024-05-08T18:12:16.894100+0000","last_peered":"2024-05-08T18:12:16.894100+0000","last_clean":"2024-05-08T18:12:16.894100+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:12:16.894100+0000","last_undegraded":"2024-05-08T18:12:16.894100+0000","last_fullsized":"2024-05-08T18:12:16.894100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.893872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:45.046890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.261929+0000","last_change":"2024-05-08T18:08:57.565097+0000","last_active":"2024-05-08T18:12:02.261929+0000","last_peered":"2024-05-08T18:12:02.261929+0000","last_clean":"2024-05-08T18:12:02.261929+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:12:02.261929+0000","last_undegraded":"2024-05-08T18:12:02.261929+0000","last_fullsized":"2024-05-08T18:12:02.261929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.214586+0000","last_change":"2024-05-08T18:12:26.214649+0000","last_active":"2024-05-08T18:12:26.214586+0000","last_peered":"2024-05-08T18:12:26.214586+0000","last_clean":"2024-05-08T18:12:26.214586+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:26.214586+0000","last_undegraded":"2024-05-08T18:12:26.214586+0000","last_fullsized":"2024-05-08T18:12:26.214586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.214403+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:05.554391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432135+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:11:11.432135+0000","last_peered":"2024-05-08T18:11:11.432135+0000","last_clean":"2024-05-08T18:11:11.432135+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:11:11.432135+0000","last_undegraded":"2024-05-08T18:11:11.432135+0000","last_fullsized":"2024-05-08T18:11:11.432135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.023222+0000","last_change":"2024-05-08T18:12:31.023275+0000","last_active":"2024-05-08T18:12:31.023222+0000","last_peered":"2024-05-08T18:12:31.023222+0000","last_clean":"2024-05-08T18:12:31.023222+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:12:31.023222+0000","last_undegraded":"2024-05-08T18:12:31.023222+0000","last_fullsized":"2024-05-08T18:12:31.023222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.023023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:20.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.430136+0000","last_change":"2024-05-08T18:12:24.430290+0000","last_active":"2024-05-08T18:12:24.430136+0000","last_peered":"2024-05-08T18:12:24.430136+0000","last_clean":"2024-05-08T18:12:24.430136+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:12:24.430136+0000","last_undegraded":"2024-05-08T18:12:24.430136+0000","last_fullsized":"2024-05-08T18:12:24.430136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.429852+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:02.971977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.358867+0000","last_change":"2024-05-08T18:12:48.358931+0000","last_active":"2024-05-08T18:12:48.358867+0000","last_peered":"2024-05-08T18:12:48.358867+0000","last_clean":"2024-05-08T18:12:48.358867+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:48.358867+0000","last_undegraded":"2024-05-08T18:12:48.358867+0000","last_fullsized":"2024-05-08T18:12:48.358867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.358666+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:43.819172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.434500+0000","last_change":"2024-05-08T18:12:27.434651+0000","last_active":"2024-05-08T18:12:27.434500+0000","last_peered":"2024-05-08T18:12:27.434500+0000","last_clean":"2024-05-08T18:12:27.434500+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:27.434500+0000","last_undegraded":"2024-05-08T18:12:27.434500+0000","last_fullsized":"2024-05-08T18:12:27.434500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.434279+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:06.052889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422915+0000","last_change":"2024-05-08T18:08:49.502184+0000","last_active":"2024-05-08T18:11:16.422915+0000","last_peered":"2024-05-08T18:11:16.422915+0000","last_clean":"2024-05-08T18:11:16.422915+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:11:16.422915+0000","last_undegraded":"2024-05-08T18:11:16.422915+0000","last_fullsized":"2024-05-08T18:11:16.422915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.429969+0000","last_change":"2024-05-08T18:08:47.498742+0000","last_active":"2024-05-08T18:11:11.429969+0000","last_peered":"2024-05-08T18:11:11.429969+0000","last_clean":"2024-05-08T18:11:11.429969+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:11:11.429969+0000","last_undegraded":"2024-05-08T18:11:11.429969+0000","last_fullsized":"2024-05-08T18:11:11.429969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.120514+0000","last_change":"2024-05-08T18:12:16.120572+0000","last_active":"2024-05-08T18:12:16.120514+0000","last_peered":"2024-05-08T18:12:16.120514+0000","last_clean":"2024-05-08T18:12:16.120514+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:12:16.120514+0000","last_undegraded":"2024-05-08T18:12:16.120514+0000","last_fullsized":"2024-05-08T18:12:16.120514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.120296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:25.274533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.373809+0000","last_change":"2024-05-08T18:12:22.373889+0000","last_active":"2024-05-08T18:12:22.373809+0000","last_peered":"2024-05-08T18:12:22.373809+0000","last_clean":"2024-05-08T18:12:22.373809+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:12:22.373809+0000","last_undegraded":"2024-05-08T18:12:22.373809+0000","last_fullsized":"2024-05-08T18:12:22.373809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.373620+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:49.336729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.917276+0000","last_change":"2024-05-08T18:12:24.917353+0000","last_active":"2024-05-08T18:12:24.917276+0000","last_peered":"2024-05-08T18:12:24.917276+0000","last_clean":"2024-05-08T18:12:24.917276+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:24.917276+0000","last_undegraded":"2024-05-08T18:12:24.917276+0000","last_fullsized":"2024-05-08T18:12:24.917276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.917056+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:36.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'11","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862159+0000","last_change":"2024-05-08T18:08:49.510841+0000","last_active":"2024-05-08T18:12:02.862159+0000","last_peered":"2024-05-08T18:12:02.862159+0000","last_clean":"2024-05-08T18:12:02.862159+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:02.862159+0000","last_undegraded":"2024-05-08T18:12:02.862159+0000","last_fullsized":"2024-05-08T18:12:02.862159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428139+0000","last_change":"2024-05-08T18:08:47.512906+0000","last_active":"2024-05-08T18:11:06.428139+0000","last_peered":"2024-05-08T18:11:06.428139+0000","last_clean":"2024-05-08T18:11:06.428139+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:11:06.428139+0000","last_undegraded":"2024-05-08T18:11:06.428139+0000","last_fullsized":"2024-05-08T18:11:06.428139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.808661+0000","last_change":"2024-05-08T18:12:30.808713+0000","last_active":"2024-05-08T18:12:30.808661+0000","last_peered":"2024-05-08T18:12:30.808661+0000","last_clean":"2024-05-08T18:12:30.808661+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:12:30.808661+0000","last_undegraded":"2024-05-08T18:12:30.808661+0000","last_fullsized":"2024-05-08T18:12:30.808661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.808460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:40.081671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.443782+0000","last_change":"2024-05-08T18:12:25.443964+0000","last_active":"2024-05-08T18:12:25.443782+0000","last_peered":"2024-05-08T18:12:25.443782+0000","last_clean":"2024-05-08T18:12:25.443782+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:12:25.443782+0000","last_undegraded":"2024-05-08T18:12:25.443782+0000","last_fullsized":"2024-05-08T18:12:25.443782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.443551+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:01.194660+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.977085+0000","last_change":"2024-05-08T18:12:18.977194+0000","last_active":"2024-05-08T18:12:18.977085+0000","last_peered":"2024-05-08T18:12:18.977085+0000","last_clean":"2024-05-08T18:12:18.977085+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:12:18.977085+0000","last_undegraded":"2024-05-08T18:12:18.977085+0000","last_fullsized":"2024-05-08T18:12:18.977085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.976803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:31.754400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.404468+0000","last_change":"2024-05-08T18:12:23.404620+0000","last_active":"2024-05-08T18:12:23.404468+0000","last_peered":"2024-05-08T18:12:23.404468+0000","last_clean":"2024-05-08T18:12:23.404468+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:12:23.404468+0000","last_undegraded":"2024-05-08T18:12:23.404468+0000","last_fullsized":"2024-05-08T18:12:23.404468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.404248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:38.428265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.842213+0000","last_change":"2024-05-08T18:12:44.842273+0000","last_active":"2024-05-08T18:12:44.842213+0000","last_peered":"2024-05-08T18:12:44.842213+0000","last_clean":"2024-05-08T18:12:44.842213+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:12:44.842213+0000","last_undegraded":"2024-05-08T18:12:44.842213+0000","last_fullsized":"2024-05-08T18:12:44.842213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.842022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:59.604961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.427982+0000","last_change":"2024-05-08T18:08:47.513909+0000","last_active":"2024-05-08T18:11:06.427982+0000","last_peered":"2024-05-08T18:11:06.427982+0000","last_clean":"2024-05-08T18:11:06.427982+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:11:06.427982+0000","last_undegraded":"2024-05-08T18:11:06.427982+0000","last_fullsized":"2024-05-08T18:11:06.427982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:41.435868+0000","last_change":"2024-05-08T18:09:28.594816+0000","last_active":"2024-05-08T18:11:41.435868+0000","last_peered":"2024-05-08T18:11:41.435868+0000","last_clean":"2024-05-08T18:11:41.435868+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:11:41.435868+0000","last_undegraded":"2024-05-08T18:11:41.435868+0000","last_fullsized":"2024-05-08T18:11:41.435868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.327762+0000","last_change":"2024-05-08T18:12:42.327923+0000","last_active":"2024-05-08T18:12:42.327762+0000","last_peered":"2024-05-08T18:12:42.327762+0000","last_clean":"2024-05-08T18:12:42.327762+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:12:42.327762+0000","last_undegraded":"2024-05-08T18:12:42.327762+0000","last_fullsized":"2024-05-08T18:12:42.327762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.327508+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:15.103422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.889035+0000","last_change":"2024-05-08T18:12:14.889091+0000","last_active":"2024-05-08T18:12:14.889035+0000","last_peered":"2024-05-08T18:12:14.889035+0000","last_clean":"2024-05-08T18:12:14.889035+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:12:14.889035+0000","last_undegraded":"2024-05-08T18:12:14.889035+0000","last_fullsized":"2024-05-08T18:12:14.889035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.888837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:43.041854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.429052+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:11:06.429052+0000","last_peered":"2024-05-08T18:11:06.429052+0000","last_clean":"2024-05-08T18:11:06.429052+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:11:06.429052+0000","last_undegraded":"2024-05-08T18:11:06.429052+0000","last_fullsized":"2024-05-08T18:11:06.429052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.229346+0000","last_change":"2024-05-08T18:12:45.229409+0000","last_active":"2024-05-08T18:12:45.229346+0000","last_peered":"2024-05-08T18:12:45.229346+0000","last_clean":"2024-05-08T18:12:45.229346+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:45.229346+0000","last_undegraded":"2024-05-08T18:12:45.229346+0000","last_fullsized":"2024-05-08T18:12:45.229346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.229157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:54.383394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430943+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:11:06.430943+0000","last_peered":"2024-05-08T18:11:06.430943+0000","last_clean":"2024-05-08T18:11:06.430943+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:11:06.430943+0000","last_undegraded":"2024-05-08T18:11:06.430943+0000","last_fullsized":"2024-05-08T18:11:06.430943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.003319+0000","last_change":"2024-05-08T18:12:32.003372+0000","last_active":"2024-05-08T18:12:32.003319+0000","last_peered":"2024-05-08T18:12:32.003319+0000","last_clean":"2024-05-08T18:12:32.003319+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:12:32.003319+0000","last_undegraded":"2024-05-08T18:12:32.003319+0000","last_fullsized":"2024-05-08T18:12:32.003319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.003096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:34.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.137274+0000","last_change":"2024-05-08T18:12:22.137373+0000","last_active":"2024-05-08T18:12:22.137274+0000","last_peered":"2024-05-08T18:12:22.137274+0000","last_clean":"2024-05-08T18:12:22.137274+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:12:22.137274+0000","last_undegraded":"2024-05-08T18:12:22.137274+0000","last_fullsized":"2024-05-08T18:12:22.137274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.137072+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.003539+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":367,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.931110+0000","last_change":"2024-05-08T18:12:13.931134+0000","last_active":"2024-05-08T18:12:13.931110+0000","last_peered":"2024-05-08T18:12:13.931110+0000","last_clean":"2024-05-08T18:12:13.931110+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:13.931110+0000","last_undegraded":"2024-05-08T18:12:13.931110+0000","last_fullsized":"2024-05-08T18:12:13.931110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.931028+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:49.682137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.421644+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:11:11.421644+0000","last_peered":"2024-05-08T18:11:11.421644+0000","last_clean":"2024-05-08T18:11:11.421644+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:11:11.421644+0000","last_undegraded":"2024-05-08T18:11:11.421644+0000","last_fullsized":"2024-05-08T18:11:11.421644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.376913+0000","last_change":"2024-05-08T18:12:38.376977+0000","last_active":"2024-05-08T18:12:38.376913+0000","last_peered":"2024-05-08T18:12:38.376913+0000","last_clean":"2024-05-08T18:12:38.376913+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:12:38.376913+0000","last_undegraded":"2024-05-08T18:12:38.376913+0000","last_fullsized":"2024-05-08T18:12:38.376913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.376714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:00.741888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430833+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:11:06.430833+0000","last_peered":"2024-05-08T18:11:06.430833+0000","last_clean":"2024-05-08T18:11:06.430833+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:11:06.430833+0000","last_undegraded":"2024-05-08T18:11:06.430833+0000","last_fullsized":"2024-05-08T18:11:06.430833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:41.435953+0000","last_change":"2024-05-08T18:09:28.599715+0000","last_active":"2024-05-08T18:11:41.435953+0000","last_peered":"2024-05-08T18:11:41.435953+0000","last_clean":"2024-05-08T18:11:41.435953+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:11:41.435953+0000","last_undegraded":"2024-05-08T18:11:41.435953+0000","last_fullsized":"2024-05-08T18:11:41.435953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'65","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.376568+0000","last_change":"2024-05-08T18:12:49.376725+0000","last_active":"2024-05-08T18:12:49.376568+0000","last_peered":"2024-05-08T18:12:49.376568+0000","last_clean":"2024-05-08T18:12:49.376568+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:12:49.376568+0000","last_undegraded":"2024-05-08T18:12:49.376568+0000","last_fullsized":"2024-05-08T18:12:49.376568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.376328+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:33.322089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.918065+0000","last_change":"2024-05-08T18:12:16.918122+0000","last_active":"2024-05-08T18:12:16.918065+0000","last_peered":"2024-05-08T18:12:16.918065+0000","last_clean":"2024-05-08T18:12:16.918065+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:12:16.918065+0000","last_undegraded":"2024-05-08T18:12:16.918065+0000","last_fullsized":"2024-05-08T18:12:16.918065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.917861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:11.528942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.053883+0000","last_change":"2024-05-08T18:12:41.054066+0000","last_active":"2024-05-08T18:12:41.053883+0000","last_peered":"2024-05-08T18:12:41.053883+0000","last_clean":"2024-05-08T18:12:41.053883+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:41.053883+0000","last_undegraded":"2024-05-08T18:12:41.053883+0000","last_fullsized":"2024-05-08T18:12:41.053883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.053624+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:02:46.543372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.769596+0000","last_change":"2024-05-08T18:12:35.769660+0000","last_active":"2024-05-08T18:12:35.769596+0000","last_peered":"2024-05-08T18:12:35.769596+0000","last_clean":"2024-05-08T18:12:35.769596+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:12:35.769596+0000","last_undegraded":"2024-05-08T18:12:35.769596+0000","last_fullsized":"2024-05-08T18:12:35.769596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.769378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:44.923615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420286+0000","last_change":"2024-05-08T18:08:47.496893+0000","last_active":"2024-05-08T18:11:06.420286+0000","last_peered":"2024-05-08T18:11:06.420286+0000","last_clean":"2024-05-08T18:11:06.420286+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:11:06.420286+0000","last_undegraded":"2024-05-08T18:11:06.420286+0000","last_fullsized":"2024-05-08T18:11:06.420286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.445582+0000","last_change":"2024-05-08T18:12:34.445639+0000","last_active":"2024-05-08T18:12:34.445582+0000","last_peered":"2024-05-08T18:12:34.445582+0000","last_clean":"2024-05-08T18:12:34.445582+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:12:34.445582+0000","last_undegraded":"2024-05-08T18:12:34.445582+0000","last_fullsized":"2024-05-08T18:12:34.445582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.445366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:27.788124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.976359+0000","last_change":"2024-05-08T18:12:19.976447+0000","last_active":"2024-05-08T18:12:19.976359+0000","last_peered":"2024-05-08T18:12:19.976359+0000","last_clean":"2024-05-08T18:12:19.976359+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:12:19.976359+0000","last_undegraded":"2024-05-08T18:12:19.976359+0000","last_fullsized":"2024-05-08T18:12:19.976359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.976156+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:44.797089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432501+0000","last_change":"2024-05-08T18:08:55.570542+0000","last_active":"2024-05-08T18:11:11.432501+0000","last_peered":"2024-05-08T18:11:11.432501+0000","last_clean":"2024-05-08T18:11:11.432501+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:11:11.432501+0000","last_undegraded":"2024-05-08T18:11:11.432501+0000","last_fullsized":"2024-05-08T18:11:11.432501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.872710+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:12:02.872710+0000","last_peered":"2024-05-08T18:12:02.872710+0000","last_clean":"2024-05-08T18:12:02.872710+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:12:02.872710+0000","last_undegraded":"2024-05-08T18:12:02.872710+0000","last_fullsized":"2024-05-08T18:12:02.872710+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.246328+0000","last_change":"2024-05-08T18:12:27.246550+0000","last_active":"2024-05-08T18:12:27.246328+0000","last_peered":"2024-05-08T18:12:27.246328+0000","last_clean":"2024-05-08T18:12:27.246328+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:27.246328+0000","last_undegraded":"2024-05-08T18:12:27.246328+0000","last_fullsized":"2024-05-08T18:12:27.246328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.246102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:55.984072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522172+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:12:09.522172+0000","last_peered":"2024-05-08T18:12:09.522172+0000","last_clean":"2024-05-08T18:12:09.522172+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:12:09.522172+0000","last_undegraded":"2024-05-08T18:12:09.522172+0000","last_fullsized":"2024-05-08T18:12:09.522172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.057420+0000","last_change":"2024-05-08T18:12:30.057479+0000","last_active":"2024-05-08T18:12:30.057420+0000","last_peered":"2024-05-08T18:12:30.057420+0000","last_clean":"2024-05-08T18:12:30.057420+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:12:30.057420+0000","last_undegraded":"2024-05-08T18:12:30.057420+0000","last_fullsized":"2024-05-08T18:12:30.057420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:54.634269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.405643+0000","last_change":"2024-05-08T18:12:28.405733+0000","last_active":"2024-05-08T18:12:28.405643+0000","last_peered":"2024-05-08T18:12:28.405643+0000","last_clean":"2024-05-08T18:12:28.405643+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:12:28.405643+0000","last_undegraded":"2024-05-08T18:12:28.405643+0000","last_fullsized":"2024-05-08T18:12:28.405643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.405516+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:23.016597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.441147+0000","last_change":"2024-05-08T18:12:15.441218+0000","last_active":"2024-05-08T18:12:15.441147+0000","last_peered":"2024-05-08T18:12:15.441147+0000","last_clean":"2024-05-08T18:12:15.441147+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:15.441147+0000","last_undegraded":"2024-05-08T18:12:15.441147+0000","last_fullsized":"2024-05-08T18:12:15.441147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.440939+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:26.637944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.876900+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:12:02.876900+0000","last_peered":"2024-05-08T18:12:02.876900+0000","last_clean":"2024-05-08T18:12:02.876900+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:12:02.876900+0000","last_undegraded":"2024-05-08T18:12:02.876900+0000","last_fullsized":"2024-05-08T18:12:02.876900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.183456+0000","last_change":"2024-05-08T18:12:47.183516+0000","last_active":"2024-05-08T18:12:47.183456+0000","last_peered":"2024-05-08T18:12:47.183456+0000","last_clean":"2024-05-08T18:12:47.183456+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:12:47.183456+0000","last_undegraded":"2024-05-08T18:12:47.183456+0000","last_fullsized":"2024-05-08T18:12:47.183456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.183265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:54.291097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429448+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:11:01.429448+0000","last_peered":"2024-05-08T18:11:01.429448+0000","last_clean":"2024-05-08T18:11:01.429448+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:11:01.429448+0000","last_undegraded":"2024-05-08T18:11:01.429448+0000","last_fullsized":"2024-05-08T18:11:01.429448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.895983+0000","last_change":"2024-05-08T18:12:27.896053+0000","last_active":"2024-05-08T18:12:27.895983+0000","last_peered":"2024-05-08T18:12:27.895983+0000","last_clean":"2024-05-08T18:12:27.895983+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:12:27.895983+0000","last_undegraded":"2024-05-08T18:12:27.895983+0000","last_fullsized":"2024-05-08T18:12:27.895983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.895781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:25.396027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.279987+0000","last_change":"2024-05-08T18:12:41.280066+0000","last_active":"2024-05-08T18:12:41.279987+0000","last_peered":"2024-05-08T18:12:41.279987+0000","last_clean":"2024-05-08T18:12:41.279987+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:12:41.279987+0000","last_undegraded":"2024-05-08T18:12:41.279987+0000","last_fullsized":"2024-05-08T18:12:41.279987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.279763+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:03.126482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.876484+0000","last_change":"2024-05-08T18:12:28.876546+0000","last_active":"2024-05-08T18:12:28.876484+0000","last_peered":"2024-05-08T18:12:28.876484+0000","last_clean":"2024-05-08T18:12:28.876484+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:28.876484+0000","last_undegraded":"2024-05-08T18:12:28.876484+0000","last_fullsized":"2024-05-08T18:12:28.876484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.876292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:13:51.241466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.427672+0000","last_change":"2024-05-08T18:08:57.569509+0000","last_active":"2024-05-08T18:11:06.427672+0000","last_peered":"2024-05-08T18:11:06.427672+0000","last_clean":"2024-05-08T18:11:06.427672+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:11:06.427672+0000","last_undegraded":"2024-05-08T18:11:06.427672+0000","last_fullsized":"2024-05-08T18:11:06.427672+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.735390+0000","last_change":"2024-05-08T18:12:37.735463+0000","last_active":"2024-05-08T18:12:37.735390+0000","last_peered":"2024-05-08T18:12:37.735390+0000","last_clean":"2024-05-08T18:12:37.735390+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:37.735390+0000","last_undegraded":"2024-05-08T18:12:37.735390+0000","last_fullsized":"2024-05-08T18:12:37.735390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.735180+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:44.843012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429318+0000","last_change":"2024-05-08T18:08:47.529160+0000","last_active":"2024-05-08T18:11:01.429318+0000","last_peered":"2024-05-08T18:11:01.429318+0000","last_clean":"2024-05-08T18:11:01.429318+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:11:01.429318+0000","last_undegraded":"2024-05-08T18:11:01.429318+0000","last_fullsized":"2024-05-08T18:11:01.429318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.106333+0000","last_change":"2024-05-08T18:12:17.106450+0000","last_active":"2024-05-08T18:12:17.106333+0000","last_peered":"2024-05-08T18:12:17.106333+0000","last_clean":"2024-05-08T18:12:17.106333+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:12:17.106333+0000","last_undegraded":"2024-05-08T18:12:17.106333+0000","last_fullsized":"2024-05-08T18:12:17.106333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.106103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:31.299089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.947238+0000","last_change":"2024-05-08T18:12:21.947331+0000","last_active":"2024-05-08T18:12:21.947238+0000","last_peered":"2024-05-08T18:12:21.947238+0000","last_clean":"2024-05-08T18:12:21.947238+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:12:21.947238+0000","last_undegraded":"2024-05-08T18:12:21.947238+0000","last_fullsized":"2024-05-08T18:12:21.947238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.947022+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:33.614218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.369594+0000","last_change":"2024-05-08T18:12:20.369656+0000","last_active":"2024-05-08T18:12:20.369594+0000","last_peered":"2024-05-08T18:12:20.369594+0000","last_clean":"2024-05-08T18:12:20.369594+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:12:20.369594+0000","last_undegraded":"2024-05-08T18:12:20.369594+0000","last_fullsized":"2024-05-08T18:12:20.369594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.369368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:12.685507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.927769+0000","last_change":"2024-05-08T18:08:57.568017+0000","last_active":"2024-05-08T18:12:02.927769+0000","last_peered":"2024-05-08T18:12:02.927769+0000","last_clean":"2024-05-08T18:12:02.927769+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:12:02.927769+0000","last_undegraded":"2024-05-08T18:12:02.927769+0000","last_fullsized":"2024-05-08T18:12:02.927769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'11","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.862192+0000","last_change":"2024-05-08T18:08:49.510311+0000","last_active":"2024-05-08T18:12:02.862192+0000","last_peered":"2024-05-08T18:12:02.862192+0000","last_clean":"2024-05-08T18:12:02.862192+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:02.862192+0000","last_undegraded":"2024-05-08T18:12:02.862192+0000","last_fullsized":"2024-05-08T18:12:02.862192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'72","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.225596+0000","last_change":"2024-05-08T18:08:33.637657+0000","last_active":"2024-05-08T18:12:13.225596+0000","last_peered":"2024-05-08T18:12:13.225596+0000","last_clean":"2024-05-08T18:12:13.225596+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:12:13.225596+0000","last_undegraded":"2024-05-08T18:12:13.225596+0000","last_fullsized":"2024-05-08T18:12:13.225596+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:32.327398+0000","last_clean_scrub_stamp":"2024-05-08T18:08:32.327398+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147409+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:12:14.147409+0000","last_peered":"2024-05-08T18:12:14.147409+0000","last_clean":"2024-05-08T18:12:14.147409+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:12:14.147409+0000","last_undegraded":"2024-05-08T18:12:14.147409+0000","last_fullsized":"2024-05-08T18:12:14.147409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428195+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:10:56.428195+0000","last_peered":"2024-05-08T18:10:56.428195+0000","last_clean":"2024-05-08T18:10:56.428195+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:10:56.428195+0000","last_undegraded":"2024-05-08T18:10:56.428195+0000","last_fullsized":"2024-05-08T18:10:56.428195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.832102+0000","last_change":"2024-05-08T18:12:25.832156+0000","last_active":"2024-05-08T18:12:25.832102+0000","last_peered":"2024-05-08T18:12:25.832102+0000","last_clean":"2024-05-08T18:12:25.832102+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:12:25.832102+0000","last_undegraded":"2024-05-08T18:12:25.832102+0000","last_fullsized":"2024-05-08T18:12:25.832102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.831900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:22.583694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'93","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.436682+0000","last_change":"2024-05-08T18:12:46.436762+0000","last_active":"2024-05-08T18:12:46.436682+0000","last_peered":"2024-05-08T18:12:46.436682+0000","last_clean":"2024-05-08T18:12:46.436682+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:46.436682+0000","last_undegraded":"2024-05-08T18:12:46.436682+0000","last_fullsized":"2024-05-08T18:12:46.436682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.436505+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:33.626162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.052555+0000","last_change":"2024-05-08T18:12:29.052679+0000","last_active":"2024-05-08T18:12:29.052555+0000","last_peered":"2024-05-08T18:12:29.052555+0000","last_clean":"2024-05-08T18:12:29.052555+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:12:29.052555+0000","last_undegraded":"2024-05-08T18:12:29.052555+0000","last_fullsized":"2024-05-08T18:12:29.052555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.052326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:01.660597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.404767+0000","last_change":"2024-05-08T18:12:35.404834+0000","last_active":"2024-05-08T18:12:35.404767+0000","last_peered":"2024-05-08T18:12:35.404767+0000","last_clean":"2024-05-08T18:12:35.404767+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:35.404767+0000","last_undegraded":"2024-05-08T18:12:35.404767+0000","last_fullsized":"2024-05-08T18:12:35.404767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.404580+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.156373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.619896+0000","last_change":"2024-05-08T18:08:49.510047+0000","last_active":"2024-05-08T18:12:02.619896+0000","last_peered":"2024-05-08T18:12:02.619896+0000","last_clean":"2024-05-08T18:12:02.619896+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:12:02.619896+0000","last_undegraded":"2024-05-08T18:12:02.619896+0000","last_fullsized":"2024-05-08T18:12:02.619896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147354+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:12:14.147354+0000","last_peered":"2024-05-08T18:12:14.147354+0000","last_clean":"2024-05-08T18:12:14.147354+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:12:14.147354+0000","last_undegraded":"2024-05-08T18:12:14.147354+0000","last_fullsized":"2024-05-08T18:12:14.147354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.417643+0000","last_change":"2024-05-08T18:08:47.515311+0000","last_active":"2024-05-08T18:10:56.417643+0000","last_peered":"2024-05-08T18:10:56.417643+0000","last_clean":"2024-05-08T18:10:56.417643+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:10:56.417643+0000","last_undegraded":"2024-05-08T18:10:56.417643+0000","last_fullsized":"2024-05-08T18:10:56.417643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.110792+0000","last_change":"2024-05-08T18:12:15.110947+0000","last_active":"2024-05-08T18:12:15.110792+0000","last_peered":"2024-05-08T18:12:15.110792+0000","last_clean":"2024-05-08T18:12:15.110792+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:12:15.110792+0000","last_undegraded":"2024-05-08T18:12:15.110792+0000","last_fullsized":"2024-05-08T18:12:15.110792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.110542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:17.286120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":516,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.874535+0000","last_change":"2024-05-08T18:12:15.874681+0000","last_active":"2024-05-08T18:12:15.874535+0000","last_peered":"2024-05-08T18:12:15.874535+0000","last_clean":"2024-05-08T18:12:15.874535+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:15.874535+0000","last_undegraded":"2024-05-08T18:12:15.874535+0000","last_fullsized":"2024-05-08T18:12:15.874535+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.874266+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:16.789721+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.388092+0000","last_change":"2024-05-08T18:12:44.388148+0000","last_active":"2024-05-08T18:12:44.388092+0000","last_peered":"2024-05-08T18:12:44.388092+0000","last_clean":"2024-05-08T18:12:44.388092+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:12:44.388092+0000","last_undegraded":"2024-05-08T18:12:44.388092+0000","last_fullsized":"2024-05-08T18:12:44.388092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.387867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:11.255581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.430283+0000","last_change":"2024-05-08T18:08:57.579069+0000","last_active":"2024-05-08T18:11:11.430283+0000","last_peered":"2024-05-08T18:11:11.430283+0000","last_clean":"2024-05-08T18:11:11.430283+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:11:11.430283+0000","last_undegraded":"2024-05-08T18:11:11.430283+0000","last_fullsized":"2024-05-08T18:11:11.430283+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.774822+0000","last_change":"2024-05-08T18:08:49.501820+0000","last_active":"2024-05-08T18:12:02.774822+0000","last_peered":"2024-05-08T18:12:02.774822+0000","last_clean":"2024-05-08T18:12:02.774822+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:02.774822+0000","last_undegraded":"2024-05-08T18:12:02.774822+0000","last_fullsized":"2024-05-08T18:12:02.774822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.687996+0000","last_change":"2024-05-08T18:08:39.433990+0000","last_active":"2024-05-08T18:12:13.687996+0000","last_peered":"2024-05-08T18:12:13.687996+0000","last_clean":"2024-05-08T18:12:13.687996+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:12:13.687996+0000","last_undegraded":"2024-05-08T18:12:13.687996+0000","last_fullsized":"2024-05-08T18:12:13.687996+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.773164+0000","last_change":"2024-05-08T18:08:47.513124+0000","last_active":"2024-05-08T18:12:12.773164+0000","last_peered":"2024-05-08T18:12:12.773164+0000","last_clean":"2024-05-08T18:12:12.773164+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:12:12.773164+0000","last_undegraded":"2024-05-08T18:12:12.773164+0000","last_fullsized":"2024-05-08T18:12:12.773164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.419200+0000","last_change":"2024-05-08T18:12:32.419268+0000","last_active":"2024-05-08T18:12:32.419200+0000","last_peered":"2024-05-08T18:12:32.419200+0000","last_clean":"2024-05-08T18:12:32.419200+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:12:32.419200+0000","last_undegraded":"2024-05-08T18:12:32.419200+0000","last_fullsized":"2024-05-08T18:12:32.419200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.419009+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:22.878609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.405760+0000","last_change":"2024-05-08T18:12:26.405846+0000","last_active":"2024-05-08T18:12:26.405760+0000","last_peered":"2024-05-08T18:12:26.405760+0000","last_clean":"2024-05-08T18:12:26.405760+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:26.405760+0000","last_undegraded":"2024-05-08T18:12:26.405760+0000","last_fullsized":"2024-05-08T18:12:26.405760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.405548+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:54.558566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.006551+0000","last_change":"2024-05-08T18:12:33.006603+0000","last_active":"2024-05-08T18:12:33.006551+0000","last_peered":"2024-05-08T18:12:33.006551+0000","last_clean":"2024-05-08T18:12:33.006551+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:12:33.006551+0000","last_undegraded":"2024-05-08T18:12:33.006551+0000","last_fullsized":"2024-05-08T18:12:33.006551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:42.160580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433565+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:11:16.433565+0000","last_peered":"2024-05-08T18:11:16.433565+0000","last_clean":"2024-05-08T18:11:16.433565+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:11:16.433565+0000","last_undegraded":"2024-05-08T18:11:16.433565+0000","last_fullsized":"2024-05-08T18:11:16.433565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.024811+0000","last_change":"2024-05-08T18:12:43.024876+0000","last_active":"2024-05-08T18:12:43.024811+0000","last_peered":"2024-05-08T18:12:43.024811+0000","last_clean":"2024-05-08T18:12:43.024811+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:43.024811+0000","last_undegraded":"2024-05-08T18:12:43.024811+0000","last_fullsized":"2024-05-08T18:12:43.024811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.024617+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:28.911270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147378+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:12:14.147378+0000","last_peered":"2024-05-08T18:12:14.147378+0000","last_clean":"2024-05-08T18:12:14.147378+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:12:14.147378+0000","last_undegraded":"2024-05-08T18:12:14.147378+0000","last_fullsized":"2024-05-08T18:12:14.147378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.425133+0000","last_change":"2024-05-08T18:08:47.507237+0000","last_active":"2024-05-08T18:10:56.425133+0000","last_peered":"2024-05-08T18:10:56.425133+0000","last_clean":"2024-05-08T18:10:56.425133+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:10:56.425133+0000","last_undegraded":"2024-05-08T18:10:56.425133+0000","last_fullsized":"2024-05-08T18:10:56.425133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.030365+0000","last_change":"2024-05-08T18:12:36.030417+0000","last_active":"2024-05-08T18:12:36.030365+0000","last_peered":"2024-05-08T18:12:36.030365+0000","last_clean":"2024-05-08T18:12:36.030365+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:12:36.030365+0000","last_undegraded":"2024-05-08T18:12:36.030365+0000","last_fullsized":"2024-05-08T18:12:36.030365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.030159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:58.141039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.401050+0000","last_change":"2024-05-08T18:12:47.401132+0000","last_active":"2024-05-08T18:12:47.401050+0000","last_peered":"2024-05-08T18:12:47.401050+0000","last_clean":"2024-05-08T18:12:47.401050+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:47.401050+0000","last_undegraded":"2024-05-08T18:12:47.401050+0000","last_fullsized":"2024-05-08T18:12:47.401050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.400857+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:20.922374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.431075+0000","last_change":"2024-05-08T18:08:55.569487+0000","last_active":"2024-05-08T18:11:06.431075+0000","last_peered":"2024-05-08T18:11:06.431075+0000","last_clean":"2024-05-08T18:11:06.431075+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:11:06.431075+0000","last_undegraded":"2024-05-08T18:11:06.431075+0000","last_fullsized":"2024-05-08T18:11:06.431075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:54.498163+0000","last_clean_scrub_stamp":"2024-05-08T18:08:54.498163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.772473+0000","last_change":"2024-05-08T18:12:40.772534+0000","last_active":"2024-05-08T18:12:40.772473+0000","last_peered":"2024-05-08T18:12:40.772473+0000","last_clean":"2024-05-08T18:12:40.772473+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:12:40.772473+0000","last_undegraded":"2024-05-08T18:12:40.772473+0000","last_fullsized":"2024-05-08T18:12:40.772473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.772281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.689481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.706210+0000","last_change":"2024-05-08T18:09:28.612611+0000","last_active":"2024-05-08T18:12:02.706210+0000","last_peered":"2024-05-08T18:12:02.706210+0000","last_clean":"2024-05-08T18:12:02.706210+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:12:02.706210+0000","last_undegraded":"2024-05-08T18:12:02.706210+0000","last_fullsized":"2024-05-08T18:12:02.706210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.231130+0000","last_change":"2024-05-08T18:12:46.231202+0000","last_active":"2024-05-08T18:12:46.231130+0000","last_peered":"2024-05-08T18:12:46.231130+0000","last_clean":"2024-05-08T18:12:46.231130+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:12:46.231130+0000","last_undegraded":"2024-05-08T18:12:46.231130+0000","last_fullsized":"2024-05-08T18:12:46.231130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.230919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.423905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.773113+0000","last_change":"2024-05-08T18:08:39.434085+0000","last_active":"2024-05-08T18:12:12.773113+0000","last_peered":"2024-05-08T18:12:12.773113+0000","last_clean":"2024-05-08T18:12:12.773113+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:12:12.773113+0000","last_undegraded":"2024-05-08T18:12:12.773113+0000","last_fullsized":"2024-05-08T18:12:12.773113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.054615+0000","last_change":"2024-05-08T18:12:35.054793+0000","last_active":"2024-05-08T18:12:35.054615+0000","last_peered":"2024-05-08T18:12:35.054615+0000","last_clean":"2024-05-08T18:12:35.054615+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:12:35.054615+0000","last_undegraded":"2024-05-08T18:12:35.054615+0000","last_fullsized":"2024-05-08T18:12:35.054615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.054395+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:03.822537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":149,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.946400+0000","last_change":"2024-05-08T18:12:21.946482+0000","last_active":"2024-05-08T18:12:21.946400+0000","last_peered":"2024-05-08T18:12:21.946400+0000","last_clean":"2024-05-08T18:12:21.946400+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:12:21.946400+0000","last_undegraded":"2024-05-08T18:12:21.946400+0000","last_fullsized":"2024-05-08T18:12:21.946400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.946183+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:14.861048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.480982+0000","last_change":"2024-05-08T18:12:14.481040+0000","last_active":"2024-05-08T18:12:14.480982+0000","last_peered":"2024-05-08T18:12:14.480982+0000","last_clean":"2024-05-08T18:12:14.480982+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:12:14.480982+0000","last_undegraded":"2024-05-08T18:12:14.480982+0000","last_fullsized":"2024-05-08T18:12:14.480982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.480775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:53.762778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422810+0000","last_change":"2024-05-08T18:08:57.564941+0000","last_active":"2024-05-08T18:11:16.422810+0000","last_peered":"2024-05-08T18:11:16.422810+0000","last_clean":"2024-05-08T18:11:16.422810+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:11:16.422810+0000","last_undegraded":"2024-05-08T18:11:16.422810+0000","last_fullsized":"2024-05-08T18:11:16.422810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.795847+0000","last_change":"2024-05-08T18:12:33.796028+0000","last_active":"2024-05-08T18:12:33.795847+0000","last_peered":"2024-05-08T18:12:33.795847+0000","last_clean":"2024-05-08T18:12:33.795847+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:33.795847+0000","last_undegraded":"2024-05-08T18:12:33.795847+0000","last_fullsized":"2024-05-08T18:12:33.795847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.795614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:47.936305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.996609+0000","last_change":"2024-05-08T18:12:45.996672+0000","last_active":"2024-05-08T18:12:45.996609+0000","last_peered":"2024-05-08T18:12:45.996609+0000","last_clean":"2024-05-08T18:12:45.996609+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:12:45.996609+0000","last_undegraded":"2024-05-08T18:12:45.996609+0000","last_fullsized":"2024-05-08T18:12:45.996609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.996412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:16.909940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147354+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:12:14.147354+0000","last_peered":"2024-05-08T18:12:14.147354+0000","last_clean":"2024-05-08T18:12:14.147354+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:12:14.147354+0000","last_undegraded":"2024-05-08T18:12:14.147354+0000","last_fullsized":"2024-05-08T18:12:14.147354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.141960+0000","last_change":"2024-05-08T18:12:21.142014+0000","last_active":"2024-05-08T18:12:21.141960+0000","last_peered":"2024-05-08T18:12:21.141960+0000","last_clean":"2024-05-08T18:12:21.141960+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:12:21.141960+0000","last_undegraded":"2024-05-08T18:12:21.141960+0000","last_fullsized":"2024-05-08T18:12:21.141960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.141767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:55.879953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.861799+0000","last_change":"2024-05-08T18:12:14.861893+0000","last_active":"2024-05-08T18:12:14.861799+0000","last_peered":"2024-05-08T18:12:14.861799+0000","last_clean":"2024-05-08T18:12:14.861799+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:12:14.861799+0000","last_undegraded":"2024-05-08T18:12:14.861799+0000","last_fullsized":"2024-05-08T18:12:14.861799+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.861606+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:16.005518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":387,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.950811+0000","last_change":"2024-05-08T18:12:20.950874+0000","last_active":"2024-05-08T18:12:20.950811+0000","last_peered":"2024-05-08T18:12:20.950811+0000","last_clean":"2024-05-08T18:12:20.950811+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:20.950811+0000","last_undegraded":"2024-05-08T18:12:20.950811+0000","last_fullsized":"2024-05-08T18:12:20.950811+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.950610+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:59.485254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433778+0000","last_change":"2024-05-08T18:08:57.559589+0000","last_active":"2024-05-08T18:11:16.433778+0000","last_peered":"2024-05-08T18:11:16.433778+0000","last_clean":"2024-05-08T18:11:16.433778+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:11:16.433778+0000","last_undegraded":"2024-05-08T18:11:16.433778+0000","last_fullsized":"2024-05-08T18:11:16.433778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'5","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.148284+0000","last_change":"2024-05-08T18:08:49.510615+0000","last_active":"2024-05-08T18:12:14.148284+0000","last_peered":"2024-05-08T18:12:14.148284+0000","last_clean":"2024-05-08T18:12:14.148284+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:14.148284+0000","last_undegraded":"2024-05-08T18:12:14.148284+0000","last_fullsized":"2024-05-08T18:12:14.148284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429761+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:11:01.429761+0000","last_peered":"2024-05-08T18:11:01.429761+0000","last_clean":"2024-05-08T18:11:01.429761+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:11:01.429761+0000","last_undegraded":"2024-05-08T18:11:01.429761+0000","last_fullsized":"2024-05-08T18:11:01.429761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.416485+0000","last_change":"2024-05-08T18:08:39.434088+0000","last_active":"2024-05-08T18:10:51.416485+0000","last_peered":"2024-05-08T18:10:51.416485+0000","last_clean":"2024-05-08T18:10:51.416485+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:10:51.416485+0000","last_undegraded":"2024-05-08T18:10:51.416485+0000","last_fullsized":"2024-05-08T18:10:51.416485+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.151532+0000","last_change":"2024-05-08T18:12:20.151592+0000","last_active":"2024-05-08T18:12:20.151532+0000","last_peered":"2024-05-08T18:12:20.151532+0000","last_clean":"2024-05-08T18:12:20.151532+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:12:20.151532+0000","last_undegraded":"2024-05-08T18:12:20.151532+0000","last_fullsized":"2024-05-08T18:12:20.151532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.151323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:59.292712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.179360+0000","last_change":"2024-05-08T18:12:32.179559+0000","last_active":"2024-05-08T18:12:32.179360+0000","last_peered":"2024-05-08T18:12:32.179360+0000","last_clean":"2024-05-08T18:12:32.179360+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:12:32.179360+0000","last_undegraded":"2024-05-08T18:12:32.179360+0000","last_fullsized":"2024-05-08T18:12:32.179360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.179116+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:47.805125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":402,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.928638+0000","last_change":"2024-05-08T18:12:17.928706+0000","last_active":"2024-05-08T18:12:17.928638+0000","last_peered":"2024-05-08T18:12:17.928638+0000","last_clean":"2024-05-08T18:12:17.928638+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:17.928638+0000","last_undegraded":"2024-05-08T18:12:17.928638+0000","last_fullsized":"2024-05-08T18:12:17.928638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.928438+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:04.849778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431641+0000","last_change":"2024-05-08T18:08:57.573590+0000","last_active":"2024-05-08T18:11:16.431641+0000","last_peered":"2024-05-08T18:11:16.431641+0000","last_clean":"2024-05-08T18:11:16.431641+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:11:16.431641+0000","last_undegraded":"2024-05-08T18:11:16.431641+0000","last_fullsized":"2024-05-08T18:11:16.431641+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'1","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.860422+0000","last_change":"2024-05-08T18:09:28.589121+0000","last_active":"2024-05-08T18:12:02.860422+0000","last_peered":"2024-05-08T18:12:02.860422+0000","last_clean":"2024-05-08T18:12:02.860422+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:12:02.860422+0000","last_undegraded":"2024-05-08T18:12:02.860422+0000","last_fullsized":"2024-05-08T18:12:02.860422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427710+0000","last_change":"2024-05-08T18:08:47.512221+0000","last_active":"2024-05-08T18:11:01.427710+0000","last_peered":"2024-05-08T18:11:01.427710+0000","last_clean":"2024-05-08T18:11:01.427710+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:11:01.427710+0000","last_undegraded":"2024-05-08T18:11:01.427710+0000","last_fullsized":"2024-05-08T18:11:01.427710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:51.427193+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:10:51.427193+0000","last_peered":"2024-05-08T18:10:51.427193+0000","last_clean":"2024-05-08T18:10:51.427193+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:10:51.427193+0000","last_undegraded":"2024-05-08T18:10:51.427193+0000","last_fullsized":"2024-05-08T18:10:51.427193+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.124317+0000","last_change":"2024-05-08T18:12:19.124317+0000","last_active":"2024-05-08T18:12:19.124317+0000","last_peered":"2024-05-08T18:12:19.124317+0000","last_clean":"2024-05-08T18:12:19.124317+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:12:19.124317+0000","last_undegraded":"2024-05-08T18:12:19.124317+0000","last_fullsized":"2024-05-08T18:12:19.124317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.124051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.234930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.388737+0000","last_change":"2024-05-08T18:12:21.388830+0000","last_active":"2024-05-08T18:12:21.388737+0000","last_peered":"2024-05-08T18:12:21.388737+0000","last_clean":"2024-05-08T18:12:21.388737+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:12:21.388737+0000","last_undegraded":"2024-05-08T18:12:21.388737+0000","last_fullsized":"2024-05-08T18:12:21.388737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.388548+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:37.145916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":104,"num_read_kb":116,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.926185+0000","last_change":"2024-05-08T18:12:20.926349+0000","last_active":"2024-05-08T18:12:20.926185+0000","last_peered":"2024-05-08T18:12:20.926185+0000","last_clean":"2024-05-08T18:12:20.926185+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:12:20.926185+0000","last_undegraded":"2024-05-08T18:12:20.926185+0000","last_fullsized":"2024-05-08T18:12:20.926185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.925962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:11.385561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.400546+0000","last_change":"2024-05-08T18:12:31.400598+0000","last_active":"2024-05-08T18:12:31.400546+0000","last_peered":"2024-05-08T18:12:31.400546+0000","last_clean":"2024-05-08T18:12:31.400546+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:12:31.400546+0000","last_undegraded":"2024-05-08T18:12:31.400546+0000","last_fullsized":"2024-05-08T18:12:31.400546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.400333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428083+0000","last_change":"2024-05-08T18:08:57.586231+0000","last_active":"2024-05-08T18:11:06.428083+0000","last_peered":"2024-05-08T18:11:06.428083+0000","last_clean":"2024-05-08T18:11:06.428083+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:11:06.428083+0000","last_undegraded":"2024-05-08T18:11:06.428083+0000","last_fullsized":"2024-05-08T18:11:06.428083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.407512+0000","last_change":"2024-05-08T18:08:49.517973+0000","last_active":"2024-05-08T18:12:02.407512+0000","last_peered":"2024-05-08T18:12:02.407512+0000","last_clean":"2024-05-08T18:12:02.407512+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:12:02.407512+0000","last_undegraded":"2024-05-08T18:12:02.407512+0000","last_fullsized":"2024-05-08T18:12:02.407512+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432328+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:11:11.432328+0000","last_peered":"2024-05-08T18:11:11.432328+0000","last_clean":"2024-05-08T18:11:11.432328+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:11:11.432328+0000","last_undegraded":"2024-05-08T18:11:11.432328+0000","last_fullsized":"2024-05-08T18:11:11.432328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.851096+0000","last_change":"2024-05-08T18:12:29.851149+0000","last_active":"2024-05-08T18:12:29.851096+0000","last_peered":"2024-05-08T18:12:29.851096+0000","last_clean":"2024-05-08T18:12:29.851096+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:12:29.851096+0000","last_undegraded":"2024-05-08T18:12:29.851096+0000","last_fullsized":"2024-05-08T18:12:29.851096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.850896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:20.522178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.217183+0000","last_change":"2024-05-08T18:12:30.217266+0000","last_active":"2024-05-08T18:12:30.217183+0000","last_peered":"2024-05-08T18:12:30.217183+0000","last_clean":"2024-05-08T18:12:30.217183+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:12:30.217183+0000","last_undegraded":"2024-05-08T18:12:30.217183+0000","last_fullsized":"2024-05-08T18:12:30.217183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.216965+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:38.316991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.247738+0000","last_change":"2024-05-08T18:12:38.247800+0000","last_active":"2024-05-08T18:12:38.247738+0000","last_peered":"2024-05-08T18:12:38.247738+0000","last_clean":"2024-05-08T18:12:38.247738+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:12:38.247738+0000","last_undegraded":"2024-05-08T18:12:38.247738+0000","last_fullsized":"2024-05-08T18:12:38.247738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.247530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:52.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.993422+0000","last_change":"2024-05-08T18:12:36.993485+0000","last_active":"2024-05-08T18:12:36.993422+0000","last_peered":"2024-05-08T18:12:36.993422+0000","last_clean":"2024-05-08T18:12:36.993422+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:36.993422+0000","last_undegraded":"2024-05-08T18:12:36.993422+0000","last_fullsized":"2024-05-08T18:12:36.993422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.993231+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:16.134620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.741836+0000","last_change":"2024-05-08T18:12:39.741896+0000","last_active":"2024-05-08T18:12:39.741836+0000","last_peered":"2024-05-08T18:12:39.741836+0000","last_clean":"2024-05-08T18:12:39.741836+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:39.741836+0000","last_undegraded":"2024-05-08T18:12:39.741836+0000","last_fullsized":"2024-05-08T18:12:39.741836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.741610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:18.882999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.157000+0000","last_change":"2024-05-08T18:12:48.157066+0000","last_active":"2024-05-08T18:12:48.157000+0000","last_peered":"2024-05-08T18:12:48.157000+0000","last_clean":"2024-05-08T18:12:48.157000+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:12:48.157000+0000","last_undegraded":"2024-05-08T18:12:48.157000+0000","last_fullsized":"2024-05-08T18:12:48.157000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.156795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:10.267674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.087419+0000","last_change":"2024-05-08T18:12:18.087520+0000","last_active":"2024-05-08T18:12:18.087419+0000","last_peered":"2024-05-08T18:12:18.087419+0000","last_clean":"2024-05-08T18:12:18.087419+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:12:18.087419+0000","last_undegraded":"2024-05-08T18:12:18.087419+0000","last_fullsized":"2024-05-08T18:12:18.087419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.087194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:46.855336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.937017+0000","last_change":"2024-05-08T18:12:25.937087+0000","last_active":"2024-05-08T18:12:25.937017+0000","last_peered":"2024-05-08T18:12:25.937017+0000","last_clean":"2024-05-08T18:12:25.937017+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:25.937017+0000","last_undegraded":"2024-05-08T18:12:25.937017+0000","last_fullsized":"2024-05-08T18:12:25.937017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.936822+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:27.641008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.381154+0000","last_change":"2024-05-08T18:12:19.381207+0000","last_active":"2024-05-08T18:12:19.381154+0000","last_peered":"2024-05-08T18:12:19.381154+0000","last_clean":"2024-05-08T18:12:19.381154+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:12:19.381154+0000","last_undegraded":"2024-05-08T18:12:19.381154+0000","last_fullsized":"2024-05-08T18:12:19.381154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.380953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:58.173357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:31.426146+0000","last_change":"2024-05-08T18:08:57.565323+0000","last_active":"2024-05-08T18:11:31.426146+0000","last_peered":"2024-05-08T18:11:31.426146+0000","last_clean":"2024-05-08T18:11:31.426146+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:11:31.426146+0000","last_undegraded":"2024-05-08T18:11:31.426146+0000","last_fullsized":"2024-05-08T18:11:31.426146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.065668+0000","last_change":"2024-05-08T18:12:42.065832+0000","last_active":"2024-05-08T18:12:42.065668+0000","last_peered":"2024-05-08T18:12:42.065668+0000","last_clean":"2024-05-08T18:12:42.065668+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:42.065668+0000","last_undegraded":"2024-05-08T18:12:42.065668+0000","last_fullsized":"2024-05-08T18:12:42.065668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.065419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:56.828357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.430548+0000","last_change":"2024-05-08T18:08:47.513365+0000","last_active":"2024-05-08T18:11:16.430548+0000","last_peered":"2024-05-08T18:11:16.430548+0000","last_clean":"2024-05-08T18:11:16.430548+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:11:16.430548+0000","last_undegraded":"2024-05-08T18:11:16.430548+0000","last_fullsized":"2024-05-08T18:11:16.430548+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.402610+0000","last_change":"2024-05-08T18:12:30.402667+0000","last_active":"2024-05-08T18:12:30.402610+0000","last_peered":"2024-05-08T18:12:30.402610+0000","last_clean":"2024-05-08T18:12:30.402610+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:12:30.402610+0000","last_undegraded":"2024-05-08T18:12:30.402610+0000","last_fullsized":"2024-05-08T18:12:30.402610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.402404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:43.180000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.966072+0000","last_change":"2024-05-08T18:12:26.966151+0000","last_active":"2024-05-08T18:12:26.966072+0000","last_peered":"2024-05-08T18:12:26.966072+0000","last_clean":"2024-05-08T18:12:26.966072+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:26.966072+0000","last_undegraded":"2024-05-08T18:12:26.966072+0000","last_fullsized":"2024-05-08T18:12:26.966072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.965884+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:00.217219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.875467+0000","last_change":"2024-05-08T18:12:24.875520+0000","last_active":"2024-05-08T18:12:24.875467+0000","last_peered":"2024-05-08T18:12:24.875467+0000","last_clean":"2024-05-08T18:12:24.875467+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:12:24.875467+0000","last_undegraded":"2024-05-08T18:12:24.875467+0000","last_fullsized":"2024-05-08T18:12:24.875467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.875266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:18.218024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:31.437590+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:11:31.437590+0000","last_peered":"2024-05-08T18:11:31.437590+0000","last_clean":"2024-05-08T18:11:31.437590+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:11:31.437590+0000","last_undegraded":"2024-05-08T18:11:31.437590+0000","last_fullsized":"2024-05-08T18:11:31.437590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'18","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.372079+0000","last_change":"2024-05-08T18:12:51.372219+0000","last_active":"2024-05-08T18:12:51.372079+0000","last_peered":"2024-05-08T18:12:51.372079+0000","last_clean":"2024-05-08T18:12:51.372079+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:51.372079+0000","last_undegraded":"2024-05-08T18:12:51.372079+0000","last_fullsized":"2024-05-08T18:12:51.372079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.371857+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:17.691699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.749496+0000","last_change":"2024-05-08T18:08:47.495539+0000","last_active":"2024-05-08T18:12:02.749496+0000","last_peered":"2024-05-08T18:12:02.749496+0000","last_clean":"2024-05-08T18:12:02.749496+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:12:02.749496+0000","last_undegraded":"2024-05-08T18:12:02.749496+0000","last_fullsized":"2024-05-08T18:12:02.749496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.236640+0000","last_change":"2024-05-08T18:12:25.236698+0000","last_active":"2024-05-08T18:12:25.236640+0000","last_peered":"2024-05-08T18:12:25.236640+0000","last_clean":"2024-05-08T18:12:25.236640+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:12:25.236640+0000","last_undegraded":"2024-05-08T18:12:25.236640+0000","last_fullsized":"2024-05-08T18:12:25.236640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.236418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:39.999356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.379139+0000","last_change":"2024-05-08T18:12:29.379206+0000","last_active":"2024-05-08T18:12:29.379139+0000","last_peered":"2024-05-08T18:12:29.379139+0000","last_clean":"2024-05-08T18:12:29.379139+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:12:29.379139+0000","last_undegraded":"2024-05-08T18:12:29.379139+0000","last_fullsized":"2024-05-08T18:12:29.379139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.378957+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:54.199891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.349903+0000","last_change":"2024-05-08T18:12:18.349967+0000","last_active":"2024-05-08T18:12:18.349903+0000","last_peered":"2024-05-08T18:12:18.349903+0000","last_clean":"2024-05-08T18:12:18.349903+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:12:18.349903+0000","last_undegraded":"2024-05-08T18:12:18.349903+0000","last_fullsized":"2024-05-08T18:12:18.349903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.349704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:51.482256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428470+0000","last_change":"2024-05-08T18:08:49.510714+0000","last_active":"2024-05-08T18:10:56.428470+0000","last_peered":"2024-05-08T18:10:56.428470+0000","last_clean":"2024-05-08T18:10:56.428470+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:10:56.428470+0000","last_undegraded":"2024-05-08T18:10:56.428470+0000","last_fullsized":"2024-05-08T18:10:56.428470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433347+0000","last_change":"2024-05-08T18:08:47.516678+0000","last_active":"2024-05-08T18:11:16.433347+0000","last_peered":"2024-05-08T18:11:16.433347+0000","last_clean":"2024-05-08T18:11:16.433347+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:11:16.433347+0000","last_undegraded":"2024-05-08T18:11:16.433347+0000","last_fullsized":"2024-05-08T18:11:16.433347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.007168+0000","last_change":"2024-05-08T18:12:34.007168+0000","last_active":"2024-05-08T18:12:34.007168+0000","last_peered":"2024-05-08T18:12:34.007168+0000","last_clean":"2024-05-08T18:12:34.007168+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:12:34.007168+0000","last_undegraded":"2024-05-08T18:12:34.007168+0000","last_fullsized":"2024-05-08T18:12:34.007168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.006922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:48.199909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.921374+0000","last_change":"2024-05-08T18:12:23.921455+0000","last_active":"2024-05-08T18:12:23.921374+0000","last_peered":"2024-05-08T18:12:23.921374+0000","last_clean":"2024-05-08T18:12:23.921374+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:12:23.921374+0000","last_undegraded":"2024-05-08T18:12:23.921374+0000","last_fullsized":"2024-05-08T18:12:23.921374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.921184+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:20.672977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.376282+0000","last_change":"2024-05-08T18:12:17.376334+0000","last_active":"2024-05-08T18:12:17.376282+0000","last_peered":"2024-05-08T18:12:17.376282+0000","last_clean":"2024-05-08T18:12:17.376282+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:12:17.376282+0000","last_undegraded":"2024-05-08T18:12:17.376282+0000","last_fullsized":"2024-05-08T18:12:17.376282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.376083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:05.332746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.423897+0000","last_change":"2024-05-08T18:08:57.565259+0000","last_active":"2024-05-08T18:11:21.423897+0000","last_peered":"2024-05-08T18:11:21.423897+0000","last_clean":"2024-05-08T18:11:21.423897+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:11:21.423897+0000","last_undegraded":"2024-05-08T18:11:21.423897+0000","last_fullsized":"2024-05-08T18:11:21.423897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.773681+0000","last_change":"2024-05-08T18:08:49.500137+0000","last_active":"2024-05-08T18:12:12.773681+0000","last_peered":"2024-05-08T18:12:12.773681+0000","last_clean":"2024-05-08T18:12:12.773681+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:12:12.773681+0000","last_undegraded":"2024-05-08T18:12:12.773681+0000","last_fullsized":"2024-05-08T18:12:12.773681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431517+0000","last_change":"2024-05-08T18:08:47.514529+0000","last_active":"2024-05-08T18:11:16.431517+0000","last_peered":"2024-05-08T18:11:16.431517+0000","last_clean":"2024-05-08T18:11:16.431517+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:11:16.431517+0000","last_undegraded":"2024-05-08T18:11:16.431517+0000","last_fullsized":"2024-05-08T18:11:16.431517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.433486+0000","last_change":"2024-05-08T18:12:33.433631+0000","last_active":"2024-05-08T18:12:33.433486+0000","last_peered":"2024-05-08T18:12:33.433486+0000","last_clean":"2024-05-08T18:12:33.433486+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:12:33.433486+0000","last_undegraded":"2024-05-08T18:12:33.433486+0000","last_fullsized":"2024-05-08T18:12:33.433486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.433233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:26.348098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.224869+0000","last_change":"2024-05-08T18:12:24.225048+0000","last_active":"2024-05-08T18:12:24.224869+0000","last_peered":"2024-05-08T18:12:24.224869+0000","last_clean":"2024-05-08T18:12:24.224869+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:12:24.224869+0000","last_undegraded":"2024-05-08T18:12:24.224869+0000","last_fullsized":"2024-05-08T18:12:24.224869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.224613+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:07.517261+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.808449+0000","last_change":"2024-05-08T18:12:32.808508+0000","last_active":"2024-05-08T18:12:32.808449+0000","last_peered":"2024-05-08T18:12:32.808449+0000","last_clean":"2024-05-08T18:12:32.808449+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:12:32.808449+0000","last_undegraded":"2024-05-08T18:12:32.808449+0000","last_fullsized":"2024-05-08T18:12:32.808449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.808259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:00.027611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434778+0000","last_change":"2024-05-08T18:08:57.553775+0000","last_active":"2024-05-08T18:11:21.434778+0000","last_peered":"2024-05-08T18:11:21.434778+0000","last_clean":"2024-05-08T18:11:21.434778+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:11:21.434778+0000","last_undegraded":"2024-05-08T18:11:21.434778+0000","last_fullsized":"2024-05-08T18:11:21.434778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.224908+0000","last_change":"2024-05-08T18:12:29.224975+0000","last_active":"2024-05-08T18:12:29.224908+0000","last_peered":"2024-05-08T18:12:29.224908+0000","last_clean":"2024-05-08T18:12:29.224908+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:29.224908+0000","last_undegraded":"2024-05-08T18:12:29.224908+0000","last_fullsized":"2024-05-08T18:12:29.224908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.224718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:07.769843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.832136+0000","last_change":"2024-05-08T18:12:49.832203+0000","last_active":"2024-05-08T18:12:49.832136+0000","last_peered":"2024-05-08T18:12:49.832136+0000","last_clean":"2024-05-08T18:12:49.832136+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:12:49.832136+0000","last_undegraded":"2024-05-08T18:12:49.832136+0000","last_fullsized":"2024-05-08T18:12:49.832136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.831921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:42.570012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.431565+0000","last_change":"2024-05-08T18:09:28.594515+0000","last_active":"2024-05-08T18:11:21.431565+0000","last_peered":"2024-05-08T18:11:21.431565+0000","last_clean":"2024-05-08T18:11:21.431565+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:11:21.431565+0000","last_undegraded":"2024-05-08T18:11:21.431565+0000","last_fullsized":"2024-05-08T18:11:21.431565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:50.471881+0000","last_clean_scrub_stamp":"2024-05-08T18:08:50.471881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.008992+0000","last_change":"2024-05-08T18:12:28.009169+0000","last_active":"2024-05-08T18:12:28.008992+0000","last_peered":"2024-05-08T18:12:28.008992+0000","last_clean":"2024-05-08T18:12:28.008992+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:12:28.008992+0000","last_undegraded":"2024-05-08T18:12:28.008992+0000","last_fullsized":"2024-05-08T18:12:28.008992+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.008749+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:18.526961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.944164+0000","last_change":"2024-05-08T18:12:12.944203+0000","last_active":"2024-05-08T18:12:12.944164+0000","last_peered":"2024-05-08T18:12:12.944164+0000","last_clean":"2024-05-08T18:12:12.944164+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:12:12.944164+0000","last_undegraded":"2024-05-08T18:12:12.944164+0000","last_fullsized":"2024-05-08T18:12:12.944164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_clean_scrub_stamp":"2024-05-08T18:12:12.944077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:02.872453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434724+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:21.434724+0000","last_peered":"2024-05-08T18:11:21.434724+0000","last_clean":"2024-05-08T18:11:21.434724+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:21.434724+0000","last_undegraded":"2024-05-08T18:11:21.434724+0000","last_fullsized":"2024-05-08T18:11:21.434724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.021717+0000","last_change":"2024-05-08T18:12:47.021777+0000","last_active":"2024-05-08T18:12:47.021717+0000","last_peered":"2024-05-08T18:12:47.021717+0000","last_clean":"2024-05-08T18:12:47.021717+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:47.021717+0000","last_undegraded":"2024-05-08T18:12:47.021717+0000","last_fullsized":"2024-05-08T18:12:47.021717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.021499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:58.501866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434863+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:11:21.434863+0000","last_peered":"2024-05-08T18:11:21.434863+0000","last_clean":"2024-05-08T18:11:21.434863+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:11:21.434863+0000","last_undegraded":"2024-05-08T18:11:21.434863+0000","last_fullsized":"2024-05-08T18:11:21.434863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.880274+0000","last_change":"2024-05-08T18:12:26.880471+0000","last_active":"2024-05-08T18:12:26.880274+0000","last_peered":"2024-05-08T18:12:26.880274+0000","last_clean":"2024-05-08T18:12:26.880274+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:12:26.880274+0000","last_undegraded":"2024-05-08T18:12:26.880274+0000","last_fullsized":"2024-05-08T18:12:26.880274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.880045+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:45.838146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.373985+0000","last_change":"2024-05-08T18:12:43.374059+0000","last_active":"2024-05-08T18:12:43.373985+0000","last_peered":"2024-05-08T18:12:43.373985+0000","last_clean":"2024-05-08T18:12:43.373985+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:12:43.373985+0000","last_undegraded":"2024-05-08T18:12:43.373985+0000","last_fullsized":"2024-05-08T18:12:43.373985+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.373798+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:10.395570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":419,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.415074+0000","last_change":"2024-05-08T18:12:16.415136+0000","last_active":"2024-05-08T18:12:16.415074+0000","last_peered":"2024-05-08T18:12:16.415074+0000","last_clean":"2024-05-08T18:12:16.415074+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:16.415074+0000","last_undegraded":"2024-05-08T18:12:16.415074+0000","last_fullsized":"2024-05-08T18:12:16.415074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.414863+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:08.725122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434563+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:11:21.434563+0000","last_peered":"2024-05-08T18:11:21.434563+0000","last_clean":"2024-05-08T18:11:21.434563+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:11:21.434563+0000","last_undegraded":"2024-05-08T18:11:21.434563+0000","last_fullsized":"2024-05-08T18:11:21.434563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.343207+0000","last_change":"2024-05-08T18:12:39.343330+0000","last_active":"2024-05-08T18:12:39.343207+0000","last_peered":"2024-05-08T18:12:39.343207+0000","last_clean":"2024-05-08T18:12:39.343207+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:39.343207+0000","last_undegraded":"2024-05-08T18:12:39.343207+0000","last_fullsized":"2024-05-08T18:12:39.343207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.342952+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:30.014235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.432946+0000","last_change":"2024-05-08T18:08:47.491784+0000","last_active":"2024-05-08T18:11:21.432946+0000","last_peered":"2024-05-08T18:11:21.432946+0000","last_clean":"2024-05-08T18:11:21.432946+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:11:21.432946+0000","last_undegraded":"2024-05-08T18:11:21.432946+0000","last_fullsized":"2024-05-08T18:11:21.432946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.920218+0000","last_change":"2024-05-08T18:12:23.920309+0000","last_active":"2024-05-08T18:12:23.920218+0000","last_peered":"2024-05-08T18:12:23.920218+0000","last_clean":"2024-05-08T18:12:23.920218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:12:23.920218+0000","last_undegraded":"2024-05-08T18:12:23.920218+0000","last_fullsized":"2024-05-08T18:12:23.920218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.919920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:16.834786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.983706+0000","last_change":"2024-05-08T18:12:18.983908+0000","last_active":"2024-05-08T18:12:18.983706+0000","last_peered":"2024-05-08T18:12:18.983706+0000","last_clean":"2024-05-08T18:12:18.983706+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:12:18.983706+0000","last_undegraded":"2024-05-08T18:12:18.983706+0000","last_fullsized":"2024-05-08T18:12:18.983706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.983474+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:34.287333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.970884+0000","last_change":"2024-05-08T18:12:19.970940+0000","last_active":"2024-05-08T18:12:19.970884+0000","last_peered":"2024-05-08T18:12:19.970884+0000","last_clean":"2024-05-08T18:12:19.970884+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:12:19.970884+0000","last_undegraded":"2024-05-08T18:12:19.970884+0000","last_fullsized":"2024-05-08T18:12:19.970884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.970683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.981624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.434318+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:11:26.434318+0000","last_peered":"2024-05-08T18:11:26.434318+0000","last_clean":"2024-05-08T18:11:26.434318+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:11:26.434318+0000","last_undegraded":"2024-05-08T18:11:26.434318+0000","last_fullsized":"2024-05-08T18:11:26.434318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.327285+0000","last_change":"2024-05-08T18:12:41.327424+0000","last_active":"2024-05-08T18:12:41.327285+0000","last_peered":"2024-05-08T18:12:41.327285+0000","last_clean":"2024-05-08T18:12:41.327285+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:12:41.327285+0000","last_undegraded":"2024-05-08T18:12:41.327285+0000","last_fullsized":"2024-05-08T18:12:41.327285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.327063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:10.463865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.435003+0000","last_change":"2024-05-08T18:08:47.528745+0000","last_active":"2024-05-08T18:11:21.435003+0000","last_peered":"2024-05-08T18:11:21.435003+0000","last_clean":"2024-05-08T18:11:21.435003+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:11:21.435003+0000","last_undegraded":"2024-05-08T18:11:21.435003+0000","last_fullsized":"2024-05-08T18:11:21.435003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.364163+0000","last_change":"2024-05-08T18:12:36.364217+0000","last_active":"2024-05-08T18:12:36.364163+0000","last_peered":"2024-05-08T18:12:36.364163+0000","last_clean":"2024-05-08T18:12:36.364163+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:12:36.364163+0000","last_undegraded":"2024-05-08T18:12:36.364163+0000","last_fullsized":"2024-05-08T18:12:36.364163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.363969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:55.322070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.890367+0000","last_change":"2024-05-08T18:12:22.890449+0000","last_active":"2024-05-08T18:12:22.890367+0000","last_peered":"2024-05-08T18:12:22.890367+0000","last_clean":"2024-05-08T18:12:22.890367+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:12:22.890367+0000","last_undegraded":"2024-05-08T18:12:22.890367+0000","last_fullsized":"2024-05-08T18:12:22.890367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.890142+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:16.232900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.203727+0000","last_change":"2024-05-08T18:12:39.203783+0000","last_active":"2024-05-08T18:12:39.203727+0000","last_peered":"2024-05-08T18:12:39.203727+0000","last_clean":"2024-05-08T18:12:39.203727+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:12:39.203727+0000","last_undegraded":"2024-05-08T18:12:39.203727+0000","last_fullsized":"2024-05-08T18:12:39.203727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.203546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:58.173003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436379+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:11:26.436379+0000","last_peered":"2024-05-08T18:11:26.436379+0000","last_clean":"2024-05-08T18:11:26.436379+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:11:26.436379+0000","last_undegraded":"2024-05-08T18:11:26.436379+0000","last_fullsized":"2024-05-08T18:11:26.436379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.406974+0000","last_change":"2024-05-08T18:08:49.512357+0000","last_active":"2024-05-08T18:12:02.406974+0000","last_peered":"2024-05-08T18:12:02.406974+0000","last_clean":"2024-05-08T18:12:02.406974+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:02.406974+0000","last_undegraded":"2024-05-08T18:12:02.406974+0000","last_fullsized":"2024-05-08T18:12:02.406974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.062680+0000","last_change":"2024-05-08T18:12:48.062680+0000","last_active":"2024-05-08T18:12:48.062680+0000","last_peered":"2024-05-08T18:12:48.062680+0000","last_clean":"2024-05-08T18:12:48.062680+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:12:48.062680+0000","last_undegraded":"2024-05-08T18:12:48.062680+0000","last_fullsized":"2024-05-08T18:12:48.062680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.062295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:40.800386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.904352+0000","last_change":"2024-05-08T18:12:22.904406+0000","last_active":"2024-05-08T18:12:22.904352+0000","last_peered":"2024-05-08T18:12:22.904352+0000","last_clean":"2024-05-08T18:12:22.904352+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:12:22.904352+0000","last_undegraded":"2024-05-08T18:12:22.904352+0000","last_fullsized":"2024-05-08T18:12:22.904352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.904163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:55.812967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.406151+0000","last_change":"2024-05-08T18:12:45.406224+0000","last_active":"2024-05-08T18:12:45.406151+0000","last_peered":"2024-05-08T18:12:45.406151+0000","last_clean":"2024-05-08T18:12:45.406151+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:12:45.406151+0000","last_undegraded":"2024-05-08T18:12:45.406151+0000","last_fullsized":"2024-05-08T18:12:45.406151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.405952+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:51.199855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.249805+0000","last_change":"2024-05-08T18:12:40.249929+0000","last_active":"2024-05-08T18:12:40.249805+0000","last_peered":"2024-05-08T18:12:40.249805+0000","last_clean":"2024-05-08T18:12:40.249805+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:12:40.249805+0000","last_undegraded":"2024-05-08T18:12:40.249805+0000","last_fullsized":"2024-05-08T18:12:40.249805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.249448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:35.988004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436285+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:11:26.436285+0000","last_peered":"2024-05-08T18:11:26.436285+0000","last_clean":"2024-05-08T18:11:26.436285+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:11:26.436285+0000","last_undegraded":"2024-05-08T18:11:26.436285+0000","last_fullsized":"2024-05-08T18:11:26.436285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.407031+0000","last_change":"2024-05-08T18:12:37.407097+0000","last_active":"2024-05-08T18:12:37.407031+0000","last_peered":"2024-05-08T18:12:37.407031+0000","last_clean":"2024-05-08T18:12:37.407031+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:12:37.407031+0000","last_undegraded":"2024-05-08T18:12:37.407031+0000","last_fullsized":"2024-05-08T18:12:37.407031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.406836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:34.907082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.583327+0000","last_change":"2024-05-08T18:08:47.498035+0000","last_active":"2024-05-08T18:12:02.583327+0000","last_peered":"2024-05-08T18:12:02.583327+0000","last_clean":"2024-05-08T18:12:02.583327+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:12:02.583327+0000","last_undegraded":"2024-05-08T18:12:02.583327+0000","last_fullsized":"2024-05-08T18:12:02.583327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'5","reported_seq":233,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.805050+0000","last_change":"2024-05-08T18:12:31.805113+0000","last_active":"2024-05-08T18:12:31.805050+0000","last_peered":"2024-05-08T18:12:31.805050+0000","last_clean":"2024-05-08T18:12:31.805050+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:12:31.805050+0000","last_undegraded":"2024-05-08T18:12:31.805050+0000","last_fullsized":"2024-05-08T18:12:31.805050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.804855+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:00.941657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.253694+0000","last_change":"2024-05-08T18:12:28.253848+0000","last_active":"2024-05-08T18:12:28.253694+0000","last_peered":"2024-05-08T18:12:28.253694+0000","last_clean":"2024-05-08T18:12:28.253694+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:28.253694+0000","last_undegraded":"2024-05-08T18:12:28.253694+0000","last_fullsized":"2024-05-08T18:12:28.253694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.253447+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:30.579578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.869619+0000","last_change":"2024-05-08T18:12:15.869678+0000","last_active":"2024-05-08T18:12:15.869619+0000","last_peered":"2024-05-08T18:12:15.869619+0000","last_clean":"2024-05-08T18:12:15.869619+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:12:15.869619+0000","last_undegraded":"2024-05-08T18:12:15.869619+0000","last_fullsized":"2024-05-08T18:12:15.869619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.869387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:54.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434936+0000","last_change":"2024-05-08T18:08:57.560370+0000","last_active":"2024-05-08T18:11:21.434936+0000","last_peered":"2024-05-08T18:11:21.434936+0000","last_clean":"2024-05-08T18:11:21.434936+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:11:21.434936+0000","last_undegraded":"2024-05-08T18:11:21.434936+0000","last_fullsized":"2024-05-08T18:11:21.434936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.809004+0000","last_change":"2024-05-08T18:12:41.809070+0000","last_active":"2024-05-08T18:12:41.809004+0000","last_peered":"2024-05-08T18:12:41.809004+0000","last_clean":"2024-05-08T18:12:41.809004+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:12:41.809004+0000","last_undegraded":"2024-05-08T18:12:41.809004+0000","last_fullsized":"2024-05-08T18:12:41.809004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.808797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:14.047209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.424957+0000","last_change":"2024-05-08T18:08:47.510817+0000","last_active":"2024-05-08T18:10:56.424957+0000","last_peered":"2024-05-08T18:10:56.424957+0000","last_clean":"2024-05-08T18:10:56.424957+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:10:56.424957+0000","last_undegraded":"2024-05-08T18:10:56.424957+0000","last_fullsized":"2024-05-08T18:10:56.424957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.010727+0000","last_change":"2024-05-08T18:12:45.010893+0000","last_active":"2024-05-08T18:12:45.010727+0000","last_peered":"2024-05-08T18:12:45.010727+0000","last_clean":"2024-05-08T18:12:45.010727+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:12:45.010727+0000","last_undegraded":"2024-05-08T18:12:45.010727+0000","last_fullsized":"2024-05-08T18:12:45.010727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.010494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:42.271457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522644+0000","last_change":"2024-05-08T18:08:47.496722+0000","last_active":"2024-05-08T18:12:09.522644+0000","last_peered":"2024-05-08T18:12:09.522644+0000","last_clean":"2024-05-08T18:12:09.522644+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:12:09.522644+0000","last_undegraded":"2024-05-08T18:12:09.522644+0000","last_fullsized":"2024-05-08T18:12:09.522644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.251217+0000","last_change":"2024-05-08T18:12:35.251283+0000","last_active":"2024-05-08T18:12:35.251217+0000","last_peered":"2024-05-08T18:12:35.251217+0000","last_clean":"2024-05-08T18:12:35.251217+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:35.251217+0000","last_undegraded":"2024-05-08T18:12:35.251217+0000","last_fullsized":"2024-05-08T18:12:35.251217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.251012+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:51.414787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:10:56.428171+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:10:56.428171+0000","last_peered":"2024-05-08T18:10:56.428171+0000","last_clean":"2024-05-08T18:10:56.428171+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:10:56.428171+0000","last_undegraded":"2024-05-08T18:10:56.428171+0000","last_fullsized":"2024-05-08T18:10:56.428171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.057429+0000","last_change":"2024-05-08T18:12:49.057497+0000","last_active":"2024-05-08T18:12:49.057429+0000","last_peered":"2024-05-08T18:12:49.057429+0000","last_clean":"2024-05-08T18:12:49.057429+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:49.057429+0000","last_undegraded":"2024-05-08T18:12:49.057429+0000","last_fullsized":"2024-05-08T18:12:49.057429+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.057230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:48.903173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.591401+0000","last_change":"2024-05-08T18:08:47.515649+0000","last_active":"2024-05-08T18:12:02.591401+0000","last_peered":"2024-05-08T18:12:02.591401+0000","last_clean":"2024-05-08T18:12:02.591401+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:02.591401+0000","last_undegraded":"2024-05-08T18:12:02.591401+0000","last_fullsized":"2024-05-08T18:12:02.591401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.025845+0000","last_change":"2024-05-08T18:12:39.025905+0000","last_active":"2024-05-08T18:12:39.025845+0000","last_peered":"2024-05-08T18:12:39.025845+0000","last_clean":"2024-05-08T18:12:39.025845+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:39.025845+0000","last_undegraded":"2024-05-08T18:12:39.025845+0000","last_fullsized":"2024-05-08T18:12:39.025845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.025648+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:42.892114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.199458+0000","last_change":"2024-05-08T18:08:47.497513+0000","last_active":"2024-05-08T18:12:02.199458+0000","last_peered":"2024-05-08T18:12:02.199458+0000","last_clean":"2024-05-08T18:12:02.199458+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:12:02.199458+0000","last_undegraded":"2024-05-08T18:12:02.199458+0000","last_fullsized":"2024-05-08T18:12:02.199458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.727916+0000","last_change":"2024-05-08T18:12:38.727988+0000","last_active":"2024-05-08T18:12:38.727916+0000","last_peered":"2024-05-08T18:12:38.727916+0000","last_clean":"2024-05-08T18:12:38.727916+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:38.727916+0000","last_undegraded":"2024-05-08T18:12:38.727916+0000","last_fullsized":"2024-05-08T18:12:38.727916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.727710+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:00.838590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.427631+0000","last_change":"2024-05-08T18:08:47.512086+0000","last_active":"2024-05-08T18:11:01.427631+0000","last_peered":"2024-05-08T18:11:01.427631+0000","last_clean":"2024-05-08T18:11:01.427631+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:11:01.427631+0000","last_undegraded":"2024-05-08T18:11:01.427631+0000","last_fullsized":"2024-05-08T18:11:01.427631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.998309+0000","last_change":"2024-05-08T18:12:50.998374+0000","last_active":"2024-05-08T18:12:50.998309+0000","last_peered":"2024-05-08T18:12:50.998309+0000","last_clean":"2024-05-08T18:12:50.998309+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:50.998309+0000","last_undegraded":"2024-05-08T18:12:50.998309+0000","last_fullsized":"2024-05-08T18:12:50.998309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.998114+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:32.393869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.215705+0000","last_change":"2024-05-08T18:12:50.215826+0000","last_active":"2024-05-08T18:12:50.215705+0000","last_peered":"2024-05-08T18:12:50.215705+0000","last_clean":"2024-05-08T18:12:50.215705+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:12:50.215705+0000","last_undegraded":"2024-05-08T18:12:50.215705+0000","last_fullsized":"2024-05-08T18:12:50.215705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.215404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.132603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.839316+0000","last_change":"2024-05-08T18:12:45.839374+0000","last_active":"2024-05-08T18:12:45.839316+0000","last_peered":"2024-05-08T18:12:45.839316+0000","last_clean":"2024-05-08T18:12:45.839316+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:45.839316+0000","last_undegraded":"2024-05-08T18:12:45.839316+0000","last_fullsized":"2024-05-08T18:12:45.839316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.839123+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:31.725776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.020853+0000","last_change":"2024-05-08T18:12:50.020909+0000","last_active":"2024-05-08T18:12:50.020853+0000","last_peered":"2024-05-08T18:12:50.020853+0000","last_clean":"2024-05-08T18:12:50.020853+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:12:50.020853+0000","last_undegraded":"2024-05-08T18:12:50.020853+0000","last_fullsized":"2024-05-08T18:12:50.020853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.020646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:05.646654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.875510+0000","last_change":"2024-05-08T18:12:50.875573+0000","last_active":"2024-05-08T18:12:50.875510+0000","last_peered":"2024-05-08T18:12:50.875510+0000","last_clean":"2024-05-08T18:12:50.875510+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:12:50.875510+0000","last_undegraded":"2024-05-08T18:12:50.875510+0000","last_fullsized":"2024-05-08T18:12:50.875510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.875317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:27.743465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:01.429284+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:11:01.429284+0000","last_peered":"2024-05-08T18:11:01.429284+0000","last_clean":"2024-05-08T18:11:01.429284+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:11:01.429284+0000","last_undegraded":"2024-05-08T18:11:01.429284+0000","last_fullsized":"2024-05-08T18:11:01.429284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.220124+0000","last_change":"2024-05-08T18:12:33.220189+0000","last_active":"2024-05-08T18:12:33.220124+0000","last_peered":"2024-05-08T18:12:33.220124+0000","last_clean":"2024-05-08T18:12:33.220124+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:33.220124+0000","last_undegraded":"2024-05-08T18:12:33.220124+0000","last_fullsized":"2024-05-08T18:12:33.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.219930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:14.615685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.420190+0000","last_change":"2024-05-08T18:08:47.515074+0000","last_active":"2024-05-08T18:11:06.420190+0000","last_peered":"2024-05-08T18:11:06.420190+0000","last_clean":"2024-05-08T18:11:06.420190+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:11:06.420190+0000","last_undegraded":"2024-05-08T18:11:06.420190+0000","last_fullsized":"2024-05-08T18:11:06.420190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.027422+0000","last_change":"2024-05-08T18:12:40.027487+0000","last_active":"2024-05-08T18:12:40.027422+0000","last_peered":"2024-05-08T18:12:40.027422+0000","last_clean":"2024-05-08T18:12:40.027422+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:40.027422+0000","last_undegraded":"2024-05-08T18:12:40.027422+0000","last_fullsized":"2024-05-08T18:12:40.027422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.027216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:32.648602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.817845+0000","last_change":"2024-05-08T18:12:47.817910+0000","last_active":"2024-05-08T18:12:47.817845+0000","last_peered":"2024-05-08T18:12:47.817845+0000","last_clean":"2024-05-08T18:12:47.817845+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:12:47.817845+0000","last_undegraded":"2024-05-08T18:12:47.817845+0000","last_fullsized":"2024-05-08T18:12:47.817845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.817632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:45.078595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.780037+0000","last_change":"2024-05-08T18:12:42.780098+0000","last_active":"2024-05-08T18:12:42.780037+0000","last_peered":"2024-05-08T18:12:42.780037+0000","last_clean":"2024-05-08T18:12:42.780037+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:42.780037+0000","last_undegraded":"2024-05-08T18:12:42.780037+0000","last_fullsized":"2024-05-08T18:12:42.780037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.779853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:09.011513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428832+0000","last_change":"2024-05-08T18:08:47.513204+0000","last_active":"2024-05-08T18:11:06.428832+0000","last_peered":"2024-05-08T18:11:06.428832+0000","last_clean":"2024-05-08T18:11:06.428832+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:11:06.428832+0000","last_undegraded":"2024-05-08T18:11:06.428832+0000","last_fullsized":"2024-05-08T18:11:06.428832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.816652+0000","last_change":"2024-05-08T18:12:34.816815+0000","last_active":"2024-05-08T18:12:34.816652+0000","last_peered":"2024-05-08T18:12:34.816652+0000","last_clean":"2024-05-08T18:12:34.816652+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:12:34.816652+0000","last_undegraded":"2024-05-08T18:12:34.816652+0000","last_fullsized":"2024-05-08T18:12:34.816652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.816409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:36.991987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.558269+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.558269+0000","last_peered":"2024-05-08T18:12:02.558269+0000","last_clean":"2024-05-08T18:12:02.558269+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.558269+0000","last_undegraded":"2024-05-08T18:12:02.558269+0000","last_fullsized":"2024-05-08T18:12:02.558269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.428784+0000","last_change":"2024-05-08T18:08:49.499082+0000","last_active":"2024-05-08T18:11:06.428784+0000","last_peered":"2024-05-08T18:11:06.428784+0000","last_clean":"2024-05-08T18:11:06.428784+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:11:06.428784+0000","last_undegraded":"2024-05-08T18:11:06.428784+0000","last_fullsized":"2024-05-08T18:11:06.428784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430920+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:11:06.430920+0000","last_peered":"2024-05-08T18:11:06.430920+0000","last_clean":"2024-05-08T18:11:06.430920+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:11:06.430920+0000","last_undegraded":"2024-05-08T18:11:06.430920+0000","last_fullsized":"2024-05-08T18:11:06.430920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430721+0000","last_change":"2024-05-08T18:08:49.507865+0000","last_active":"2024-05-08T18:11:06.430721+0000","last_peered":"2024-05-08T18:11:06.430721+0000","last_clean":"2024-05-08T18:11:06.430721+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:11:06.430721+0000","last_undegraded":"2024-05-08T18:11:06.430721+0000","last_fullsized":"2024-05-08T18:11:06.430721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.351552+0000","last_change":"2024-05-08T18:12:40.351619+0000","last_active":"2024-05-08T18:12:40.351552+0000","last_peered":"2024-05-08T18:12:40.351552+0000","last_clean":"2024-05-08T18:12:40.351552+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:40.351552+0000","last_undegraded":"2024-05-08T18:12:40.351552+0000","last_fullsized":"2024-05-08T18:12:40.351552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.351359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:49.624570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.826935+0000","last_change":"2024-05-08T18:12:46.826997+0000","last_active":"2024-05-08T18:12:46.826935+0000","last_peered":"2024-05-08T18:12:46.826935+0000","last_clean":"2024-05-08T18:12:46.826935+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:12:46.826935+0000","last_undegraded":"2024-05-08T18:12:46.826935+0000","last_fullsized":"2024-05-08T18:12:46.826935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.826741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:51.665811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521508+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:12:09.521508+0000","last_peered":"2024-05-08T18:12:09.521508+0000","last_clean":"2024-05-08T18:12:09.521508+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:12:09.521508+0000","last_undegraded":"2024-05-08T18:12:09.521508+0000","last_fullsized":"2024-05-08T18:12:09.521508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432043+0000","last_change":"2024-05-08T18:08:47.516126+0000","last_active":"2024-05-08T18:11:11.432043+0000","last_peered":"2024-05-08T18:11:11.432043+0000","last_clean":"2024-05-08T18:11:11.432043+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:11:11.432043+0000","last_undegraded":"2024-05-08T18:11:11.432043+0000","last_fullsized":"2024-05-08T18:11:11.432043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422870+0000","last_change":"2024-05-08T18:08:49.501282+0000","last_active":"2024-05-08T18:11:16.422870+0000","last_peered":"2024-05-08T18:11:16.422870+0000","last_clean":"2024-05-08T18:11:16.422870+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:11:16.422870+0000","last_undegraded":"2024-05-08T18:11:16.422870+0000","last_fullsized":"2024-05-08T18:11:16.422870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.421370+0000","last_change":"2024-05-08T18:08:47.515944+0000","last_active":"2024-05-08T18:11:11.421370+0000","last_peered":"2024-05-08T18:11:11.421370+0000","last_clean":"2024-05-08T18:11:11.421370+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:11:11.421370+0000","last_undegraded":"2024-05-08T18:11:11.421370+0000","last_fullsized":"2024-05-08T18:11:11.421370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431757+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:11:16.431757+0000","last_peered":"2024-05-08T18:11:16.431757+0000","last_clean":"2024-05-08T18:11:16.431757+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:11:16.431757+0000","last_undegraded":"2024-05-08T18:11:16.431757+0000","last_fullsized":"2024-05-08T18:11:16.431757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705720,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":145208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705720,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705719,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335504,"statfs":{"total":96636764160,"available":96599556096,"internally_reserved":0,"allocated":1024000,"data_stored":735055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705720,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":144761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:12:55.409 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.409 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.409 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.409 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.410 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.411 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.412 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.413 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.413 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.413 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.413 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.413 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.413 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.414 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T18:08:32.327398+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=32, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.415 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T18:08:54.498163+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=54, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.416 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.417 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.418 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T18:08:50.471881+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=50, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.419 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.420 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.421 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.422 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.423 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.423 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.423 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.423 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:12:55.423 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:13:15.424 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:13:15.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.553+0000 7f0daf9c3640 1 Processor -- start 2024-05-08T18:13:15.557 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.553+0000 7f0daf9c3640 1 -- start start 2024-05-08T18:13:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0daf9c3640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f0da812f4f0 0x7f0da81318e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0daf9c3640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0da8070940 con 0x7f0da812c720 2024-05-08T18:13:15.558 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0daf9c3640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f0da8113d70 con 0x7f0da812f4f0 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0dad75f640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f0da812c720 0x7f0da812cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:53638/0 (socket says 172.21.15.53:53638) 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0dad75f640 1 -- 172.21.15.53:0/2446908127 learned_addr learned my addr 172.21.15.53:0/2446908127 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0dacf5e640 1 --2- 172.21.15.53:0/2446908127 >> v2:172.21.15.53:3300/0 conn(0x7f0da812f4f0 0x7f0da81318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0d9bfff640 1 -- 172.21.15.53:0/2446908127 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954080960 0 0) 0x7f0da8070940 con 0x7f0da812c720 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0d9bfff640 1 -- 172.21.15.53:0/2446908127 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d94003530 con 0x7f0da812c720 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0dacf5e640 1 -- 172.21.15.53:0/2446908127 >> v1:172.21.15.53:6789/0 conn(0x7f0da812c720 legacy=0x7f0da812cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:15.559 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0dacf5e640 1 -- 172.21.15.53:0/2446908127 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da809e250 con 0x7f0da812f4f0 2024-05-08T18:13:15.560 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0dacf5e640 1 --2- 172.21.15.53:0/2446908127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812f4f0 0x7f0da81318e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009740 tx=0x7f0da401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169b71e8143cd6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0d9bfff640 1 -- 172.21.15.53:0/2446908127 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da40b0070 con 0x7f0da812f4f0 2024-05-08T18:13:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0d9bfff640 1 -- 172.21.15.53:0/2446908127 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0da40ab530 con 0x7f0da812f4f0 2024-05-08T18:13:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.557+0000 7f0d9bfff640 1 -- 172.21.15.53:0/2446908127 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0da40ab830 con 0x7f0da812f4f0 2024-05-08T18:13:15.561 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2446908127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812f4f0 msgr2=0x7f0da81318e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 --2- 172.21.15.53:0/2446908127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812f4f0 0x7f0da81318e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0da4009740 tx=0x7f0da401c370 comp rx=0 tx=0).stop 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2446908127 shutdown_connections 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 --2- 172.21.15.53:0/2446908127 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812f4f0 0x7f0da81318e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2446908127 >> 172.21.15.53:0/2446908127 conn(0x7f0da809be60 msgr2=0x7f0da809d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2446908127 shutdown_connections 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2446908127 wait complete. 2024-05-08T18:13:15.562 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 Processor -- start 2024-05-08T18:13:15.563 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- start start 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 0x7f0da8114010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f0da81347c0 con 0x7f0da812c720 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0dad75f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 0x7f0da8114010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0dad75f640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 0x7f0da8114010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:46468/0 (socket says 172.21.15.53:46468) 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0dad75f640 1 -- 172.21.15.53:0/2994114113 learned_addr learned my addr 172.21.15.53:0/2994114113 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0dad75f640 1 -- 172.21.15.53:0/2994114113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da8128ac0 con 0x7f0da812c720 2024-05-08T18:13:15.564 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0dad75f640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 0x7f0da8114010 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00c450 tx=0x7f0d9c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d9c017070 con 0x7f0da812c720 2024-05-08T18:13:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d9c005ce0 con 0x7f0da812c720 2024-05-08T18:13:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da81158c0 con 0x7f0da812c720 2024-05-08T18:13:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d9c007200 con 0x7f0da812c720 2024-05-08T18:13:15.565 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da8114550 con 0x7f0da812c720 2024-05-08T18:13:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f0d9c01a070 con 0x7f0da812c720 2024-05-08T18:13:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.561+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da8064150 con 0x7f0da812c720 2024-05-08T18:13:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.565+0000 7f0d99ffb640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d8c039b50 0x7f0d8c03c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.565+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f0d9c04cff0 con 0x7f0da812c720 2024-05-08T18:13:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.565+0000 7f0dacf5e640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d8c039b50 0x7f0d8c03c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:15.566 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.565+0000 7f0dacf5e640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d8c039b50 0x7f0d8c03c010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0da40ad000 tx=0x7f0da40a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:15.570 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.569+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0d9c04b3d0 con 0x7f0da812c720 2024-05-08T18:13:15.731 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.729+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0da806e850 con 0x7f0d8c039b50 2024-05-08T18:13:15.776 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.773+0000 7f0d99ffb640 1 -- 172.21.15.53:0/2994114113 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664655 (secure 0 0 0) 0x7f0da806e850 con 0x7f0d8c039b50 2024-05-08T18:13:15.779 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:13:15.789 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d8c039b50 msgr2=0x7f0d8c03c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d8c039b50 0x7f0d8c03c010 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0da40ad000 tx=0x7f0da40a6000 comp rx=0 tx=0).stop 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 msgr2=0x7f0da8114010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 0x7f0da8114010 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00c450 tx=0x7f0d9c00c910 comp rx=0 tx=0).stop 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 shutdown_connections 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f0d8c039b50 0x7f0d8c03c010 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 --2- 172.21.15.53:0/2994114113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0da812c720 0x7f0da8114010 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 >> 172.21.15.53:0/2994114113 conn(0x7f0da809be60 msgr2=0x7f0da8129f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 shutdown_connections 2024-05-08T18:13:15.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:15.785+0000 7f0daf9c3640 1 -- 172.21.15.53:0/2994114113 wait complete. 2024-05-08T18:13:15.808 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-05-08T18:13:15.444418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603093,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5068,"num_read_kb":4654,"num_write":2121,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4742,"ondisk_log_size":4742,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1758306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006529"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.248061+0000","last_change":"2024-05-08T18:12:56.248061+0000","last_active":"2024-05-08T18:12:56.248061+0000","last_peered":"2024-05-08T18:12:56.248061+0000","last_clean":"2024-05-08T18:12:56.248061+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:12:56.248061+0000","last_undegraded":"2024-05-08T18:12:56.248061+0000","last_fullsized":"2024-05-08T18:12:56.248061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:56.247806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:56.247806+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.247806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:01.086876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.892197+0000","last_change":"2024-05-08T18:13:06.892256+0000","last_active":"2024-05-08T18:13:06.892197+0000","last_peered":"2024-05-08T18:13:06.892197+0000","last_clean":"2024-05-08T18:13:06.892197+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:13:06.892197+0000","last_undegraded":"2024-05-08T18:13:06.892197+0000","last_fullsized":"2024-05-08T18:13:06.892197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:13:06.892004+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:13:06.892004+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.892004+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:39.749902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.040493+0000","last_change":"2024-05-08T18:12:44.040493+0000","last_active":"2024-05-08T18:12:44.040493+0000","last_peered":"2024-05-08T18:12:44.040493+0000","last_clean":"2024-05-08T18:12:44.040493+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:12:44.040493+0000","last_undegraded":"2024-05-08T18:12:44.040493+0000","last_fullsized":"2024-05-08T18:12:44.040493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.040231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:27.160502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.148333+0000","last_change":"2024-05-08T18:13:05.148393+0000","last_active":"2024-05-08T18:13:05.148333+0000","last_peered":"2024-05-08T18:13:05.148333+0000","last_clean":"2024-05-08T18:13:05.148333+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:13:05.148333+0000","last_undegraded":"2024-05-08T18:13:05.148333+0000","last_fullsized":"2024-05-08T18:13:05.148333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:05.148127+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:05.148127+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.148127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:11.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.238634+0000","last_change":"2024-05-08T18:13:07.238700+0000","last_active":"2024-05-08T18:13:07.238634+0000","last_peered":"2024-05-08T18:13:07.238634+0000","last_clean":"2024-05-08T18:13:07.238634+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:13:07.238634+0000","last_undegraded":"2024-05-08T18:13:07.238634+0000","last_fullsized":"2024-05-08T18:13:07.238634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:07.238421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:07.238421+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.238421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:03.039607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.399421+0000","last_change":"2024-05-08T18:12:50.399487+0000","last_active":"2024-05-08T18:12:50.399421+0000","last_peered":"2024-05-08T18:12:50.399421+0000","last_clean":"2024-05-08T18:12:50.399421+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:50.399421+0000","last_undegraded":"2024-05-08T18:12:50.399421+0000","last_fullsized":"2024-05-08T18:12:50.399421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.399205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:56.807281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.232589+0000","last_change":"2024-05-08T18:12:54.232650+0000","last_active":"2024-05-08T18:12:54.232589+0000","last_peered":"2024-05-08T18:12:54.232589+0000","last_clean":"2024-05-08T18:12:54.232589+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:12:54.232589+0000","last_undegraded":"2024-05-08T18:12:54.232589+0000","last_fullsized":"2024-05-08T18:12:54.232589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:54.232364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:54.232364+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.232364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:08.995302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.207777+0000","last_change":"2024-05-08T18:12:31.207848+0000","last_active":"2024-05-08T18:12:31.207777+0000","last_peered":"2024-05-08T18:12:31.207777+0000","last_clean":"2024-05-08T18:12:31.207777+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:12:31.207777+0000","last_undegraded":"2024-05-08T18:12:31.207777+0000","last_fullsized":"2024-05-08T18:12:31.207777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.207573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:31.053515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434887+0000","last_change":"2024-05-08T18:08:47.508486+0000","last_active":"2024-05-08T18:11:21.434887+0000","last_peered":"2024-05-08T18:11:21.434887+0000","last_clean":"2024-05-08T18:11:21.434887+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:11:21.434887+0000","last_undegraded":"2024-05-08T18:11:21.434887+0000","last_fullsized":"2024-05-08T18:11:21.434887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.850755+0000","last_change":"2024-05-08T18:12:48.850755+0000","last_active":"2024-05-08T18:12:48.850755+0000","last_peered":"2024-05-08T18:12:48.850755+0000","last_clean":"2024-05-08T18:12:48.850755+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:12:48.850755+0000","last_undegraded":"2024-05-08T18:12:48.850755+0000","last_fullsized":"2024-05-08T18:12:48.850755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.850265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:19.763792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.266763+0000","last_change":"2024-05-08T18:12:44.266831+0000","last_active":"2024-05-08T18:12:44.266763+0000","last_peered":"2024-05-08T18:12:44.266763+0000","last_clean":"2024-05-08T18:12:44.266763+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:12:44.266763+0000","last_undegraded":"2024-05-08T18:12:44.266763+0000","last_fullsized":"2024-05-08T18:12:44.266763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.266562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:46.442140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.367754+0000","last_change":"2024-05-08T18:12:54.367754+0000","last_active":"2024-05-08T18:12:54.367754+0000","last_peered":"2024-05-08T18:12:54.367754+0000","last_clean":"2024-05-08T18:12:54.367754+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:54.367754+0000","last_undegraded":"2024-05-08T18:12:54.367754+0000","last_fullsized":"2024-05-08T18:12:54.367754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:54.367506+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:54.367506+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.367506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:00.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434699+0000","last_change":"2024-05-08T18:08:47.497449+0000","last_active":"2024-05-08T18:11:21.434699+0000","last_peered":"2024-05-08T18:11:21.434699+0000","last_clean":"2024-05-08T18:11:21.434699+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:11:21.434699+0000","last_undegraded":"2024-05-08T18:11:21.434699+0000","last_fullsized":"2024-05-08T18:11:21.434699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.309526+0000","last_change":"2024-05-08T18:12:43.309526+0000","last_active":"2024-05-08T18:12:43.309526+0000","last_peered":"2024-05-08T18:12:43.309526+0000","last_clean":"2024-05-08T18:12:43.309526+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:43.309526+0000","last_undegraded":"2024-05-08T18:12:43.309526+0000","last_fullsized":"2024-05-08T18:12:43.309526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.309244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:57.449936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.942337+0000","last_change":"2024-05-08T18:13:03.942401+0000","last_active":"2024-05-08T18:13:03.942337+0000","last_peered":"2024-05-08T18:13:03.942337+0000","last_clean":"2024-05-08T18:13:03.942337+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:13:03.942337+0000","last_undegraded":"2024-05-08T18:13:03.942337+0000","last_fullsized":"2024-05-08T18:13:03.942337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:03.942113+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:03.942113+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.942113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:13.921262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.193621+0000","last_change":"2024-05-08T18:12:51.193621+0000","last_active":"2024-05-08T18:12:51.193621+0000","last_peered":"2024-05-08T18:12:51.193621+0000","last_clean":"2024-05-08T18:12:51.193621+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:51.193621+0000","last_undegraded":"2024-05-08T18:12:51.193621+0000","last_fullsized":"2024-05-08T18:12:51.193621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.193346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:23.431759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.261460+0000","last_change":"2024-05-08T18:13:02.261543+0000","last_active":"2024-05-08T18:13:02.261460+0000","last_peered":"2024-05-08T18:13:02.261460+0000","last_clean":"2024-05-08T18:13:02.261460+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:13:02.261460+0000","last_undegraded":"2024-05-08T18:13:02.261460+0000","last_fullsized":"2024-05-08T18:13:02.261460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:02.261275+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:02.261275+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.261275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:36.032032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.908511+0000","last_change":"2024-05-08T18:13:04.908577+0000","last_active":"2024-05-08T18:13:04.908511+0000","last_peered":"2024-05-08T18:13:04.908511+0000","last_clean":"2024-05-08T18:13:04.908511+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:13:04.908511+0000","last_undegraded":"2024-05-08T18:13:04.908511+0000","last_fullsized":"2024-05-08T18:13:04.908511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:04.908272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:04.908272+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.908272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:42.262211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.798635+0000","last_change":"2024-05-08T18:12:56.798700+0000","last_active":"2024-05-08T18:12:56.798635+0000","last_peered":"2024-05-08T18:12:56.798635+0000","last_clean":"2024-05-08T18:12:56.798635+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:56.798635+0000","last_undegraded":"2024-05-08T18:12:56.798635+0000","last_fullsized":"2024-05-08T18:12:56.798635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:56.798384+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:56.798384+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.798384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:56.254807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.180024+0000","last_change":"2024-05-08T18:12:59.180081+0000","last_active":"2024-05-08T18:12:59.180024+0000","last_peered":"2024-05-08T18:12:59.180024+0000","last_clean":"2024-05-08T18:12:59.180024+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:12:59.180024+0000","last_undegraded":"2024-05-08T18:12:59.180024+0000","last_fullsized":"2024-05-08T18:12:59.180024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.179832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.179832+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.179832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:07.279858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.778773+0000","last_change":"2024-05-08T18:12:54.778832+0000","last_active":"2024-05-08T18:12:54.778773+0000","last_peered":"2024-05-08T18:12:54.778773+0000","last_clean":"2024-05-08T18:12:54.778773+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:12:54.778773+0000","last_undegraded":"2024-05-08T18:12:54.778773+0000","last_fullsized":"2024-05-08T18:12:54.778773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:54.778578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:54.778578+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.778578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:40.040820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.823551+0000","last_change":"2024-05-08T18:12:53.823607+0000","last_active":"2024-05-08T18:12:53.823551+0000","last_peered":"2024-05-08T18:12:53.823551+0000","last_clean":"2024-05-08T18:12:53.823551+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:12:53.823551+0000","last_undegraded":"2024-05-08T18:12:53.823551+0000","last_fullsized":"2024-05-08T18:12:53.823551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:53.823360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:53.823360+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.823360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:44.187535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.422714+0000","last_change":"2024-05-08T18:09:28.612178+0000","last_active":"2024-05-08T18:11:16.422714+0000","last_peered":"2024-05-08T18:11:16.422714+0000","last_clean":"2024-05-08T18:11:16.422714+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:11:16.422714+0000","last_undegraded":"2024-05-08T18:11:16.422714+0000","last_fullsized":"2024-05-08T18:11:16.422714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.819076+0000","last_change":"2024-05-08T18:13:01.819143+0000","last_active":"2024-05-08T18:13:01.819076+0000","last_peered":"2024-05-08T18:13:01.819076+0000","last_clean":"2024-05-08T18:13:01.819076+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:13:01.819076+0000","last_undegraded":"2024-05-08T18:13:01.819076+0000","last_fullsized":"2024-05-08T18:13:01.819076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:13:01.818889+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:13:01.818889+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.818889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:36.102569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.206865+0000","last_change":"2024-05-08T18:12:49.206927+0000","last_active":"2024-05-08T18:12:49.206865+0000","last_peered":"2024-05-08T18:12:49.206865+0000","last_clean":"2024-05-08T18:12:49.206865+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:49.206865+0000","last_undegraded":"2024-05-08T18:12:49.206865+0000","last_fullsized":"2024-05-08T18:12:49.206865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.206666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.348056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.885478+0000","last_change":"2024-05-08T18:13:05.885545+0000","last_active":"2024-05-08T18:13:05.885478+0000","last_peered":"2024-05-08T18:13:05.885478+0000","last_clean":"2024-05-08T18:13:05.885478+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:13:05.885478+0000","last_undegraded":"2024-05-08T18:13:05.885478+0000","last_fullsized":"2024-05-08T18:13:05.885478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:05.885279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:05.885279+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.885279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:38.337159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.820924+0000","last_change":"2024-05-08T18:12:43.820989+0000","last_active":"2024-05-08T18:12:43.820924+0000","last_peered":"2024-05-08T18:12:43.820924+0000","last_clean":"2024-05-08T18:12:43.820924+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:12:43.820924+0000","last_undegraded":"2024-05-08T18:12:43.820924+0000","last_fullsized":"2024-05-08T18:12:43.820924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.820707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:27.113355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.522345+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:12:09.522345+0000","last_peered":"2024-05-08T18:12:09.522345+0000","last_clean":"2024-05-08T18:12:09.522345+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:12:09.522345+0000","last_undegraded":"2024-05-08T18:12:09.522345+0000","last_fullsized":"2024-05-08T18:12:09.522345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.861935+0000","last_change":"2024-05-08T18:13:07.861997+0000","last_active":"2024-05-08T18:13:07.861935+0000","last_peered":"2024-05-08T18:13:07.861935+0000","last_clean":"2024-05-08T18:13:07.861935+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:13:07.861935+0000","last_undegraded":"2024-05-08T18:13:07.861935+0000","last_fullsized":"2024-05-08T18:13:07.861935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:13:07.861737+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:13:07.861737+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.861737+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:40.313616+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.234796+0000","last_change":"2024-05-08T18:12:37.234862+0000","last_active":"2024-05-08T18:12:37.234796+0000","last_peered":"2024-05-08T18:12:37.234796+0000","last_clean":"2024-05-08T18:12:37.234796+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:37.234796+0000","last_undegraded":"2024-05-08T18:12:37.234796+0000","last_fullsized":"2024-05-08T18:12:37.234796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.234593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:20.089848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432270+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:11:11.432270+0000","last_peered":"2024-05-08T18:11:11.432270+0000","last_clean":"2024-05-08T18:11:11.432270+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:11:11.432270+0000","last_undegraded":"2024-05-08T18:11:11.432270+0000","last_fullsized":"2024-05-08T18:11:11.432270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.174115+0000","last_change":"2024-05-08T18:12:23.174172+0000","last_active":"2024-05-08T18:12:23.174115+0000","last_peered":"2024-05-08T18:12:23.174115+0000","last_clean":"2024-05-08T18:12:23.174115+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:12:23.174115+0000","last_undegraded":"2024-05-08T18:12:23.174115+0000","last_fullsized":"2024-05-08T18:12:23.174115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.173919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:15.795305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.265666+0000","last_change":"2024-05-08T18:12:36.265809+0000","last_active":"2024-05-08T18:12:36.265666+0000","last_peered":"2024-05-08T18:12:36.265666+0000","last_clean":"2024-05-08T18:12:36.265666+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:12:36.265666+0000","last_undegraded":"2024-05-08T18:12:36.265666+0000","last_fullsized":"2024-05-08T18:12:36.265666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.265414+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:04.357749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.877627+0000","last_change":"2024-05-08T18:12:13.877680+0000","last_active":"2024-05-08T18:12:13.877627+0000","last_peered":"2024-05-08T18:12:13.877627+0000","last_clean":"2024-05-08T18:12:13.877627+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:12:13.877627+0000","last_undegraded":"2024-05-08T18:12:13.877627+0000","last_fullsized":"2024-05-08T18:12:13.877627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.877412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:24.163300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.726142+0000","last_change":"2024-05-08T18:12:36.726229+0000","last_active":"2024-05-08T18:12:36.726142+0000","last_peered":"2024-05-08T18:12:36.726142+0000","last_clean":"2024-05-08T18:12:36.726142+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:12:36.726142+0000","last_undegraded":"2024-05-08T18:12:36.726142+0000","last_fullsized":"2024-05-08T18:12:36.726142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.725932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:50.918918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.242345+0000","last_change":"2024-05-08T18:12:34.242410+0000","last_active":"2024-05-08T18:12:34.242345+0000","last_peered":"2024-05-08T18:12:34.242345+0000","last_clean":"2024-05-08T18:12:34.242345+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:34.242345+0000","last_undegraded":"2024-05-08T18:12:34.242345+0000","last_fullsized":"2024-05-08T18:12:34.242345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.242141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:57.784530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.323223+0000","last_change":"2024-05-08T18:12:42.323322+0000","last_active":"2024-05-08T18:12:42.323223+0000","last_peered":"2024-05-08T18:12:42.323223+0000","last_clean":"2024-05-08T18:12:42.323223+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:12:42.323223+0000","last_undegraded":"2024-05-08T18:12:42.323223+0000","last_fullsized":"2024-05-08T18:12:42.323223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.322977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:09.542329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.020358+0000","last_change":"2024-05-08T18:12:38.020423+0000","last_active":"2024-05-08T18:12:38.020358+0000","last_peered":"2024-05-08T18:12:38.020358+0000","last_clean":"2024-05-08T18:12:38.020358+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:12:38.020358+0000","last_undegraded":"2024-05-08T18:12:38.020358+0000","last_fullsized":"2024-05-08T18:12:38.020358+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.020159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:12.758346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.937689+0000","last_change":"2024-05-08T18:12:17.937761+0000","last_active":"2024-05-08T18:12:17.937689+0000","last_peered":"2024-05-08T18:12:17.937689+0000","last_clean":"2024-05-08T18:12:17.937689+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:12:17.937689+0000","last_undegraded":"2024-05-08T18:12:17.937689+0000","last_fullsized":"2024-05-08T18:12:17.937689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.937441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:59.874450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.894100+0000","last_change":"2024-05-08T18:12:16.894205+0000","last_active":"2024-05-08T18:12:16.894100+0000","last_peered":"2024-05-08T18:12:16.894100+0000","last_clean":"2024-05-08T18:12:16.894100+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:12:16.894100+0000","last_undegraded":"2024-05-08T18:12:16.894100+0000","last_fullsized":"2024-05-08T18:12:16.894100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.893872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:45.046890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.863001+0000","last_change":"2024-05-08T18:13:08.863072+0000","last_active":"2024-05-08T18:13:08.863001+0000","last_peered":"2024-05-08T18:13:08.863001+0000","last_clean":"2024-05-08T18:13:08.863001+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:13:08.863001+0000","last_undegraded":"2024-05-08T18:13:08.863001+0000","last_fullsized":"2024-05-08T18:13:08.863001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:13:08.862805+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:13:08.862805+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.862805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:15.270881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.214586+0000","last_change":"2024-05-08T18:12:26.214649+0000","last_active":"2024-05-08T18:12:26.214586+0000","last_peered":"2024-05-08T18:12:26.214586+0000","last_clean":"2024-05-08T18:12:26.214586+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:26.214586+0000","last_undegraded":"2024-05-08T18:12:26.214586+0000","last_fullsized":"2024-05-08T18:12:26.214586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.214403+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:05.554391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432135+0000","last_change":"2024-05-08T18:08:47.521987+0000","last_active":"2024-05-08T18:11:11.432135+0000","last_peered":"2024-05-08T18:11:11.432135+0000","last_clean":"2024-05-08T18:11:11.432135+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:11:11.432135+0000","last_undegraded":"2024-05-08T18:11:11.432135+0000","last_fullsized":"2024-05-08T18:11:11.432135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.023222+0000","last_change":"2024-05-08T18:12:31.023275+0000","last_active":"2024-05-08T18:12:31.023222+0000","last_peered":"2024-05-08T18:12:31.023222+0000","last_clean":"2024-05-08T18:12:31.023222+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:12:31.023222+0000","last_undegraded":"2024-05-08T18:12:31.023222+0000","last_fullsized":"2024-05-08T18:12:31.023222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.023023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:20.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.430136+0000","last_change":"2024-05-08T18:12:24.430290+0000","last_active":"2024-05-08T18:12:24.430136+0000","last_peered":"2024-05-08T18:12:24.430136+0000","last_clean":"2024-05-08T18:12:24.430136+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:12:24.430136+0000","last_undegraded":"2024-05-08T18:12:24.430136+0000","last_fullsized":"2024-05-08T18:12:24.430136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.429852+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:02.971977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.358867+0000","last_change":"2024-05-08T18:12:48.358931+0000","last_active":"2024-05-08T18:12:48.358867+0000","last_peered":"2024-05-08T18:12:48.358867+0000","last_clean":"2024-05-08T18:12:48.358867+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:48.358867+0000","last_undegraded":"2024-05-08T18:12:48.358867+0000","last_fullsized":"2024-05-08T18:12:48.358867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.358666+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:43.819172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.434500+0000","last_change":"2024-05-08T18:12:27.434651+0000","last_active":"2024-05-08T18:12:27.434500+0000","last_peered":"2024-05-08T18:12:27.434500+0000","last_clean":"2024-05-08T18:12:27.434500+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:27.434500+0000","last_undegraded":"2024-05-08T18:12:27.434500+0000","last_fullsized":"2024-05-08T18:12:27.434500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.434279+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:06.052889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.868783+0000","last_change":"2024-05-08T18:13:06.868912+0000","last_active":"2024-05-08T18:13:06.868783+0000","last_peered":"2024-05-08T18:13:06.868783+0000","last_clean":"2024-05-08T18:13:06.868783+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:13:06.868783+0000","last_undegraded":"2024-05-08T18:13:06.868783+0000","last_fullsized":"2024-05-08T18:13:06.868783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:06.868553+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:06.868553+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.868553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:50.814314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.870194+0000","last_change":"2024-05-08T18:13:03.870256+0000","last_active":"2024-05-08T18:13:03.870194+0000","last_peered":"2024-05-08T18:13:03.870194+0000","last_clean":"2024-05-08T18:13:03.870194+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:13:03.870194+0000","last_undegraded":"2024-05-08T18:13:03.870194+0000","last_fullsized":"2024-05-08T18:13:03.870194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:03.869968+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:03.869968+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.869968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:47.740107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.120514+0000","last_change":"2024-05-08T18:12:16.120572+0000","last_active":"2024-05-08T18:12:16.120514+0000","last_peered":"2024-05-08T18:12:16.120514+0000","last_clean":"2024-05-08T18:12:16.120514+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:12:16.120514+0000","last_undegraded":"2024-05-08T18:12:16.120514+0000","last_fullsized":"2024-05-08T18:12:16.120514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.120296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:25.274533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.373809+0000","last_change":"2024-05-08T18:12:22.373889+0000","last_active":"2024-05-08T18:12:22.373809+0000","last_peered":"2024-05-08T18:12:22.373809+0000","last_clean":"2024-05-08T18:12:22.373809+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:12:22.373809+0000","last_undegraded":"2024-05-08T18:12:22.373809+0000","last_fullsized":"2024-05-08T18:12:22.373809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.373620+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:49.336729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.917276+0000","last_change":"2024-05-08T18:12:24.917353+0000","last_active":"2024-05-08T18:12:24.917276+0000","last_peered":"2024-05-08T18:12:24.917276+0000","last_clean":"2024-05-08T18:12:24.917276+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:24.917276+0000","last_undegraded":"2024-05-08T18:12:24.917276+0000","last_fullsized":"2024-05-08T18:12:24.917276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.917056+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:36.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.379434+0000","last_change":"2024-05-08T18:12:55.379434+0000","last_active":"2024-05-08T18:12:55.379434+0000","last_peered":"2024-05-08T18:12:55.379434+0000","last_clean":"2024-05-08T18:12:55.379434+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:55.379434+0000","last_undegraded":"2024-05-08T18:12:55.379434+0000","last_fullsized":"2024-05-08T18:12:55.379434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:55.379170+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:55.379170+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.379170+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:34.739950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.201813+0000","last_change":"2024-05-08T18:12:58.201917+0000","last_active":"2024-05-08T18:12:58.201813+0000","last_peered":"2024-05-08T18:12:58.201813+0000","last_clean":"2024-05-08T18:12:58.201813+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:12:58.201813+0000","last_undegraded":"2024-05-08T18:12:58.201813+0000","last_fullsized":"2024-05-08T18:12:58.201813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:58.201466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:58.201466+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.201466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:29.114994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.808713+0000","last_change":"2024-05-08T18:12:30.808713+0000","last_active":"2024-05-08T18:12:30.808713+0000","last_peered":"2024-05-08T18:12:30.808713+0000","last_clean":"2024-05-08T18:12:30.808713+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:12:30.808713+0000","last_undegraded":"2024-05-08T18:12:30.808713+0000","last_fullsized":"2024-05-08T18:12:30.808713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.808460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:40.081671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.443782+0000","last_change":"2024-05-08T18:12:25.443964+0000","last_active":"2024-05-08T18:12:25.443782+0000","last_peered":"2024-05-08T18:12:25.443782+0000","last_clean":"2024-05-08T18:12:25.443782+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:12:25.443782+0000","last_undegraded":"2024-05-08T18:12:25.443782+0000","last_fullsized":"2024-05-08T18:12:25.443782+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.443551+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:01.194660+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.977085+0000","last_change":"2024-05-08T18:12:18.977194+0000","last_active":"2024-05-08T18:12:18.977085+0000","last_peered":"2024-05-08T18:12:18.977085+0000","last_clean":"2024-05-08T18:12:18.977085+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:12:18.977085+0000","last_undegraded":"2024-05-08T18:12:18.977085+0000","last_fullsized":"2024-05-08T18:12:18.977085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.976803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:31.754400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.404620+0000","last_change":"2024-05-08T18:12:23.404620+0000","last_active":"2024-05-08T18:12:23.404620+0000","last_peered":"2024-05-08T18:12:23.404620+0000","last_clean":"2024-05-08T18:12:23.404620+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:12:23.404620+0000","last_undegraded":"2024-05-08T18:12:23.404620+0000","last_fullsized":"2024-05-08T18:12:23.404620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.404248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:38.428265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.842273+0000","last_change":"2024-05-08T18:12:44.842273+0000","last_active":"2024-05-08T18:12:44.842273+0000","last_peered":"2024-05-08T18:12:44.842273+0000","last_clean":"2024-05-08T18:12:44.842273+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:12:44.842273+0000","last_undegraded":"2024-05-08T18:12:44.842273+0000","last_fullsized":"2024-05-08T18:12:44.842273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.842022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:59.604961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.147878+0000","last_change":"2024-05-08T18:12:52.147942+0000","last_active":"2024-05-08T18:12:52.147878+0000","last_peered":"2024-05-08T18:12:52.147878+0000","last_clean":"2024-05-08T18:12:52.147878+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:12:52.147878+0000","last_undegraded":"2024-05-08T18:12:52.147878+0000","last_fullsized":"2024-05-08T18:12:52.147878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:52.147668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:52.147668+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.147668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:18.379328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.105889+0000","last_change":"2024-05-08T18:13:06.106025+0000","last_active":"2024-05-08T18:13:06.105889+0000","last_peered":"2024-05-08T18:13:06.105889+0000","last_clean":"2024-05-08T18:13:06.105889+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:13:06.105889+0000","last_undegraded":"2024-05-08T18:13:06.105889+0000","last_fullsized":"2024-05-08T18:13:06.105889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:06.105659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:06.105659+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.105659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:48.960913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.327762+0000","last_change":"2024-05-08T18:12:42.327923+0000","last_active":"2024-05-08T18:12:42.327762+0000","last_peered":"2024-05-08T18:12:42.327762+0000","last_clean":"2024-05-08T18:12:42.327762+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:12:42.327762+0000","last_undegraded":"2024-05-08T18:12:42.327762+0000","last_fullsized":"2024-05-08T18:12:42.327762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.327508+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:15.103422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.889035+0000","last_change":"2024-05-08T18:12:14.889091+0000","last_active":"2024-05-08T18:12:14.889035+0000","last_peered":"2024-05-08T18:12:14.889035+0000","last_clean":"2024-05-08T18:12:14.889035+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:12:14.889035+0000","last_undegraded":"2024-05-08T18:12:14.889035+0000","last_fullsized":"2024-05-08T18:12:14.889035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.888837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:43.041854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.227810+0000","last_change":"2024-05-08T18:08:57.579212+0000","last_active":"2024-05-08T18:12:13.227810+0000","last_peered":"2024-05-08T18:12:13.227810+0000","last_clean":"2024-05-08T18:12:13.227810+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:12:13.227810+0000","last_undegraded":"2024-05-08T18:12:13.227810+0000","last_fullsized":"2024-05-08T18:12:13.227810+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.229409+0000","last_change":"2024-05-08T18:12:45.229409+0000","last_active":"2024-05-08T18:12:45.229409+0000","last_peered":"2024-05-08T18:12:45.229409+0000","last_clean":"2024-05-08T18:12:45.229409+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:45.229409+0000","last_undegraded":"2024-05-08T18:12:45.229409+0000","last_fullsized":"2024-05-08T18:12:45.229409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.229157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:54.383394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430943+0000","last_change":"2024-05-08T18:08:47.502489+0000","last_active":"2024-05-08T18:11:06.430943+0000","last_peered":"2024-05-08T18:11:06.430943+0000","last_clean":"2024-05-08T18:11:06.430943+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:11:06.430943+0000","last_undegraded":"2024-05-08T18:11:06.430943+0000","last_fullsized":"2024-05-08T18:11:06.430943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.003319+0000","last_change":"2024-05-08T18:12:32.003372+0000","last_active":"2024-05-08T18:12:32.003319+0000","last_peered":"2024-05-08T18:12:32.003319+0000","last_clean":"2024-05-08T18:12:32.003319+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:12:32.003319+0000","last_undegraded":"2024-05-08T18:12:32.003319+0000","last_fullsized":"2024-05-08T18:12:32.003319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.003096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:34.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.137274+0000","last_change":"2024-05-08T18:12:22.137373+0000","last_active":"2024-05-08T18:12:22.137274+0000","last_peered":"2024-05-08T18:12:22.137274+0000","last_clean":"2024-05-08T18:12:22.137274+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:12:22.137274+0000","last_undegraded":"2024-05-08T18:12:22.137274+0000","last_fullsized":"2024-05-08T18:12:22.137274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.137072+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.003539+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":367,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.931110+0000","last_change":"2024-05-08T18:12:13.931134+0000","last_active":"2024-05-08T18:12:13.931110+0000","last_peered":"2024-05-08T18:12:13.931110+0000","last_clean":"2024-05-08T18:12:13.931110+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:13.931110+0000","last_undegraded":"2024-05-08T18:12:13.931110+0000","last_fullsized":"2024-05-08T18:12:13.931110+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.931028+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:49.682137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.421644+0000","last_change":"2024-05-08T18:08:57.577913+0000","last_active":"2024-05-08T18:11:11.421644+0000","last_peered":"2024-05-08T18:11:11.421644+0000","last_clean":"2024-05-08T18:11:11.421644+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:11:11.421644+0000","last_undegraded":"2024-05-08T18:11:11.421644+0000","last_fullsized":"2024-05-08T18:11:11.421644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.376913+0000","last_change":"2024-05-08T18:12:38.376977+0000","last_active":"2024-05-08T18:12:38.376913+0000","last_peered":"2024-05-08T18:12:38.376913+0000","last_clean":"2024-05-08T18:12:38.376913+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:12:38.376913+0000","last_undegraded":"2024-05-08T18:12:38.376913+0000","last_fullsized":"2024-05-08T18:12:38.376913+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.376714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:00.741888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430833+0000","last_change":"2024-05-08T18:08:47.521626+0000","last_active":"2024-05-08T18:11:06.430833+0000","last_peered":"2024-05-08T18:11:06.430833+0000","last_clean":"2024-05-08T18:11:06.430833+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:11:06.430833+0000","last_undegraded":"2024-05-08T18:11:06.430833+0000","last_fullsized":"2024-05-08T18:11:06.430833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.091185+0000","last_change":"2024-05-08T18:13:07.091236+0000","last_active":"2024-05-08T18:13:07.091185+0000","last_peered":"2024-05-08T18:13:07.091185+0000","last_clean":"2024-05-08T18:13:07.091185+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:13:07.091185+0000","last_undegraded":"2024-05-08T18:13:07.091185+0000","last_fullsized":"2024-05-08T18:13:07.091185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:07.090998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:07.090998+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.090998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:21.221385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'65","reported_seq":138,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.376568+0000","last_change":"2024-05-08T18:12:49.376725+0000","last_active":"2024-05-08T18:12:49.376568+0000","last_peered":"2024-05-08T18:12:49.376568+0000","last_clean":"2024-05-08T18:12:49.376568+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:12:49.376568+0000","last_undegraded":"2024-05-08T18:12:49.376568+0000","last_fullsized":"2024-05-08T18:12:49.376568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.376328+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:33.322089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.918065+0000","last_change":"2024-05-08T18:12:16.918122+0000","last_active":"2024-05-08T18:12:16.918065+0000","last_peered":"2024-05-08T18:12:16.918065+0000","last_clean":"2024-05-08T18:12:16.918065+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:12:16.918065+0000","last_undegraded":"2024-05-08T18:12:16.918065+0000","last_fullsized":"2024-05-08T18:12:16.918065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.917861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:11.528942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.053883+0000","last_change":"2024-05-08T18:12:41.054066+0000","last_active":"2024-05-08T18:12:41.053883+0000","last_peered":"2024-05-08T18:12:41.053883+0000","last_clean":"2024-05-08T18:12:41.053883+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:41.053883+0000","last_undegraded":"2024-05-08T18:12:41.053883+0000","last_fullsized":"2024-05-08T18:12:41.053883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.053624+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:02:46.543372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.769596+0000","last_change":"2024-05-08T18:12:35.769660+0000","last_active":"2024-05-08T18:12:35.769596+0000","last_peered":"2024-05-08T18:12:35.769596+0000","last_clean":"2024-05-08T18:12:35.769596+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:12:35.769596+0000","last_undegraded":"2024-05-08T18:12:35.769596+0000","last_fullsized":"2024-05-08T18:12:35.769596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.769378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:44.923615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.963854+0000","last_change":"2024-05-08T18:13:01.963915+0000","last_active":"2024-05-08T18:13:01.963854+0000","last_peered":"2024-05-08T18:13:01.963854+0000","last_clean":"2024-05-08T18:13:01.963854+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:13:01.963854+0000","last_undegraded":"2024-05-08T18:13:01.963854+0000","last_fullsized":"2024-05-08T18:13:01.963854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:01.963654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:01.963654+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.963654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:08.778529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.445582+0000","last_change":"2024-05-08T18:12:34.445639+0000","last_active":"2024-05-08T18:12:34.445582+0000","last_peered":"2024-05-08T18:12:34.445582+0000","last_clean":"2024-05-08T18:12:34.445582+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:12:34.445582+0000","last_undegraded":"2024-05-08T18:12:34.445582+0000","last_fullsized":"2024-05-08T18:12:34.445582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.445366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:27.788124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.976359+0000","last_change":"2024-05-08T18:12:19.976447+0000","last_active":"2024-05-08T18:12:19.976359+0000","last_peered":"2024-05-08T18:12:19.976359+0000","last_clean":"2024-05-08T18:12:19.976359+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:12:19.976359+0000","last_undegraded":"2024-05-08T18:12:19.976359+0000","last_fullsized":"2024-05-08T18:12:19.976359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.976156+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:44.797089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.381969+0000","last_change":"2024-05-08T18:12:56.382028+0000","last_active":"2024-05-08T18:12:56.381969+0000","last_peered":"2024-05-08T18:12:56.381969+0000","last_clean":"2024-05-08T18:12:56.381969+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:12:56.381969+0000","last_undegraded":"2024-05-08T18:12:56.381969+0000","last_fullsized":"2024-05-08T18:12:56.381969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:56.381778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:56.381778+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.381778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:56.402417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.150035+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:12:14.150035+0000","last_peered":"2024-05-08T18:12:14.150035+0000","last_clean":"2024-05-08T18:12:14.150035+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:12:14.150035+0000","last_undegraded":"2024-05-08T18:12:14.150035+0000","last_fullsized":"2024-05-08T18:12:14.150035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.246328+0000","last_change":"2024-05-08T18:12:27.246550+0000","last_active":"2024-05-08T18:12:27.246328+0000","last_peered":"2024-05-08T18:12:27.246328+0000","last_clean":"2024-05-08T18:12:27.246328+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:27.246328+0000","last_undegraded":"2024-05-08T18:12:27.246328+0000","last_fullsized":"2024-05-08T18:12:27.246328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.246102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:55.984072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147566+0000","last_change":"2024-05-08T18:08:47.503061+0000","last_active":"2024-05-08T18:12:14.147566+0000","last_peered":"2024-05-08T18:12:14.147566+0000","last_clean":"2024-05-08T18:12:14.147566+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:12:14.147566+0000","last_undegraded":"2024-05-08T18:12:14.147566+0000","last_fullsized":"2024-05-08T18:12:14.147566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.057420+0000","last_change":"2024-05-08T18:12:30.057479+0000","last_active":"2024-05-08T18:12:30.057420+0000","last_peered":"2024-05-08T18:12:30.057420+0000","last_clean":"2024-05-08T18:12:30.057420+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:12:30.057420+0000","last_undegraded":"2024-05-08T18:12:30.057420+0000","last_fullsized":"2024-05-08T18:12:30.057420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:54.634269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.405643+0000","last_change":"2024-05-08T18:12:28.405733+0000","last_active":"2024-05-08T18:12:28.405643+0000","last_peered":"2024-05-08T18:12:28.405643+0000","last_clean":"2024-05-08T18:12:28.405643+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:12:28.405643+0000","last_undegraded":"2024-05-08T18:12:28.405643+0000","last_fullsized":"2024-05-08T18:12:28.405643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.405516+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:23.016597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":443,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.441147+0000","last_change":"2024-05-08T18:12:15.441218+0000","last_active":"2024-05-08T18:12:15.441147+0000","last_peered":"2024-05-08T18:12:15.441147+0000","last_clean":"2024-05-08T18:12:15.441147+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:15.441147+0000","last_undegraded":"2024-05-08T18:12:15.441147+0000","last_fullsized":"2024-05-08T18:12:15.441147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.440939+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:26.637944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'12","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.774695+0000","last_change":"2024-05-08T18:08:57.565733+0000","last_active":"2024-05-08T18:12:12.774695+0000","last_peered":"2024-05-08T18:12:12.774695+0000","last_clean":"2024-05-08T18:12:12.774695+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:12:12.774695+0000","last_undegraded":"2024-05-08T18:12:12.774695+0000","last_fullsized":"2024-05-08T18:12:12.774695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.183456+0000","last_change":"2024-05-08T18:12:47.183516+0000","last_active":"2024-05-08T18:12:47.183456+0000","last_peered":"2024-05-08T18:12:47.183456+0000","last_clean":"2024-05-08T18:12:47.183456+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:12:47.183456+0000","last_undegraded":"2024-05-08T18:12:47.183456+0000","last_fullsized":"2024-05-08T18:12:47.183456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.183265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:54.291097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147615+0000","last_change":"2024-05-08T18:08:47.507004+0000","last_active":"2024-05-08T18:12:14.147615+0000","last_peered":"2024-05-08T18:12:14.147615+0000","last_clean":"2024-05-08T18:12:14.147615+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:12:14.147615+0000","last_undegraded":"2024-05-08T18:12:14.147615+0000","last_fullsized":"2024-05-08T18:12:14.147615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":428,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.895983+0000","last_change":"2024-05-08T18:12:27.896053+0000","last_active":"2024-05-08T18:12:27.895983+0000","last_peered":"2024-05-08T18:12:27.895983+0000","last_clean":"2024-05-08T18:12:27.895983+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:12:27.895983+0000","last_undegraded":"2024-05-08T18:12:27.895983+0000","last_fullsized":"2024-05-08T18:12:27.895983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.895781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:25.396027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.279987+0000","last_change":"2024-05-08T18:12:41.280066+0000","last_active":"2024-05-08T18:12:41.279987+0000","last_peered":"2024-05-08T18:12:41.279987+0000","last_clean":"2024-05-08T18:12:41.279987+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:12:41.279987+0000","last_undegraded":"2024-05-08T18:12:41.279987+0000","last_fullsized":"2024-05-08T18:12:41.279987+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.279763+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:03.126482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":472,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.876484+0000","last_change":"2024-05-08T18:12:28.876546+0000","last_active":"2024-05-08T18:12:28.876484+0000","last_peered":"2024-05-08T18:12:28.876484+0000","last_clean":"2024-05-08T18:12:28.876484+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:28.876484+0000","last_undegraded":"2024-05-08T18:12:28.876484+0000","last_fullsized":"2024-05-08T18:12:28.876484+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.876292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:13:51.241466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.173413+0000","last_change":"2024-05-08T18:13:02.173413+0000","last_active":"2024-05-08T18:13:02.173413+0000","last_peered":"2024-05-08T18:13:02.173413+0000","last_clean":"2024-05-08T18:13:02.173413+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:13:02.173413+0000","last_undegraded":"2024-05-08T18:13:02.173413+0000","last_fullsized":"2024-05-08T18:13:02.173413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:02.173161+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:02.173161+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.173161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:43.568916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.735390+0000","last_change":"2024-05-08T18:12:37.735463+0000","last_active":"2024-05-08T18:12:37.735390+0000","last_peered":"2024-05-08T18:12:37.735390+0000","last_clean":"2024-05-08T18:12:37.735390+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:37.735390+0000","last_undegraded":"2024-05-08T18:12:37.735390+0000","last_fullsized":"2024-05-08T18:12:37.735390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.735180+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:44.843012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.188288+0000","last_change":"2024-05-08T18:13:06.188288+0000","last_active":"2024-05-08T18:13:06.188288+0000","last_peered":"2024-05-08T18:13:06.188288+0000","last_clean":"2024-05-08T18:13:06.188288+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:13:06.188288+0000","last_undegraded":"2024-05-08T18:13:06.188288+0000","last_fullsized":"2024-05-08T18:13:06.188288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:06.188003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:06.188003+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.188003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:36.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.106333+0000","last_change":"2024-05-08T18:12:17.106450+0000","last_active":"2024-05-08T18:12:17.106333+0000","last_peered":"2024-05-08T18:12:17.106333+0000","last_clean":"2024-05-08T18:12:17.106333+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:12:17.106333+0000","last_undegraded":"2024-05-08T18:12:17.106333+0000","last_fullsized":"2024-05-08T18:12:17.106333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.106103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:31.299089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.947238+0000","last_change":"2024-05-08T18:12:21.947331+0000","last_active":"2024-05-08T18:12:21.947238+0000","last_peered":"2024-05-08T18:12:21.947238+0000","last_clean":"2024-05-08T18:12:21.947238+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:12:21.947238+0000","last_undegraded":"2024-05-08T18:12:21.947238+0000","last_fullsized":"2024-05-08T18:12:21.947238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.947022+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:33.614218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.369594+0000","last_change":"2024-05-08T18:12:20.369656+0000","last_active":"2024-05-08T18:12:20.369594+0000","last_peered":"2024-05-08T18:12:20.369594+0000","last_clean":"2024-05-08T18:12:20.369594+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:12:20.369594+0000","last_undegraded":"2024-05-08T18:12:20.369594+0000","last_fullsized":"2024-05-08T18:12:20.369594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.369368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:12.685507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.847346+0000","last_change":"2024-05-08T18:13:08.847346+0000","last_active":"2024-05-08T18:13:08.847346+0000","last_peered":"2024-05-08T18:13:08.847346+0000","last_clean":"2024-05-08T18:13:08.847346+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:13:08.847346+0000","last_undegraded":"2024-05-08T18:13:08.847346+0000","last_fullsized":"2024-05-08T18:13:08.847346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:13:08.846978+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:13:08.846978+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.846978+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.532271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'12","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.335989+0000","last_change":"2024-05-08T18:12:59.335989+0000","last_active":"2024-05-08T18:12:59.335989+0000","last_peered":"2024-05-08T18:12:59.335989+0000","last_clean":"2024-05-08T18:12:59.335989+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:59.335989+0000","last_undegraded":"2024-05-08T18:12:59.335989+0000","last_fullsized":"2024-05-08T18:12:59.335989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:59.335739+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:59.335739+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.335739+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:09.899686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.842012+0000","last_change":"2024-05-08T18:12:58.842089+0000","last_active":"2024-05-08T18:12:58.842012+0000","last_peered":"2024-05-08T18:12:58.842012+0000","last_clean":"2024-05-08T18:12:58.842012+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:12:58.842012+0000","last_undegraded":"2024-05-08T18:12:58.842012+0000","last_fullsized":"2024-05-08T18:12:58.842012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-05-08T18:12:58.841819+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-05-08T18:12:58.841819+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.841819+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:12.972206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147409+0000","last_change":"2024-05-08T18:08:39.434825+0000","last_active":"2024-05-08T18:12:14.147409+0000","last_peered":"2024-05-08T18:12:14.147409+0000","last_clean":"2024-05-08T18:12:14.147409+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:12:14.147409+0000","last_undegraded":"2024-05-08T18:12:14.147409+0000","last_fullsized":"2024-05-08T18:12:14.147409+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147445+0000","last_change":"2024-05-08T18:08:47.528209+0000","last_active":"2024-05-08T18:12:14.147445+0000","last_peered":"2024-05-08T18:12:14.147445+0000","last_clean":"2024-05-08T18:12:14.147445+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:12:14.147445+0000","last_undegraded":"2024-05-08T18:12:14.147445+0000","last_fullsized":"2024-05-08T18:12:14.147445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.832156+0000","last_change":"2024-05-08T18:12:25.832156+0000","last_active":"2024-05-08T18:12:25.832156+0000","last_peered":"2024-05-08T18:12:25.832156+0000","last_clean":"2024-05-08T18:12:25.832156+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:12:25.832156+0000","last_undegraded":"2024-05-08T18:12:25.832156+0000","last_fullsized":"2024-05-08T18:12:25.832156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.831900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:22.583694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'93","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.436682+0000","last_change":"2024-05-08T18:12:46.436762+0000","last_active":"2024-05-08T18:12:46.436682+0000","last_peered":"2024-05-08T18:12:46.436682+0000","last_clean":"2024-05-08T18:12:46.436682+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:46.436682+0000","last_undegraded":"2024-05-08T18:12:46.436682+0000","last_fullsized":"2024-05-08T18:12:46.436682+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.436505+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:33.626162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.052555+0000","last_change":"2024-05-08T18:12:29.052679+0000","last_active":"2024-05-08T18:12:29.052555+0000","last_peered":"2024-05-08T18:12:29.052555+0000","last_clean":"2024-05-08T18:12:29.052555+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:12:29.052555+0000","last_undegraded":"2024-05-08T18:12:29.052555+0000","last_fullsized":"2024-05-08T18:12:29.052555+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.052326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:01.660597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.404767+0000","last_change":"2024-05-08T18:12:35.404834+0000","last_active":"2024-05-08T18:12:35.404767+0000","last_peered":"2024-05-08T18:12:35.404767+0000","last_clean":"2024-05-08T18:12:35.404767+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:35.404767+0000","last_undegraded":"2024-05-08T18:12:35.404767+0000","last_fullsized":"2024-05-08T18:12:35.404767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.404580+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.156373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.301685+0000","last_change":"2024-05-08T18:13:01.301685+0000","last_active":"2024-05-08T18:13:01.301685+0000","last_peered":"2024-05-08T18:13:01.301685+0000","last_clean":"2024-05-08T18:13:01.301685+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:13:01.301685+0000","last_undegraded":"2024-05-08T18:13:01.301685+0000","last_fullsized":"2024-05-08T18:13:01.301685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-05-08T18:13:01.301413+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-05-08T18:13:01.301413+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.301413+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:44.881643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147354+0000","last_change":"2024-05-08T18:08:39.431253+0000","last_active":"2024-05-08T18:12:14.147354+0000","last_peered":"2024-05-08T18:12:14.147354+0000","last_clean":"2024-05-08T18:12:14.147354+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:12:14.147354+0000","last_undegraded":"2024-05-08T18:12:14.147354+0000","last_fullsized":"2024-05-08T18:12:14.147354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.887765+0000","last_change":"2024-05-08T18:12:55.887765+0000","last_active":"2024-05-08T18:12:55.887765+0000","last_peered":"2024-05-08T18:12:55.887765+0000","last_clean":"2024-05-08T18:12:55.887765+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:12:55.887765+0000","last_undegraded":"2024-05-08T18:12:55.887765+0000","last_fullsized":"2024-05-08T18:12:55.887765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:55.887504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:55.887504+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.887504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:10.017891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.110947+0000","last_change":"2024-05-08T18:12:15.110947+0000","last_active":"2024-05-08T18:12:15.110947+0000","last_peered":"2024-05-08T18:12:15.110947+0000","last_clean":"2024-05-08T18:12:15.110947+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:12:15.110947+0000","last_undegraded":"2024-05-08T18:12:15.110947+0000","last_fullsized":"2024-05-08T18:12:15.110947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.110542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:17.286120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.874681+0000","last_change":"2024-05-08T18:12:15.874681+0000","last_active":"2024-05-08T18:12:15.874681+0000","last_peered":"2024-05-08T18:12:15.874681+0000","last_clean":"2024-05-08T18:12:15.874681+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:15.874681+0000","last_undegraded":"2024-05-08T18:12:15.874681+0000","last_fullsized":"2024-05-08T18:12:15.874681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.874266+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:16.789721+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.388148+0000","last_change":"2024-05-08T18:12:44.388148+0000","last_active":"2024-05-08T18:12:44.388148+0000","last_peered":"2024-05-08T18:12:44.388148+0000","last_clean":"2024-05-08T18:12:44.388148+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:12:44.388148+0000","last_undegraded":"2024-05-08T18:12:44.388148+0000","last_fullsized":"2024-05-08T18:12:44.388148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.387867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:11.255581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.852248+0000","last_change":"2024-05-08T18:13:10.852306+0000","last_active":"2024-05-08T18:13:10.852248+0000","last_peered":"2024-05-08T18:13:10.852248+0000","last_clean":"2024-05-08T18:13:10.852248+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:13:10.852248+0000","last_undegraded":"2024-05-08T18:13:10.852248+0000","last_fullsized":"2024-05-08T18:13:10.852248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:13:10.852058+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:13:10.852058+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.852058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:17.260134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.914567+0000","last_change":"2024-05-08T18:12:56.914567+0000","last_active":"2024-05-08T18:12:56.914567+0000","last_peered":"2024-05-08T18:12:56.914567+0000","last_clean":"2024-05-08T18:12:56.914567+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:56.914567+0000","last_undegraded":"2024-05-08T18:12:56.914567+0000","last_fullsized":"2024-05-08T18:12:56.914567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:56.914288+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:56.914288+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.914288+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:15.883745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.186005+0000","last_change":"2024-05-08T18:12:53.186057+0000","last_active":"2024-05-08T18:12:53.186005+0000","last_peered":"2024-05-08T18:12:53.186005+0000","last_clean":"2024-05-08T18:12:53.186005+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:12:53.186005+0000","last_undegraded":"2024-05-08T18:12:53.186005+0000","last_fullsized":"2024-05-08T18:12:53.186005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:53.185807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:53.185807+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.185807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:36.478455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.924067+0000","last_change":"2024-05-08T18:13:04.924126+0000","last_active":"2024-05-08T18:13:04.924067+0000","last_peered":"2024-05-08T18:13:04.924067+0000","last_clean":"2024-05-08T18:13:04.924067+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:13:04.924067+0000","last_undegraded":"2024-05-08T18:13:04.924067+0000","last_fullsized":"2024-05-08T18:13:04.924067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:04.923862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:04.923862+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.923862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:37.781760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.419268+0000","last_change":"2024-05-08T18:12:32.419268+0000","last_active":"2024-05-08T18:12:32.419268+0000","last_peered":"2024-05-08T18:12:32.419268+0000","last_clean":"2024-05-08T18:12:32.419268+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:12:32.419268+0000","last_undegraded":"2024-05-08T18:12:32.419268+0000","last_fullsized":"2024-05-08T18:12:32.419268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.419009+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:22.878609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.405846+0000","last_change":"2024-05-08T18:12:26.405846+0000","last_active":"2024-05-08T18:12:26.405846+0000","last_peered":"2024-05-08T18:12:26.405846+0000","last_clean":"2024-05-08T18:12:26.405846+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:26.405846+0000","last_undegraded":"2024-05-08T18:12:26.405846+0000","last_fullsized":"2024-05-08T18:12:26.405846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.405548+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:54.558566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.006603+0000","last_change":"2024-05-08T18:12:33.006603+0000","last_active":"2024-05-08T18:12:33.006603+0000","last_peered":"2024-05-08T18:12:33.006603+0000","last_clean":"2024-05-08T18:12:33.006603+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:12:33.006603+0000","last_undegraded":"2024-05-08T18:12:33.006603+0000","last_fullsized":"2024-05-08T18:12:33.006603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:42.160580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.433565+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:11:16.433565+0000","last_peered":"2024-05-08T18:11:16.433565+0000","last_clean":"2024-05-08T18:11:16.433565+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:11:16.433565+0000","last_undegraded":"2024-05-08T18:11:16.433565+0000","last_fullsized":"2024-05-08T18:11:16.433565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.024876+0000","last_change":"2024-05-08T18:12:43.024876+0000","last_active":"2024-05-08T18:12:43.024876+0000","last_peered":"2024-05-08T18:12:43.024876+0000","last_clean":"2024-05-08T18:12:43.024876+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:43.024876+0000","last_undegraded":"2024-05-08T18:12:43.024876+0000","last_fullsized":"2024-05-08T18:12:43.024876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.024617+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:28.911270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147378+0000","last_change":"2024-05-08T18:08:39.431205+0000","last_active":"2024-05-08T18:12:14.147378+0000","last_peered":"2024-05-08T18:12:14.147378+0000","last_clean":"2024-05-08T18:12:14.147378+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:12:14.147378+0000","last_undegraded":"2024-05-08T18:12:14.147378+0000","last_fullsized":"2024-05-08T18:12:14.147378+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.213523+0000","last_change":"2024-05-08T18:12:55.213523+0000","last_active":"2024-05-08T18:12:55.213523+0000","last_peered":"2024-05-08T18:12:55.213523+0000","last_clean":"2024-05-08T18:12:55.213523+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:12:55.213523+0000","last_undegraded":"2024-05-08T18:12:55.213523+0000","last_fullsized":"2024-05-08T18:12:55.213523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:55.213207+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:55.213207+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.213207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:41.099860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.030417+0000","last_change":"2024-05-08T18:12:36.030417+0000","last_active":"2024-05-08T18:12:36.030417+0000","last_peered":"2024-05-08T18:12:36.030417+0000","last_clean":"2024-05-08T18:12:36.030417+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:12:36.030417+0000","last_undegraded":"2024-05-08T18:12:36.030417+0000","last_fullsized":"2024-05-08T18:12:36.030417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.030159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:58.141039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.401050+0000","last_change":"2024-05-08T18:12:47.401132+0000","last_active":"2024-05-08T18:12:47.401050+0000","last_peered":"2024-05-08T18:12:47.401050+0000","last_clean":"2024-05-08T18:12:47.401050+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:47.401050+0000","last_undegraded":"2024-05-08T18:12:47.401050+0000","last_fullsized":"2024-05-08T18:12:47.401050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.400857+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:20.922374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.354849+0000","last_change":"2024-05-08T18:12:52.354905+0000","last_active":"2024-05-08T18:12:52.354849+0000","last_peered":"2024-05-08T18:12:52.354849+0000","last_clean":"2024-05-08T18:12:52.354849+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:12:52.354849+0000","last_undegraded":"2024-05-08T18:12:52.354849+0000","last_fullsized":"2024-05-08T18:12:52.354849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:52.354612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:52.354612+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.354612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:55.331263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.772473+0000","last_change":"2024-05-08T18:12:40.772534+0000","last_active":"2024-05-08T18:12:40.772473+0000","last_peered":"2024-05-08T18:12:40.772473+0000","last_clean":"2024-05-08T18:12:40.772473+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:12:40.772473+0000","last_undegraded":"2024-05-08T18:12:40.772473+0000","last_fullsized":"2024-05-08T18:12:40.772473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.772281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.689481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.115316+0000","last_change":"2024-05-08T18:13:08.115376+0000","last_active":"2024-05-08T18:13:08.115316+0000","last_peered":"2024-05-08T18:13:08.115316+0000","last_clean":"2024-05-08T18:13:08.115316+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:13:08.115316+0000","last_undegraded":"2024-05-08T18:13:08.115316+0000","last_fullsized":"2024-05-08T18:13:08.115316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:13:08.115092+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:13:08.115092+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.115092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:27.084548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.231202+0000","last_change":"2024-05-08T18:12:46.231202+0000","last_active":"2024-05-08T18:12:46.231202+0000","last_peered":"2024-05-08T18:12:46.231202+0000","last_clean":"2024-05-08T18:12:46.231202+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:12:46.231202+0000","last_undegraded":"2024-05-08T18:12:46.231202+0000","last_fullsized":"2024-05-08T18:12:46.231202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.230919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.423905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.971100+0000","last_change":"2024-05-08T18:12:59.971158+0000","last_active":"2024-05-08T18:12:59.971100+0000","last_peered":"2024-05-08T18:12:59.971100+0000","last_clean":"2024-05-08T18:12:59.971100+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:12:59.971100+0000","last_undegraded":"2024-05-08T18:12:59.971100+0000","last_fullsized":"2024-05-08T18:12:59.971100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.970903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.970903+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.970903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:32.746818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.054793+0000","last_change":"2024-05-08T18:12:35.054793+0000","last_active":"2024-05-08T18:12:35.054793+0000","last_peered":"2024-05-08T18:12:35.054793+0000","last_clean":"2024-05-08T18:12:35.054793+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:12:35.054793+0000","last_undegraded":"2024-05-08T18:12:35.054793+0000","last_fullsized":"2024-05-08T18:12:35.054793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.054395+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:03.822537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.946482+0000","last_change":"2024-05-08T18:12:21.946482+0000","last_active":"2024-05-08T18:12:21.946482+0000","last_peered":"2024-05-08T18:12:21.946482+0000","last_clean":"2024-05-08T18:12:21.946482+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:12:21.946482+0000","last_undegraded":"2024-05-08T18:12:21.946482+0000","last_fullsized":"2024-05-08T18:12:21.946482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.946183+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:14.861048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.481040+0000","last_change":"2024-05-08T18:12:14.481040+0000","last_active":"2024-05-08T18:12:14.481040+0000","last_peered":"2024-05-08T18:12:14.481040+0000","last_clean":"2024-05-08T18:12:14.481040+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:12:14.481040+0000","last_undegraded":"2024-05-08T18:12:14.481040+0000","last_fullsized":"2024-05-08T18:12:14.481040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.480775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:53.762778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.882153+0000","last_change":"2024-05-08T18:13:07.882214+0000","last_active":"2024-05-08T18:13:07.882153+0000","last_peered":"2024-05-08T18:13:07.882153+0000","last_clean":"2024-05-08T18:13:07.882153+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:13:07.882153+0000","last_undegraded":"2024-05-08T18:13:07.882153+0000","last_fullsized":"2024-05-08T18:13:07.882153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:13:07.881924+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:13:07.881924+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.881924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:57.023639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.796028+0000","last_change":"2024-05-08T18:12:33.796028+0000","last_active":"2024-05-08T18:12:33.796028+0000","last_peered":"2024-05-08T18:12:33.796028+0000","last_clean":"2024-05-08T18:12:33.796028+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:33.796028+0000","last_undegraded":"2024-05-08T18:12:33.796028+0000","last_fullsized":"2024-05-08T18:12:33.796028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.795614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:47.936305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.996672+0000","last_change":"2024-05-08T18:12:45.996672+0000","last_active":"2024-05-08T18:12:45.996672+0000","last_peered":"2024-05-08T18:12:45.996672+0000","last_clean":"2024-05-08T18:12:45.996672+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:12:45.996672+0000","last_undegraded":"2024-05-08T18:12:45.996672+0000","last_fullsized":"2024-05-08T18:12:45.996672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.996412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:16.909940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147354+0000","last_change":"2024-05-08T18:08:39.431684+0000","last_active":"2024-05-08T18:12:14.147354+0000","last_peered":"2024-05-08T18:12:14.147354+0000","last_clean":"2024-05-08T18:12:14.147354+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:12:14.147354+0000","last_undegraded":"2024-05-08T18:12:14.147354+0000","last_fullsized":"2024-05-08T18:12:14.147354+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.142014+0000","last_change":"2024-05-08T18:12:21.142014+0000","last_active":"2024-05-08T18:12:21.142014+0000","last_peered":"2024-05-08T18:12:21.142014+0000","last_clean":"2024-05-08T18:12:21.142014+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:12:21.142014+0000","last_undegraded":"2024-05-08T18:12:21.142014+0000","last_fullsized":"2024-05-08T18:12:21.142014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.141767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:55.879953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.861893+0000","last_change":"2024-05-08T18:12:14.861893+0000","last_active":"2024-05-08T18:12:14.861893+0000","last_peered":"2024-05-08T18:12:14.861893+0000","last_clean":"2024-05-08T18:12:14.861893+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:12:14.861893+0000","last_undegraded":"2024-05-08T18:12:14.861893+0000","last_fullsized":"2024-05-08T18:12:14.861893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.861606+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:16.005518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.950874+0000","last_change":"2024-05-08T18:12:20.950874+0000","last_active":"2024-05-08T18:12:20.950874+0000","last_peered":"2024-05-08T18:12:20.950874+0000","last_clean":"2024-05-08T18:12:20.950874+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:20.950874+0000","last_undegraded":"2024-05-08T18:12:20.950874+0000","last_fullsized":"2024-05-08T18:12:20.950874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.950610+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:59.485254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.195971+0000","last_change":"2024-05-08T18:13:04.196038+0000","last_active":"2024-05-08T18:13:04.195971+0000","last_peered":"2024-05-08T18:13:04.195971+0000","last_clean":"2024-05-08T18:13:04.195971+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:13:04.195971+0000","last_undegraded":"2024-05-08T18:13:04.195971+0000","last_fullsized":"2024-05-08T18:13:04.195971+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-08T18:13:04.195762+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-08T18:13:04.195762+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.195762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:11.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.360827+0000","last_change":"2024-05-08T18:12:58.360896+0000","last_active":"2024-05-08T18:12:58.360827+0000","last_peered":"2024-05-08T18:12:58.360827+0000","last_clean":"2024-05-08T18:12:58.360827+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:58.360827+0000","last_undegraded":"2024-05-08T18:12:58.360827+0000","last_fullsized":"2024-05-08T18:12:58.360827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:58.360616+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:58.360616+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.360616+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:22.299329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147483+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:12:14.147483+0000","last_peered":"2024-05-08T18:12:14.147483+0000","last_clean":"2024-05-08T18:12:14.147483+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:12:14.147483+0000","last_undegraded":"2024-05-08T18:12:14.147483+0000","last_fullsized":"2024-05-08T18:12:14.147483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.957538+0000","last_change":"2024-05-08T18:12:58.957538+0000","last_active":"2024-05-08T18:12:58.957538+0000","last_peered":"2024-05-08T18:12:58.957538+0000","last_clean":"2024-05-08T18:12:58.957538+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:12:58.957538+0000","last_undegraded":"2024-05-08T18:12:58.957538+0000","last_fullsized":"2024-05-08T18:12:58.957538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:58.957285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:58.957285+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.957285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:20.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.151592+0000","last_change":"2024-05-08T18:12:20.151592+0000","last_active":"2024-05-08T18:12:20.151592+0000","last_peered":"2024-05-08T18:12:20.151592+0000","last_clean":"2024-05-08T18:12:20.151592+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:12:20.151592+0000","last_undegraded":"2024-05-08T18:12:20.151592+0000","last_fullsized":"2024-05-08T18:12:20.151592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.151323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:59.292712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.179559+0000","last_change":"2024-05-08T18:12:32.179559+0000","last_active":"2024-05-08T18:12:32.179559+0000","last_peered":"2024-05-08T18:12:32.179559+0000","last_clean":"2024-05-08T18:12:32.179559+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:12:32.179559+0000","last_undegraded":"2024-05-08T18:12:32.179559+0000","last_fullsized":"2024-05-08T18:12:32.179559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.179116+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:47.805125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.928706+0000","last_change":"2024-05-08T18:12:17.928706+0000","last_active":"2024-05-08T18:12:17.928706+0000","last_peered":"2024-05-08T18:12:17.928706+0000","last_clean":"2024-05-08T18:12:17.928706+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:17.928706+0000","last_undegraded":"2024-05-08T18:12:17.928706+0000","last_fullsized":"2024-05-08T18:12:17.928706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.928438+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:04.849778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.869459+0000","last_change":"2024-05-08T18:13:09.869544+0000","last_active":"2024-05-08T18:13:09.869459+0000","last_peered":"2024-05-08T18:13:09.869459+0000","last_clean":"2024-05-08T18:13:09.869459+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:13:09.869459+0000","last_undegraded":"2024-05-08T18:13:09.869459+0000","last_fullsized":"2024-05-08T18:13:09.869459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:13:09.869263+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:13:09.869263+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.869263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.422084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.135297+0000","last_change":"2024-05-08T18:13:04.135360+0000","last_active":"2024-05-08T18:13:04.135297+0000","last_peered":"2024-05-08T18:13:04.135297+0000","last_clean":"2024-05-08T18:13:04.135297+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:13:04.135297+0000","last_undegraded":"2024-05-08T18:13:04.135297+0000","last_fullsized":"2024-05-08T18:13:04.135297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:04.135088+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:04.135088+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.135088+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.298862+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.832553+0000","last_change":"2024-05-08T18:12:57.832553+0000","last_active":"2024-05-08T18:12:57.832553+0000","last_peered":"2024-05-08T18:12:57.832553+0000","last_clean":"2024-05-08T18:12:57.832553+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:12:57.832553+0000","last_undegraded":"2024-05-08T18:12:57.832553+0000","last_fullsized":"2024-05-08T18:12:57.832553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.832169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.832169+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.832169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:40.687423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147421+0000","last_change":"2024-05-08T18:08:39.483061+0000","last_active":"2024-05-08T18:12:14.147421+0000","last_peered":"2024-05-08T18:12:14.147421+0000","last_clean":"2024-05-08T18:12:14.147421+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:12:14.147421+0000","last_undegraded":"2024-05-08T18:12:14.147421+0000","last_fullsized":"2024-05-08T18:12:14.147421+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:38.409703+0000","last_clean_scrub_stamp":"2024-05-08T18:08:38.409703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.124317+0000","last_change":"2024-05-08T18:12:19.124317+0000","last_active":"2024-05-08T18:12:19.124317+0000","last_peered":"2024-05-08T18:12:19.124317+0000","last_clean":"2024-05-08T18:12:19.124317+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:12:19.124317+0000","last_undegraded":"2024-05-08T18:12:19.124317+0000","last_fullsized":"2024-05-08T18:12:19.124317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.124051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.234930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.388830+0000","last_change":"2024-05-08T18:12:21.388830+0000","last_active":"2024-05-08T18:12:21.388830+0000","last_peered":"2024-05-08T18:12:21.388830+0000","last_clean":"2024-05-08T18:12:21.388830+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:12:21.388830+0000","last_undegraded":"2024-05-08T18:12:21.388830+0000","last_fullsized":"2024-05-08T18:12:21.388830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.388548+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:37.145916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":104,"num_read_kb":116,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.926349+0000","last_change":"2024-05-08T18:12:20.926349+0000","last_active":"2024-05-08T18:12:20.926349+0000","last_peered":"2024-05-08T18:12:20.926349+0000","last_clean":"2024-05-08T18:12:20.926349+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:12:20.926349+0000","last_undegraded":"2024-05-08T18:12:20.926349+0000","last_fullsized":"2024-05-08T18:12:20.926349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.925962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:11.385561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.400546+0000","last_change":"2024-05-08T18:12:31.400598+0000","last_active":"2024-05-08T18:12:31.400546+0000","last_peered":"2024-05-08T18:12:31.400546+0000","last_clean":"2024-05-08T18:12:31.400546+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:12:31.400546+0000","last_undegraded":"2024-05-08T18:12:31.400546+0000","last_fullsized":"2024-05-08T18:12:31.400546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.400333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.169886+0000","last_change":"2024-05-08T18:13:03.169886+0000","last_active":"2024-05-08T18:13:03.169886+0000","last_peered":"2024-05-08T18:13:03.169886+0000","last_clean":"2024-05-08T18:13:03.169886+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:13:03.169886+0000","last_undegraded":"2024-05-08T18:13:03.169886+0000","last_fullsized":"2024-05-08T18:13:03.169886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:03.169522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:03.169522+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.169522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:26.711911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.137542+0000","last_change":"2024-05-08T18:13:01.137601+0000","last_active":"2024-05-08T18:13:01.137542+0000","last_peered":"2024-05-08T18:13:01.137542+0000","last_clean":"2024-05-08T18:13:01.137542+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:13:01.137542+0000","last_undegraded":"2024-05-08T18:13:01.137542+0000","last_fullsized":"2024-05-08T18:13:01.137542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:01.137324+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:01.137324+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.137324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:16.763333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:11.432328+0000","last_change":"2024-05-08T18:08:47.527783+0000","last_active":"2024-05-08T18:11:11.432328+0000","last_peered":"2024-05-08T18:11:11.432328+0000","last_clean":"2024-05-08T18:11:11.432328+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:11:11.432328+0000","last_undegraded":"2024-05-08T18:11:11.432328+0000","last_fullsized":"2024-05-08T18:11:11.432328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.851096+0000","last_change":"2024-05-08T18:12:29.851149+0000","last_active":"2024-05-08T18:12:29.851096+0000","last_peered":"2024-05-08T18:12:29.851096+0000","last_clean":"2024-05-08T18:12:29.851096+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:12:29.851096+0000","last_undegraded":"2024-05-08T18:12:29.851096+0000","last_fullsized":"2024-05-08T18:12:29.851096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.850896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:20.522178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.217183+0000","last_change":"2024-05-08T18:12:30.217266+0000","last_active":"2024-05-08T18:12:30.217183+0000","last_peered":"2024-05-08T18:12:30.217183+0000","last_clean":"2024-05-08T18:12:30.217183+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:12:30.217183+0000","last_undegraded":"2024-05-08T18:12:30.217183+0000","last_fullsized":"2024-05-08T18:12:30.217183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.216965+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:38.316991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.247738+0000","last_change":"2024-05-08T18:12:38.247800+0000","last_active":"2024-05-08T18:12:38.247738+0000","last_peered":"2024-05-08T18:12:38.247738+0000","last_clean":"2024-05-08T18:12:38.247738+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:12:38.247738+0000","last_undegraded":"2024-05-08T18:12:38.247738+0000","last_fullsized":"2024-05-08T18:12:38.247738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.247530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:52.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.993485+0000","last_change":"2024-05-08T18:12:36.993485+0000","last_active":"2024-05-08T18:12:36.993485+0000","last_peered":"2024-05-08T18:12:36.993485+0000","last_clean":"2024-05-08T18:12:36.993485+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:36.993485+0000","last_undegraded":"2024-05-08T18:12:36.993485+0000","last_fullsized":"2024-05-08T18:12:36.993485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.993231+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:16.134620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.741836+0000","last_change":"2024-05-08T18:12:39.741896+0000","last_active":"2024-05-08T18:12:39.741836+0000","last_peered":"2024-05-08T18:12:39.741836+0000","last_clean":"2024-05-08T18:12:39.741836+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:39.741836+0000","last_undegraded":"2024-05-08T18:12:39.741836+0000","last_fullsized":"2024-05-08T18:12:39.741836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.741610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:18.882999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.157000+0000","last_change":"2024-05-08T18:12:48.157066+0000","last_active":"2024-05-08T18:12:48.157000+0000","last_peered":"2024-05-08T18:12:48.157000+0000","last_clean":"2024-05-08T18:12:48.157000+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:12:48.157000+0000","last_undegraded":"2024-05-08T18:12:48.157000+0000","last_fullsized":"2024-05-08T18:12:48.157000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.156795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:10.267674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.087419+0000","last_change":"2024-05-08T18:12:18.087520+0000","last_active":"2024-05-08T18:12:18.087419+0000","last_peered":"2024-05-08T18:12:18.087419+0000","last_clean":"2024-05-08T18:12:18.087419+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:12:18.087419+0000","last_undegraded":"2024-05-08T18:12:18.087419+0000","last_fullsized":"2024-05-08T18:12:18.087419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.087194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:46.855336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.937017+0000","last_change":"2024-05-08T18:12:25.937087+0000","last_active":"2024-05-08T18:12:25.937017+0000","last_peered":"2024-05-08T18:12:25.937017+0000","last_clean":"2024-05-08T18:12:25.937017+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:25.937017+0000","last_undegraded":"2024-05-08T18:12:25.937017+0000","last_fullsized":"2024-05-08T18:12:25.937017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.936822+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:27.641008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.381154+0000","last_change":"2024-05-08T18:12:19.381207+0000","last_active":"2024-05-08T18:12:19.381154+0000","last_peered":"2024-05-08T18:12:19.381154+0000","last_clean":"2024-05-08T18:12:19.381154+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:12:19.381154+0000","last_undegraded":"2024-05-08T18:12:19.381154+0000","last_fullsized":"2024-05-08T18:12:19.381154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.380953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:58.173357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.901329+0000","last_change":"2024-05-08T18:13:10.901383+0000","last_active":"2024-05-08T18:13:10.901329+0000","last_peered":"2024-05-08T18:13:10.901329+0000","last_clean":"2024-05-08T18:13:10.901329+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:13:10.901329+0000","last_undegraded":"2024-05-08T18:13:10.901329+0000","last_fullsized":"2024-05-08T18:13:10.901329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:10.901138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:10.901138+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.901138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:56.190416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.065668+0000","last_change":"2024-05-08T18:12:42.065832+0000","last_active":"2024-05-08T18:12:42.065668+0000","last_peered":"2024-05-08T18:12:42.065668+0000","last_clean":"2024-05-08T18:12:42.065668+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:42.065668+0000","last_undegraded":"2024-05-08T18:12:42.065668+0000","last_fullsized":"2024-05-08T18:12:42.065668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.065419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:56.828357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.165268+0000","last_change":"2024-05-08T18:13:00.165328+0000","last_active":"2024-05-08T18:13:00.165268+0000","last_peered":"2024-05-08T18:13:00.165268+0000","last_clean":"2024-05-08T18:13:00.165268+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:13:00.165268+0000","last_undegraded":"2024-05-08T18:13:00.165268+0000","last_fullsized":"2024-05-08T18:13:00.165268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:00.165065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:00.165065+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.165065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:00.011008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.402610+0000","last_change":"2024-05-08T18:12:30.402667+0000","last_active":"2024-05-08T18:12:30.402610+0000","last_peered":"2024-05-08T18:12:30.402610+0000","last_clean":"2024-05-08T18:12:30.402610+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:12:30.402610+0000","last_undegraded":"2024-05-08T18:12:30.402610+0000","last_fullsized":"2024-05-08T18:12:30.402610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.402404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:43.180000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.966072+0000","last_change":"2024-05-08T18:12:26.966151+0000","last_active":"2024-05-08T18:12:26.966072+0000","last_peered":"2024-05-08T18:12:26.966072+0000","last_clean":"2024-05-08T18:12:26.966072+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:26.966072+0000","last_undegraded":"2024-05-08T18:12:26.966072+0000","last_fullsized":"2024-05-08T18:12:26.966072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.965884+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:00.217219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.875467+0000","last_change":"2024-05-08T18:12:24.875520+0000","last_active":"2024-05-08T18:12:24.875467+0000","last_peered":"2024-05-08T18:12:24.875467+0000","last_clean":"2024-05-08T18:12:24.875467+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:12:24.875467+0000","last_undegraded":"2024-05-08T18:12:24.875467+0000","last_fullsized":"2024-05-08T18:12:24.875467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.875266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:18.218024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:31.437590+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:11:31.437590+0000","last_peered":"2024-05-08T18:11:31.437590+0000","last_clean":"2024-05-08T18:11:31.437590+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:11:31.437590+0000","last_undegraded":"2024-05-08T18:11:31.437590+0000","last_fullsized":"2024-05-08T18:11:31.437590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'18","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.372079+0000","last_change":"2024-05-08T18:12:51.372219+0000","last_active":"2024-05-08T18:12:51.372079+0000","last_peered":"2024-05-08T18:12:51.372079+0000","last_clean":"2024-05-08T18:12:51.372079+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:51.372079+0000","last_undegraded":"2024-05-08T18:12:51.372079+0000","last_fullsized":"2024-05-08T18:12:51.372079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.371857+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:17.691699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.856837+0000","last_change":"2024-05-08T18:13:00.856913+0000","last_active":"2024-05-08T18:13:00.856837+0000","last_peered":"2024-05-08T18:13:00.856837+0000","last_clean":"2024-05-08T18:13:00.856837+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:13:00.856837+0000","last_undegraded":"2024-05-08T18:13:00.856837+0000","last_fullsized":"2024-05-08T18:13:00.856837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:00.856639+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:00.856639+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.856639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:22.152206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.236640+0000","last_change":"2024-05-08T18:12:25.236698+0000","last_active":"2024-05-08T18:12:25.236640+0000","last_peered":"2024-05-08T18:12:25.236640+0000","last_clean":"2024-05-08T18:12:25.236640+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:12:25.236640+0000","last_undegraded":"2024-05-08T18:12:25.236640+0000","last_fullsized":"2024-05-08T18:12:25.236640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.236418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:39.999356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.379139+0000","last_change":"2024-05-08T18:12:29.379206+0000","last_active":"2024-05-08T18:12:29.379139+0000","last_peered":"2024-05-08T18:12:29.379139+0000","last_clean":"2024-05-08T18:12:29.379139+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:12:29.379139+0000","last_undegraded":"2024-05-08T18:12:29.379139+0000","last_fullsized":"2024-05-08T18:12:29.379139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.378957+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:54.199891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.349903+0000","last_change":"2024-05-08T18:12:18.349967+0000","last_active":"2024-05-08T18:12:18.349903+0000","last_peered":"2024-05-08T18:12:18.349903+0000","last_clean":"2024-05-08T18:12:18.349903+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:12:18.349903+0000","last_undegraded":"2024-05-08T18:12:18.349903+0000","last_fullsized":"2024-05-08T18:12:18.349903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.349704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:51.482256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.345032+0000","last_change":"2024-05-08T18:12:57.345032+0000","last_active":"2024-05-08T18:12:57.345032+0000","last_peered":"2024-05-08T18:12:57.345032+0000","last_clean":"2024-05-08T18:12:57.345032+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:12:57.345032+0000","last_undegraded":"2024-05-08T18:12:57.345032+0000","last_fullsized":"2024-05-08T18:12:57.345032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:57.344755+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:57.344755+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.344755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:15.489585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.237154+0000","last_change":"2024-05-08T18:13:10.237287+0000","last_active":"2024-05-08T18:13:10.237154+0000","last_peered":"2024-05-08T18:13:10.237154+0000","last_clean":"2024-05-08T18:13:10.237154+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:13:10.237154+0000","last_undegraded":"2024-05-08T18:13:10.237154+0000","last_fullsized":"2024-05-08T18:13:10.237154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:10.236825+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:10.236825+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.236825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:12.359658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.007168+0000","last_change":"2024-05-08T18:12:34.007168+0000","last_active":"2024-05-08T18:12:34.007168+0000","last_peered":"2024-05-08T18:12:34.007168+0000","last_clean":"2024-05-08T18:12:34.007168+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:12:34.007168+0000","last_undegraded":"2024-05-08T18:12:34.007168+0000","last_fullsized":"2024-05-08T18:12:34.007168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.006922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:48.199909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.921374+0000","last_change":"2024-05-08T18:12:23.921455+0000","last_active":"2024-05-08T18:12:23.921374+0000","last_peered":"2024-05-08T18:12:23.921374+0000","last_clean":"2024-05-08T18:12:23.921374+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:12:23.921374+0000","last_undegraded":"2024-05-08T18:12:23.921374+0000","last_fullsized":"2024-05-08T18:12:23.921374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.921184+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:20.672977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.376282+0000","last_change":"2024-05-08T18:12:17.376334+0000","last_active":"2024-05-08T18:12:17.376282+0000","last_peered":"2024-05-08T18:12:17.376282+0000","last_clean":"2024-05-08T18:12:17.376282+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:12:17.376282+0000","last_undegraded":"2024-05-08T18:12:17.376282+0000","last_fullsized":"2024-05-08T18:12:17.376282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.376083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:05.332746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.878874+0000","last_change":"2024-05-08T18:13:09.878935+0000","last_active":"2024-05-08T18:13:09.878874+0000","last_peered":"2024-05-08T18:13:09.878874+0000","last_clean":"2024-05-08T18:13:09.878874+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:13:09.878874+0000","last_undegraded":"2024-05-08T18:13:09.878874+0000","last_fullsized":"2024-05-08T18:13:09.878874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:13:09.878674+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:13:09.878674+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.878674+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:38.482012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.942036+0000","last_change":"2024-05-08T18:12:52.942212+0000","last_active":"2024-05-08T18:12:52.942036+0000","last_peered":"2024-05-08T18:12:52.942036+0000","last_clean":"2024-05-08T18:12:52.942036+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:12:52.942036+0000","last_undegraded":"2024-05-08T18:12:52.942036+0000","last_fullsized":"2024-05-08T18:12:52.942036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:52.941803+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:52.941803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.941803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:09.105577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.829170+0000","last_change":"2024-05-08T18:12:51.829233+0000","last_active":"2024-05-08T18:12:51.829170+0000","last_peered":"2024-05-08T18:12:51.829170+0000","last_clean":"2024-05-08T18:12:51.829170+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:12:51.829170+0000","last_undegraded":"2024-05-08T18:12:51.829170+0000","last_fullsized":"2024-05-08T18:12:51.829170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:51.828945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:51.828945+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.828945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:45.312745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.433631+0000","last_change":"2024-05-08T18:12:33.433631+0000","last_active":"2024-05-08T18:12:33.433631+0000","last_peered":"2024-05-08T18:12:33.433631+0000","last_clean":"2024-05-08T18:12:33.433631+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:12:33.433631+0000","last_undegraded":"2024-05-08T18:12:33.433631+0000","last_fullsized":"2024-05-08T18:12:33.433631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.433233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:26.348098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.224869+0000","last_change":"2024-05-08T18:12:24.225048+0000","last_active":"2024-05-08T18:12:24.224869+0000","last_peered":"2024-05-08T18:12:24.224869+0000","last_clean":"2024-05-08T18:12:24.224869+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:12:24.224869+0000","last_undegraded":"2024-05-08T18:12:24.224869+0000","last_fullsized":"2024-05-08T18:12:24.224869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.224613+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:07.517261+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.808449+0000","last_change":"2024-05-08T18:12:32.808508+0000","last_active":"2024-05-08T18:12:32.808449+0000","last_peered":"2024-05-08T18:12:32.808449+0000","last_clean":"2024-05-08T18:12:32.808449+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:12:32.808449+0000","last_undegraded":"2024-05-08T18:12:32.808449+0000","last_fullsized":"2024-05-08T18:12:32.808449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.808259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:00.027611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.330975+0000","last_change":"2024-05-08T18:13:00.331027+0000","last_active":"2024-05-08T18:13:00.330975+0000","last_peered":"2024-05-08T18:13:00.330975+0000","last_clean":"2024-05-08T18:13:00.330975+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:13:00.330975+0000","last_undegraded":"2024-05-08T18:13:00.330975+0000","last_fullsized":"2024-05-08T18:13:00.330975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:00.330783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:00.330783+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.330783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:42.570757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.224908+0000","last_change":"2024-05-08T18:12:29.224975+0000","last_active":"2024-05-08T18:12:29.224908+0000","last_peered":"2024-05-08T18:12:29.224908+0000","last_clean":"2024-05-08T18:12:29.224908+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:29.224908+0000","last_undegraded":"2024-05-08T18:12:29.224908+0000","last_fullsized":"2024-05-08T18:12:29.224908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.224718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:07.769843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.832136+0000","last_change":"2024-05-08T18:12:49.832203+0000","last_active":"2024-05-08T18:12:49.832136+0000","last_peered":"2024-05-08T18:12:49.832136+0000","last_clean":"2024-05-08T18:12:49.832136+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:12:49.832136+0000","last_undegraded":"2024-05-08T18:12:49.832136+0000","last_fullsized":"2024-05-08T18:12:49.832136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.831921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:42.570012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.149694+0000","last_change":"2024-05-08T18:13:05.149758+0000","last_active":"2024-05-08T18:13:05.149694+0000","last_peered":"2024-05-08T18:13:05.149694+0000","last_clean":"2024-05-08T18:13:05.149694+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:13:05.149694+0000","last_undegraded":"2024-05-08T18:13:05.149694+0000","last_fullsized":"2024-05-08T18:13:05.149694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:05.149428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:05.149428+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.149428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.241764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.009169+0000","last_change":"2024-05-08T18:12:28.009169+0000","last_active":"2024-05-08T18:12:28.009169+0000","last_peered":"2024-05-08T18:12:28.009169+0000","last_clean":"2024-05-08T18:12:28.009169+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:12:28.009169+0000","last_undegraded":"2024-05-08T18:12:28.009169+0000","last_fullsized":"2024-05-08T18:12:28.009169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.008749+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:18.526961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.944203+0000","last_change":"2024-05-08T18:12:12.944203+0000","last_active":"2024-05-08T18:12:12.944203+0000","last_peered":"2024-05-08T18:12:12.944203+0000","last_clean":"2024-05-08T18:12:12.944203+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:12:12.944203+0000","last_undegraded":"2024-05-08T18:12:12.944203+0000","last_fullsized":"2024-05-08T18:12:12.944203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_clean_scrub_stamp":"2024-05-08T18:12:12.944077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:02.872453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434724+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:21.434724+0000","last_peered":"2024-05-08T18:11:21.434724+0000","last_clean":"2024-05-08T18:11:21.434724+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:21.434724+0000","last_undegraded":"2024-05-08T18:11:21.434724+0000","last_fullsized":"2024-05-08T18:11:21.434724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.021717+0000","last_change":"2024-05-08T18:12:47.021777+0000","last_active":"2024-05-08T18:12:47.021717+0000","last_peered":"2024-05-08T18:12:47.021717+0000","last_clean":"2024-05-08T18:12:47.021717+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:47.021717+0000","last_undegraded":"2024-05-08T18:12:47.021717+0000","last_fullsized":"2024-05-08T18:12:47.021717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.021499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:58.501866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434863+0000","last_change":"2024-05-08T18:08:47.508898+0000","last_active":"2024-05-08T18:11:21.434863+0000","last_peered":"2024-05-08T18:11:21.434863+0000","last_clean":"2024-05-08T18:11:21.434863+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:11:21.434863+0000","last_undegraded":"2024-05-08T18:11:21.434863+0000","last_fullsized":"2024-05-08T18:11:21.434863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.880274+0000","last_change":"2024-05-08T18:12:26.880471+0000","last_active":"2024-05-08T18:12:26.880274+0000","last_peered":"2024-05-08T18:12:26.880274+0000","last_clean":"2024-05-08T18:12:26.880274+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:12:26.880274+0000","last_undegraded":"2024-05-08T18:12:26.880274+0000","last_fullsized":"2024-05-08T18:12:26.880274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.880045+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:45.838146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.374059+0000","last_change":"2024-05-08T18:12:43.374059+0000","last_active":"2024-05-08T18:12:43.374059+0000","last_peered":"2024-05-08T18:12:43.374059+0000","last_clean":"2024-05-08T18:12:43.374059+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:12:43.374059+0000","last_undegraded":"2024-05-08T18:12:43.374059+0000","last_fullsized":"2024-05-08T18:12:43.374059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.373798+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:10.395570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.415136+0000","last_change":"2024-05-08T18:12:16.415136+0000","last_active":"2024-05-08T18:12:16.415136+0000","last_peered":"2024-05-08T18:12:16.415136+0000","last_clean":"2024-05-08T18:12:16.415136+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:16.415136+0000","last_undegraded":"2024-05-08T18:12:16.415136+0000","last_fullsized":"2024-05-08T18:12:16.415136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.414863+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:08.725122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434563+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:11:21.434563+0000","last_peered":"2024-05-08T18:11:21.434563+0000","last_clean":"2024-05-08T18:11:21.434563+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:11:21.434563+0000","last_undegraded":"2024-05-08T18:11:21.434563+0000","last_fullsized":"2024-05-08T18:11:21.434563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.343207+0000","last_change":"2024-05-08T18:12:39.343330+0000","last_active":"2024-05-08T18:12:39.343207+0000","last_peered":"2024-05-08T18:12:39.343207+0000","last_clean":"2024-05-08T18:12:39.343207+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:39.343207+0000","last_undegraded":"2024-05-08T18:12:39.343207+0000","last_fullsized":"2024-05-08T18:12:39.343207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.342952+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:30.014235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.828152+0000","last_change":"2024-05-08T18:12:59.828209+0000","last_active":"2024-05-08T18:12:59.828152+0000","last_peered":"2024-05-08T18:12:59.828152+0000","last_clean":"2024-05-08T18:12:59.828152+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:12:59.828152+0000","last_undegraded":"2024-05-08T18:12:59.828152+0000","last_fullsized":"2024-05-08T18:12:59.828152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.827904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.827904+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.827904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:58.305517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.920218+0000","last_change":"2024-05-08T18:12:23.920309+0000","last_active":"2024-05-08T18:12:23.920218+0000","last_peered":"2024-05-08T18:12:23.920218+0000","last_clean":"2024-05-08T18:12:23.920218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:12:23.920218+0000","last_undegraded":"2024-05-08T18:12:23.920218+0000","last_fullsized":"2024-05-08T18:12:23.920218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.919920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:16.834786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.983706+0000","last_change":"2024-05-08T18:12:18.983908+0000","last_active":"2024-05-08T18:12:18.983706+0000","last_peered":"2024-05-08T18:12:18.983706+0000","last_clean":"2024-05-08T18:12:18.983706+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:12:18.983706+0000","last_undegraded":"2024-05-08T18:12:18.983706+0000","last_fullsized":"2024-05-08T18:12:18.983706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.983474+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:34.287333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.970884+0000","last_change":"2024-05-08T18:12:19.970940+0000","last_active":"2024-05-08T18:12:19.970884+0000","last_peered":"2024-05-08T18:12:19.970884+0000","last_clean":"2024-05-08T18:12:19.970884+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:12:19.970884+0000","last_undegraded":"2024-05-08T18:12:19.970884+0000","last_fullsized":"2024-05-08T18:12:19.970884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.970683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.981624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.434318+0000","last_change":"2024-05-08T18:08:57.579355+0000","last_active":"2024-05-08T18:11:26.434318+0000","last_peered":"2024-05-08T18:11:26.434318+0000","last_clean":"2024-05-08T18:11:26.434318+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:11:26.434318+0000","last_undegraded":"2024-05-08T18:11:26.434318+0000","last_fullsized":"2024-05-08T18:11:26.434318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.327285+0000","last_change":"2024-05-08T18:12:41.327424+0000","last_active":"2024-05-08T18:12:41.327285+0000","last_peered":"2024-05-08T18:12:41.327285+0000","last_clean":"2024-05-08T18:12:41.327285+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:12:41.327285+0000","last_undegraded":"2024-05-08T18:12:41.327285+0000","last_fullsized":"2024-05-08T18:12:41.327285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.327063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:10.463865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.275732+0000","last_change":"2024-05-08T18:13:09.275882+0000","last_active":"2024-05-08T18:13:09.275732+0000","last_peered":"2024-05-08T18:13:09.275732+0000","last_clean":"2024-05-08T18:13:09.275732+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:13:09.275732+0000","last_undegraded":"2024-05-08T18:13:09.275732+0000","last_fullsized":"2024-05-08T18:13:09.275732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:09.275495+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:09.275495+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.275495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:46.545687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.364163+0000","last_change":"2024-05-08T18:12:36.364217+0000","last_active":"2024-05-08T18:12:36.364163+0000","last_peered":"2024-05-08T18:12:36.364163+0000","last_clean":"2024-05-08T18:12:36.364163+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:12:36.364163+0000","last_undegraded":"2024-05-08T18:12:36.364163+0000","last_fullsized":"2024-05-08T18:12:36.364163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.363969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:55.322070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.890367+0000","last_change":"2024-05-08T18:12:22.890449+0000","last_active":"2024-05-08T18:12:22.890367+0000","last_peered":"2024-05-08T18:12:22.890367+0000","last_clean":"2024-05-08T18:12:22.890367+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:12:22.890367+0000","last_undegraded":"2024-05-08T18:12:22.890367+0000","last_fullsized":"2024-05-08T18:12:22.890367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.890142+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:16.232900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.203727+0000","last_change":"2024-05-08T18:12:39.203783+0000","last_active":"2024-05-08T18:12:39.203727+0000","last_peered":"2024-05-08T18:12:39.203727+0000","last_clean":"2024-05-08T18:12:39.203727+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:12:39.203727+0000","last_undegraded":"2024-05-08T18:12:39.203727+0000","last_fullsized":"2024-05-08T18:12:39.203727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.203546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:58.173003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436379+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:11:26.436379+0000","last_peered":"2024-05-08T18:11:26.436379+0000","last_clean":"2024-05-08T18:11:26.436379+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:11:26.436379+0000","last_undegraded":"2024-05-08T18:11:26.436379+0000","last_fullsized":"2024-05-08T18:11:26.436379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.386872+0000","last_change":"2024-05-08T18:12:53.386937+0000","last_active":"2024-05-08T18:12:53.386872+0000","last_peered":"2024-05-08T18:12:53.386872+0000","last_clean":"2024-05-08T18:12:53.386872+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:53.386872+0000","last_undegraded":"2024-05-08T18:12:53.386872+0000","last_fullsized":"2024-05-08T18:12:53.386872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:53.386676+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:53.386676+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.386676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:12.923206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.062680+0000","last_change":"2024-05-08T18:12:48.062680+0000","last_active":"2024-05-08T18:12:48.062680+0000","last_peered":"2024-05-08T18:12:48.062680+0000","last_clean":"2024-05-08T18:12:48.062680+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:12:48.062680+0000","last_undegraded":"2024-05-08T18:12:48.062680+0000","last_fullsized":"2024-05-08T18:12:48.062680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.062295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:40.800386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.904352+0000","last_change":"2024-05-08T18:12:22.904406+0000","last_active":"2024-05-08T18:12:22.904352+0000","last_peered":"2024-05-08T18:12:22.904352+0000","last_clean":"2024-05-08T18:12:22.904352+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:12:22.904352+0000","last_undegraded":"2024-05-08T18:12:22.904352+0000","last_fullsized":"2024-05-08T18:12:22.904352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.904163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:55.812967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.406151+0000","last_change":"2024-05-08T18:12:45.406224+0000","last_active":"2024-05-08T18:12:45.406151+0000","last_peered":"2024-05-08T18:12:45.406151+0000","last_clean":"2024-05-08T18:12:45.406151+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:12:45.406151+0000","last_undegraded":"2024-05-08T18:12:45.406151+0000","last_fullsized":"2024-05-08T18:12:45.406151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.405952+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:51.199855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.249805+0000","last_change":"2024-05-08T18:12:40.249929+0000","last_active":"2024-05-08T18:12:40.249805+0000","last_peered":"2024-05-08T18:12:40.249805+0000","last_clean":"2024-05-08T18:12:40.249805+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:12:40.249805+0000","last_undegraded":"2024-05-08T18:12:40.249805+0000","last_fullsized":"2024-05-08T18:12:40.249805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.249448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:35.988004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436285+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:11:26.436285+0000","last_peered":"2024-05-08T18:11:26.436285+0000","last_clean":"2024-05-08T18:11:26.436285+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:11:26.436285+0000","last_undegraded":"2024-05-08T18:11:26.436285+0000","last_fullsized":"2024-05-08T18:11:26.436285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.407031+0000","last_change":"2024-05-08T18:12:37.407097+0000","last_active":"2024-05-08T18:12:37.407031+0000","last_peered":"2024-05-08T18:12:37.407031+0000","last_clean":"2024-05-08T18:12:37.407031+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:12:37.407031+0000","last_undegraded":"2024-05-08T18:12:37.407031+0000","last_fullsized":"2024-05-08T18:12:37.407031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.406836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:34.907082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.827275+0000","last_change":"2024-05-08T18:13:02.827344+0000","last_active":"2024-05-08T18:13:02.827275+0000","last_peered":"2024-05-08T18:13:02.827275+0000","last_clean":"2024-05-08T18:13:02.827275+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:13:02.827275+0000","last_undegraded":"2024-05-08T18:13:02.827275+0000","last_fullsized":"2024-05-08T18:13:02.827275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:13:02.827060+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:13:02.827060+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.827060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:32.773786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'5","reported_seq":233,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.805050+0000","last_change":"2024-05-08T18:12:31.805113+0000","last_active":"2024-05-08T18:12:31.805050+0000","last_peered":"2024-05-08T18:12:31.805050+0000","last_clean":"2024-05-08T18:12:31.805050+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:12:31.805050+0000","last_undegraded":"2024-05-08T18:12:31.805050+0000","last_fullsized":"2024-05-08T18:12:31.805050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.804855+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:00.941657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.253694+0000","last_change":"2024-05-08T18:12:28.253848+0000","last_active":"2024-05-08T18:12:28.253694+0000","last_peered":"2024-05-08T18:12:28.253694+0000","last_clean":"2024-05-08T18:12:28.253694+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:28.253694+0000","last_undegraded":"2024-05-08T18:12:28.253694+0000","last_fullsized":"2024-05-08T18:12:28.253694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.253447+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:30.579578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.869619+0000","last_change":"2024-05-08T18:12:15.869678+0000","last_active":"2024-05-08T18:12:15.869619+0000","last_peered":"2024-05-08T18:12:15.869619+0000","last_clean":"2024-05-08T18:12:15.869619+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:12:15.869619+0000","last_undegraded":"2024-05-08T18:12:15.869619+0000","last_fullsized":"2024-05-08T18:12:15.869619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.869387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:54.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.238584+0000","last_change":"2024-05-08T18:13:08.238687+0000","last_active":"2024-05-08T18:13:08.238584+0000","last_peered":"2024-05-08T18:13:08.238584+0000","last_clean":"2024-05-08T18:13:08.238584+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:13:08.238584+0000","last_undegraded":"2024-05-08T18:13:08.238584+0000","last_fullsized":"2024-05-08T18:13:08.238584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:08.238370+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:08.238370+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.238370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:06.147782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.809070+0000","last_change":"2024-05-08T18:12:41.809070+0000","last_active":"2024-05-08T18:12:41.809070+0000","last_peered":"2024-05-08T18:12:41.809070+0000","last_clean":"2024-05-08T18:12:41.809070+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:12:41.809070+0000","last_undegraded":"2024-05-08T18:12:41.809070+0000","last_fullsized":"2024-05-08T18:12:41.809070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.808797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:14.047209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.226520+0000","last_change":"2024-05-08T18:12:57.226520+0000","last_active":"2024-05-08T18:12:57.226520+0000","last_peered":"2024-05-08T18:12:57.226520+0000","last_clean":"2024-05-08T18:12:57.226520+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:12:57.226520+0000","last_undegraded":"2024-05-08T18:12:57.226520+0000","last_fullsized":"2024-05-08T18:12:57.226520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.226257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.226257+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.226257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:54.487220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.010893+0000","last_change":"2024-05-08T18:12:45.010893+0000","last_active":"2024-05-08T18:12:45.010893+0000","last_peered":"2024-05-08T18:12:45.010893+0000","last_clean":"2024-05-08T18:12:45.010893+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:12:45.010893+0000","last_undegraded":"2024-05-08T18:12:45.010893+0000","last_fullsized":"2024-05-08T18:12:45.010893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.010494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:42.271457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.003402+0000","last_change":"2024-05-08T18:13:01.003402+0000","last_active":"2024-05-08T18:13:01.003402+0000","last_peered":"2024-05-08T18:13:01.003402+0000","last_clean":"2024-05-08T18:13:01.003402+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:13:01.003402+0000","last_undegraded":"2024-05-08T18:13:01.003402+0000","last_fullsized":"2024-05-08T18:13:01.003402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:01.003113+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:01.003113+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.003113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:28.024885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.251283+0000","last_change":"2024-05-08T18:12:35.251283+0000","last_active":"2024-05-08T18:12:35.251283+0000","last_peered":"2024-05-08T18:12:35.251283+0000","last_clean":"2024-05-08T18:12:35.251283+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:35.251283+0000","last_undegraded":"2024-05-08T18:12:35.251283+0000","last_fullsized":"2024-05-08T18:12:35.251283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.251012+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:51.414787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147753+0000","last_change":"2024-05-08T18:08:47.519541+0000","last_active":"2024-05-08T18:12:14.147753+0000","last_peered":"2024-05-08T18:12:14.147753+0000","last_clean":"2024-05-08T18:12:14.147753+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:12:14.147753+0000","last_undegraded":"2024-05-08T18:12:14.147753+0000","last_fullsized":"2024-05-08T18:12:14.147753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.057497+0000","last_change":"2024-05-08T18:12:49.057497+0000","last_active":"2024-05-08T18:12:49.057497+0000","last_peered":"2024-05-08T18:12:49.057497+0000","last_clean":"2024-05-08T18:12:49.057497+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:49.057497+0000","last_undegraded":"2024-05-08T18:12:49.057497+0000","last_fullsized":"2024-05-08T18:12:49.057497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.057230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:48.903173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.898282+0000","last_change":"2024-05-08T18:12:53.898282+0000","last_active":"2024-05-08T18:12:53.898282+0000","last_peered":"2024-05-08T18:12:53.898282+0000","last_clean":"2024-05-08T18:12:53.898282+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:53.898282+0000","last_undegraded":"2024-05-08T18:12:53.898282+0000","last_fullsized":"2024-05-08T18:12:53.898282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:53.897902+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:53.897902+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.897902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.990238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.025905+0000","last_change":"2024-05-08T18:12:39.025905+0000","last_active":"2024-05-08T18:12:39.025905+0000","last_peered":"2024-05-08T18:12:39.025905+0000","last_clean":"2024-05-08T18:12:39.025905+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:39.025905+0000","last_undegraded":"2024-05-08T18:12:39.025905+0000","last_fullsized":"2024-05-08T18:12:39.025905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.025648+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:42.892114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.974127+0000","last_change":"2024-05-08T18:13:02.974127+0000","last_active":"2024-05-08T18:13:02.974127+0000","last_peered":"2024-05-08T18:13:02.974127+0000","last_clean":"2024-05-08T18:13:02.974127+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:13:02.974127+0000","last_undegraded":"2024-05-08T18:13:02.974127+0000","last_fullsized":"2024-05-08T18:13:02.974127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:02.973841+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:02.973841+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.973841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:08.767744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.727988+0000","last_change":"2024-05-08T18:12:38.727988+0000","last_active":"2024-05-08T18:12:38.727988+0000","last_peered":"2024-05-08T18:12:38.727988+0000","last_clean":"2024-05-08T18:12:38.727988+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:38.727988+0000","last_undegraded":"2024-05-08T18:12:38.727988+0000","last_fullsized":"2024-05-08T18:12:38.727988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.727710+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:00.838590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.936828+0000","last_change":"2024-05-08T18:13:05.936828+0000","last_active":"2024-05-08T18:13:05.936828+0000","last_peered":"2024-05-08T18:13:05.936828+0000","last_clean":"2024-05-08T18:13:05.936828+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:13:05.936828+0000","last_undegraded":"2024-05-08T18:13:05.936828+0000","last_fullsized":"2024-05-08T18:13:05.936828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:05.936573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:05.936573+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.936573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:15.915722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.998374+0000","last_change":"2024-05-08T18:12:50.998374+0000","last_active":"2024-05-08T18:12:50.998374+0000","last_peered":"2024-05-08T18:12:50.998374+0000","last_clean":"2024-05-08T18:12:50.998374+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:50.998374+0000","last_undegraded":"2024-05-08T18:12:50.998374+0000","last_fullsized":"2024-05-08T18:12:50.998374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.998114+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:32.393869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.215826+0000","last_change":"2024-05-08T18:12:50.215826+0000","last_active":"2024-05-08T18:12:50.215826+0000","last_peered":"2024-05-08T18:12:50.215826+0000","last_clean":"2024-05-08T18:12:50.215826+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:12:50.215826+0000","last_undegraded":"2024-05-08T18:12:50.215826+0000","last_fullsized":"2024-05-08T18:12:50.215826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.215404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.132603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.839374+0000","last_change":"2024-05-08T18:12:45.839374+0000","last_active":"2024-05-08T18:12:45.839374+0000","last_peered":"2024-05-08T18:12:45.839374+0000","last_clean":"2024-05-08T18:12:45.839374+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:45.839374+0000","last_undegraded":"2024-05-08T18:12:45.839374+0000","last_fullsized":"2024-05-08T18:12:45.839374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.839123+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:31.725776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.020909+0000","last_change":"2024-05-08T18:12:50.020909+0000","last_active":"2024-05-08T18:12:50.020909+0000","last_peered":"2024-05-08T18:12:50.020909+0000","last_clean":"2024-05-08T18:12:50.020909+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:12:50.020909+0000","last_undegraded":"2024-05-08T18:12:50.020909+0000","last_fullsized":"2024-05-08T18:12:50.020909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.020646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:05.646654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.875510+0000","last_change":"2024-05-08T18:12:50.875573+0000","last_active":"2024-05-08T18:12:50.875510+0000","last_peered":"2024-05-08T18:12:50.875510+0000","last_clean":"2024-05-08T18:12:50.875510+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:12:50.875510+0000","last_undegraded":"2024-05-08T18:12:50.875510+0000","last_fullsized":"2024-05-08T18:12:50.875510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.875317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:27.743465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.148011+0000","last_change":"2024-05-08T18:08:47.507222+0000","last_active":"2024-05-08T18:12:14.148011+0000","last_peered":"2024-05-08T18:12:14.148011+0000","last_clean":"2024-05-08T18:12:14.148011+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:12:14.148011+0000","last_undegraded":"2024-05-08T18:12:14.148011+0000","last_fullsized":"2024-05-08T18:12:14.148011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.220124+0000","last_change":"2024-05-08T18:12:33.220189+0000","last_active":"2024-05-08T18:12:33.220124+0000","last_peered":"2024-05-08T18:12:33.220124+0000","last_clean":"2024-05-08T18:12:33.220124+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:33.220124+0000","last_undegraded":"2024-05-08T18:12:33.220124+0000","last_fullsized":"2024-05-08T18:12:33.220124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.219930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:14.615685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.951181+0000","last_change":"2024-05-08T18:12:57.951243+0000","last_active":"2024-05-08T18:12:57.951181+0000","last_peered":"2024-05-08T18:12:57.951181+0000","last_clean":"2024-05-08T18:12:57.951181+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:12:57.951181+0000","last_undegraded":"2024-05-08T18:12:57.951181+0000","last_fullsized":"2024-05-08T18:12:57.951181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.950978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.950978+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.950978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:53.689534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.027422+0000","last_change":"2024-05-08T18:12:40.027487+0000","last_active":"2024-05-08T18:12:40.027422+0000","last_peered":"2024-05-08T18:12:40.027422+0000","last_clean":"2024-05-08T18:12:40.027422+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:40.027422+0000","last_undegraded":"2024-05-08T18:12:40.027422+0000","last_fullsized":"2024-05-08T18:12:40.027422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.027216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:32.648602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.817845+0000","last_change":"2024-05-08T18:12:47.817910+0000","last_active":"2024-05-08T18:12:47.817845+0000","last_peered":"2024-05-08T18:12:47.817845+0000","last_clean":"2024-05-08T18:12:47.817845+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:12:47.817845+0000","last_undegraded":"2024-05-08T18:12:47.817845+0000","last_fullsized":"2024-05-08T18:12:47.817845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.817632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:45.078595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.780037+0000","last_change":"2024-05-08T18:12:42.780098+0000","last_active":"2024-05-08T18:12:42.780037+0000","last_peered":"2024-05-08T18:12:42.780037+0000","last_clean":"2024-05-08T18:12:42.780037+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:42.780037+0000","last_undegraded":"2024-05-08T18:12:42.780037+0000","last_fullsized":"2024-05-08T18:12:42.780037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.779853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:09.011513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.756361+0000","last_change":"2024-05-08T18:12:55.756420+0000","last_active":"2024-05-08T18:12:55.756361+0000","last_peered":"2024-05-08T18:12:55.756361+0000","last_clean":"2024-05-08T18:12:55.756361+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:12:55.756361+0000","last_undegraded":"2024-05-08T18:12:55.756361+0000","last_fullsized":"2024-05-08T18:12:55.756361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:55.756173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:55.756173+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.756173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:11.919948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.816652+0000","last_change":"2024-05-08T18:12:34.816815+0000","last_active":"2024-05-08T18:12:34.816652+0000","last_peered":"2024-05-08T18:12:34.816652+0000","last_clean":"2024-05-08T18:12:34.816652+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:12:34.816652+0000","last_undegraded":"2024-05-08T18:12:34.816652+0000","last_fullsized":"2024-05-08T18:12:34.816652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.816409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:36.991987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:02.558269+0000","last_change":"2024-05-08T18:08:47.501076+0000","last_active":"2024-05-08T18:12:02.558269+0000","last_peered":"2024-05-08T18:12:02.558269+0000","last_clean":"2024-05-08T18:12:02.558269+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:12:02.558269+0000","last_undegraded":"2024-05-08T18:12:02.558269+0000","last_fullsized":"2024-05-08T18:12:02.558269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.822477+0000","last_change":"2024-05-08T18:12:52.822535+0000","last_active":"2024-05-08T18:12:52.822477+0000","last_peered":"2024-05-08T18:12:52.822477+0000","last_clean":"2024-05-08T18:12:52.822477+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:12:52.822477+0000","last_undegraded":"2024-05-08T18:12:52.822477+0000","last_fullsized":"2024-05-08T18:12:52.822477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:52.822284+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:52.822284+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.822284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.447474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:06.430920+0000","last_change":"2024-05-08T18:08:47.528395+0000","last_active":"2024-05-08T18:11:06.430920+0000","last_peered":"2024-05-08T18:11:06.430920+0000","last_clean":"2024-05-08T18:11:06.430920+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:11:06.430920+0000","last_undegraded":"2024-05-08T18:11:06.430920+0000","last_fullsized":"2024-05-08T18:11:06.430920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.223799+0000","last_change":"2024-05-08T18:13:03.223932+0000","last_active":"2024-05-08T18:13:03.223799+0000","last_peered":"2024-05-08T18:13:03.223799+0000","last_clean":"2024-05-08T18:13:03.223799+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:13:03.223799+0000","last_undegraded":"2024-05-08T18:13:03.223799+0000","last_fullsized":"2024-05-08T18:13:03.223799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:03.223576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:03.223576+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.223576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:26.136048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.351552+0000","last_change":"2024-05-08T18:12:40.351619+0000","last_active":"2024-05-08T18:12:40.351552+0000","last_peered":"2024-05-08T18:12:40.351552+0000","last_clean":"2024-05-08T18:12:40.351552+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:40.351552+0000","last_undegraded":"2024-05-08T18:12:40.351552+0000","last_fullsized":"2024-05-08T18:12:40.351552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.351359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:49.624570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.826997+0000","last_change":"2024-05-08T18:12:46.826997+0000","last_active":"2024-05-08T18:12:46.826997+0000","last_peered":"2024-05-08T18:12:46.826997+0000","last_clean":"2024-05-08T18:12:46.826997+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:12:46.826997+0000","last_undegraded":"2024-05-08T18:12:46.826997+0000","last_fullsized":"2024-05-08T18:12:46.826997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.826741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:51.665811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:09.521508+0000","last_change":"2024-05-08T18:08:47.520615+0000","last_active":"2024-05-08T18:12:09.521508+0000","last_peered":"2024-05-08T18:12:09.521508+0000","last_clean":"2024-05-08T18:12:09.521508+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:12:09.521508+0000","last_undegraded":"2024-05-08T18:12:09.521508+0000","last_fullsized":"2024-05-08T18:12:09.521508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.210579+0000","last_change":"2024-05-08T18:13:11.210636+0000","last_active":"2024-05-08T18:13:11.210579+0000","last_peered":"2024-05-08T18:13:11.210579+0000","last_clean":"2024-05-08T18:13:11.210579+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:13:11.210579+0000","last_undegraded":"2024-05-08T18:13:11.210579+0000","last_fullsized":"2024-05-08T18:13:11.210579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:11.210380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:11.210380+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.210380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:17.869561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.899889+0000","last_change":"2024-05-08T18:12:54.899948+0000","last_active":"2024-05-08T18:12:54.899889+0000","last_peered":"2024-05-08T18:12:54.899889+0000","last_clean":"2024-05-08T18:12:54.899889+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:12:54.899889+0000","last_undegraded":"2024-05-08T18:12:54.899889+0000","last_fullsized":"2024-05-08T18:12:54.899889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:54.899696+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:54.899696+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.899696+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:37.754950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.977422+0000","last_change":"2024-05-08T18:12:51.977478+0000","last_active":"2024-05-08T18:12:51.977422+0000","last_peered":"2024-05-08T18:12:51.977422+0000","last_clean":"2024-05-08T18:12:51.977422+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:12:51.977422+0000","last_undegraded":"2024-05-08T18:12:51.977422+0000","last_fullsized":"2024-05-08T18:12:51.977422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:51.977218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:51.977218+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.977218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:15.519607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:16.431757+0000","last_change":"2024-05-08T18:09:28.589531+0000","last_active":"2024-05-08T18:11:16.431757+0000","last_peered":"2024-05-08T18:11:16.431757+0000","last_clean":"2024-05-08T18:11:16.431757+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:11:16.431757+0000","last_undegraded":"2024-05-08T18:11:16.431757+0000","last_fullsized":"2024-05-08T18:11:16.431757+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:48.457908+0000","last_clean_scrub_stamp":"2024-05-08T18:08:48.457908+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705724,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":145208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705724,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705723,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1024000,"data_stored":735055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705724,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":144761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:13:15.818 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.818 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.818 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.818 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.819 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.819 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.819 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.819 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.820 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.820 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.820 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.820 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.820 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.821 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.821 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.821 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.821 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.821 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.822 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.822 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.822 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.822 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T18:08:38.409703+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=38, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.823 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.823 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.823 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.823 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.823 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.824 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.824 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.824 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.824 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.825 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.825 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.825 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.825 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.825 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T18:08:48.457908+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=48, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:15.825 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:13:35.826 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:13:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.957+0000 7f7f27175640 1 Processor -- start 2024-05-08T18:13:35.961 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.957+0000 7f7f27175640 1 -- start start 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f7f2012f4f0 0x7f7f201318e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f20070940 con 0x7f7f2012c720 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f7f20113d70 con 0x7f7f2012f4f0 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f24f11640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f7f2012c720 0x7f7f2012cb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:58096/0 (socket says 172.21.15.53:58096) 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f24f11640 1 -- 172.21.15.53:0/1859135456 learned_addr learned my addr 172.21.15.53:0/1859135456 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1ffff640 1 --2- 172.21.15.53:0/1859135456 >> v2:172.21.15.53:3300/0 conn(0x7f7f2012f4f0 0x7f7f201318e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1ffff640 1 -- 172.21.15.53:0/1859135456 >> v1:172.21.15.53:6789/0 conn(0x7f7f2012c720 legacy=0x7f7f2012cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:35.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1ffff640 1 -- 172.21.15.53:0/1859135456 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2009e250 con 0x7f7f2012f4f0 2024-05-08T18:13:35.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1ffff640 1 --2- 172.21.15.53:0/1859135456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012f4f0 0x7f7f201318e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009740 tx=0x7f7f0801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609e189454488221 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:35.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1f7fe640 1 -- 172.21.15.53:0/1859135456 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f080b0070 con 0x7f7f2012f4f0 2024-05-08T18:13:35.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1f7fe640 1 -- 172.21.15.53:0/1859135456 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f080ab530 con 0x7f7f2012f4f0 2024-05-08T18:13:35.964 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f1f7fe640 1 -- 172.21.15.53:0/1859135456 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f080ab830 con 0x7f7f2012f4f0 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- 172.21.15.53:0/1859135456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012f4f0 msgr2=0x7f7f201318e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 --2- 172.21.15.53:0/1859135456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012f4f0 0x7f7f201318e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009740 tx=0x7f7f0801c370 comp rx=0 tx=0).stop 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- 172.21.15.53:0/1859135456 shutdown_connections 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 --2- 172.21.15.53:0/1859135456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012f4f0 0x7f7f201318e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- 172.21.15.53:0/1859135456 >> 172.21.15.53:0/1859135456 conn(0x7f7f2009be60 msgr2=0x7f7f2009d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- 172.21.15.53:0/1859135456 shutdown_connections 2024-05-08T18:13:35.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.961+0000 7f7f27175640 1 -- 172.21.15.53:0/1859135456 wait complete. 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 Processor -- start 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 -- start start 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 0x7f7f20126b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f7f201347c0 con 0x7f7f2012c720 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f24f11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 0x7f7f20126b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f24f11640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 0x7f7f20126b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:41900/0 (socket says 172.21.15.53:41900) 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f24f11640 1 -- 172.21.15.53:0/3605704077 learned_addr learned my addr 172.21.15.53:0/3605704077 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f24f11640 1 -- 172.21.15.53:0/3605704077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f201287c0 con 0x7f7f2012c720 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f24f11640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 0x7f7f20126b70 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800cbd0 tx=0x7f7f1800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f18017070 con 0x7f7f2012c720 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1800abc0 con 0x7f7f2012c720 2024-05-08T18:13:35.967 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f20129730 con 0x7f7f2012c720 2024-05-08T18:13:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f18012400 con 0x7f7f2012c720 2024-05-08T18:13:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f201270b0 con 0x7f7f2012c720 2024-05-08T18:13:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f7f1801a070 con 0x7f7f2012c720 2024-05-08T18:13:35.968 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f20064150 con 0x7f7f2012c720 2024-05-08T18:13:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1d7fa640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7f00039b50 0x7f7f0003c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f7f1804da40 con 0x7f7f2012c720 2024-05-08T18:13:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.965+0000 7f7f1ffff640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7f00039b50 0x7f7f0003c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:35.969 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.969+0000 7f7f1ffff640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7f00039b50 0x7f7f0003c010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f080ad000 tx=0x7f7f080a6000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:35.973 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:35.969+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7f180078c0 con 0x7f7f2012c720 2024-05-08T18:13:36.132 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.129+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f20127be0 con 0x7f7f00039b50 2024-05-08T18:13:36.178 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.177+0000 7f7f1d7fa640 1 -- 172.21.15.53:0/3605704077 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665659 (secure 0 0 0) 0x7f7f080093e0 con 0x7f7f00039b50 2024-05-08T18:13:36.182 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:13:36.190 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:13:36.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7f00039b50 msgr2=0x7f7f0003c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:36.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7f00039b50 0x7f7f0003c010 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f080ad000 tx=0x7f7f080a6000 comp rx=0 tx=0).stop 2024-05-08T18:13:36.191 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 msgr2=0x7f7f20126b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 0x7f7f20126b70 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800cbd0 tx=0x7f7f1800a430 comp rx=0 tx=0).stop 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 shutdown_connections 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f7f00039b50 0x7f7f0003c010 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 --2- 172.21.15.53:0/3605704077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2012c720 0x7f7f20126b70 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 >> 172.21.15.53:0/3605704077 conn(0x7f7f2009be60 msgr2=0x7f7f2012d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 shutdown_connections 2024-05-08T18:13:36.192 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:36.185+0000 7f7f27175640 1 -- 172.21.15.53:0/3605704077 wait complete. 2024-05-08T18:13:36.209 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-05-08T18:13:35.454375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603093,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5068,"num_read_kb":4654,"num_write":2121,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4744,"ondisk_log_size":4744,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1758306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006615"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.248061+0000","last_change":"2024-05-08T18:12:56.248061+0000","last_active":"2024-05-08T18:12:56.248061+0000","last_peered":"2024-05-08T18:12:56.248061+0000","last_clean":"2024-05-08T18:12:56.248061+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:12:56.248061+0000","last_undegraded":"2024-05-08T18:12:56.248061+0000","last_fullsized":"2024-05-08T18:12:56.248061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:56.247806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:56.247806+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.247806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:01.086876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":87,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.892197+0000","last_change":"2024-05-08T18:13:06.892256+0000","last_active":"2024-05-08T18:13:06.892197+0000","last_peered":"2024-05-08T18:13:06.892197+0000","last_clean":"2024-05-08T18:13:06.892197+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:13:06.892197+0000","last_undegraded":"2024-05-08T18:13:06.892197+0000","last_fullsized":"2024-05-08T18:13:06.892197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:13:06.892004+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:13:06.892004+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.892004+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:39.749902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.040493+0000","last_change":"2024-05-08T18:12:44.040493+0000","last_active":"2024-05-08T18:12:44.040493+0000","last_peered":"2024-05-08T18:12:44.040493+0000","last_clean":"2024-05-08T18:12:44.040493+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:12:44.040493+0000","last_undegraded":"2024-05-08T18:12:44.040493+0000","last_fullsized":"2024-05-08T18:12:44.040493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.040231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:27.160502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.148333+0000","last_change":"2024-05-08T18:13:05.148393+0000","last_active":"2024-05-08T18:13:05.148333+0000","last_peered":"2024-05-08T18:13:05.148333+0000","last_clean":"2024-05-08T18:13:05.148333+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:13:05.148333+0000","last_undegraded":"2024-05-08T18:13:05.148333+0000","last_fullsized":"2024-05-08T18:13:05.148333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:05.148127+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:05.148127+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.148127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:11.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.238634+0000","last_change":"2024-05-08T18:13:07.238700+0000","last_active":"2024-05-08T18:13:07.238634+0000","last_peered":"2024-05-08T18:13:07.238634+0000","last_clean":"2024-05-08T18:13:07.238634+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:13:07.238634+0000","last_undegraded":"2024-05-08T18:13:07.238634+0000","last_fullsized":"2024-05-08T18:13:07.238634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:07.238421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:07.238421+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.238421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:03.039607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.399421+0000","last_change":"2024-05-08T18:12:50.399487+0000","last_active":"2024-05-08T18:12:50.399421+0000","last_peered":"2024-05-08T18:12:50.399421+0000","last_clean":"2024-05-08T18:12:50.399421+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:50.399421+0000","last_undegraded":"2024-05-08T18:12:50.399421+0000","last_fullsized":"2024-05-08T18:12:50.399421+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.399205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:56.807281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.232589+0000","last_change":"2024-05-08T18:12:54.232650+0000","last_active":"2024-05-08T18:12:54.232589+0000","last_peered":"2024-05-08T18:12:54.232589+0000","last_clean":"2024-05-08T18:12:54.232589+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:12:54.232589+0000","last_undegraded":"2024-05-08T18:12:54.232589+0000","last_fullsized":"2024-05-08T18:12:54.232589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:54.232364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:54.232364+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.232364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:08.995302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.207777+0000","last_change":"2024-05-08T18:12:31.207848+0000","last_active":"2024-05-08T18:12:31.207777+0000","last_peered":"2024-05-08T18:12:31.207777+0000","last_clean":"2024-05-08T18:12:31.207777+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:12:31.207777+0000","last_undegraded":"2024-05-08T18:12:31.207777+0000","last_fullsized":"2024-05-08T18:12:31.207777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.207573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:31.053515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:15.257700+0000","last_change":"2024-05-08T18:13:15.257850+0000","last_active":"2024-05-08T18:13:15.257700+0000","last_peered":"2024-05-08T18:13:15.257700+0000","last_clean":"2024-05-08T18:13:15.257700+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:13:15.257700+0000","last_undegraded":"2024-05-08T18:13:15.257700+0000","last_fullsized":"2024-05-08T18:13:15.257700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:13:15.257418+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:13:15.257418+0000","last_clean_scrub_stamp":"2024-05-08T18:13:15.257418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:40.563872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.850755+0000","last_change":"2024-05-08T18:12:48.850755+0000","last_active":"2024-05-08T18:12:48.850755+0000","last_peered":"2024-05-08T18:12:48.850755+0000","last_clean":"2024-05-08T18:12:48.850755+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:12:48.850755+0000","last_undegraded":"2024-05-08T18:12:48.850755+0000","last_fullsized":"2024-05-08T18:12:48.850755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.850265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:19.763792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.266763+0000","last_change":"2024-05-08T18:12:44.266831+0000","last_active":"2024-05-08T18:12:44.266763+0000","last_peered":"2024-05-08T18:12:44.266763+0000","last_clean":"2024-05-08T18:12:44.266763+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:12:44.266763+0000","last_undegraded":"2024-05-08T18:12:44.266763+0000","last_fullsized":"2024-05-08T18:12:44.266763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.266562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:46.442140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.367754+0000","last_change":"2024-05-08T18:12:54.367754+0000","last_active":"2024-05-08T18:12:54.367754+0000","last_peered":"2024-05-08T18:12:54.367754+0000","last_clean":"2024-05-08T18:12:54.367754+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:54.367754+0000","last_undegraded":"2024-05-08T18:12:54.367754+0000","last_fullsized":"2024-05-08T18:12:54.367754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:54.367506+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:54.367506+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.367506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:00.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:31.208722+0000","last_change":"2024-05-08T18:13:31.208884+0000","last_active":"2024-05-08T18:13:31.208722+0000","last_peered":"2024-05-08T18:13:31.208722+0000","last_clean":"2024-05-08T18:13:31.208722+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:13:31.208722+0000","last_undegraded":"2024-05-08T18:13:31.208722+0000","last_fullsized":"2024-05-08T18:13:31.208722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:13:31.208482+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:13:31.208482+0000","last_clean_scrub_stamp":"2024-05-08T18:13:31.208482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:45.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.309526+0000","last_change":"2024-05-08T18:12:43.309526+0000","last_active":"2024-05-08T18:12:43.309526+0000","last_peered":"2024-05-08T18:12:43.309526+0000","last_clean":"2024-05-08T18:12:43.309526+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:43.309526+0000","last_undegraded":"2024-05-08T18:12:43.309526+0000","last_fullsized":"2024-05-08T18:12:43.309526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.309244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:57.449936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.942337+0000","last_change":"2024-05-08T18:13:03.942401+0000","last_active":"2024-05-08T18:13:03.942337+0000","last_peered":"2024-05-08T18:13:03.942337+0000","last_clean":"2024-05-08T18:13:03.942337+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:13:03.942337+0000","last_undegraded":"2024-05-08T18:13:03.942337+0000","last_fullsized":"2024-05-08T18:13:03.942337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:03.942113+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:03.942113+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.942113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:13.921262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.193621+0000","last_change":"2024-05-08T18:12:51.193621+0000","last_active":"2024-05-08T18:12:51.193621+0000","last_peered":"2024-05-08T18:12:51.193621+0000","last_clean":"2024-05-08T18:12:51.193621+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:51.193621+0000","last_undegraded":"2024-05-08T18:12:51.193621+0000","last_fullsized":"2024-05-08T18:12:51.193621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.193346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:23.431759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.261543+0000","last_change":"2024-05-08T18:13:02.261543+0000","last_active":"2024-05-08T18:13:02.261543+0000","last_peered":"2024-05-08T18:13:02.261543+0000","last_clean":"2024-05-08T18:13:02.261543+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:13:02.261543+0000","last_undegraded":"2024-05-08T18:13:02.261543+0000","last_fullsized":"2024-05-08T18:13:02.261543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:02.261275+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:02.261275+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.261275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:36.032032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.908511+0000","last_change":"2024-05-08T18:13:04.908577+0000","last_active":"2024-05-08T18:13:04.908511+0000","last_peered":"2024-05-08T18:13:04.908511+0000","last_clean":"2024-05-08T18:13:04.908511+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:13:04.908511+0000","last_undegraded":"2024-05-08T18:13:04.908511+0000","last_fullsized":"2024-05-08T18:13:04.908511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:04.908272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:04.908272+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.908272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:42.262211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.798700+0000","last_change":"2024-05-08T18:12:56.798700+0000","last_active":"2024-05-08T18:12:56.798700+0000","last_peered":"2024-05-08T18:12:56.798700+0000","last_clean":"2024-05-08T18:12:56.798700+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:56.798700+0000","last_undegraded":"2024-05-08T18:12:56.798700+0000","last_fullsized":"2024-05-08T18:12:56.798700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:56.798384+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:56.798384+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.798384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:56.254807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.180024+0000","last_change":"2024-05-08T18:12:59.180081+0000","last_active":"2024-05-08T18:12:59.180024+0000","last_peered":"2024-05-08T18:12:59.180024+0000","last_clean":"2024-05-08T18:12:59.180024+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:12:59.180024+0000","last_undegraded":"2024-05-08T18:12:59.180024+0000","last_fullsized":"2024-05-08T18:12:59.180024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.179832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.179832+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.179832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:07.279858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.778832+0000","last_change":"2024-05-08T18:12:54.778832+0000","last_active":"2024-05-08T18:12:54.778832+0000","last_peered":"2024-05-08T18:12:54.778832+0000","last_clean":"2024-05-08T18:12:54.778832+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:12:54.778832+0000","last_undegraded":"2024-05-08T18:12:54.778832+0000","last_fullsized":"2024-05-08T18:12:54.778832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:54.778578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:54.778578+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.778578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:40.040820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.823551+0000","last_change":"2024-05-08T18:12:53.823607+0000","last_active":"2024-05-08T18:12:53.823551+0000","last_peered":"2024-05-08T18:12:53.823551+0000","last_clean":"2024-05-08T18:12:53.823551+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:12:53.823551+0000","last_undegraded":"2024-05-08T18:12:53.823551+0000","last_fullsized":"2024-05-08T18:12:53.823551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:53.823360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:53.823360+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.823360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:44.187535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":117,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:13.947514+0000","last_change":"2024-05-08T18:13:13.947580+0000","last_active":"2024-05-08T18:13:13.947514+0000","last_peered":"2024-05-08T18:13:13.947514+0000","last_clean":"2024-05-08T18:13:13.947514+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:13:13.947514+0000","last_undegraded":"2024-05-08T18:13:13.947514+0000","last_fullsized":"2024-05-08T18:13:13.947514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:13:13.947306+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:13:13.947306+0000","last_clean_scrub_stamp":"2024-05-08T18:13:13.947306+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:25.277262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.819076+0000","last_change":"2024-05-08T18:13:01.819143+0000","last_active":"2024-05-08T18:13:01.819076+0000","last_peered":"2024-05-08T18:13:01.819076+0000","last_clean":"2024-05-08T18:13:01.819076+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:13:01.819076+0000","last_undegraded":"2024-05-08T18:13:01.819076+0000","last_fullsized":"2024-05-08T18:13:01.819076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:13:01.818889+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:13:01.818889+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.818889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:36.102569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.206865+0000","last_change":"2024-05-08T18:12:49.206927+0000","last_active":"2024-05-08T18:12:49.206865+0000","last_peered":"2024-05-08T18:12:49.206865+0000","last_clean":"2024-05-08T18:12:49.206865+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:49.206865+0000","last_undegraded":"2024-05-08T18:12:49.206865+0000","last_fullsized":"2024-05-08T18:12:49.206865+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.206666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.348056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.885478+0000","last_change":"2024-05-08T18:13:05.885545+0000","last_active":"2024-05-08T18:13:05.885478+0000","last_peered":"2024-05-08T18:13:05.885478+0000","last_clean":"2024-05-08T18:13:05.885478+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:13:05.885478+0000","last_undegraded":"2024-05-08T18:13:05.885478+0000","last_fullsized":"2024-05-08T18:13:05.885478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:05.885279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:05.885279+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.885279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:38.337159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.820924+0000","last_change":"2024-05-08T18:12:43.820989+0000","last_active":"2024-05-08T18:12:43.820924+0000","last_peered":"2024-05-08T18:12:43.820924+0000","last_clean":"2024-05-08T18:12:43.820924+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:12:43.820924+0000","last_undegraded":"2024-05-08T18:12:43.820924+0000","last_fullsized":"2024-05-08T18:12:43.820924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.820707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:27.113355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.148158+0000","last_change":"2024-05-08T18:08:47.499113+0000","last_active":"2024-05-08T18:12:14.148158+0000","last_peered":"2024-05-08T18:12:14.148158+0000","last_clean":"2024-05-08T18:12:14.148158+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:12:14.148158+0000","last_undegraded":"2024-05-08T18:12:14.148158+0000","last_fullsized":"2024-05-08T18:12:14.148158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.861935+0000","last_change":"2024-05-08T18:13:07.861997+0000","last_active":"2024-05-08T18:13:07.861935+0000","last_peered":"2024-05-08T18:13:07.861935+0000","last_clean":"2024-05-08T18:13:07.861935+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:13:07.861935+0000","last_undegraded":"2024-05-08T18:13:07.861935+0000","last_fullsized":"2024-05-08T18:13:07.861935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:13:07.861737+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:13:07.861737+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.861737+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:40.313616+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.234862+0000","last_change":"2024-05-08T18:12:37.234862+0000","last_active":"2024-05-08T18:12:37.234862+0000","last_peered":"2024-05-08T18:12:37.234862+0000","last_clean":"2024-05-08T18:12:37.234862+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:37.234862+0000","last_undegraded":"2024-05-08T18:12:37.234862+0000","last_fullsized":"2024-05-08T18:12:37.234862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.234593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:20.089848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147812+0000","last_change":"2024-05-08T18:08:47.528463+0000","last_active":"2024-05-08T18:12:14.147812+0000","last_peered":"2024-05-08T18:12:14.147812+0000","last_clean":"2024-05-08T18:12:14.147812+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:12:14.147812+0000","last_undegraded":"2024-05-08T18:12:14.147812+0000","last_fullsized":"2024-05-08T18:12:14.147812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.174115+0000","last_change":"2024-05-08T18:12:23.174172+0000","last_active":"2024-05-08T18:12:23.174115+0000","last_peered":"2024-05-08T18:12:23.174115+0000","last_clean":"2024-05-08T18:12:23.174115+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:12:23.174115+0000","last_undegraded":"2024-05-08T18:12:23.174115+0000","last_fullsized":"2024-05-08T18:12:23.174115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.173919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:15.795305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.265666+0000","last_change":"2024-05-08T18:12:36.265809+0000","last_active":"2024-05-08T18:12:36.265666+0000","last_peered":"2024-05-08T18:12:36.265666+0000","last_clean":"2024-05-08T18:12:36.265666+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:12:36.265666+0000","last_undegraded":"2024-05-08T18:12:36.265666+0000","last_fullsized":"2024-05-08T18:12:36.265666+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.265414+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:04.357749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.877627+0000","last_change":"2024-05-08T18:12:13.877680+0000","last_active":"2024-05-08T18:12:13.877627+0000","last_peered":"2024-05-08T18:12:13.877627+0000","last_clean":"2024-05-08T18:12:13.877627+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:12:13.877627+0000","last_undegraded":"2024-05-08T18:12:13.877627+0000","last_fullsized":"2024-05-08T18:12:13.877627+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.877412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:24.163300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.726142+0000","last_change":"2024-05-08T18:12:36.726229+0000","last_active":"2024-05-08T18:12:36.726142+0000","last_peered":"2024-05-08T18:12:36.726142+0000","last_clean":"2024-05-08T18:12:36.726142+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:12:36.726142+0000","last_undegraded":"2024-05-08T18:12:36.726142+0000","last_fullsized":"2024-05-08T18:12:36.726142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.725932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:50.918918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.242345+0000","last_change":"2024-05-08T18:12:34.242410+0000","last_active":"2024-05-08T18:12:34.242345+0000","last_peered":"2024-05-08T18:12:34.242345+0000","last_clean":"2024-05-08T18:12:34.242345+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:34.242345+0000","last_undegraded":"2024-05-08T18:12:34.242345+0000","last_fullsized":"2024-05-08T18:12:34.242345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.242141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:57.784530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.323322+0000","last_change":"2024-05-08T18:12:42.323322+0000","last_active":"2024-05-08T18:12:42.323322+0000","last_peered":"2024-05-08T18:12:42.323322+0000","last_clean":"2024-05-08T18:12:42.323322+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:12:42.323322+0000","last_undegraded":"2024-05-08T18:12:42.323322+0000","last_fullsized":"2024-05-08T18:12:42.323322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.322977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:09.542329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.020423+0000","last_change":"2024-05-08T18:12:38.020423+0000","last_active":"2024-05-08T18:12:38.020423+0000","last_peered":"2024-05-08T18:12:38.020423+0000","last_clean":"2024-05-08T18:12:38.020423+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:12:38.020423+0000","last_undegraded":"2024-05-08T18:12:38.020423+0000","last_fullsized":"2024-05-08T18:12:38.020423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.020159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:12.758346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.937689+0000","last_change":"2024-05-08T18:12:17.937761+0000","last_active":"2024-05-08T18:12:17.937689+0000","last_peered":"2024-05-08T18:12:17.937689+0000","last_clean":"2024-05-08T18:12:17.937689+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:12:17.937689+0000","last_undegraded":"2024-05-08T18:12:17.937689+0000","last_fullsized":"2024-05-08T18:12:17.937689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.937441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:59.874450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.894100+0000","last_change":"2024-05-08T18:12:16.894205+0000","last_active":"2024-05-08T18:12:16.894100+0000","last_peered":"2024-05-08T18:12:16.894100+0000","last_clean":"2024-05-08T18:12:16.894100+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:12:16.894100+0000","last_undegraded":"2024-05-08T18:12:16.894100+0000","last_fullsized":"2024-05-08T18:12:16.894100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.893872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:45.046890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.863001+0000","last_change":"2024-05-08T18:13:08.863072+0000","last_active":"2024-05-08T18:13:08.863001+0000","last_peered":"2024-05-08T18:13:08.863001+0000","last_clean":"2024-05-08T18:13:08.863001+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:13:08.863001+0000","last_undegraded":"2024-05-08T18:13:08.863001+0000","last_fullsized":"2024-05-08T18:13:08.863001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:13:08.862805+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:13:08.862805+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.862805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:15.270881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.214586+0000","last_change":"2024-05-08T18:12:26.214649+0000","last_active":"2024-05-08T18:12:26.214586+0000","last_peered":"2024-05-08T18:12:26.214586+0000","last_clean":"2024-05-08T18:12:26.214586+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:26.214586+0000","last_undegraded":"2024-05-08T18:12:26.214586+0000","last_fullsized":"2024-05-08T18:12:26.214586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.214403+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:05.554391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:18.209577+0000","last_change":"2024-05-08T18:13:18.209577+0000","last_active":"2024-05-08T18:13:18.209577+0000","last_peered":"2024-05-08T18:13:18.209577+0000","last_clean":"2024-05-08T18:13:18.209577+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:13:18.209577+0000","last_undegraded":"2024-05-08T18:13:18.209577+0000","last_fullsized":"2024-05-08T18:13:18.209577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:18.209288+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:18.209288+0000","last_clean_scrub_stamp":"2024-05-08T18:13:18.209288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:25.457604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.023222+0000","last_change":"2024-05-08T18:12:31.023275+0000","last_active":"2024-05-08T18:12:31.023222+0000","last_peered":"2024-05-08T18:12:31.023222+0000","last_clean":"2024-05-08T18:12:31.023222+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:12:31.023222+0000","last_undegraded":"2024-05-08T18:12:31.023222+0000","last_fullsized":"2024-05-08T18:12:31.023222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.023023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:20.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.430136+0000","last_change":"2024-05-08T18:12:24.430290+0000","last_active":"2024-05-08T18:12:24.430136+0000","last_peered":"2024-05-08T18:12:24.430136+0000","last_clean":"2024-05-08T18:12:24.430136+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:12:24.430136+0000","last_undegraded":"2024-05-08T18:12:24.430136+0000","last_fullsized":"2024-05-08T18:12:24.430136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.429852+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:02.971977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":404,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.358867+0000","last_change":"2024-05-08T18:12:48.358931+0000","last_active":"2024-05-08T18:12:48.358867+0000","last_peered":"2024-05-08T18:12:48.358867+0000","last_clean":"2024-05-08T18:12:48.358867+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:48.358867+0000","last_undegraded":"2024-05-08T18:12:48.358867+0000","last_fullsized":"2024-05-08T18:12:48.358867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.358666+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:43.819172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.434500+0000","last_change":"2024-05-08T18:12:27.434651+0000","last_active":"2024-05-08T18:12:27.434500+0000","last_peered":"2024-05-08T18:12:27.434500+0000","last_clean":"2024-05-08T18:12:27.434500+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:27.434500+0000","last_undegraded":"2024-05-08T18:12:27.434500+0000","last_fullsized":"2024-05-08T18:12:27.434500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.434279+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:06.052889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.868783+0000","last_change":"2024-05-08T18:13:06.868912+0000","last_active":"2024-05-08T18:13:06.868783+0000","last_peered":"2024-05-08T18:13:06.868783+0000","last_clean":"2024-05-08T18:13:06.868783+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:13:06.868783+0000","last_undegraded":"2024-05-08T18:13:06.868783+0000","last_fullsized":"2024-05-08T18:13:06.868783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:06.868553+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:06.868553+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.868553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:50.814314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.870256+0000","last_change":"2024-05-08T18:13:03.870256+0000","last_active":"2024-05-08T18:13:03.870256+0000","last_peered":"2024-05-08T18:13:03.870256+0000","last_clean":"2024-05-08T18:13:03.870256+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:13:03.870256+0000","last_undegraded":"2024-05-08T18:13:03.870256+0000","last_fullsized":"2024-05-08T18:13:03.870256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:03.869968+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:03.869968+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.869968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:47.740107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.120514+0000","last_change":"2024-05-08T18:12:16.120572+0000","last_active":"2024-05-08T18:12:16.120514+0000","last_peered":"2024-05-08T18:12:16.120514+0000","last_clean":"2024-05-08T18:12:16.120514+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:12:16.120514+0000","last_undegraded":"2024-05-08T18:12:16.120514+0000","last_fullsized":"2024-05-08T18:12:16.120514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.120296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:25.274533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.373809+0000","last_change":"2024-05-08T18:12:22.373889+0000","last_active":"2024-05-08T18:12:22.373809+0000","last_peered":"2024-05-08T18:12:22.373809+0000","last_clean":"2024-05-08T18:12:22.373809+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:12:22.373809+0000","last_undegraded":"2024-05-08T18:12:22.373809+0000","last_fullsized":"2024-05-08T18:12:22.373809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.373620+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:49.336729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":414,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.917276+0000","last_change":"2024-05-08T18:12:24.917353+0000","last_active":"2024-05-08T18:12:24.917276+0000","last_peered":"2024-05-08T18:12:24.917276+0000","last_clean":"2024-05-08T18:12:24.917276+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:24.917276+0000","last_undegraded":"2024-05-08T18:12:24.917276+0000","last_fullsized":"2024-05-08T18:12:24.917276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.917056+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:36.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.379434+0000","last_change":"2024-05-08T18:12:55.379434+0000","last_active":"2024-05-08T18:12:55.379434+0000","last_peered":"2024-05-08T18:12:55.379434+0000","last_clean":"2024-05-08T18:12:55.379434+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:55.379434+0000","last_undegraded":"2024-05-08T18:12:55.379434+0000","last_fullsized":"2024-05-08T18:12:55.379434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:55.379170+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:55.379170+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.379170+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:34.739950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.201917+0000","last_change":"2024-05-08T18:12:58.201917+0000","last_active":"2024-05-08T18:12:58.201917+0000","last_peered":"2024-05-08T18:12:58.201917+0000","last_clean":"2024-05-08T18:12:58.201917+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:12:58.201917+0000","last_undegraded":"2024-05-08T18:12:58.201917+0000","last_fullsized":"2024-05-08T18:12:58.201917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:58.201466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:58.201466+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.201466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:29.114994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.808713+0000","last_change":"2024-05-08T18:12:30.808713+0000","last_active":"2024-05-08T18:12:30.808713+0000","last_peered":"2024-05-08T18:12:30.808713+0000","last_clean":"2024-05-08T18:12:30.808713+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:12:30.808713+0000","last_undegraded":"2024-05-08T18:12:30.808713+0000","last_fullsized":"2024-05-08T18:12:30.808713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.808460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:40.081671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.443964+0000","last_change":"2024-05-08T18:12:25.443964+0000","last_active":"2024-05-08T18:12:25.443964+0000","last_peered":"2024-05-08T18:12:25.443964+0000","last_clean":"2024-05-08T18:12:25.443964+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:12:25.443964+0000","last_undegraded":"2024-05-08T18:12:25.443964+0000","last_fullsized":"2024-05-08T18:12:25.443964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.443551+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:01.194660+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.977194+0000","last_change":"2024-05-08T18:12:18.977194+0000","last_active":"2024-05-08T18:12:18.977194+0000","last_peered":"2024-05-08T18:12:18.977194+0000","last_clean":"2024-05-08T18:12:18.977194+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:12:18.977194+0000","last_undegraded":"2024-05-08T18:12:18.977194+0000","last_fullsized":"2024-05-08T18:12:18.977194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.976803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:31.754400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.404620+0000","last_change":"2024-05-08T18:12:23.404620+0000","last_active":"2024-05-08T18:12:23.404620+0000","last_peered":"2024-05-08T18:12:23.404620+0000","last_clean":"2024-05-08T18:12:23.404620+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:12:23.404620+0000","last_undegraded":"2024-05-08T18:12:23.404620+0000","last_fullsized":"2024-05-08T18:12:23.404620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.404248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:38.428265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.842273+0000","last_change":"2024-05-08T18:12:44.842273+0000","last_active":"2024-05-08T18:12:44.842273+0000","last_peered":"2024-05-08T18:12:44.842273+0000","last_clean":"2024-05-08T18:12:44.842273+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:12:44.842273+0000","last_undegraded":"2024-05-08T18:12:44.842273+0000","last_fullsized":"2024-05-08T18:12:44.842273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.842022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:59.604961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.147942+0000","last_change":"2024-05-08T18:12:52.147942+0000","last_active":"2024-05-08T18:12:52.147942+0000","last_peered":"2024-05-08T18:12:52.147942+0000","last_clean":"2024-05-08T18:12:52.147942+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:12:52.147942+0000","last_undegraded":"2024-05-08T18:12:52.147942+0000","last_fullsized":"2024-05-08T18:12:52.147942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:52.147668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:52.147668+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.147668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:18.379328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.105889+0000","last_change":"2024-05-08T18:13:06.106025+0000","last_active":"2024-05-08T18:13:06.105889+0000","last_peered":"2024-05-08T18:13:06.105889+0000","last_clean":"2024-05-08T18:13:06.105889+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:13:06.105889+0000","last_undegraded":"2024-05-08T18:13:06.105889+0000","last_fullsized":"2024-05-08T18:13:06.105889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:06.105659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:06.105659+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.105659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:48.960913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.327923+0000","last_change":"2024-05-08T18:12:42.327923+0000","last_active":"2024-05-08T18:12:42.327923+0000","last_peered":"2024-05-08T18:12:42.327923+0000","last_clean":"2024-05-08T18:12:42.327923+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:12:42.327923+0000","last_undegraded":"2024-05-08T18:12:42.327923+0000","last_fullsized":"2024-05-08T18:12:42.327923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.327508+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:15.103422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.889091+0000","last_change":"2024-05-08T18:12:14.889091+0000","last_active":"2024-05-08T18:12:14.889091+0000","last_peered":"2024-05-08T18:12:14.889091+0000","last_clean":"2024-05-08T18:12:14.889091+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:12:14.889091+0000","last_undegraded":"2024-05-08T18:12:14.889091+0000","last_fullsized":"2024-05-08T18:12:14.889091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.888837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:43.041854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.881815+0000","last_change":"2024-05-08T18:13:11.881883+0000","last_active":"2024-05-08T18:13:11.881815+0000","last_peered":"2024-05-08T18:13:11.881815+0000","last_clean":"2024-05-08T18:13:11.881815+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:13:11.881815+0000","last_undegraded":"2024-05-08T18:13:11.881815+0000","last_fullsized":"2024-05-08T18:13:11.881815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:11.881614+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:11.881614+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.881614+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:38.201456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.229409+0000","last_change":"2024-05-08T18:12:45.229409+0000","last_active":"2024-05-08T18:12:45.229409+0000","last_peered":"2024-05-08T18:12:45.229409+0000","last_clean":"2024-05-08T18:12:45.229409+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:45.229409+0000","last_undegraded":"2024-05-08T18:12:45.229409+0000","last_fullsized":"2024-05-08T18:12:45.229409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.229157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:54.383394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:23.210847+0000","last_change":"2024-05-08T18:13:23.210907+0000","last_active":"2024-05-08T18:13:23.210847+0000","last_peered":"2024-05-08T18:13:23.210847+0000","last_clean":"2024-05-08T18:13:23.210847+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:13:23.210847+0000","last_undegraded":"2024-05-08T18:13:23.210847+0000","last_fullsized":"2024-05-08T18:13:23.210847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:23.210647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:23.210647+0000","last_clean_scrub_stamp":"2024-05-08T18:13:23.210647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:28.297936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.003372+0000","last_change":"2024-05-08T18:12:32.003372+0000","last_active":"2024-05-08T18:12:32.003372+0000","last_peered":"2024-05-08T18:12:32.003372+0000","last_clean":"2024-05-08T18:12:32.003372+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:12:32.003372+0000","last_undegraded":"2024-05-08T18:12:32.003372+0000","last_fullsized":"2024-05-08T18:12:32.003372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.003096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:34.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.137373+0000","last_change":"2024-05-08T18:12:22.137373+0000","last_active":"2024-05-08T18:12:22.137373+0000","last_peered":"2024-05-08T18:12:22.137373+0000","last_clean":"2024-05-08T18:12:22.137373+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:12:22.137373+0000","last_undegraded":"2024-05-08T18:12:22.137373+0000","last_fullsized":"2024-05-08T18:12:22.137373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.137072+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.003539+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.931134+0000","last_change":"2024-05-08T18:12:13.931134+0000","last_active":"2024-05-08T18:12:13.931134+0000","last_peered":"2024-05-08T18:12:13.931134+0000","last_clean":"2024-05-08T18:12:13.931134+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:13.931134+0000","last_undegraded":"2024-05-08T18:12:13.931134+0000","last_fullsized":"2024-05-08T18:12:13.931134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.931028+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:49.682137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:12.913550+0000","last_change":"2024-05-08T18:13:12.913550+0000","last_active":"2024-05-08T18:13:12.913550+0000","last_peered":"2024-05-08T18:13:12.913550+0000","last_clean":"2024-05-08T18:13:12.913550+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:13:12.913550+0000","last_undegraded":"2024-05-08T18:13:12.913550+0000","last_fullsized":"2024-05-08T18:13:12.913550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:12.913308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:12.913308+0000","last_clean_scrub_stamp":"2024-05-08T18:13:12.913308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:54.296537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.376977+0000","last_change":"2024-05-08T18:12:38.376977+0000","last_active":"2024-05-08T18:12:38.376977+0000","last_peered":"2024-05-08T18:12:38.376977+0000","last_clean":"2024-05-08T18:12:38.376977+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:12:38.376977+0000","last_undegraded":"2024-05-08T18:12:38.376977+0000","last_fullsized":"2024-05-08T18:12:38.376977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.376714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:00.741888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:16.282627+0000","last_change":"2024-05-08T18:13:16.282627+0000","last_active":"2024-05-08T18:13:16.282627+0000","last_peered":"2024-05-08T18:13:16.282627+0000","last_clean":"2024-05-08T18:13:16.282627+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:13:16.282627+0000","last_undegraded":"2024-05-08T18:13:16.282627+0000","last_fullsized":"2024-05-08T18:13:16.282627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:16.282359+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:16.282359+0000","last_clean_scrub_stamp":"2024-05-08T18:13:16.282359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:45.788437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.091185+0000","last_change":"2024-05-08T18:13:07.091236+0000","last_active":"2024-05-08T18:13:07.091185+0000","last_peered":"2024-05-08T18:13:07.091185+0000","last_clean":"2024-05-08T18:13:07.091185+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:13:07.091185+0000","last_undegraded":"2024-05-08T18:13:07.091185+0000","last_fullsized":"2024-05-08T18:13:07.091185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:07.090998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:07.090998+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.090998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:21.221385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'65","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.376725+0000","last_change":"2024-05-08T18:12:49.376725+0000","last_active":"2024-05-08T18:12:49.376725+0000","last_peered":"2024-05-08T18:12:49.376725+0000","last_clean":"2024-05-08T18:12:49.376725+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:12:49.376725+0000","last_undegraded":"2024-05-08T18:12:49.376725+0000","last_fullsized":"2024-05-08T18:12:49.376725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.376328+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:33.322089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.918122+0000","last_change":"2024-05-08T18:12:16.918122+0000","last_active":"2024-05-08T18:12:16.918122+0000","last_peered":"2024-05-08T18:12:16.918122+0000","last_clean":"2024-05-08T18:12:16.918122+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:12:16.918122+0000","last_undegraded":"2024-05-08T18:12:16.918122+0000","last_fullsized":"2024-05-08T18:12:16.918122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.917861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:11.528942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.054066+0000","last_change":"2024-05-08T18:12:41.054066+0000","last_active":"2024-05-08T18:12:41.054066+0000","last_peered":"2024-05-08T18:12:41.054066+0000","last_clean":"2024-05-08T18:12:41.054066+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:41.054066+0000","last_undegraded":"2024-05-08T18:12:41.054066+0000","last_fullsized":"2024-05-08T18:12:41.054066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.053624+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:02:46.543372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.769660+0000","last_change":"2024-05-08T18:12:35.769660+0000","last_active":"2024-05-08T18:12:35.769660+0000","last_peered":"2024-05-08T18:12:35.769660+0000","last_clean":"2024-05-08T18:12:35.769660+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:12:35.769660+0000","last_undegraded":"2024-05-08T18:12:35.769660+0000","last_fullsized":"2024-05-08T18:12:35.769660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.769378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:44.923615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.963915+0000","last_change":"2024-05-08T18:13:01.963915+0000","last_active":"2024-05-08T18:13:01.963915+0000","last_peered":"2024-05-08T18:13:01.963915+0000","last_clean":"2024-05-08T18:13:01.963915+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:13:01.963915+0000","last_undegraded":"2024-05-08T18:13:01.963915+0000","last_fullsized":"2024-05-08T18:13:01.963915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:01.963654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:01.963654+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.963654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:08.778529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.445639+0000","last_change":"2024-05-08T18:12:34.445639+0000","last_active":"2024-05-08T18:12:34.445639+0000","last_peered":"2024-05-08T18:12:34.445639+0000","last_clean":"2024-05-08T18:12:34.445639+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:12:34.445639+0000","last_undegraded":"2024-05-08T18:12:34.445639+0000","last_fullsized":"2024-05-08T18:12:34.445639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.445366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:27.788124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.976447+0000","last_change":"2024-05-08T18:12:19.976447+0000","last_active":"2024-05-08T18:12:19.976447+0000","last_peered":"2024-05-08T18:12:19.976447+0000","last_clean":"2024-05-08T18:12:19.976447+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:12:19.976447+0000","last_undegraded":"2024-05-08T18:12:19.976447+0000","last_fullsized":"2024-05-08T18:12:19.976447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.976156+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:44.797089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.382028+0000","last_change":"2024-05-08T18:12:56.382028+0000","last_active":"2024-05-08T18:12:56.382028+0000","last_peered":"2024-05-08T18:12:56.382028+0000","last_clean":"2024-05-08T18:12:56.382028+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:12:56.382028+0000","last_undegraded":"2024-05-08T18:12:56.382028+0000","last_fullsized":"2024-05-08T18:12:56.382028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:56.381778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:56.381778+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.381778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:56.402417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.150035+0000","last_change":"2024-05-08T18:08:57.575388+0000","last_active":"2024-05-08T18:12:14.150035+0000","last_peered":"2024-05-08T18:12:14.150035+0000","last_clean":"2024-05-08T18:12:14.150035+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:12:14.150035+0000","last_undegraded":"2024-05-08T18:12:14.150035+0000","last_fullsized":"2024-05-08T18:12:14.150035+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.246550+0000","last_change":"2024-05-08T18:12:27.246550+0000","last_active":"2024-05-08T18:12:27.246550+0000","last_peered":"2024-05-08T18:12:27.246550+0000","last_clean":"2024-05-08T18:12:27.246550+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:27.246550+0000","last_undegraded":"2024-05-08T18:12:27.246550+0000","last_fullsized":"2024-05-08T18:12:27.246550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.246102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:55.984072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:21.241050+0000","last_change":"2024-05-08T18:13:21.241178+0000","last_active":"2024-05-08T18:13:21.241050+0000","last_peered":"2024-05-08T18:13:21.241050+0000","last_clean":"2024-05-08T18:13:21.241050+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:13:21.241050+0000","last_undegraded":"2024-05-08T18:13:21.241050+0000","last_fullsized":"2024-05-08T18:13:21.241050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:21.240741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:21.240741+0000","last_clean_scrub_stamp":"2024-05-08T18:13:21.240741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:40.562247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.057479+0000","last_change":"2024-05-08T18:12:30.057479+0000","last_active":"2024-05-08T18:12:30.057479+0000","last_peered":"2024-05-08T18:12:30.057479+0000","last_clean":"2024-05-08T18:12:30.057479+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:12:30.057479+0000","last_undegraded":"2024-05-08T18:12:30.057479+0000","last_fullsized":"2024-05-08T18:12:30.057479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:54.634269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.405733+0000","last_change":"2024-05-08T18:12:28.405733+0000","last_active":"2024-05-08T18:12:28.405733+0000","last_peered":"2024-05-08T18:12:28.405733+0000","last_clean":"2024-05-08T18:12:28.405733+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:12:28.405733+0000","last_undegraded":"2024-05-08T18:12:28.405733+0000","last_fullsized":"2024-05-08T18:12:28.405733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.405516+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:23.016597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.441218+0000","last_change":"2024-05-08T18:12:15.441218+0000","last_active":"2024-05-08T18:12:15.441218+0000","last_peered":"2024-05-08T18:12:15.441218+0000","last_clean":"2024-05-08T18:12:15.441218+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:15.441218+0000","last_undegraded":"2024-05-08T18:12:15.441218+0000","last_fullsized":"2024-05-08T18:12:15.441218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.440939+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:26.637944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.873518+0000","last_change":"2024-05-08T18:13:11.873618+0000","last_active":"2024-05-08T18:13:11.873518+0000","last_peered":"2024-05-08T18:13:11.873518+0000","last_clean":"2024-05-08T18:13:11.873518+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:13:11.873518+0000","last_undegraded":"2024-05-08T18:13:11.873518+0000","last_fullsized":"2024-05-08T18:13:11.873518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T18:13:11.873300+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T18:13:11.873300+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.873300+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:10.588507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.183516+0000","last_change":"2024-05-08T18:12:47.183516+0000","last_active":"2024-05-08T18:12:47.183516+0000","last_peered":"2024-05-08T18:12:47.183516+0000","last_clean":"2024-05-08T18:12:47.183516+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:12:47.183516+0000","last_undegraded":"2024-05-08T18:12:47.183516+0000","last_fullsized":"2024-05-08T18:12:47.183516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.183265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:54.291097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:19.187838+0000","last_change":"2024-05-08T18:13:19.187905+0000","last_active":"2024-05-08T18:13:19.187838+0000","last_peered":"2024-05-08T18:13:19.187838+0000","last_clean":"2024-05-08T18:13:19.187838+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:13:19.187838+0000","last_undegraded":"2024-05-08T18:13:19.187838+0000","last_fullsized":"2024-05-08T18:13:19.187838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:19.187628+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:19.187628+0000","last_clean_scrub_stamp":"2024-05-08T18:13:19.187628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.770747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.896053+0000","last_change":"2024-05-08T18:12:27.896053+0000","last_active":"2024-05-08T18:12:27.896053+0000","last_peered":"2024-05-08T18:12:27.896053+0000","last_clean":"2024-05-08T18:12:27.896053+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:12:27.896053+0000","last_undegraded":"2024-05-08T18:12:27.896053+0000","last_fullsized":"2024-05-08T18:12:27.896053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.895781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:25.396027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.280066+0000","last_change":"2024-05-08T18:12:41.280066+0000","last_active":"2024-05-08T18:12:41.280066+0000","last_peered":"2024-05-08T18:12:41.280066+0000","last_clean":"2024-05-08T18:12:41.280066+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:12:41.280066+0000","last_undegraded":"2024-05-08T18:12:41.280066+0000","last_fullsized":"2024-05-08T18:12:41.280066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.279763+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:03.126482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.876546+0000","last_change":"2024-05-08T18:12:28.876546+0000","last_active":"2024-05-08T18:12:28.876546+0000","last_peered":"2024-05-08T18:12:28.876546+0000","last_clean":"2024-05-08T18:12:28.876546+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:28.876546+0000","last_undegraded":"2024-05-08T18:12:28.876546+0000","last_fullsized":"2024-05-08T18:12:28.876546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.876292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:13:51.241466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.173413+0000","last_change":"2024-05-08T18:13:02.173413+0000","last_active":"2024-05-08T18:13:02.173413+0000","last_peered":"2024-05-08T18:13:02.173413+0000","last_clean":"2024-05-08T18:13:02.173413+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:13:02.173413+0000","last_undegraded":"2024-05-08T18:13:02.173413+0000","last_fullsized":"2024-05-08T18:13:02.173413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:02.173161+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:02.173161+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.173161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:43.568916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.735463+0000","last_change":"2024-05-08T18:12:37.735463+0000","last_active":"2024-05-08T18:12:37.735463+0000","last_peered":"2024-05-08T18:12:37.735463+0000","last_clean":"2024-05-08T18:12:37.735463+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:37.735463+0000","last_undegraded":"2024-05-08T18:12:37.735463+0000","last_fullsized":"2024-05-08T18:12:37.735463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.735180+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:44.843012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.188288+0000","last_change":"2024-05-08T18:13:06.188288+0000","last_active":"2024-05-08T18:13:06.188288+0000","last_peered":"2024-05-08T18:13:06.188288+0000","last_clean":"2024-05-08T18:13:06.188288+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:13:06.188288+0000","last_undegraded":"2024-05-08T18:13:06.188288+0000","last_fullsized":"2024-05-08T18:13:06.188288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:06.188003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:06.188003+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.188003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:36.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.106450+0000","last_change":"2024-05-08T18:12:17.106450+0000","last_active":"2024-05-08T18:12:17.106450+0000","last_peered":"2024-05-08T18:12:17.106450+0000","last_clean":"2024-05-08T18:12:17.106450+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:12:17.106450+0000","last_undegraded":"2024-05-08T18:12:17.106450+0000","last_fullsized":"2024-05-08T18:12:17.106450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.106103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:31.299089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.947331+0000","last_change":"2024-05-08T18:12:21.947331+0000","last_active":"2024-05-08T18:12:21.947331+0000","last_peered":"2024-05-08T18:12:21.947331+0000","last_clean":"2024-05-08T18:12:21.947331+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:12:21.947331+0000","last_undegraded":"2024-05-08T18:12:21.947331+0000","last_fullsized":"2024-05-08T18:12:21.947331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.947022+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:33.614218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.369656+0000","last_change":"2024-05-08T18:12:20.369656+0000","last_active":"2024-05-08T18:12:20.369656+0000","last_peered":"2024-05-08T18:12:20.369656+0000","last_clean":"2024-05-08T18:12:20.369656+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:12:20.369656+0000","last_undegraded":"2024-05-08T18:12:20.369656+0000","last_fullsized":"2024-05-08T18:12:20.369656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.369368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:12.685507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.847346+0000","last_change":"2024-05-08T18:13:08.847346+0000","last_active":"2024-05-08T18:13:08.847346+0000","last_peered":"2024-05-08T18:13:08.847346+0000","last_clean":"2024-05-08T18:13:08.847346+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:13:08.847346+0000","last_undegraded":"2024-05-08T18:13:08.847346+0000","last_fullsized":"2024-05-08T18:13:08.847346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:13:08.846978+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:13:08.846978+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.846978+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.532271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'12","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.335989+0000","last_change":"2024-05-08T18:12:59.335989+0000","last_active":"2024-05-08T18:12:59.335989+0000","last_peered":"2024-05-08T18:12:59.335989+0000","last_clean":"2024-05-08T18:12:59.335989+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:59.335989+0000","last_undegraded":"2024-05-08T18:12:59.335989+0000","last_fullsized":"2024-05-08T18:12:59.335989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:59.335739+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:59.335739+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.335739+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:09.899686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.842012+0000","last_change":"2024-05-08T18:12:58.842089+0000","last_active":"2024-05-08T18:12:58.842012+0000","last_peered":"2024-05-08T18:12:58.842012+0000","last_clean":"2024-05-08T18:12:58.842012+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:12:58.842012+0000","last_undegraded":"2024-05-08T18:12:58.842012+0000","last_fullsized":"2024-05-08T18:12:58.842012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-05-08T18:12:58.841819+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-05-08T18:12:58.841819+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.841819+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:12.972206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:29.208912+0000","last_change":"2024-05-08T18:13:29.209051+0000","last_active":"2024-05-08T18:13:29.208912+0000","last_peered":"2024-05-08T18:13:29.208912+0000","last_clean":"2024-05-08T18:13:29.208912+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:13:29.208912+0000","last_undegraded":"2024-05-08T18:13:29.208912+0000","last_fullsized":"2024-05-08T18:13:29.208912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:29.208645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:29.208645+0000","last_clean_scrub_stamp":"2024-05-08T18:13:29.208645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.126520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:22.196296+0000","last_change":"2024-05-08T18:13:22.196453+0000","last_active":"2024-05-08T18:13:22.196296+0000","last_peered":"2024-05-08T18:13:22.196296+0000","last_clean":"2024-05-08T18:13:22.196296+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:13:22.196296+0000","last_undegraded":"2024-05-08T18:13:22.196296+0000","last_fullsized":"2024-05-08T18:13:22.196296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:22.196051+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:22.196051+0000","last_clean_scrub_stamp":"2024-05-08T18:13:22.196051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:38.694602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.832156+0000","last_change":"2024-05-08T18:12:25.832156+0000","last_active":"2024-05-08T18:12:25.832156+0000","last_peered":"2024-05-08T18:12:25.832156+0000","last_clean":"2024-05-08T18:12:25.832156+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:12:25.832156+0000","last_undegraded":"2024-05-08T18:12:25.832156+0000","last_fullsized":"2024-05-08T18:12:25.832156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.831900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:22.583694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'93","reported_seq":184,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.436762+0000","last_change":"2024-05-08T18:12:46.436762+0000","last_active":"2024-05-08T18:12:46.436762+0000","last_peered":"2024-05-08T18:12:46.436762+0000","last_clean":"2024-05-08T18:12:46.436762+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:46.436762+0000","last_undegraded":"2024-05-08T18:12:46.436762+0000","last_fullsized":"2024-05-08T18:12:46.436762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.436505+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:33.626162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.052679+0000","last_change":"2024-05-08T18:12:29.052679+0000","last_active":"2024-05-08T18:12:29.052679+0000","last_peered":"2024-05-08T18:12:29.052679+0000","last_clean":"2024-05-08T18:12:29.052679+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:12:29.052679+0000","last_undegraded":"2024-05-08T18:12:29.052679+0000","last_fullsized":"2024-05-08T18:12:29.052679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.052326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:01.660597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.404834+0000","last_change":"2024-05-08T18:12:35.404834+0000","last_active":"2024-05-08T18:12:35.404834+0000","last_peered":"2024-05-08T18:12:35.404834+0000","last_clean":"2024-05-08T18:12:35.404834+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:35.404834+0000","last_undegraded":"2024-05-08T18:12:35.404834+0000","last_fullsized":"2024-05-08T18:12:35.404834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.404580+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.156373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.301685+0000","last_change":"2024-05-08T18:13:01.301685+0000","last_active":"2024-05-08T18:13:01.301685+0000","last_peered":"2024-05-08T18:13:01.301685+0000","last_clean":"2024-05-08T18:13:01.301685+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:13:01.301685+0000","last_undegraded":"2024-05-08T18:13:01.301685+0000","last_fullsized":"2024-05-08T18:13:01.301685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-05-08T18:13:01.301413+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-05-08T18:13:01.301413+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.301413+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:44.881643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:27.209606+0000","last_change":"2024-05-08T18:13:27.209690+0000","last_active":"2024-05-08T18:13:27.209606+0000","last_peered":"2024-05-08T18:13:27.209606+0000","last_clean":"2024-05-08T18:13:27.209606+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:13:27.209606+0000","last_undegraded":"2024-05-08T18:13:27.209606+0000","last_fullsized":"2024-05-08T18:13:27.209606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:27.209355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:27.209355+0000","last_clean_scrub_stamp":"2024-05-08T18:13:27.209355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:51.205512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.887765+0000","last_change":"2024-05-08T18:12:55.887765+0000","last_active":"2024-05-08T18:12:55.887765+0000","last_peered":"2024-05-08T18:12:55.887765+0000","last_clean":"2024-05-08T18:12:55.887765+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:12:55.887765+0000","last_undegraded":"2024-05-08T18:12:55.887765+0000","last_fullsized":"2024-05-08T18:12:55.887765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:55.887504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:55.887504+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.887504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:10.017891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.110947+0000","last_change":"2024-05-08T18:12:15.110947+0000","last_active":"2024-05-08T18:12:15.110947+0000","last_peered":"2024-05-08T18:12:15.110947+0000","last_clean":"2024-05-08T18:12:15.110947+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:12:15.110947+0000","last_undegraded":"2024-05-08T18:12:15.110947+0000","last_fullsized":"2024-05-08T18:12:15.110947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.110542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:17.286120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.874681+0000","last_change":"2024-05-08T18:12:15.874681+0000","last_active":"2024-05-08T18:12:15.874681+0000","last_peered":"2024-05-08T18:12:15.874681+0000","last_clean":"2024-05-08T18:12:15.874681+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:15.874681+0000","last_undegraded":"2024-05-08T18:12:15.874681+0000","last_fullsized":"2024-05-08T18:12:15.874681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.874266+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:16.789721+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.388148+0000","last_change":"2024-05-08T18:12:44.388148+0000","last_active":"2024-05-08T18:12:44.388148+0000","last_peered":"2024-05-08T18:12:44.388148+0000","last_clean":"2024-05-08T18:12:44.388148+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:12:44.388148+0000","last_undegraded":"2024-05-08T18:12:44.388148+0000","last_fullsized":"2024-05-08T18:12:44.388148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.387867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:11.255581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.852306+0000","last_change":"2024-05-08T18:13:10.852306+0000","last_active":"2024-05-08T18:13:10.852306+0000","last_peered":"2024-05-08T18:13:10.852306+0000","last_clean":"2024-05-08T18:13:10.852306+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:13:10.852306+0000","last_undegraded":"2024-05-08T18:13:10.852306+0000","last_fullsized":"2024-05-08T18:13:10.852306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:13:10.852058+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:13:10.852058+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.852058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:17.260134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.914567+0000","last_change":"2024-05-08T18:12:56.914567+0000","last_active":"2024-05-08T18:12:56.914567+0000","last_peered":"2024-05-08T18:12:56.914567+0000","last_clean":"2024-05-08T18:12:56.914567+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:56.914567+0000","last_undegraded":"2024-05-08T18:12:56.914567+0000","last_fullsized":"2024-05-08T18:12:56.914567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:56.914288+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:56.914288+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.914288+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:15.883745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.186005+0000","last_change":"2024-05-08T18:12:53.186057+0000","last_active":"2024-05-08T18:12:53.186005+0000","last_peered":"2024-05-08T18:12:53.186005+0000","last_clean":"2024-05-08T18:12:53.186005+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:12:53.186005+0000","last_undegraded":"2024-05-08T18:12:53.186005+0000","last_fullsized":"2024-05-08T18:12:53.186005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:53.185807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:53.185807+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.185807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:36.478455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.924067+0000","last_change":"2024-05-08T18:13:04.924126+0000","last_active":"2024-05-08T18:13:04.924067+0000","last_peered":"2024-05-08T18:13:04.924067+0000","last_clean":"2024-05-08T18:13:04.924067+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:13:04.924067+0000","last_undegraded":"2024-05-08T18:13:04.924067+0000","last_fullsized":"2024-05-08T18:13:04.924067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:04.923862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:04.923862+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.923862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:37.781760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.419268+0000","last_change":"2024-05-08T18:12:32.419268+0000","last_active":"2024-05-08T18:12:32.419268+0000","last_peered":"2024-05-08T18:12:32.419268+0000","last_clean":"2024-05-08T18:12:32.419268+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:12:32.419268+0000","last_undegraded":"2024-05-08T18:12:32.419268+0000","last_fullsized":"2024-05-08T18:12:32.419268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.419009+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:22.878609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.405846+0000","last_change":"2024-05-08T18:12:26.405846+0000","last_active":"2024-05-08T18:12:26.405846+0000","last_peered":"2024-05-08T18:12:26.405846+0000","last_clean":"2024-05-08T18:12:26.405846+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:26.405846+0000","last_undegraded":"2024-05-08T18:12:26.405846+0000","last_fullsized":"2024-05-08T18:12:26.405846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.405548+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:54.558566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.006603+0000","last_change":"2024-05-08T18:12:33.006603+0000","last_active":"2024-05-08T18:12:33.006603+0000","last_peered":"2024-05-08T18:12:33.006603+0000","last_clean":"2024-05-08T18:12:33.006603+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:12:33.006603+0000","last_undegraded":"2024-05-08T18:12:33.006603+0000","last_fullsized":"2024-05-08T18:12:33.006603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:42.160580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.150045+0000","last_change":"2024-05-08T18:08:57.572548+0000","last_active":"2024-05-08T18:12:14.150045+0000","last_peered":"2024-05-08T18:12:14.150045+0000","last_clean":"2024-05-08T18:12:14.150045+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:12:14.150045+0000","last_undegraded":"2024-05-08T18:12:14.150045+0000","last_fullsized":"2024-05-08T18:12:14.150045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.024876+0000","last_change":"2024-05-08T18:12:43.024876+0000","last_active":"2024-05-08T18:12:43.024876+0000","last_peered":"2024-05-08T18:12:43.024876+0000","last_clean":"2024-05-08T18:12:43.024876+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:43.024876+0000","last_undegraded":"2024-05-08T18:12:43.024876+0000","last_fullsized":"2024-05-08T18:12:43.024876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.024617+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:28.911270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:26.206836+0000","last_change":"2024-05-08T18:13:26.206890+0000","last_active":"2024-05-08T18:13:26.206836+0000","last_peered":"2024-05-08T18:13:26.206836+0000","last_clean":"2024-05-08T18:13:26.206836+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:13:26.206836+0000","last_undegraded":"2024-05-08T18:13:26.206836+0000","last_fullsized":"2024-05-08T18:13:26.206836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:26.206627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:26.206627+0000","last_clean_scrub_stamp":"2024-05-08T18:13:26.206627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:08.476561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.213523+0000","last_change":"2024-05-08T18:12:55.213523+0000","last_active":"2024-05-08T18:12:55.213523+0000","last_peered":"2024-05-08T18:12:55.213523+0000","last_clean":"2024-05-08T18:12:55.213523+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:12:55.213523+0000","last_undegraded":"2024-05-08T18:12:55.213523+0000","last_fullsized":"2024-05-08T18:12:55.213523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:55.213207+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:55.213207+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.213207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:41.099860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.030417+0000","last_change":"2024-05-08T18:12:36.030417+0000","last_active":"2024-05-08T18:12:36.030417+0000","last_peered":"2024-05-08T18:12:36.030417+0000","last_clean":"2024-05-08T18:12:36.030417+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:12:36.030417+0000","last_undegraded":"2024-05-08T18:12:36.030417+0000","last_fullsized":"2024-05-08T18:12:36.030417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.030159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:58.141039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.401132+0000","last_change":"2024-05-08T18:12:47.401132+0000","last_active":"2024-05-08T18:12:47.401132+0000","last_peered":"2024-05-08T18:12:47.401132+0000","last_clean":"2024-05-08T18:12:47.401132+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:47.401132+0000","last_undegraded":"2024-05-08T18:12:47.401132+0000","last_fullsized":"2024-05-08T18:12:47.401132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.400857+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:20.922374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.354905+0000","last_change":"2024-05-08T18:12:52.354905+0000","last_active":"2024-05-08T18:12:52.354905+0000","last_peered":"2024-05-08T18:12:52.354905+0000","last_clean":"2024-05-08T18:12:52.354905+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:12:52.354905+0000","last_undegraded":"2024-05-08T18:12:52.354905+0000","last_fullsized":"2024-05-08T18:12:52.354905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:52.354612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:52.354612+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.354612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:55.331263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.772534+0000","last_change":"2024-05-08T18:12:40.772534+0000","last_active":"2024-05-08T18:12:40.772534+0000","last_peered":"2024-05-08T18:12:40.772534+0000","last_clean":"2024-05-08T18:12:40.772534+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:12:40.772534+0000","last_undegraded":"2024-05-08T18:12:40.772534+0000","last_fullsized":"2024-05-08T18:12:40.772534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.772281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.689481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.115316+0000","last_change":"2024-05-08T18:13:08.115376+0000","last_active":"2024-05-08T18:13:08.115316+0000","last_peered":"2024-05-08T18:13:08.115316+0000","last_clean":"2024-05-08T18:13:08.115316+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:13:08.115316+0000","last_undegraded":"2024-05-08T18:13:08.115316+0000","last_fullsized":"2024-05-08T18:13:08.115316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:13:08.115092+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:13:08.115092+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.115092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:27.084548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.231202+0000","last_change":"2024-05-08T18:12:46.231202+0000","last_active":"2024-05-08T18:12:46.231202+0000","last_peered":"2024-05-08T18:12:46.231202+0000","last_clean":"2024-05-08T18:12:46.231202+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:12:46.231202+0000","last_undegraded":"2024-05-08T18:12:46.231202+0000","last_fullsized":"2024-05-08T18:12:46.231202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.230919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.423905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.971100+0000","last_change":"2024-05-08T18:12:59.971158+0000","last_active":"2024-05-08T18:12:59.971100+0000","last_peered":"2024-05-08T18:12:59.971100+0000","last_clean":"2024-05-08T18:12:59.971100+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:12:59.971100+0000","last_undegraded":"2024-05-08T18:12:59.971100+0000","last_fullsized":"2024-05-08T18:12:59.971100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.970903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.970903+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.970903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:32.746818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.054793+0000","last_change":"2024-05-08T18:12:35.054793+0000","last_active":"2024-05-08T18:12:35.054793+0000","last_peered":"2024-05-08T18:12:35.054793+0000","last_clean":"2024-05-08T18:12:35.054793+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:12:35.054793+0000","last_undegraded":"2024-05-08T18:12:35.054793+0000","last_fullsized":"2024-05-08T18:12:35.054793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.054395+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:03.822537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.946482+0000","last_change":"2024-05-08T18:12:21.946482+0000","last_active":"2024-05-08T18:12:21.946482+0000","last_peered":"2024-05-08T18:12:21.946482+0000","last_clean":"2024-05-08T18:12:21.946482+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:12:21.946482+0000","last_undegraded":"2024-05-08T18:12:21.946482+0000","last_fullsized":"2024-05-08T18:12:21.946482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.946183+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:14.861048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.481040+0000","last_change":"2024-05-08T18:12:14.481040+0000","last_active":"2024-05-08T18:12:14.481040+0000","last_peered":"2024-05-08T18:12:14.481040+0000","last_clean":"2024-05-08T18:12:14.481040+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:12:14.481040+0000","last_undegraded":"2024-05-08T18:12:14.481040+0000","last_fullsized":"2024-05-08T18:12:14.481040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.480775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:53.762778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.882214+0000","last_change":"2024-05-08T18:13:07.882214+0000","last_active":"2024-05-08T18:13:07.882214+0000","last_peered":"2024-05-08T18:13:07.882214+0000","last_clean":"2024-05-08T18:13:07.882214+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:13:07.882214+0000","last_undegraded":"2024-05-08T18:13:07.882214+0000","last_fullsized":"2024-05-08T18:13:07.882214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:13:07.881924+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:13:07.881924+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.881924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:57.023639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.796028+0000","last_change":"2024-05-08T18:12:33.796028+0000","last_active":"2024-05-08T18:12:33.796028+0000","last_peered":"2024-05-08T18:12:33.796028+0000","last_clean":"2024-05-08T18:12:33.796028+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:33.796028+0000","last_undegraded":"2024-05-08T18:12:33.796028+0000","last_fullsized":"2024-05-08T18:12:33.796028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.795614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:47.936305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.996672+0000","last_change":"2024-05-08T18:12:45.996672+0000","last_active":"2024-05-08T18:12:45.996672+0000","last_peered":"2024-05-08T18:12:45.996672+0000","last_clean":"2024-05-08T18:12:45.996672+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:12:45.996672+0000","last_undegraded":"2024-05-08T18:12:45.996672+0000","last_fullsized":"2024-05-08T18:12:45.996672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.996412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:16.909940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:28.173123+0000","last_change":"2024-05-08T18:13:28.173256+0000","last_active":"2024-05-08T18:13:28.173123+0000","last_peered":"2024-05-08T18:13:28.173123+0000","last_clean":"2024-05-08T18:13:28.173123+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:13:28.173123+0000","last_undegraded":"2024-05-08T18:13:28.173123+0000","last_fullsized":"2024-05-08T18:13:28.173123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:28.172889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:28.172889+0000","last_clean_scrub_stamp":"2024-05-08T18:13:28.172889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:42.232277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.142014+0000","last_change":"2024-05-08T18:12:21.142014+0000","last_active":"2024-05-08T18:12:21.142014+0000","last_peered":"2024-05-08T18:12:21.142014+0000","last_clean":"2024-05-08T18:12:21.142014+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:12:21.142014+0000","last_undegraded":"2024-05-08T18:12:21.142014+0000","last_fullsized":"2024-05-08T18:12:21.142014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.141767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:55.879953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.861893+0000","last_change":"2024-05-08T18:12:14.861893+0000","last_active":"2024-05-08T18:12:14.861893+0000","last_peered":"2024-05-08T18:12:14.861893+0000","last_clean":"2024-05-08T18:12:14.861893+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:12:14.861893+0000","last_undegraded":"2024-05-08T18:12:14.861893+0000","last_fullsized":"2024-05-08T18:12:14.861893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.861606+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:16.005518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.950874+0000","last_change":"2024-05-08T18:12:20.950874+0000","last_active":"2024-05-08T18:12:20.950874+0000","last_peered":"2024-05-08T18:12:20.950874+0000","last_clean":"2024-05-08T18:12:20.950874+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:20.950874+0000","last_undegraded":"2024-05-08T18:12:20.950874+0000","last_fullsized":"2024-05-08T18:12:20.950874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.950610+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:59.485254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.196038+0000","last_change":"2024-05-08T18:13:04.196038+0000","last_active":"2024-05-08T18:13:04.196038+0000","last_peered":"2024-05-08T18:13:04.196038+0000","last_clean":"2024-05-08T18:13:04.196038+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:13:04.196038+0000","last_undegraded":"2024-05-08T18:13:04.196038+0000","last_fullsized":"2024-05-08T18:13:04.196038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-08T18:13:04.195762+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-08T18:13:04.195762+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.195762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:11.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.360827+0000","last_change":"2024-05-08T18:12:58.360896+0000","last_active":"2024-05-08T18:12:58.360827+0000","last_peered":"2024-05-08T18:12:58.360827+0000","last_clean":"2024-05-08T18:12:58.360827+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:58.360827+0000","last_undegraded":"2024-05-08T18:12:58.360827+0000","last_fullsized":"2024-05-08T18:12:58.360827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:58.360616+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:58.360616+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.360616+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:22.299329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.147483+0000","last_change":"2024-05-08T18:08:47.500529+0000","last_active":"2024-05-08T18:12:14.147483+0000","last_peered":"2024-05-08T18:12:14.147483+0000","last_clean":"2024-05-08T18:12:14.147483+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:12:14.147483+0000","last_undegraded":"2024-05-08T18:12:14.147483+0000","last_fullsized":"2024-05-08T18:12:14.147483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:46.443596+0000","last_clean_scrub_stamp":"2024-05-08T18:08:46.443596+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.957538+0000","last_change":"2024-05-08T18:12:58.957538+0000","last_active":"2024-05-08T18:12:58.957538+0000","last_peered":"2024-05-08T18:12:58.957538+0000","last_clean":"2024-05-08T18:12:58.957538+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:12:58.957538+0000","last_undegraded":"2024-05-08T18:12:58.957538+0000","last_fullsized":"2024-05-08T18:12:58.957538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:58.957285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:58.957285+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.957285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:20.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.151592+0000","last_change":"2024-05-08T18:12:20.151592+0000","last_active":"2024-05-08T18:12:20.151592+0000","last_peered":"2024-05-08T18:12:20.151592+0000","last_clean":"2024-05-08T18:12:20.151592+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:12:20.151592+0000","last_undegraded":"2024-05-08T18:12:20.151592+0000","last_fullsized":"2024-05-08T18:12:20.151592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.151323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:59.292712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.179559+0000","last_change":"2024-05-08T18:12:32.179559+0000","last_active":"2024-05-08T18:12:32.179559+0000","last_peered":"2024-05-08T18:12:32.179559+0000","last_clean":"2024-05-08T18:12:32.179559+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:12:32.179559+0000","last_undegraded":"2024-05-08T18:12:32.179559+0000","last_fullsized":"2024-05-08T18:12:32.179559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.179116+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:47.805125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.928706+0000","last_change":"2024-05-08T18:12:17.928706+0000","last_active":"2024-05-08T18:12:17.928706+0000","last_peered":"2024-05-08T18:12:17.928706+0000","last_clean":"2024-05-08T18:12:17.928706+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:17.928706+0000","last_undegraded":"2024-05-08T18:12:17.928706+0000","last_fullsized":"2024-05-08T18:12:17.928706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.928438+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:04.849778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.869544+0000","last_change":"2024-05-08T18:13:09.869544+0000","last_active":"2024-05-08T18:13:09.869544+0000","last_peered":"2024-05-08T18:13:09.869544+0000","last_clean":"2024-05-08T18:13:09.869544+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:13:09.869544+0000","last_undegraded":"2024-05-08T18:13:09.869544+0000","last_fullsized":"2024-05-08T18:13:09.869544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:13:09.869263+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:13:09.869263+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.869263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.422084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.135297+0000","last_change":"2024-05-08T18:13:04.135360+0000","last_active":"2024-05-08T18:13:04.135297+0000","last_peered":"2024-05-08T18:13:04.135297+0000","last_clean":"2024-05-08T18:13:04.135297+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:13:04.135297+0000","last_undegraded":"2024-05-08T18:13:04.135297+0000","last_fullsized":"2024-05-08T18:13:04.135297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:04.135088+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:04.135088+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.135088+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.298862+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.832553+0000","last_change":"2024-05-08T18:12:57.832553+0000","last_active":"2024-05-08T18:12:57.832553+0000","last_peered":"2024-05-08T18:12:57.832553+0000","last_clean":"2024-05-08T18:12:57.832553+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:12:57.832553+0000","last_undegraded":"2024-05-08T18:12:57.832553+0000","last_fullsized":"2024-05-08T18:12:57.832553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.832169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.832169+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.832169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:40.687423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:30.220183+0000","last_change":"2024-05-08T18:13:30.220237+0000","last_active":"2024-05-08T18:13:30.220183+0000","last_peered":"2024-05-08T18:13:30.220183+0000","last_clean":"2024-05-08T18:13:30.220183+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:13:30.220183+0000","last_undegraded":"2024-05-08T18:13:30.220183+0000","last_fullsized":"2024-05-08T18:13:30.220183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:30.219978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:30.219978+0000","last_clean_scrub_stamp":"2024-05-08T18:13:30.219978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:12.354995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.124317+0000","last_change":"2024-05-08T18:12:19.124317+0000","last_active":"2024-05-08T18:12:19.124317+0000","last_peered":"2024-05-08T18:12:19.124317+0000","last_clean":"2024-05-08T18:12:19.124317+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:12:19.124317+0000","last_undegraded":"2024-05-08T18:12:19.124317+0000","last_fullsized":"2024-05-08T18:12:19.124317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.124051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.234930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.388830+0000","last_change":"2024-05-08T18:12:21.388830+0000","last_active":"2024-05-08T18:12:21.388830+0000","last_peered":"2024-05-08T18:12:21.388830+0000","last_clean":"2024-05-08T18:12:21.388830+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:12:21.388830+0000","last_undegraded":"2024-05-08T18:12:21.388830+0000","last_fullsized":"2024-05-08T18:12:21.388830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.388548+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:37.145916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":104,"num_read_kb":116,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.926349+0000","last_change":"2024-05-08T18:12:20.926349+0000","last_active":"2024-05-08T18:12:20.926349+0000","last_peered":"2024-05-08T18:12:20.926349+0000","last_clean":"2024-05-08T18:12:20.926349+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:12:20.926349+0000","last_undegraded":"2024-05-08T18:12:20.926349+0000","last_fullsized":"2024-05-08T18:12:20.926349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.925962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:11.385561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.400598+0000","last_change":"2024-05-08T18:12:31.400598+0000","last_active":"2024-05-08T18:12:31.400598+0000","last_peered":"2024-05-08T18:12:31.400598+0000","last_clean":"2024-05-08T18:12:31.400598+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:12:31.400598+0000","last_undegraded":"2024-05-08T18:12:31.400598+0000","last_fullsized":"2024-05-08T18:12:31.400598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.400333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.169886+0000","last_change":"2024-05-08T18:13:03.169886+0000","last_active":"2024-05-08T18:13:03.169886+0000","last_peered":"2024-05-08T18:13:03.169886+0000","last_clean":"2024-05-08T18:13:03.169886+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:13:03.169886+0000","last_undegraded":"2024-05-08T18:13:03.169886+0000","last_fullsized":"2024-05-08T18:13:03.169886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:03.169522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:03.169522+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.169522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:26.711911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.137601+0000","last_change":"2024-05-08T18:13:01.137601+0000","last_active":"2024-05-08T18:13:01.137601+0000","last_peered":"2024-05-08T18:13:01.137601+0000","last_clean":"2024-05-08T18:13:01.137601+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:13:01.137601+0000","last_undegraded":"2024-05-08T18:13:01.137601+0000","last_fullsized":"2024-05-08T18:13:01.137601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:01.137324+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:01.137324+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.137324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:16.763333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:20.226601+0000","last_change":"2024-05-08T18:13:20.226601+0000","last_active":"2024-05-08T18:13:20.226601+0000","last_peered":"2024-05-08T18:13:20.226601+0000","last_clean":"2024-05-08T18:13:20.226601+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:13:20.226601+0000","last_undegraded":"2024-05-08T18:13:20.226601+0000","last_fullsized":"2024-05-08T18:13:20.226601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:20.226335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:20.226335+0000","last_clean_scrub_stamp":"2024-05-08T18:13:20.226335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.134040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.851149+0000","last_change":"2024-05-08T18:12:29.851149+0000","last_active":"2024-05-08T18:12:29.851149+0000","last_peered":"2024-05-08T18:12:29.851149+0000","last_clean":"2024-05-08T18:12:29.851149+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:12:29.851149+0000","last_undegraded":"2024-05-08T18:12:29.851149+0000","last_fullsized":"2024-05-08T18:12:29.851149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.850896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:20.522178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":95,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.217183+0000","last_change":"2024-05-08T18:12:30.217266+0000","last_active":"2024-05-08T18:12:30.217183+0000","last_peered":"2024-05-08T18:12:30.217183+0000","last_clean":"2024-05-08T18:12:30.217183+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:12:30.217183+0000","last_undegraded":"2024-05-08T18:12:30.217183+0000","last_fullsized":"2024-05-08T18:12:30.217183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.216965+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:38.316991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.247738+0000","last_change":"2024-05-08T18:12:38.247800+0000","last_active":"2024-05-08T18:12:38.247738+0000","last_peered":"2024-05-08T18:12:38.247738+0000","last_clean":"2024-05-08T18:12:38.247738+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:12:38.247738+0000","last_undegraded":"2024-05-08T18:12:38.247738+0000","last_fullsized":"2024-05-08T18:12:38.247738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.247530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:52.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.993485+0000","last_change":"2024-05-08T18:12:36.993485+0000","last_active":"2024-05-08T18:12:36.993485+0000","last_peered":"2024-05-08T18:12:36.993485+0000","last_clean":"2024-05-08T18:12:36.993485+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:36.993485+0000","last_undegraded":"2024-05-08T18:12:36.993485+0000","last_fullsized":"2024-05-08T18:12:36.993485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.993231+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:16.134620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.741896+0000","last_change":"2024-05-08T18:12:39.741896+0000","last_active":"2024-05-08T18:12:39.741896+0000","last_peered":"2024-05-08T18:12:39.741896+0000","last_clean":"2024-05-08T18:12:39.741896+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:39.741896+0000","last_undegraded":"2024-05-08T18:12:39.741896+0000","last_fullsized":"2024-05-08T18:12:39.741896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.741610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:18.882999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.157000+0000","last_change":"2024-05-08T18:12:48.157066+0000","last_active":"2024-05-08T18:12:48.157000+0000","last_peered":"2024-05-08T18:12:48.157000+0000","last_clean":"2024-05-08T18:12:48.157000+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:12:48.157000+0000","last_undegraded":"2024-05-08T18:12:48.157000+0000","last_fullsized":"2024-05-08T18:12:48.157000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.156795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:10.267674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.087520+0000","last_change":"2024-05-08T18:12:18.087520+0000","last_active":"2024-05-08T18:12:18.087520+0000","last_peered":"2024-05-08T18:12:18.087520+0000","last_clean":"2024-05-08T18:12:18.087520+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:12:18.087520+0000","last_undegraded":"2024-05-08T18:12:18.087520+0000","last_fullsized":"2024-05-08T18:12:18.087520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.087194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:46.855336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.937017+0000","last_change":"2024-05-08T18:12:25.937087+0000","last_active":"2024-05-08T18:12:25.937017+0000","last_peered":"2024-05-08T18:12:25.937017+0000","last_clean":"2024-05-08T18:12:25.937017+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:25.937017+0000","last_undegraded":"2024-05-08T18:12:25.937017+0000","last_fullsized":"2024-05-08T18:12:25.937017+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.936822+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:27.641008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.381154+0000","last_change":"2024-05-08T18:12:19.381207+0000","last_active":"2024-05-08T18:12:19.381154+0000","last_peered":"2024-05-08T18:12:19.381154+0000","last_clean":"2024-05-08T18:12:19.381154+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:12:19.381154+0000","last_undegraded":"2024-05-08T18:12:19.381154+0000","last_fullsized":"2024-05-08T18:12:19.381154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.380953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:58.173357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.901329+0000","last_change":"2024-05-08T18:13:10.901383+0000","last_active":"2024-05-08T18:13:10.901329+0000","last_peered":"2024-05-08T18:13:10.901329+0000","last_clean":"2024-05-08T18:13:10.901329+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:13:10.901329+0000","last_undegraded":"2024-05-08T18:13:10.901329+0000","last_fullsized":"2024-05-08T18:13:10.901329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:10.901138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:10.901138+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.901138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:56.190416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.065832+0000","last_change":"2024-05-08T18:12:42.065832+0000","last_active":"2024-05-08T18:12:42.065832+0000","last_peered":"2024-05-08T18:12:42.065832+0000","last_clean":"2024-05-08T18:12:42.065832+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:42.065832+0000","last_undegraded":"2024-05-08T18:12:42.065832+0000","last_fullsized":"2024-05-08T18:12:42.065832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.065419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:56.828357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.165268+0000","last_change":"2024-05-08T18:13:00.165328+0000","last_active":"2024-05-08T18:13:00.165268+0000","last_peered":"2024-05-08T18:13:00.165268+0000","last_clean":"2024-05-08T18:13:00.165268+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:13:00.165268+0000","last_undegraded":"2024-05-08T18:13:00.165268+0000","last_fullsized":"2024-05-08T18:13:00.165268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:00.165065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:00.165065+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.165065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:00.011008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.402667+0000","last_change":"2024-05-08T18:12:30.402667+0000","last_active":"2024-05-08T18:12:30.402667+0000","last_peered":"2024-05-08T18:12:30.402667+0000","last_clean":"2024-05-08T18:12:30.402667+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:12:30.402667+0000","last_undegraded":"2024-05-08T18:12:30.402667+0000","last_fullsized":"2024-05-08T18:12:30.402667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.402404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:43.180000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.966072+0000","last_change":"2024-05-08T18:12:26.966151+0000","last_active":"2024-05-08T18:12:26.966072+0000","last_peered":"2024-05-08T18:12:26.966072+0000","last_clean":"2024-05-08T18:12:26.966072+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:26.966072+0000","last_undegraded":"2024-05-08T18:12:26.966072+0000","last_fullsized":"2024-05-08T18:12:26.966072+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.965884+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:00.217219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.875467+0000","last_change":"2024-05-08T18:12:24.875520+0000","last_active":"2024-05-08T18:12:24.875467+0000","last_peered":"2024-05-08T18:12:24.875467+0000","last_clean":"2024-05-08T18:12:24.875467+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:12:24.875467+0000","last_undegraded":"2024-05-08T18:12:24.875467+0000","last_fullsized":"2024-05-08T18:12:24.875467+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.875266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:18.218024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:31.437590+0000","last_change":"2024-05-08T18:08:57.572358+0000","last_active":"2024-05-08T18:11:31.437590+0000","last_peered":"2024-05-08T18:11:31.437590+0000","last_clean":"2024-05-08T18:11:31.437590+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:11:31.437590+0000","last_undegraded":"2024-05-08T18:11:31.437590+0000","last_fullsized":"2024-05-08T18:11:31.437590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'18","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.372219+0000","last_change":"2024-05-08T18:12:51.372219+0000","last_active":"2024-05-08T18:12:51.372219+0000","last_peered":"2024-05-08T18:12:51.372219+0000","last_clean":"2024-05-08T18:12:51.372219+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:51.372219+0000","last_undegraded":"2024-05-08T18:12:51.372219+0000","last_fullsized":"2024-05-08T18:12:51.372219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.371857+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:17.691699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.856837+0000","last_change":"2024-05-08T18:13:00.856913+0000","last_active":"2024-05-08T18:13:00.856837+0000","last_peered":"2024-05-08T18:13:00.856837+0000","last_clean":"2024-05-08T18:13:00.856837+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:13:00.856837+0000","last_undegraded":"2024-05-08T18:13:00.856837+0000","last_fullsized":"2024-05-08T18:13:00.856837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:00.856639+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:00.856639+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.856639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:22.152206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.236698+0000","last_change":"2024-05-08T18:12:25.236698+0000","last_active":"2024-05-08T18:12:25.236698+0000","last_peered":"2024-05-08T18:12:25.236698+0000","last_clean":"2024-05-08T18:12:25.236698+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:12:25.236698+0000","last_undegraded":"2024-05-08T18:12:25.236698+0000","last_fullsized":"2024-05-08T18:12:25.236698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.236418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:39.999356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.379139+0000","last_change":"2024-05-08T18:12:29.379206+0000","last_active":"2024-05-08T18:12:29.379139+0000","last_peered":"2024-05-08T18:12:29.379139+0000","last_clean":"2024-05-08T18:12:29.379139+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:12:29.379139+0000","last_undegraded":"2024-05-08T18:12:29.379139+0000","last_fullsized":"2024-05-08T18:12:29.379139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.378957+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:54.199891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.349903+0000","last_change":"2024-05-08T18:12:18.349967+0000","last_active":"2024-05-08T18:12:18.349903+0000","last_peered":"2024-05-08T18:12:18.349903+0000","last_clean":"2024-05-08T18:12:18.349903+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:12:18.349903+0000","last_undegraded":"2024-05-08T18:12:18.349903+0000","last_fullsized":"2024-05-08T18:12:18.349903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.349704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:51.482256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.345032+0000","last_change":"2024-05-08T18:12:57.345032+0000","last_active":"2024-05-08T18:12:57.345032+0000","last_peered":"2024-05-08T18:12:57.345032+0000","last_clean":"2024-05-08T18:12:57.345032+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:12:57.345032+0000","last_undegraded":"2024-05-08T18:12:57.345032+0000","last_fullsized":"2024-05-08T18:12:57.345032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:57.344755+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:57.344755+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.344755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:15.489585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.237154+0000","last_change":"2024-05-08T18:13:10.237287+0000","last_active":"2024-05-08T18:13:10.237154+0000","last_peered":"2024-05-08T18:13:10.237154+0000","last_clean":"2024-05-08T18:13:10.237154+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:13:10.237154+0000","last_undegraded":"2024-05-08T18:13:10.237154+0000","last_fullsized":"2024-05-08T18:13:10.237154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:10.236825+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:10.236825+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.236825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:12.359658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.007168+0000","last_change":"2024-05-08T18:12:34.007168+0000","last_active":"2024-05-08T18:12:34.007168+0000","last_peered":"2024-05-08T18:12:34.007168+0000","last_clean":"2024-05-08T18:12:34.007168+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:12:34.007168+0000","last_undegraded":"2024-05-08T18:12:34.007168+0000","last_fullsized":"2024-05-08T18:12:34.007168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.006922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:48.199909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.921374+0000","last_change":"2024-05-08T18:12:23.921455+0000","last_active":"2024-05-08T18:12:23.921374+0000","last_peered":"2024-05-08T18:12:23.921374+0000","last_clean":"2024-05-08T18:12:23.921374+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:12:23.921374+0000","last_undegraded":"2024-05-08T18:12:23.921374+0000","last_fullsized":"2024-05-08T18:12:23.921374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.921184+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:20.672977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.376282+0000","last_change":"2024-05-08T18:12:17.376334+0000","last_active":"2024-05-08T18:12:17.376282+0000","last_peered":"2024-05-08T18:12:17.376282+0000","last_clean":"2024-05-08T18:12:17.376282+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:12:17.376282+0000","last_undegraded":"2024-05-08T18:12:17.376282+0000","last_fullsized":"2024-05-08T18:12:17.376282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.376083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:05.332746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.878874+0000","last_change":"2024-05-08T18:13:09.878935+0000","last_active":"2024-05-08T18:13:09.878874+0000","last_peered":"2024-05-08T18:13:09.878874+0000","last_clean":"2024-05-08T18:13:09.878874+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:13:09.878874+0000","last_undegraded":"2024-05-08T18:13:09.878874+0000","last_fullsized":"2024-05-08T18:13:09.878874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:13:09.878674+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:13:09.878674+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.878674+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:38.482012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.942036+0000","last_change":"2024-05-08T18:12:52.942212+0000","last_active":"2024-05-08T18:12:52.942036+0000","last_peered":"2024-05-08T18:12:52.942036+0000","last_clean":"2024-05-08T18:12:52.942036+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:12:52.942036+0000","last_undegraded":"2024-05-08T18:12:52.942036+0000","last_fullsized":"2024-05-08T18:12:52.942036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:52.941803+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:52.941803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.941803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:09.105577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.829170+0000","last_change":"2024-05-08T18:12:51.829233+0000","last_active":"2024-05-08T18:12:51.829170+0000","last_peered":"2024-05-08T18:12:51.829170+0000","last_clean":"2024-05-08T18:12:51.829170+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:12:51.829170+0000","last_undegraded":"2024-05-08T18:12:51.829170+0000","last_fullsized":"2024-05-08T18:12:51.829170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:51.828945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:51.828945+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.828945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:45.312745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.433631+0000","last_change":"2024-05-08T18:12:33.433631+0000","last_active":"2024-05-08T18:12:33.433631+0000","last_peered":"2024-05-08T18:12:33.433631+0000","last_clean":"2024-05-08T18:12:33.433631+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:12:33.433631+0000","last_undegraded":"2024-05-08T18:12:33.433631+0000","last_fullsized":"2024-05-08T18:12:33.433631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.433233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:26.348098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.224869+0000","last_change":"2024-05-08T18:12:24.225048+0000","last_active":"2024-05-08T18:12:24.224869+0000","last_peered":"2024-05-08T18:12:24.224869+0000","last_clean":"2024-05-08T18:12:24.224869+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:12:24.224869+0000","last_undegraded":"2024-05-08T18:12:24.224869+0000","last_fullsized":"2024-05-08T18:12:24.224869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.224613+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:07.517261+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.808449+0000","last_change":"2024-05-08T18:12:32.808508+0000","last_active":"2024-05-08T18:12:32.808449+0000","last_peered":"2024-05-08T18:12:32.808449+0000","last_clean":"2024-05-08T18:12:32.808449+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:12:32.808449+0000","last_undegraded":"2024-05-08T18:12:32.808449+0000","last_fullsized":"2024-05-08T18:12:32.808449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.808259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:00.027611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.330975+0000","last_change":"2024-05-08T18:13:00.331027+0000","last_active":"2024-05-08T18:13:00.330975+0000","last_peered":"2024-05-08T18:13:00.330975+0000","last_clean":"2024-05-08T18:13:00.330975+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:13:00.330975+0000","last_undegraded":"2024-05-08T18:13:00.330975+0000","last_fullsized":"2024-05-08T18:13:00.330975+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:00.330783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:00.330783+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.330783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:42.570757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.224908+0000","last_change":"2024-05-08T18:12:29.224975+0000","last_active":"2024-05-08T18:12:29.224908+0000","last_peered":"2024-05-08T18:12:29.224908+0000","last_clean":"2024-05-08T18:12:29.224908+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:29.224908+0000","last_undegraded":"2024-05-08T18:12:29.224908+0000","last_fullsized":"2024-05-08T18:12:29.224908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.224718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:07.769843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.832136+0000","last_change":"2024-05-08T18:12:49.832203+0000","last_active":"2024-05-08T18:12:49.832136+0000","last_peered":"2024-05-08T18:12:49.832136+0000","last_clean":"2024-05-08T18:12:49.832136+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:12:49.832136+0000","last_undegraded":"2024-05-08T18:12:49.832136+0000","last_fullsized":"2024-05-08T18:12:49.832136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.831921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:42.570012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.149694+0000","last_change":"2024-05-08T18:13:05.149758+0000","last_active":"2024-05-08T18:13:05.149694+0000","last_peered":"2024-05-08T18:13:05.149694+0000","last_clean":"2024-05-08T18:13:05.149694+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:13:05.149694+0000","last_undegraded":"2024-05-08T18:13:05.149694+0000","last_fullsized":"2024-05-08T18:13:05.149694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:05.149428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:05.149428+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.149428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.241764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.009169+0000","last_change":"2024-05-08T18:12:28.009169+0000","last_active":"2024-05-08T18:12:28.009169+0000","last_peered":"2024-05-08T18:12:28.009169+0000","last_clean":"2024-05-08T18:12:28.009169+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:12:28.009169+0000","last_undegraded":"2024-05-08T18:12:28.009169+0000","last_fullsized":"2024-05-08T18:12:28.009169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.008749+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:18.526961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.944203+0000","last_change":"2024-05-08T18:12:12.944203+0000","last_active":"2024-05-08T18:12:12.944203+0000","last_peered":"2024-05-08T18:12:12.944203+0000","last_clean":"2024-05-08T18:12:12.944203+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:12:12.944203+0000","last_undegraded":"2024-05-08T18:12:12.944203+0000","last_fullsized":"2024-05-08T18:12:12.944203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_clean_scrub_stamp":"2024-05-08T18:12:12.944077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:02.872453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434724+0000","last_change":"2024-05-08T18:08:57.568369+0000","last_active":"2024-05-08T18:11:21.434724+0000","last_peered":"2024-05-08T18:11:21.434724+0000","last_clean":"2024-05-08T18:11:21.434724+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:11:21.434724+0000","last_undegraded":"2024-05-08T18:11:21.434724+0000","last_fullsized":"2024-05-08T18:11:21.434724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.021717+0000","last_change":"2024-05-08T18:12:47.021777+0000","last_active":"2024-05-08T18:12:47.021717+0000","last_peered":"2024-05-08T18:12:47.021717+0000","last_clean":"2024-05-08T18:12:47.021717+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:47.021717+0000","last_undegraded":"2024-05-08T18:12:47.021717+0000","last_fullsized":"2024-05-08T18:12:47.021717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.021499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:58.501866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:13.250724+0000","last_change":"2024-05-08T18:13:13.250799+0000","last_active":"2024-05-08T18:13:13.250724+0000","last_peered":"2024-05-08T18:13:13.250724+0000","last_clean":"2024-05-08T18:13:13.250724+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:13:13.250724+0000","last_undegraded":"2024-05-08T18:13:13.250724+0000","last_fullsized":"2024-05-08T18:13:13.250724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:13.250506+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:13.250506+0000","last_clean_scrub_stamp":"2024-05-08T18:13:13.250506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:51.643769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'5","reported_seq":238,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.880274+0000","last_change":"2024-05-08T18:12:26.880471+0000","last_active":"2024-05-08T18:12:26.880274+0000","last_peered":"2024-05-08T18:12:26.880274+0000","last_clean":"2024-05-08T18:12:26.880274+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:12:26.880274+0000","last_undegraded":"2024-05-08T18:12:26.880274+0000","last_fullsized":"2024-05-08T18:12:26.880274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.880045+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:45.838146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.374059+0000","last_change":"2024-05-08T18:12:43.374059+0000","last_active":"2024-05-08T18:12:43.374059+0000","last_peered":"2024-05-08T18:12:43.374059+0000","last_clean":"2024-05-08T18:12:43.374059+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:12:43.374059+0000","last_undegraded":"2024-05-08T18:12:43.374059+0000","last_fullsized":"2024-05-08T18:12:43.374059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.373798+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:10.395570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.415136+0000","last_change":"2024-05-08T18:12:16.415136+0000","last_active":"2024-05-08T18:12:16.415136+0000","last_peered":"2024-05-08T18:12:16.415136+0000","last_clean":"2024-05-08T18:12:16.415136+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:16.415136+0000","last_undegraded":"2024-05-08T18:12:16.415136+0000","last_fullsized":"2024-05-08T18:12:16.415136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.414863+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:08.725122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:21.434563+0000","last_change":"2024-05-08T18:08:57.575843+0000","last_active":"2024-05-08T18:11:21.434563+0000","last_peered":"2024-05-08T18:11:21.434563+0000","last_clean":"2024-05-08T18:11:21.434563+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:11:21.434563+0000","last_undegraded":"2024-05-08T18:11:21.434563+0000","last_fullsized":"2024-05-08T18:11:21.434563+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.343207+0000","last_change":"2024-05-08T18:12:39.343330+0000","last_active":"2024-05-08T18:12:39.343207+0000","last_peered":"2024-05-08T18:12:39.343207+0000","last_clean":"2024-05-08T18:12:39.343207+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:39.343207+0000","last_undegraded":"2024-05-08T18:12:39.343207+0000","last_fullsized":"2024-05-08T18:12:39.343207+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.342952+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:30.014235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.828152+0000","last_change":"2024-05-08T18:12:59.828209+0000","last_active":"2024-05-08T18:12:59.828152+0000","last_peered":"2024-05-08T18:12:59.828152+0000","last_clean":"2024-05-08T18:12:59.828152+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:12:59.828152+0000","last_undegraded":"2024-05-08T18:12:59.828152+0000","last_fullsized":"2024-05-08T18:12:59.828152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.827904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.827904+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.827904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:58.305517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.920218+0000","last_change":"2024-05-08T18:12:23.920309+0000","last_active":"2024-05-08T18:12:23.920218+0000","last_peered":"2024-05-08T18:12:23.920218+0000","last_clean":"2024-05-08T18:12:23.920218+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:12:23.920218+0000","last_undegraded":"2024-05-08T18:12:23.920218+0000","last_fullsized":"2024-05-08T18:12:23.920218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.919920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:16.834786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":103,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.983706+0000","last_change":"2024-05-08T18:12:18.983908+0000","last_active":"2024-05-08T18:12:18.983706+0000","last_peered":"2024-05-08T18:12:18.983706+0000","last_clean":"2024-05-08T18:12:18.983706+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:12:18.983706+0000","last_undegraded":"2024-05-08T18:12:18.983706+0000","last_fullsized":"2024-05-08T18:12:18.983706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.983474+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:34.287333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.970884+0000","last_change":"2024-05-08T18:12:19.970940+0000","last_active":"2024-05-08T18:12:19.970884+0000","last_peered":"2024-05-08T18:12:19.970884+0000","last_clean":"2024-05-08T18:12:19.970884+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:12:19.970884+0000","last_undegraded":"2024-05-08T18:12:19.970884+0000","last_fullsized":"2024-05-08T18:12:19.970884+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.970683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.981624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:12.929617+0000","last_change":"2024-05-08T18:13:12.929769+0000","last_active":"2024-05-08T18:13:12.929617+0000","last_peered":"2024-05-08T18:13:12.929617+0000","last_clean":"2024-05-08T18:13:12.929617+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:13:12.929617+0000","last_undegraded":"2024-05-08T18:13:12.929617+0000","last_fullsized":"2024-05-08T18:13:12.929617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:13:12.929342+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:13:12.929342+0000","last_clean_scrub_stamp":"2024-05-08T18:13:12.929342+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:15.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.327285+0000","last_change":"2024-05-08T18:12:41.327424+0000","last_active":"2024-05-08T18:12:41.327285+0000","last_peered":"2024-05-08T18:12:41.327285+0000","last_clean":"2024-05-08T18:12:41.327285+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:12:41.327285+0000","last_undegraded":"2024-05-08T18:12:41.327285+0000","last_fullsized":"2024-05-08T18:12:41.327285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.327063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:10.463865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.275732+0000","last_change":"2024-05-08T18:13:09.275882+0000","last_active":"2024-05-08T18:13:09.275732+0000","last_peered":"2024-05-08T18:13:09.275732+0000","last_clean":"2024-05-08T18:13:09.275732+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:13:09.275732+0000","last_undegraded":"2024-05-08T18:13:09.275732+0000","last_fullsized":"2024-05-08T18:13:09.275732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:09.275495+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:09.275495+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.275495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:46.545687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.364163+0000","last_change":"2024-05-08T18:12:36.364217+0000","last_active":"2024-05-08T18:12:36.364163+0000","last_peered":"2024-05-08T18:12:36.364163+0000","last_clean":"2024-05-08T18:12:36.364163+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:12:36.364163+0000","last_undegraded":"2024-05-08T18:12:36.364163+0000","last_fullsized":"2024-05-08T18:12:36.364163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.363969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:55.322070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.890367+0000","last_change":"2024-05-08T18:12:22.890449+0000","last_active":"2024-05-08T18:12:22.890367+0000","last_peered":"2024-05-08T18:12:22.890367+0000","last_clean":"2024-05-08T18:12:22.890367+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:12:22.890367+0000","last_undegraded":"2024-05-08T18:12:22.890367+0000","last_fullsized":"2024-05-08T18:12:22.890367+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.890142+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:16.232900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.203727+0000","last_change":"2024-05-08T18:12:39.203783+0000","last_active":"2024-05-08T18:12:39.203727+0000","last_peered":"2024-05-08T18:12:39.203727+0000","last_clean":"2024-05-08T18:12:39.203727+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:12:39.203727+0000","last_undegraded":"2024-05-08T18:12:39.203727+0000","last_fullsized":"2024-05-08T18:12:39.203727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.203546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:58.173003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436379+0000","last_change":"2024-05-08T18:08:57.572472+0000","last_active":"2024-05-08T18:11:26.436379+0000","last_peered":"2024-05-08T18:11:26.436379+0000","last_clean":"2024-05-08T18:11:26.436379+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:11:26.436379+0000","last_undegraded":"2024-05-08T18:11:26.436379+0000","last_fullsized":"2024-05-08T18:11:26.436379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.386872+0000","last_change":"2024-05-08T18:12:53.386937+0000","last_active":"2024-05-08T18:12:53.386872+0000","last_peered":"2024-05-08T18:12:53.386872+0000","last_clean":"2024-05-08T18:12:53.386872+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:53.386872+0000","last_undegraded":"2024-05-08T18:12:53.386872+0000","last_fullsized":"2024-05-08T18:12:53.386872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:53.386676+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:53.386676+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.386676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:12.923206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.062680+0000","last_change":"2024-05-08T18:12:48.062680+0000","last_active":"2024-05-08T18:12:48.062680+0000","last_peered":"2024-05-08T18:12:48.062680+0000","last_clean":"2024-05-08T18:12:48.062680+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:12:48.062680+0000","last_undegraded":"2024-05-08T18:12:48.062680+0000","last_fullsized":"2024-05-08T18:12:48.062680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.062295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:40.800386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.904352+0000","last_change":"2024-05-08T18:12:22.904406+0000","last_active":"2024-05-08T18:12:22.904352+0000","last_peered":"2024-05-08T18:12:22.904352+0000","last_clean":"2024-05-08T18:12:22.904352+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:12:22.904352+0000","last_undegraded":"2024-05-08T18:12:22.904352+0000","last_fullsized":"2024-05-08T18:12:22.904352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.904163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:55.812967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.406151+0000","last_change":"2024-05-08T18:12:45.406224+0000","last_active":"2024-05-08T18:12:45.406151+0000","last_peered":"2024-05-08T18:12:45.406151+0000","last_clean":"2024-05-08T18:12:45.406151+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:12:45.406151+0000","last_undegraded":"2024-05-08T18:12:45.406151+0000","last_fullsized":"2024-05-08T18:12:45.406151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.405952+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:51.199855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.249805+0000","last_change":"2024-05-08T18:12:40.249929+0000","last_active":"2024-05-08T18:12:40.249805+0000","last_peered":"2024-05-08T18:12:40.249805+0000","last_clean":"2024-05-08T18:12:40.249805+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:12:40.249805+0000","last_undegraded":"2024-05-08T18:12:40.249805+0000","last_fullsized":"2024-05-08T18:12:40.249805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.249448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:35.988004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:11:26.436285+0000","last_change":"2024-05-08T18:08:57.570542+0000","last_active":"2024-05-08T18:11:26.436285+0000","last_peered":"2024-05-08T18:11:26.436285+0000","last_clean":"2024-05-08T18:11:26.436285+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:11:26.436285+0000","last_undegraded":"2024-05-08T18:11:26.436285+0000","last_fullsized":"2024-05-08T18:11:26.436285+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:08:56.512407+0000","last_clean_scrub_stamp":"2024-05-08T18:08:56.512407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.407031+0000","last_change":"2024-05-08T18:12:37.407097+0000","last_active":"2024-05-08T18:12:37.407031+0000","last_peered":"2024-05-08T18:12:37.407031+0000","last_clean":"2024-05-08T18:12:37.407031+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:12:37.407031+0000","last_undegraded":"2024-05-08T18:12:37.407031+0000","last_fullsized":"2024-05-08T18:12:37.407031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.406836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:34.907082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.827275+0000","last_change":"2024-05-08T18:13:02.827344+0000","last_active":"2024-05-08T18:13:02.827275+0000","last_peered":"2024-05-08T18:13:02.827275+0000","last_clean":"2024-05-08T18:13:02.827275+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:13:02.827275+0000","last_undegraded":"2024-05-08T18:13:02.827275+0000","last_fullsized":"2024-05-08T18:13:02.827275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:13:02.827060+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:13:02.827060+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.827060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:32.773786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'5","reported_seq":233,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.805050+0000","last_change":"2024-05-08T18:12:31.805113+0000","last_active":"2024-05-08T18:12:31.805050+0000","last_peered":"2024-05-08T18:12:31.805050+0000","last_clean":"2024-05-08T18:12:31.805050+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:12:31.805050+0000","last_undegraded":"2024-05-08T18:12:31.805050+0000","last_fullsized":"2024-05-08T18:12:31.805050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.804855+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:00.941657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.253694+0000","last_change":"2024-05-08T18:12:28.253848+0000","last_active":"2024-05-08T18:12:28.253694+0000","last_peered":"2024-05-08T18:12:28.253694+0000","last_clean":"2024-05-08T18:12:28.253694+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:28.253694+0000","last_undegraded":"2024-05-08T18:12:28.253694+0000","last_fullsized":"2024-05-08T18:12:28.253694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.253447+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:30.579578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.869619+0000","last_change":"2024-05-08T18:12:15.869678+0000","last_active":"2024-05-08T18:12:15.869619+0000","last_peered":"2024-05-08T18:12:15.869619+0000","last_clean":"2024-05-08T18:12:15.869619+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:12:15.869619+0000","last_undegraded":"2024-05-08T18:12:15.869619+0000","last_fullsized":"2024-05-08T18:12:15.869619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.869387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:54.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.238584+0000","last_change":"2024-05-08T18:13:08.238687+0000","last_active":"2024-05-08T18:13:08.238584+0000","last_peered":"2024-05-08T18:13:08.238584+0000","last_clean":"2024-05-08T18:13:08.238584+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:13:08.238584+0000","last_undegraded":"2024-05-08T18:13:08.238584+0000","last_fullsized":"2024-05-08T18:13:08.238584+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:08.238370+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:08.238370+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.238370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:06.147782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.809070+0000","last_change":"2024-05-08T18:12:41.809070+0000","last_active":"2024-05-08T18:12:41.809070+0000","last_peered":"2024-05-08T18:12:41.809070+0000","last_clean":"2024-05-08T18:12:41.809070+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:12:41.809070+0000","last_undegraded":"2024-05-08T18:12:41.809070+0000","last_fullsized":"2024-05-08T18:12:41.809070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.808797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:14.047209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.226520+0000","last_change":"2024-05-08T18:12:57.226520+0000","last_active":"2024-05-08T18:12:57.226520+0000","last_peered":"2024-05-08T18:12:57.226520+0000","last_clean":"2024-05-08T18:12:57.226520+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:12:57.226520+0000","last_undegraded":"2024-05-08T18:12:57.226520+0000","last_fullsized":"2024-05-08T18:12:57.226520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.226257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.226257+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.226257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:54.487220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.010893+0000","last_change":"2024-05-08T18:12:45.010893+0000","last_active":"2024-05-08T18:12:45.010893+0000","last_peered":"2024-05-08T18:12:45.010893+0000","last_clean":"2024-05-08T18:12:45.010893+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:12:45.010893+0000","last_undegraded":"2024-05-08T18:12:45.010893+0000","last_fullsized":"2024-05-08T18:12:45.010893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.010494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:42.271457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.003402+0000","last_change":"2024-05-08T18:13:01.003402+0000","last_active":"2024-05-08T18:13:01.003402+0000","last_peered":"2024-05-08T18:13:01.003402+0000","last_clean":"2024-05-08T18:13:01.003402+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:13:01.003402+0000","last_undegraded":"2024-05-08T18:13:01.003402+0000","last_fullsized":"2024-05-08T18:13:01.003402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:01.003113+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:01.003113+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.003113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:28.024885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.251283+0000","last_change":"2024-05-08T18:12:35.251283+0000","last_active":"2024-05-08T18:12:35.251283+0000","last_peered":"2024-05-08T18:12:35.251283+0000","last_clean":"2024-05-08T18:12:35.251283+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:35.251283+0000","last_undegraded":"2024-05-08T18:12:35.251283+0000","last_fullsized":"2024-05-08T18:12:35.251283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.251012+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:51.414787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:12.251564+0000","last_change":"2024-05-08T18:13:12.251679+0000","last_active":"2024-05-08T18:13:12.251564+0000","last_peered":"2024-05-08T18:13:12.251564+0000","last_clean":"2024-05-08T18:13:12.251564+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:13:12.251564+0000","last_undegraded":"2024-05-08T18:13:12.251564+0000","last_fullsized":"2024-05-08T18:13:12.251564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:12.251334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:12.251334+0000","last_clean_scrub_stamp":"2024-05-08T18:13:12.251334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:13.337224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.057497+0000","last_change":"2024-05-08T18:12:49.057497+0000","last_active":"2024-05-08T18:12:49.057497+0000","last_peered":"2024-05-08T18:12:49.057497+0000","last_clean":"2024-05-08T18:12:49.057497+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:49.057497+0000","last_undegraded":"2024-05-08T18:12:49.057497+0000","last_fullsized":"2024-05-08T18:12:49.057497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.057230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:48.903173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.898282+0000","last_change":"2024-05-08T18:12:53.898282+0000","last_active":"2024-05-08T18:12:53.898282+0000","last_peered":"2024-05-08T18:12:53.898282+0000","last_clean":"2024-05-08T18:12:53.898282+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:53.898282+0000","last_undegraded":"2024-05-08T18:12:53.898282+0000","last_fullsized":"2024-05-08T18:12:53.898282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:53.897902+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:53.897902+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.897902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.990238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.025905+0000","last_change":"2024-05-08T18:12:39.025905+0000","last_active":"2024-05-08T18:12:39.025905+0000","last_peered":"2024-05-08T18:12:39.025905+0000","last_clean":"2024-05-08T18:12:39.025905+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:39.025905+0000","last_undegraded":"2024-05-08T18:12:39.025905+0000","last_fullsized":"2024-05-08T18:12:39.025905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.025648+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:42.892114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.974127+0000","last_change":"2024-05-08T18:13:02.974127+0000","last_active":"2024-05-08T18:13:02.974127+0000","last_peered":"2024-05-08T18:13:02.974127+0000","last_clean":"2024-05-08T18:13:02.974127+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:13:02.974127+0000","last_undegraded":"2024-05-08T18:13:02.974127+0000","last_fullsized":"2024-05-08T18:13:02.974127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:02.973841+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:02.973841+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.973841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:08.767744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.727988+0000","last_change":"2024-05-08T18:12:38.727988+0000","last_active":"2024-05-08T18:12:38.727988+0000","last_peered":"2024-05-08T18:12:38.727988+0000","last_clean":"2024-05-08T18:12:38.727988+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:38.727988+0000","last_undegraded":"2024-05-08T18:12:38.727988+0000","last_fullsized":"2024-05-08T18:12:38.727988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.727710+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:00.838590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.936828+0000","last_change":"2024-05-08T18:13:05.936828+0000","last_active":"2024-05-08T18:13:05.936828+0000","last_peered":"2024-05-08T18:13:05.936828+0000","last_clean":"2024-05-08T18:13:05.936828+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:13:05.936828+0000","last_undegraded":"2024-05-08T18:13:05.936828+0000","last_fullsized":"2024-05-08T18:13:05.936828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:05.936573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:05.936573+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.936573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:15.915722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.998374+0000","last_change":"2024-05-08T18:12:50.998374+0000","last_active":"2024-05-08T18:12:50.998374+0000","last_peered":"2024-05-08T18:12:50.998374+0000","last_clean":"2024-05-08T18:12:50.998374+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:50.998374+0000","last_undegraded":"2024-05-08T18:12:50.998374+0000","last_fullsized":"2024-05-08T18:12:50.998374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.998114+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:32.393869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.215826+0000","last_change":"2024-05-08T18:12:50.215826+0000","last_active":"2024-05-08T18:12:50.215826+0000","last_peered":"2024-05-08T18:12:50.215826+0000","last_clean":"2024-05-08T18:12:50.215826+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:12:50.215826+0000","last_undegraded":"2024-05-08T18:12:50.215826+0000","last_fullsized":"2024-05-08T18:12:50.215826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.215404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.132603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.839374+0000","last_change":"2024-05-08T18:12:45.839374+0000","last_active":"2024-05-08T18:12:45.839374+0000","last_peered":"2024-05-08T18:12:45.839374+0000","last_clean":"2024-05-08T18:12:45.839374+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:45.839374+0000","last_undegraded":"2024-05-08T18:12:45.839374+0000","last_fullsized":"2024-05-08T18:12:45.839374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.839123+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:31.725776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.020909+0000","last_change":"2024-05-08T18:12:50.020909+0000","last_active":"2024-05-08T18:12:50.020909+0000","last_peered":"2024-05-08T18:12:50.020909+0000","last_clean":"2024-05-08T18:12:50.020909+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:12:50.020909+0000","last_undegraded":"2024-05-08T18:12:50.020909+0000","last_fullsized":"2024-05-08T18:12:50.020909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.020646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:05.646654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.875573+0000","last_change":"2024-05-08T18:12:50.875573+0000","last_active":"2024-05-08T18:12:50.875573+0000","last_peered":"2024-05-08T18:12:50.875573+0000","last_clean":"2024-05-08T18:12:50.875573+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:12:50.875573+0000","last_undegraded":"2024-05-08T18:12:50.875573+0000","last_fullsized":"2024-05-08T18:12:50.875573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.875317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:27.743465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:17.249934+0000","last_change":"2024-05-08T18:13:17.249992+0000","last_active":"2024-05-08T18:13:17.249934+0000","last_peered":"2024-05-08T18:13:17.249934+0000","last_clean":"2024-05-08T18:13:17.249934+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:13:17.249934+0000","last_undegraded":"2024-05-08T18:13:17.249934+0000","last_fullsized":"2024-05-08T18:13:17.249934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:17.249723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:17.249723+0000","last_clean_scrub_stamp":"2024-05-08T18:13:17.249723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:16.836681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.220189+0000","last_change":"2024-05-08T18:12:33.220189+0000","last_active":"2024-05-08T18:12:33.220189+0000","last_peered":"2024-05-08T18:12:33.220189+0000","last_clean":"2024-05-08T18:12:33.220189+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:33.220189+0000","last_undegraded":"2024-05-08T18:12:33.220189+0000","last_fullsized":"2024-05-08T18:12:33.220189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.219930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:14.615685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.951243+0000","last_change":"2024-05-08T18:12:57.951243+0000","last_active":"2024-05-08T18:12:57.951243+0000","last_peered":"2024-05-08T18:12:57.951243+0000","last_clean":"2024-05-08T18:12:57.951243+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:12:57.951243+0000","last_undegraded":"2024-05-08T18:12:57.951243+0000","last_fullsized":"2024-05-08T18:12:57.951243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.950978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.950978+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.950978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:53.689534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.027487+0000","last_change":"2024-05-08T18:12:40.027487+0000","last_active":"2024-05-08T18:12:40.027487+0000","last_peered":"2024-05-08T18:12:40.027487+0000","last_clean":"2024-05-08T18:12:40.027487+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:40.027487+0000","last_undegraded":"2024-05-08T18:12:40.027487+0000","last_fullsized":"2024-05-08T18:12:40.027487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.027216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:32.648602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.817910+0000","last_change":"2024-05-08T18:12:47.817910+0000","last_active":"2024-05-08T18:12:47.817910+0000","last_peered":"2024-05-08T18:12:47.817910+0000","last_clean":"2024-05-08T18:12:47.817910+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:12:47.817910+0000","last_undegraded":"2024-05-08T18:12:47.817910+0000","last_fullsized":"2024-05-08T18:12:47.817910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.817632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:45.078595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.780098+0000","last_change":"2024-05-08T18:12:42.780098+0000","last_active":"2024-05-08T18:12:42.780098+0000","last_peered":"2024-05-08T18:12:42.780098+0000","last_clean":"2024-05-08T18:12:42.780098+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:42.780098+0000","last_undegraded":"2024-05-08T18:12:42.780098+0000","last_fullsized":"2024-05-08T18:12:42.780098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.779853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:09.011513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.756420+0000","last_change":"2024-05-08T18:12:55.756420+0000","last_active":"2024-05-08T18:12:55.756420+0000","last_peered":"2024-05-08T18:12:55.756420+0000","last_clean":"2024-05-08T18:12:55.756420+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:12:55.756420+0000","last_undegraded":"2024-05-08T18:12:55.756420+0000","last_fullsized":"2024-05-08T18:12:55.756420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:55.756173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:55.756173+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.756173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:11.919948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.816815+0000","last_change":"2024-05-08T18:12:34.816815+0000","last_active":"2024-05-08T18:12:34.816815+0000","last_peered":"2024-05-08T18:12:34.816815+0000","last_clean":"2024-05-08T18:12:34.816815+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:12:34.816815+0000","last_undegraded":"2024-05-08T18:12:34.816815+0000","last_fullsized":"2024-05-08T18:12:34.816815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.816409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:36.991987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:25.242971+0000","last_change":"2024-05-08T18:13:25.243102+0000","last_active":"2024-05-08T18:13:25.242971+0000","last_peered":"2024-05-08T18:13:25.242971+0000","last_clean":"2024-05-08T18:13:25.242971+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:13:25.242971+0000","last_undegraded":"2024-05-08T18:13:25.242971+0000","last_fullsized":"2024-05-08T18:13:25.242971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:25.242718+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:25.242718+0000","last_clean_scrub_stamp":"2024-05-08T18:13:25.242718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:17.800437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.822535+0000","last_change":"2024-05-08T18:12:52.822535+0000","last_active":"2024-05-08T18:12:52.822535+0000","last_peered":"2024-05-08T18:12:52.822535+0000","last_clean":"2024-05-08T18:12:52.822535+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:12:52.822535+0000","last_undegraded":"2024-05-08T18:12:52.822535+0000","last_fullsized":"2024-05-08T18:12:52.822535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:52.822284+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:52.822284+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.822284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.447474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:24.234382+0000","last_change":"2024-05-08T18:13:24.234508+0000","last_active":"2024-05-08T18:13:24.234382+0000","last_peered":"2024-05-08T18:13:24.234382+0000","last_clean":"2024-05-08T18:13:24.234382+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:13:24.234382+0000","last_undegraded":"2024-05-08T18:13:24.234382+0000","last_fullsized":"2024-05-08T18:13:24.234382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:24.234101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:24.234101+0000","last_clean_scrub_stamp":"2024-05-08T18:13:24.234101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:47.780634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.223932+0000","last_change":"2024-05-08T18:13:03.223932+0000","last_active":"2024-05-08T18:13:03.223932+0000","last_peered":"2024-05-08T18:13:03.223932+0000","last_clean":"2024-05-08T18:13:03.223932+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:13:03.223932+0000","last_undegraded":"2024-05-08T18:13:03.223932+0000","last_fullsized":"2024-05-08T18:13:03.223932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:03.223576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:03.223576+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.223576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:26.136048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.351619+0000","last_change":"2024-05-08T18:12:40.351619+0000","last_active":"2024-05-08T18:12:40.351619+0000","last_peered":"2024-05-08T18:12:40.351619+0000","last_clean":"2024-05-08T18:12:40.351619+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:40.351619+0000","last_undegraded":"2024-05-08T18:12:40.351619+0000","last_fullsized":"2024-05-08T18:12:40.351619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.351359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:49.624570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.826997+0000","last_change":"2024-05-08T18:12:46.826997+0000","last_active":"2024-05-08T18:12:46.826997+0000","last_peered":"2024-05-08T18:12:46.826997+0000","last_clean":"2024-05-08T18:12:46.826997+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:12:46.826997+0000","last_undegraded":"2024-05-08T18:12:46.826997+0000","last_fullsized":"2024-05-08T18:12:46.826997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.826741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:51.665811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:14.273625+0000","last_change":"2024-05-08T18:13:14.273625+0000","last_active":"2024-05-08T18:13:14.273625+0000","last_peered":"2024-05-08T18:13:14.273625+0000","last_clean":"2024-05-08T18:13:14.273625+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:13:14.273625+0000","last_undegraded":"2024-05-08T18:13:14.273625+0000","last_fullsized":"2024-05-08T18:13:14.273625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:14.273308+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:14.273308+0000","last_clean_scrub_stamp":"2024-05-08T18:13:14.273308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:22:55.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.210636+0000","last_change":"2024-05-08T18:13:11.210636+0000","last_active":"2024-05-08T18:13:11.210636+0000","last_peered":"2024-05-08T18:13:11.210636+0000","last_clean":"2024-05-08T18:13:11.210636+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:13:11.210636+0000","last_undegraded":"2024-05-08T18:13:11.210636+0000","last_fullsized":"2024-05-08T18:13:11.210636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:11.210380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:11.210380+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.210380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:17.869561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.899889+0000","last_change":"2024-05-08T18:12:54.899948+0000","last_active":"2024-05-08T18:12:54.899889+0000","last_peered":"2024-05-08T18:12:54.899889+0000","last_clean":"2024-05-08T18:12:54.899889+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:12:54.899889+0000","last_undegraded":"2024-05-08T18:12:54.899889+0000","last_fullsized":"2024-05-08T18:12:54.899889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:54.899696+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:54.899696+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.899696+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:37.754950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.977478+0000","last_change":"2024-05-08T18:12:51.977478+0000","last_active":"2024-05-08T18:12:51.977478+0000","last_peered":"2024-05-08T18:12:51.977478+0000","last_clean":"2024-05-08T18:12:51.977478+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:12:51.977478+0000","last_undegraded":"2024-05-08T18:12:51.977478+0000","last_fullsized":"2024-05-08T18:12:51.977478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:51.977218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:51.977218+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.977218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:15.519607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:13.963542+0000","last_change":"2024-05-08T18:13:13.963603+0000","last_active":"2024-05-08T18:13:13.963542+0000","last_peered":"2024-05-08T18:13:13.963542+0000","last_clean":"2024-05-08T18:13:13.963542+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:13:13.963542+0000","last_undegraded":"2024-05-08T18:13:13.963542+0000","last_fullsized":"2024-05-08T18:13:13.963542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:13.963354+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:13.963354+0000","last_clean_scrub_stamp":"2024-05-08T18:13:13.963354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:33.499884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705728,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":145208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705728,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705727,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1024000,"data_stored":735055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705728,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":144761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:13:36.220 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.220 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.221 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.221 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.221 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T18:08:46.443596+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.222 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.222 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.222 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.223 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.223 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T18:08:56.512407+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=8, tm_sec=56, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=18, tm_min=12, tm_sec=11, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T18:13:36.223 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T18:13:56.225 DEBUG:teuthology.orchestra.run.smithi053:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T18:13:56.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.361+0000 7f3e1df81640 1 Processor -- start 2024-05-08T18:13:56.361 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.361+0000 7f3e1df81640 1 -- start start 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e1df81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f3e18070f40 0x7f3e18138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e1df81640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e18071e00 con 0x7f3e18070450 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e1df81640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f3e180725c0 con 0x7f3e18070f40 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e177fe640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f3e18070450 0x7f3e18070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59196/0 (socket says 172.21.15.53:59196) 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e177fe640 1 -- 172.21.15.53:0/1786269925 learned_addr learned my addr 172.21.15.53:0/1786269925 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1786269925 >> v2:172.21.15.53:3300/0 conn(0x7f3e18070f40 0x7f3e18138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e16ffd640 1 -- 172.21.15.53:0/1786269925 >> v1:172.21.15.53:6789/0 conn(0x7f3e18070450 legacy=0x7f3e18070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.362 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e16ffd640 1 -- 172.21.15.53:0/1786269925 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1809e250 con 0x7f3e18070f40 2024-05-08T18:13:56.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1786269925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070f40 0x7f3e18138ea0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009740 tx=0x7f3e0001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164fa4eeb46c52a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:56.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e167fc640 1 -- 172.21.15.53:0/1786269925 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e000b0070 con 0x7f3e18070f40 2024-05-08T18:13:56.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e167fc640 1 -- 172.21.15.53:0/1786269925 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e000ab530 con 0x7f3e18070f40 2024-05-08T18:13:56.364 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e167fc640 1 -- 172.21.15.53:0/1786269925 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e000ab830 con 0x7f3e18070f40 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e1df81640 1 -- 172.21.15.53:0/1786269925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070f40 msgr2=0x7f3e18138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.365+0000 7f3e1df81640 1 --2- 172.21.15.53:0/1786269925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070f40 0x7f3e18138ea0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009740 tx=0x7f3e0001c370 comp rx=0 tx=0).stop 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1786269925 shutdown_connections 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 --2- 172.21.15.53:0/1786269925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070f40 0x7f3e18138ea0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1786269925 >> 172.21.15.53:0/1786269925 conn(0x7f3e1809be60 msgr2=0x7f3e1809d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1786269925 shutdown_connections 2024-05-08T18:13:56.365 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1786269925 wait complete. 2024-05-08T18:13:56.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 Processor -- start 2024-05-08T18:13:56.366 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- start start 2024-05-08T18:13:56.367 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 0x7f3e181257e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1813bd80 con 0x7f3e18070450 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 0x7f3e181257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e177fe640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 0x7f3e181257e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38776/0 (socket says 172.21.15.53:38776) 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e177fe640 1 -- 172.21.15.53:0/1397731868 learned_addr learned my addr 172.21.15.53:0/1397731868 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e177fe640 1 -- 172.21.15.53:0/1397731868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e18136c30 con 0x7f3e18070450 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e177fe640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 0x7f3e181257e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800cb40 tx=0x7f3e0800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e08017070 con 0x7f3e18070450 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0800aba0 con 0x7f3e18070450 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e18128c00 con 0x7f3e18070450 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e08012400 con 0x7f3e18070450 2024-05-08T18:13:56.368 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e18128570 con 0x7f3e18070450 2024-05-08T18:13:56.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.369+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e18127360 con 0x7f3e18070450 2024-05-08T18:13:56.369 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.373+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f3e0801a070 con 0x7f3e18070450 2024-05-08T18:13:56.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.373+0000 7f3e0ffff640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3df8039b50 0x7f3df803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:56.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.373+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f3e0804dda0 con 0x7f3e18070450 2024-05-08T18:13:56.370 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.373+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3df8039b50 0x7f3df803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:56.371 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.373+0000 7f3e16ffd640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3df8039b50 0x7f3df803c010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e000ad000 tx=0x7f3e00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:56.373 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.377+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3e08021020 con 0x7f3e18070450 2024-05-08T18:13:56.535 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.537+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 --> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e18064150 con 0x7f3df8039b50 2024-05-08T18:13:56.580 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.581+0000 7f3e0ffff640 1 -- 172.21.15.53:0/1397731868 <== mgr.4101 v2:172.21.15.114:6824/1414075515 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666043 (secure 0 0 0) 0x7f3e18064150 con 0x7f3df8039b50 2024-05-08T18:13:56.584 INFO:teuthology.orchestra.run.smithi053.stdout: 2024-05-08T18:13:56.592 INFO:teuthology.orchestra.run.smithi053.stderr:dumped all 2024-05-08T18:13:56.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.589+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3df8039b50 msgr2=0x7f3df803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.589+0000 7f3e1df81640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3df8039b50 0x7f3df803c010 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3e000ad000 tx=0x7f3e00008040 comp rx=0 tx=0).stop 2024-05-08T18:13:56.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.589+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 msgr2=0x7f3e181257e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.593 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.589+0000 7f3e1df81640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 0x7f3e181257e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f3e0800cb40 tx=0x7f3e0800a060 comp rx=0 tx=0).stop 2024-05-08T18:13:56.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.593+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 shutdown_connections 2024-05-08T18:13:56.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.593+0000 7f3e1df81640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f3df8039b50 0x7f3df803c010 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:56.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.593+0000 7f3e1df81640 1 --2- 172.21.15.53:0/1397731868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e18070450 0x7f3e181257e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:56.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.593+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 >> 172.21.15.53:0/1397731868 conn(0x7f3e1809be60 msgr2=0x7f3e18136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:56.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.593+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 shutdown_connections 2024-05-08T18:13:56.594 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.593+0000 7f3e1df81640 1 -- 172.21.15.53:0/1397731868 wait complete. 2024-05-08T18:13:56.612 INFO:teuthology.orchestra.run.smithi053.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-05-08T18:13:55.464416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603093,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5068,"num_read_kb":4654,"num_write":2121,"num_write_kb":60586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4745,"ondisk_log_size":4745,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152504,"kb_used_data":2840,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334856,"statfs":{"total":386547056640,"available":386390892544,"internally_reserved":0,"allocated":2908160,"data_stored":1758306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006443"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.248061+0000","last_change":"2024-05-08T18:12:56.248061+0000","last_active":"2024-05-08T18:12:56.248061+0000","last_peered":"2024-05-08T18:12:56.248061+0000","last_clean":"2024-05-08T18:12:56.248061+0000","last_became_active":"2024-05-08T18:08:47.509958+0000","last_became_peered":"2024-05-08T18:08:47.509958+0000","last_unstale":"2024-05-08T18:12:56.248061+0000","last_undegraded":"2024-05-08T18:12:56.248061+0000","last_fullsized":"2024-05-08T18:12:56.248061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:56.247806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:56.247806+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.247806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:01.086876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'18","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.892256+0000","last_change":"2024-05-08T18:13:06.892256+0000","last_active":"2024-05-08T18:13:06.892256+0000","last_peered":"2024-05-08T18:13:06.892256+0000","last_clean":"2024-05-08T18:13:06.892256+0000","last_became_active":"2024-05-08T18:08:49.500690+0000","last_became_peered":"2024-05-08T18:08:49.500690+0000","last_unstale":"2024-05-08T18:13:06.892256+0000","last_undegraded":"2024-05-08T18:13:06.892256+0000","last_fullsized":"2024-05-08T18:13:06.892256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:13:06.892004+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:13:06.892004+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.892004+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:39.749902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":58,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.040493+0000","last_change":"2024-05-08T18:12:44.040493+0000","last_active":"2024-05-08T18:12:44.040493+0000","last_peered":"2024-05-08T18:12:44.040493+0000","last_clean":"2024-05-08T18:12:44.040493+0000","last_became_active":"2024-05-08T18:08:47.514276+0000","last_became_peered":"2024-05-08T18:08:47.514276+0000","last_unstale":"2024-05-08T18:12:44.040493+0000","last_undegraded":"2024-05-08T18:12:44.040493+0000","last_fullsized":"2024-05-08T18:12:44.040493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.040231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.040231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:27.160502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.148393+0000","last_change":"2024-05-08T18:13:05.148393+0000","last_active":"2024-05-08T18:13:05.148393+0000","last_peered":"2024-05-08T18:13:05.148393+0000","last_clean":"2024-05-08T18:13:05.148393+0000","last_became_active":"2024-05-08T18:08:49.504001+0000","last_became_peered":"2024-05-08T18:08:49.504001+0000","last_unstale":"2024-05-08T18:13:05.148393+0000","last_undegraded":"2024-05-08T18:13:05.148393+0000","last_fullsized":"2024-05-08T18:13:05.148393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:05.148127+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:05.148127+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.148127+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:11.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.238634+0000","last_change":"2024-05-08T18:13:07.238700+0000","last_active":"2024-05-08T18:13:07.238634+0000","last_peered":"2024-05-08T18:13:07.238634+0000","last_clean":"2024-05-08T18:13:07.238634+0000","last_became_active":"2024-05-08T18:08:47.528184+0000","last_became_peered":"2024-05-08T18:08:47.528184+0000","last_unstale":"2024-05-08T18:13:07.238634+0000","last_undegraded":"2024-05-08T18:13:07.238634+0000","last_fullsized":"2024-05-08T18:13:07.238634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:07.238421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:07.238421+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.238421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:03.039607+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.399487+0000","last_change":"2024-05-08T18:12:50.399487+0000","last_active":"2024-05-08T18:12:50.399487+0000","last_peered":"2024-05-08T18:12:50.399487+0000","last_clean":"2024-05-08T18:12:50.399487+0000","last_became_active":"2024-05-08T18:08:49.510372+0000","last_became_peered":"2024-05-08T18:08:49.510372+0000","last_unstale":"2024-05-08T18:12:50.399487+0000","last_undegraded":"2024-05-08T18:12:50.399487+0000","last_fullsized":"2024-05-08T18:12:50.399487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:50.399205+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.399205+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:02:56.807281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.232589+0000","last_change":"2024-05-08T18:12:54.232650+0000","last_active":"2024-05-08T18:12:54.232589+0000","last_peered":"2024-05-08T18:12:54.232589+0000","last_clean":"2024-05-08T18:12:54.232589+0000","last_became_active":"2024-05-08T18:08:47.506114+0000","last_became_peered":"2024-05-08T18:08:47.506114+0000","last_unstale":"2024-05-08T18:12:54.232589+0000","last_undegraded":"2024-05-08T18:12:54.232589+0000","last_fullsized":"2024-05-08T18:12:54.232589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:54.232364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:54.232364+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.232364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:22:08.995302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.207848+0000","last_change":"2024-05-08T18:12:31.207848+0000","last_active":"2024-05-08T18:12:31.207848+0000","last_peered":"2024-05-08T18:12:31.207848+0000","last_clean":"2024-05-08T18:12:31.207848+0000","last_became_active":"2024-05-08T18:08:49.514310+0000","last_became_peered":"2024-05-08T18:08:49.514310+0000","last_unstale":"2024-05-08T18:12:31.207848+0000","last_undegraded":"2024-05-08T18:12:31.207848+0000","last_fullsized":"2024-05-08T18:12:31.207848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:31.207573+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.207573+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:31.053515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:15.257850+0000","last_change":"2024-05-08T18:13:15.257850+0000","last_active":"2024-05-08T18:13:15.257850+0000","last_peered":"2024-05-08T18:13:15.257850+0000","last_clean":"2024-05-08T18:13:15.257850+0000","last_became_active":"2024-05-08T18:08:47.507194+0000","last_became_peered":"2024-05-08T18:08:47.507194+0000","last_unstale":"2024-05-08T18:13:15.257850+0000","last_undegraded":"2024-05-08T18:13:15.257850+0000","last_fullsized":"2024-05-08T18:13:15.257850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:13:15.257418+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:13:15.257418+0000","last_clean_scrub_stamp":"2024-05-08T18:13:15.257418+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:33:40.563872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.850755+0000","last_change":"2024-05-08T18:12:48.850755+0000","last_active":"2024-05-08T18:12:48.850755+0000","last_peered":"2024-05-08T18:12:48.850755+0000","last_clean":"2024-05-08T18:12:48.850755+0000","last_became_active":"2024-05-08T18:08:49.497030+0000","last_became_peered":"2024-05-08T18:08:49.497030+0000","last_unstale":"2024-05-08T18:12:48.850755+0000","last_undegraded":"2024-05-08T18:12:48.850755+0000","last_fullsized":"2024-05-08T18:12:48.850755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:48.850265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.850265+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:19.763792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'3","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.266831+0000","last_change":"2024-05-08T18:12:44.266831+0000","last_active":"2024-05-08T18:12:44.266831+0000","last_peered":"2024-05-08T18:12:44.266831+0000","last_clean":"2024-05-08T18:12:44.266831+0000","last_became_active":"2024-05-08T18:08:47.509894+0000","last_became_peered":"2024-05-08T18:08:47.509894+0000","last_unstale":"2024-05-08T18:12:44.266831+0000","last_undegraded":"2024-05-08T18:12:44.266831+0000","last_fullsized":"2024-05-08T18:12:44.266831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:12:44.266562+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.266562+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:46.442140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"32'14","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.367754+0000","last_change":"2024-05-08T18:12:54.367754+0000","last_active":"2024-05-08T18:12:54.367754+0000","last_peered":"2024-05-08T18:12:54.367754+0000","last_clean":"2024-05-08T18:12:54.367754+0000","last_became_active":"2024-05-08T18:08:49.507900+0000","last_became_peered":"2024-05-08T18:08:49.507900+0000","last_unstale":"2024-05-08T18:12:54.367754+0000","last_undegraded":"2024-05-08T18:12:54.367754+0000","last_fullsized":"2024-05-08T18:12:54.367754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:54.367506+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:54.367506+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.367506+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:00.952351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"30'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:31.208884+0000","last_change":"2024-05-08T18:13:31.208884+0000","last_active":"2024-05-08T18:13:31.208884+0000","last_peered":"2024-05-08T18:13:31.208884+0000","last_clean":"2024-05-08T18:13:31.208884+0000","last_became_active":"2024-05-08T18:08:47.495666+0000","last_became_peered":"2024-05-08T18:08:47.495666+0000","last_unstale":"2024-05-08T18:13:31.208884+0000","last_undegraded":"2024-05-08T18:13:31.208884+0000","last_fullsized":"2024-05-08T18:13:31.208884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:13:31.208482+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:13:31.208482+0000","last_clean_scrub_stamp":"2024-05-08T18:13:31.208482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:45.891330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'12","reported_seq":73,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.309526+0000","last_change":"2024-05-08T18:12:43.309526+0000","last_active":"2024-05-08T18:12:43.309526+0000","last_peered":"2024-05-08T18:12:43.309526+0000","last_clean":"2024-05-08T18:12:43.309526+0000","last_became_active":"2024-05-08T18:08:49.496701+0000","last_became_peered":"2024-05-08T18:08:49.496701+0000","last_unstale":"2024-05-08T18:12:43.309526+0000","last_undegraded":"2024-05-08T18:12:43.309526+0000","last_fullsized":"2024-05-08T18:12:43.309526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:43.309244+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.309244+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:57.449936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.942401+0000","last_change":"2024-05-08T18:13:03.942401+0000","last_active":"2024-05-08T18:13:03.942401+0000","last_peered":"2024-05-08T18:13:03.942401+0000","last_clean":"2024-05-08T18:13:03.942401+0000","last_became_active":"2024-05-08T18:08:47.510855+0000","last_became_peered":"2024-05-08T18:08:47.510855+0000","last_unstale":"2024-05-08T18:13:03.942401+0000","last_undegraded":"2024-05-08T18:13:03.942401+0000","last_fullsized":"2024-05-08T18:13:03.942401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:03.942113+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:03.942113+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.942113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:13.921262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.193621+0000","last_change":"2024-05-08T18:12:51.193621+0000","last_active":"2024-05-08T18:12:51.193621+0000","last_peered":"2024-05-08T18:12:51.193621+0000","last_clean":"2024-05-08T18:12:51.193621+0000","last_became_active":"2024-05-08T18:08:49.515231+0000","last_became_peered":"2024-05-08T18:08:49.515231+0000","last_unstale":"2024-05-08T18:12:51.193621+0000","last_undegraded":"2024-05-08T18:12:51.193621+0000","last_fullsized":"2024-05-08T18:12:51.193621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:51.193346+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.193346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:23.431759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.261543+0000","last_change":"2024-05-08T18:13:02.261543+0000","last_active":"2024-05-08T18:13:02.261543+0000","last_peered":"2024-05-08T18:13:02.261543+0000","last_clean":"2024-05-08T18:13:02.261543+0000","last_became_active":"2024-05-08T18:08:49.506415+0000","last_became_peered":"2024-05-08T18:08:49.506415+0000","last_unstale":"2024-05-08T18:13:02.261543+0000","last_undegraded":"2024-05-08T18:13:02.261543+0000","last_fullsized":"2024-05-08T18:13:02.261543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:02.261275+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:02.261275+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.261275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:36.032032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.908577+0000","last_change":"2024-05-08T18:13:04.908577+0000","last_active":"2024-05-08T18:13:04.908577+0000","last_peered":"2024-05-08T18:13:04.908577+0000","last_clean":"2024-05-08T18:13:04.908577+0000","last_became_active":"2024-05-08T18:08:47.511387+0000","last_became_peered":"2024-05-08T18:08:47.511387+0000","last_unstale":"2024-05-08T18:13:04.908577+0000","last_undegraded":"2024-05-08T18:13:04.908577+0000","last_fullsized":"2024-05-08T18:13:04.908577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:04.908272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:04.908272+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.908272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:42.262211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'12","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.798700+0000","last_change":"2024-05-08T18:12:56.798700+0000","last_active":"2024-05-08T18:12:56.798700+0000","last_peered":"2024-05-08T18:12:56.798700+0000","last_clean":"2024-05-08T18:12:56.798700+0000","last_became_active":"2024-05-08T18:08:49.498066+0000","last_became_peered":"2024-05-08T18:08:49.498066+0000","last_unstale":"2024-05-08T18:12:56.798700+0000","last_undegraded":"2024-05-08T18:12:56.798700+0000","last_fullsized":"2024-05-08T18:12:56.798700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:56.798384+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:56.798384+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.798384+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:49:56.254807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.180081+0000","last_change":"2024-05-08T18:12:59.180081+0000","last_active":"2024-05-08T18:12:59.180081+0000","last_peered":"2024-05-08T18:12:59.180081+0000","last_clean":"2024-05-08T18:12:59.180081+0000","last_became_active":"2024-05-08T18:08:47.505874+0000","last_became_peered":"2024-05-08T18:08:47.505874+0000","last_unstale":"2024-05-08T18:12:59.180081+0000","last_undegraded":"2024-05-08T18:12:59.180081+0000","last_fullsized":"2024-05-08T18:12:59.180081+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.179832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.179832+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.179832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:37:07.279858+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.778832+0000","last_change":"2024-05-08T18:12:54.778832+0000","last_active":"2024-05-08T18:12:54.778832+0000","last_peered":"2024-05-08T18:12:54.778832+0000","last_clean":"2024-05-08T18:12:54.778832+0000","last_became_active":"2024-05-08T18:08:49.499262+0000","last_became_peered":"2024-05-08T18:08:49.499262+0000","last_unstale":"2024-05-08T18:12:54.778832+0000","last_undegraded":"2024-05-08T18:12:54.778832+0000","last_fullsized":"2024-05-08T18:12:54.778832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:54.778578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:54.778578+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.778578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:40.040820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.823607+0000","last_change":"2024-05-08T18:12:53.823607+0000","last_active":"2024-05-08T18:12:53.823607+0000","last_peered":"2024-05-08T18:12:53.823607+0000","last_clean":"2024-05-08T18:12:53.823607+0000","last_became_active":"2024-05-08T18:08:47.513101+0000","last_became_peered":"2024-05-08T18:08:47.513101+0000","last_unstale":"2024-05-08T18:12:53.823607+0000","last_undegraded":"2024-05-08T18:12:53.823607+0000","last_fullsized":"2024-05-08T18:12:53.823607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:53.823360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:53.823360+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.823360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:44.187535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'16","reported_seq":118,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:13.947580+0000","last_change":"2024-05-08T18:13:13.947580+0000","last_active":"2024-05-08T18:13:13.947580+0000","last_peered":"2024-05-08T18:13:13.947580+0000","last_clean":"2024-05-08T18:13:13.947580+0000","last_became_active":"2024-05-08T18:09:28.599757+0000","last_became_peered":"2024-05-08T18:09:28.599757+0000","last_unstale":"2024-05-08T18:13:13.947580+0000","last_undegraded":"2024-05-08T18:13:13.947580+0000","last_fullsized":"2024-05-08T18:13:13.947580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:13:13.947306+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:13:13.947306+0000","last_clean_scrub_stamp":"2024-05-08T18:13:13.947306+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:58:25.277262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":79,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"32'6","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.819143+0000","last_change":"2024-05-08T18:13:01.819143+0000","last_active":"2024-05-08T18:13:01.819143+0000","last_peered":"2024-05-08T18:13:01.819143+0000","last_clean":"2024-05-08T18:13:01.819143+0000","last_became_active":"2024-05-08T18:08:47.494878+0000","last_became_peered":"2024-05-08T18:08:47.494878+0000","last_unstale":"2024-05-08T18:13:01.819143+0000","last_undegraded":"2024-05-08T18:13:01.819143+0000","last_fullsized":"2024-05-08T18:13:01.819143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:13:01.818889+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:13:01.818889+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.818889+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:20:36.102569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6,"num_write_kb":8817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.206927+0000","last_change":"2024-05-08T18:12:49.206927+0000","last_active":"2024-05-08T18:12:49.206927+0000","last_peered":"2024-05-08T18:12:49.206927+0000","last_clean":"2024-05-08T18:12:49.206927+0000","last_became_active":"2024-05-08T18:08:49.511166+0000","last_became_peered":"2024-05-08T18:08:49.511166+0000","last_unstale":"2024-05-08T18:12:49.206927+0000","last_undegraded":"2024-05-08T18:12:49.206927+0000","last_fullsized":"2024-05-08T18:12:49.206927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:49.206666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.206666+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.348056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.885545+0000","last_change":"2024-05-08T18:13:05.885545+0000","last_active":"2024-05-08T18:13:05.885545+0000","last_peered":"2024-05-08T18:13:05.885545+0000","last_clean":"2024-05-08T18:13:05.885545+0000","last_became_active":"2024-05-08T18:08:47.511582+0000","last_became_peered":"2024-05-08T18:08:47.511582+0000","last_unstale":"2024-05-08T18:13:05.885545+0000","last_undegraded":"2024-05-08T18:13:05.885545+0000","last_fullsized":"2024-05-08T18:13:05.885545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:05.885279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:05.885279+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.885279+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:38.337159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.820989+0000","last_change":"2024-05-08T18:12:43.820989+0000","last_active":"2024-05-08T18:12:43.820989+0000","last_peered":"2024-05-08T18:12:43.820989+0000","last_clean":"2024-05-08T18:12:43.820989+0000","last_became_active":"2024-05-08T18:08:49.495653+0000","last_became_peered":"2024-05-08T18:08:49.495653+0000","last_unstale":"2024-05-08T18:12:43.820989+0000","last_undegraded":"2024-05-08T18:12:43.820989+0000","last_fullsized":"2024-05-08T18:12:43.820989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:43.820707+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.820707+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:27.113355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:32.231020+0000","last_change":"2024-05-08T18:13:32.231175+0000","last_active":"2024-05-08T18:13:32.231020+0000","last_peered":"2024-05-08T18:13:32.231020+0000","last_clean":"2024-05-08T18:13:32.231020+0000","last_became_active":"2024-05-08T18:08:47.498697+0000","last_became_peered":"2024-05-08T18:08:47.498697+0000","last_unstale":"2024-05-08T18:13:32.231020+0000","last_undegraded":"2024-05-08T18:13:32.231020+0000","last_fullsized":"2024-05-08T18:13:32.231020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:32.230770+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:32.230770+0000","last_clean_scrub_stamp":"2024-05-08T18:13:32.230770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:22:28.044806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'36","reported_seq":110,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.861997+0000","last_change":"2024-05-08T18:13:07.861997+0000","last_active":"2024-05-08T18:13:07.861997+0000","last_peered":"2024-05-08T18:13:07.861997+0000","last_clean":"2024-05-08T18:13:07.861997+0000","last_became_active":"2024-05-08T18:08:57.567279+0000","last_became_peered":"2024-05-08T18:08:57.567279+0000","last_unstale":"2024-05-08T18:13:07.861997+0000","last_undegraded":"2024-05-08T18:13:07.861997+0000","last_fullsized":"2024-05-08T18:13:07.861997+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:13:07.861737+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:13:07.861737+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.861737+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:40.313616+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.234862+0000","last_change":"2024-05-08T18:12:37.234862+0000","last_active":"2024-05-08T18:12:37.234862+0000","last_peered":"2024-05-08T18:12:37.234862+0000","last_clean":"2024-05-08T18:12:37.234862+0000","last_became_active":"2024-05-08T18:08:49.512439+0000","last_became_peered":"2024-05-08T18:08:49.512439+0000","last_unstale":"2024-05-08T18:12:37.234862+0000","last_undegraded":"2024-05-08T18:12:37.234862+0000","last_fullsized":"2024-05-08T18:12:37.234862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:37.234593+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.234593+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:20.089848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:34.169141+0000","last_change":"2024-05-08T18:13:34.169306+0000","last_active":"2024-05-08T18:13:34.169141+0000","last_peered":"2024-05-08T18:13:34.169141+0000","last_clean":"2024-05-08T18:13:34.169141+0000","last_became_active":"2024-05-08T18:08:47.527422+0000","last_became_peered":"2024-05-08T18:08:47.527422+0000","last_unstale":"2024-05-08T18:13:34.169141+0000","last_undegraded":"2024-05-08T18:13:34.169141+0000","last_fullsized":"2024-05-08T18:13:34.169141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:34.168883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:34.168883+0000","last_clean_scrub_stamp":"2024-05-08T18:13:34.168883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:24:57.342555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.174172+0000","last_change":"2024-05-08T18:12:23.174172+0000","last_active":"2024-05-08T18:12:23.174172+0000","last_peered":"2024-05-08T18:12:23.174172+0000","last_clean":"2024-05-08T18:12:23.174172+0000","last_became_active":"2024-05-08T18:08:51.505346+0000","last_became_peered":"2024-05-08T18:08:51.505346+0000","last_unstale":"2024-05-08T18:12:23.174172+0000","last_undegraded":"2024-05-08T18:12:23.174172+0000","last_fullsized":"2024-05-08T18:12:23.174172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.173919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.173919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:15.795305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.265809+0000","last_change":"2024-05-08T18:12:36.265809+0000","last_active":"2024-05-08T18:12:36.265809+0000","last_peered":"2024-05-08T18:12:36.265809+0000","last_clean":"2024-05-08T18:12:36.265809+0000","last_became_active":"2024-05-08T18:08:53.548113+0000","last_became_peered":"2024-05-08T18:08:53.548113+0000","last_unstale":"2024-05-08T18:12:36.265809+0000","last_undegraded":"2024-05-08T18:12:36.265809+0000","last_fullsized":"2024-05-08T18:12:36.265809+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:36.265414+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.265414+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:04.357749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.877680+0000","last_change":"2024-05-08T18:12:13.877680+0000","last_active":"2024-05-08T18:12:13.877680+0000","last_peered":"2024-05-08T18:12:13.877680+0000","last_clean":"2024-05-08T18:12:13.877680+0000","last_became_active":"2024-05-08T18:08:55.543633+0000","last_became_peered":"2024-05-08T18:08:55.543633+0000","last_unstale":"2024-05-08T18:12:13.877680+0000","last_undegraded":"2024-05-08T18:12:13.877680+0000","last_fullsized":"2024-05-08T18:12:13.877680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:13.877412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.877412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:24.163300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.726229+0000","last_change":"2024-05-08T18:12:36.726229+0000","last_active":"2024-05-08T18:12:36.726229+0000","last_peered":"2024-05-08T18:12:36.726229+0000","last_clean":"2024-05-08T18:12:36.726229+0000","last_became_active":"2024-05-08T18:08:57.561794+0000","last_became_peered":"2024-05-08T18:08:57.561794+0000","last_unstale":"2024-05-08T18:12:36.726229+0000","last_undegraded":"2024-05-08T18:12:36.726229+0000","last_fullsized":"2024-05-08T18:12:36.726229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:12:36.725932+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.725932+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:50.918918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'12","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.242410+0000","last_change":"2024-05-08T18:12:34.242410+0000","last_active":"2024-05-08T18:12:34.242410+0000","last_peered":"2024-05-08T18:12:34.242410+0000","last_clean":"2024-05-08T18:12:34.242410+0000","last_became_active":"2024-05-08T18:08:49.513072+0000","last_became_peered":"2024-05-08T18:08:49.513072+0000","last_unstale":"2024-05-08T18:12:34.242410+0000","last_undegraded":"2024-05-08T18:12:34.242410+0000","last_fullsized":"2024-05-08T18:12:34.242410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:34.242141+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.242141+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:38:57.784530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.323322+0000","last_change":"2024-05-08T18:12:42.323322+0000","last_active":"2024-05-08T18:12:42.323322+0000","last_peered":"2024-05-08T18:12:42.323322+0000","last_clean":"2024-05-08T18:12:42.323322+0000","last_became_active":"2024-05-08T18:08:47.513948+0000","last_became_peered":"2024-05-08T18:08:47.513948+0000","last_unstale":"2024-05-08T18:12:42.323322+0000","last_undegraded":"2024-05-08T18:12:42.323322+0000","last_fullsized":"2024-05-08T18:12:42.323322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:42.322977+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.322977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:09.542329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.020423+0000","last_change":"2024-05-08T18:12:38.020423+0000","last_active":"2024-05-08T18:12:38.020423+0000","last_peered":"2024-05-08T18:12:38.020423+0000","last_clean":"2024-05-08T18:12:38.020423+0000","last_became_active":"2024-05-08T18:08:51.507963+0000","last_became_peered":"2024-05-08T18:08:51.507963+0000","last_unstale":"2024-05-08T18:12:38.020423+0000","last_undegraded":"2024-05-08T18:12:38.020423+0000","last_fullsized":"2024-05-08T18:12:38.020423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.020159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.020159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:12.758346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.937761+0000","last_change":"2024-05-08T18:12:17.937761+0000","last_active":"2024-05-08T18:12:17.937761+0000","last_peered":"2024-05-08T18:12:17.937761+0000","last_clean":"2024-05-08T18:12:17.937761+0000","last_became_active":"2024-05-08T18:08:53.519482+0000","last_became_peered":"2024-05-08T18:08:53.519482+0000","last_unstale":"2024-05-08T18:12:17.937761+0000","last_undegraded":"2024-05-08T18:12:17.937761+0000","last_fullsized":"2024-05-08T18:12:17.937761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:17.937441+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.937441+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:10:59.874450+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.894205+0000","last_change":"2024-05-08T18:12:16.894205+0000","last_active":"2024-05-08T18:12:16.894205+0000","last_peered":"2024-05-08T18:12:16.894205+0000","last_clean":"2024-05-08T18:12:16.894205+0000","last_became_active":"2024-05-08T18:08:55.555491+0000","last_became_peered":"2024-05-08T18:08:55.555491+0000","last_unstale":"2024-05-08T18:12:16.894205+0000","last_undegraded":"2024-05-08T18:12:16.894205+0000","last_fullsized":"2024-05-08T18:12:16.894205+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.893872+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.893872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:45.046890+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'8","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.863001+0000","last_change":"2024-05-08T18:13:08.863072+0000","last_active":"2024-05-08T18:13:08.863001+0000","last_peered":"2024-05-08T18:13:08.863001+0000","last_clean":"2024-05-08T18:13:08.863001+0000","last_became_active":"2024-05-08T18:08:57.564216+0000","last_became_peered":"2024-05-08T18:08:57.564216+0000","last_unstale":"2024-05-08T18:13:08.863001+0000","last_undegraded":"2024-05-08T18:13:08.863001+0000","last_fullsized":"2024-05-08T18:13:08.863001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:13:08.862805+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:13:08.862805+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.862805+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:15.270881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'20","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.214649+0000","last_change":"2024-05-08T18:12:26.214649+0000","last_active":"2024-05-08T18:12:26.214649+0000","last_peered":"2024-05-08T18:12:26.214649+0000","last_clean":"2024-05-08T18:12:26.214649+0000","last_became_active":"2024-05-08T18:08:49.515068+0000","last_became_peered":"2024-05-08T18:08:49.515068+0000","last_unstale":"2024-05-08T18:12:26.214649+0000","last_undegraded":"2024-05-08T18:12:26.214649+0000","last_fullsized":"2024-05-08T18:12:26.214649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:26.214403+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.214403+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:58:05.554391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":63,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:18.209577+0000","last_change":"2024-05-08T18:13:18.209577+0000","last_active":"2024-05-08T18:13:18.209577+0000","last_peered":"2024-05-08T18:13:18.209577+0000","last_clean":"2024-05-08T18:13:18.209577+0000","last_became_active":"2024-05-08T18:08:47.520646+0000","last_became_peered":"2024-05-08T18:08:47.520646+0000","last_unstale":"2024-05-08T18:13:18.209577+0000","last_undegraded":"2024-05-08T18:13:18.209577+0000","last_fullsized":"2024-05-08T18:13:18.209577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:18.209288+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:18.209288+0000","last_clean_scrub_stamp":"2024-05-08T18:13:18.209288+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:25.457604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.023275+0000","last_change":"2024-05-08T18:12:31.023275+0000","last_active":"2024-05-08T18:12:31.023275+0000","last_peered":"2024-05-08T18:12:31.023275+0000","last_clean":"2024-05-08T18:12:31.023275+0000","last_became_active":"2024-05-08T18:08:51.510564+0000","last_became_peered":"2024-05-08T18:08:51.510564+0000","last_unstale":"2024-05-08T18:12:31.023275+0000","last_undegraded":"2024-05-08T18:12:31.023275+0000","last_fullsized":"2024-05-08T18:12:31.023275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.023023+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.023023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:20.420985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'16","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.430290+0000","last_change":"2024-05-08T18:12:24.430290+0000","last_active":"2024-05-08T18:12:24.430290+0000","last_peered":"2024-05-08T18:12:24.430290+0000","last_clean":"2024-05-08T18:12:24.430290+0000","last_became_active":"2024-05-08T18:08:53.547194+0000","last_became_peered":"2024-05-08T18:08:53.547194+0000","last_unstale":"2024-05-08T18:12:24.430290+0000","last_undegraded":"2024-05-08T18:12:24.430290+0000","last_fullsized":"2024-05-08T18:12:24.430290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:24.429852+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.429852+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:03:02.971977+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'286","reported_seq":405,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.358931+0000","last_change":"2024-05-08T18:12:48.358931+0000","last_active":"2024-05-08T18:12:48.358931+0000","last_peered":"2024-05-08T18:12:48.358931+0000","last_clean":"2024-05-08T18:12:48.358931+0000","last_became_active":"2024-05-08T18:08:55.568756+0000","last_became_peered":"2024-05-08T18:08:55.568756+0000","last_unstale":"2024-05-08T18:12:48.358931+0000","last_undegraded":"2024-05-08T18:12:48.358931+0000","last_fullsized":"2024-05-08T18:12:48.358931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'286","last_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_deep_scrub":"32'286","last_deep_scrub_stamp":"2024-05-08T18:12:48.358666+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.358666+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:52:43.819172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.434500+0000","last_change":"2024-05-08T18:12:27.434651+0000","last_active":"2024-05-08T18:12:27.434500+0000","last_peered":"2024-05-08T18:12:27.434500+0000","last_clean":"2024-05-08T18:12:27.434500+0000","last_became_active":"2024-05-08T18:08:57.563340+0000","last_became_peered":"2024-05-08T18:08:57.563340+0000","last_unstale":"2024-05-08T18:12:27.434500+0000","last_undegraded":"2024-05-08T18:12:27.434500+0000","last_fullsized":"2024-05-08T18:12:27.434500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:27.434279+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.434279+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:06.052889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.868912+0000","last_change":"2024-05-08T18:13:06.868912+0000","last_active":"2024-05-08T18:13:06.868912+0000","last_peered":"2024-05-08T18:13:06.868912+0000","last_clean":"2024-05-08T18:13:06.868912+0000","last_became_active":"2024-05-08T18:08:49.501352+0000","last_became_peered":"2024-05-08T18:08:49.501352+0000","last_unstale":"2024-05-08T18:13:06.868912+0000","last_undegraded":"2024-05-08T18:13:06.868912+0000","last_fullsized":"2024-05-08T18:13:06.868912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:06.868553+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:06.868553+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.868553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:50.814314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.870256+0000","last_change":"2024-05-08T18:13:03.870256+0000","last_active":"2024-05-08T18:13:03.870256+0000","last_peered":"2024-05-08T18:13:03.870256+0000","last_clean":"2024-05-08T18:13:03.870256+0000","last_became_active":"2024-05-08T18:08:47.494431+0000","last_became_peered":"2024-05-08T18:08:47.494431+0000","last_unstale":"2024-05-08T18:13:03.870256+0000","last_undegraded":"2024-05-08T18:13:03.870256+0000","last_fullsized":"2024-05-08T18:13:03.870256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:03.869968+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:03.869968+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.869968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:47.740107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.120572+0000","last_change":"2024-05-08T18:12:16.120572+0000","last_active":"2024-05-08T18:12:16.120572+0000","last_peered":"2024-05-08T18:12:16.120572+0000","last_clean":"2024-05-08T18:12:16.120572+0000","last_became_active":"2024-05-08T18:08:51.512783+0000","last_became_peered":"2024-05-08T18:08:51.512783+0000","last_unstale":"2024-05-08T18:12:16.120572+0000","last_undegraded":"2024-05-08T18:12:16.120572+0000","last_fullsized":"2024-05-08T18:12:16.120572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.120296+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.120296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:25.274533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.373889+0000","last_change":"2024-05-08T18:12:22.373889+0000","last_active":"2024-05-08T18:12:22.373889+0000","last_peered":"2024-05-08T18:12:22.373889+0000","last_clean":"2024-05-08T18:12:22.373889+0000","last_became_active":"2024-05-08T18:08:53.549295+0000","last_became_peered":"2024-05-08T18:08:53.549295+0000","last_unstale":"2024-05-08T18:12:22.373889+0000","last_undegraded":"2024-05-08T18:12:22.373889+0000","last_fullsized":"2024-05-08T18:12:22.373889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:22.373620+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.373620+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:42:49.336729+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'285","reported_seq":415,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.917353+0000","last_change":"2024-05-08T18:12:24.917353+0000","last_active":"2024-05-08T18:12:24.917353+0000","last_peered":"2024-05-08T18:12:24.917353+0000","last_clean":"2024-05-08T18:12:24.917353+0000","last_became_active":"2024-05-08T18:08:55.558848+0000","last_became_peered":"2024-05-08T18:08:55.558848+0000","last_unstale":"2024-05-08T18:12:24.917353+0000","last_undegraded":"2024-05-08T18:12:24.917353+0000","last_fullsized":"2024-05-08T18:12:24.917353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:24.917056+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.917056+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:15:36.692867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'12","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.379434+0000","last_change":"2024-05-08T18:12:55.379434+0000","last_active":"2024-05-08T18:12:55.379434+0000","last_peered":"2024-05-08T18:12:55.379434+0000","last_clean":"2024-05-08T18:12:55.379434+0000","last_became_active":"2024-05-08T18:08:49.508274+0000","last_became_peered":"2024-05-08T18:08:49.508274+0000","last_unstale":"2024-05-08T18:12:55.379434+0000","last_undegraded":"2024-05-08T18:12:55.379434+0000","last_fullsized":"2024-05-08T18:12:55.379434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:55.379170+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:55.379170+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.379170+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:14:34.739950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.201917+0000","last_change":"2024-05-08T18:12:58.201917+0000","last_active":"2024-05-08T18:12:58.201917+0000","last_peered":"2024-05-08T18:12:58.201917+0000","last_clean":"2024-05-08T18:12:58.201917+0000","last_became_active":"2024-05-08T18:08:47.510530+0000","last_became_peered":"2024-05-08T18:08:47.510530+0000","last_unstale":"2024-05-08T18:12:58.201917+0000","last_undegraded":"2024-05-08T18:12:58.201917+0000","last_fullsized":"2024-05-08T18:12:58.201917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:58.201466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:58.201466+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.201466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:29.114994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.808713+0000","last_change":"2024-05-08T18:12:30.808713+0000","last_active":"2024-05-08T18:12:30.808713+0000","last_peered":"2024-05-08T18:12:30.808713+0000","last_clean":"2024-05-08T18:12:30.808713+0000","last_became_active":"2024-05-08T18:08:51.511102+0000","last_became_peered":"2024-05-08T18:08:51.511102+0000","last_unstale":"2024-05-08T18:12:30.808713+0000","last_undegraded":"2024-05-08T18:12:30.808713+0000","last_fullsized":"2024-05-08T18:12:30.808713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.808460+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.808460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:40.081671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'51","reported_seq":112,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.443964+0000","last_change":"2024-05-08T18:12:25.443964+0000","last_active":"2024-05-08T18:12:25.443964+0000","last_peered":"2024-05-08T18:12:25.443964+0000","last_clean":"2024-05-08T18:12:25.443964+0000","last_became_active":"2024-05-08T18:08:53.533811+0000","last_became_peered":"2024-05-08T18:08:53.533811+0000","last_unstale":"2024-05-08T18:12:25.443964+0000","last_undegraded":"2024-05-08T18:12:25.443964+0000","last_fullsized":"2024-05-08T18:12:25.443964+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'51","last_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_deep_scrub":"32'51","last_deep_scrub_stamp":"2024-05-08T18:12:25.443551+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.443551+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:01.194660+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.977194+0000","last_change":"2024-05-08T18:12:18.977194+0000","last_active":"2024-05-08T18:12:18.977194+0000","last_peered":"2024-05-08T18:12:18.977194+0000","last_clean":"2024-05-08T18:12:18.977194+0000","last_became_active":"2024-05-08T18:08:55.542605+0000","last_became_peered":"2024-05-08T18:08:55.542605+0000","last_unstale":"2024-05-08T18:12:18.977194+0000","last_undegraded":"2024-05-08T18:12:18.977194+0000","last_fullsized":"2024-05-08T18:12:18.977194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.976803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.976803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:31.754400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'9","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.404620+0000","last_change":"2024-05-08T18:12:23.404620+0000","last_active":"2024-05-08T18:12:23.404620+0000","last_peered":"2024-05-08T18:12:23.404620+0000","last_clean":"2024-05-08T18:12:23.404620+0000","last_became_active":"2024-05-08T18:08:57.557705+0000","last_became_peered":"2024-05-08T18:08:57.557705+0000","last_unstale":"2024-05-08T18:12:23.404620+0000","last_undegraded":"2024-05-08T18:12:23.404620+0000","last_fullsized":"2024-05-08T18:12:23.404620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:12:23.404248+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.404248+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:43:38.428265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":19,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.842273+0000","last_change":"2024-05-08T18:12:44.842273+0000","last_active":"2024-05-08T18:12:44.842273+0000","last_peered":"2024-05-08T18:12:44.842273+0000","last_clean":"2024-05-08T18:12:44.842273+0000","last_became_active":"2024-05-08T18:08:49.496917+0000","last_became_peered":"2024-05-08T18:08:49.496917+0000","last_unstale":"2024-05-08T18:12:44.842273+0000","last_undegraded":"2024-05-08T18:12:44.842273+0000","last_fullsized":"2024-05-08T18:12:44.842273+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:44.842022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.842022+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:59.604961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.147942+0000","last_change":"2024-05-08T18:12:52.147942+0000","last_active":"2024-05-08T18:12:52.147942+0000","last_peered":"2024-05-08T18:12:52.147942+0000","last_clean":"2024-05-08T18:12:52.147942+0000","last_became_active":"2024-05-08T18:08:47.507089+0000","last_became_peered":"2024-05-08T18:08:47.507089+0000","last_unstale":"2024-05-08T18:12:52.147942+0000","last_undegraded":"2024-05-08T18:12:52.147942+0000","last_fullsized":"2024-05-08T18:12:52.147942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:52.147668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:52.147668+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.147668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:18.379328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.106025+0000","last_change":"2024-05-08T18:13:06.106025+0000","last_active":"2024-05-08T18:13:06.106025+0000","last_peered":"2024-05-08T18:13:06.106025+0000","last_clean":"2024-05-08T18:13:06.106025+0000","last_became_active":"2024-05-08T18:09:28.590733+0000","last_became_peered":"2024-05-08T18:09:28.590733+0000","last_unstale":"2024-05-08T18:13:06.106025+0000","last_undegraded":"2024-05-08T18:13:06.106025+0000","last_fullsized":"2024-05-08T18:13:06.106025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:06.105659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:06.105659+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.105659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:48.960913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.327923+0000","last_change":"2024-05-08T18:12:42.327923+0000","last_active":"2024-05-08T18:12:42.327923+0000","last_peered":"2024-05-08T18:12:42.327923+0000","last_clean":"2024-05-08T18:12:42.327923+0000","last_became_active":"2024-05-08T18:08:53.557638+0000","last_became_peered":"2024-05-08T18:08:53.557638+0000","last_unstale":"2024-05-08T18:12:42.327923+0000","last_undegraded":"2024-05-08T18:12:42.327923+0000","last_fullsized":"2024-05-08T18:12:42.327923+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-05-08T18:12:42.327508+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.327508+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:15.103422+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.889091+0000","last_change":"2024-05-08T18:12:14.889091+0000","last_active":"2024-05-08T18:12:14.889091+0000","last_peered":"2024-05-08T18:12:14.889091+0000","last_clean":"2024-05-08T18:12:14.889091+0000","last_became_active":"2024-05-08T18:08:55.545672+0000","last_became_peered":"2024-05-08T18:08:55.545672+0000","last_unstale":"2024-05-08T18:12:14.889091+0000","last_undegraded":"2024-05-08T18:12:14.889091+0000","last_fullsized":"2024-05-08T18:12:14.889091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.888837+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.888837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:43.041854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.881815+0000","last_change":"2024-05-08T18:13:11.881883+0000","last_active":"2024-05-08T18:13:11.881815+0000","last_peered":"2024-05-08T18:13:11.881815+0000","last_clean":"2024-05-08T18:13:11.881815+0000","last_became_active":"2024-05-08T18:08:57.578184+0000","last_became_peered":"2024-05-08T18:08:57.578184+0000","last_unstale":"2024-05-08T18:13:11.881815+0000","last_undegraded":"2024-05-08T18:13:11.881815+0000","last_fullsized":"2024-05-08T18:13:11.881815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:11.881614+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:11.881614+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.881614+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:38.201456+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'6","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.229409+0000","last_change":"2024-05-08T18:12:45.229409+0000","last_active":"2024-05-08T18:12:45.229409+0000","last_peered":"2024-05-08T18:12:45.229409+0000","last_clean":"2024-05-08T18:12:45.229409+0000","last_became_active":"2024-05-08T18:08:49.508686+0000","last_became_peered":"2024-05-08T18:08:49.508686+0000","last_unstale":"2024-05-08T18:12:45.229409+0000","last_undegraded":"2024-05-08T18:12:45.229409+0000","last_fullsized":"2024-05-08T18:12:45.229409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.229157+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.229157+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:54.383394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:23.210847+0000","last_change":"2024-05-08T18:13:23.210907+0000","last_active":"2024-05-08T18:13:23.210847+0000","last_peered":"2024-05-08T18:13:23.210847+0000","last_clean":"2024-05-08T18:13:23.210847+0000","last_became_active":"2024-05-08T18:08:47.502170+0000","last_became_peered":"2024-05-08T18:08:47.502170+0000","last_unstale":"2024-05-08T18:13:23.210847+0000","last_undegraded":"2024-05-08T18:13:23.210847+0000","last_fullsized":"2024-05-08T18:13:23.210847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:23.210647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:23.210647+0000","last_clean_scrub_stamp":"2024-05-08T18:13:23.210647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:20:28.297936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.003372+0000","last_change":"2024-05-08T18:12:32.003372+0000","last_active":"2024-05-08T18:12:32.003372+0000","last_peered":"2024-05-08T18:12:32.003372+0000","last_clean":"2024-05-08T18:12:32.003372+0000","last_became_active":"2024-05-08T18:08:51.511049+0000","last_became_peered":"2024-05-08T18:08:51.511049+0000","last_unstale":"2024-05-08T18:12:32.003372+0000","last_undegraded":"2024-05-08T18:12:32.003372+0000","last_fullsized":"2024-05-08T18:12:32.003372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.003096+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.003096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:34.178674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.137373+0000","last_change":"2024-05-08T18:12:22.137373+0000","last_active":"2024-05-08T18:12:22.137373+0000","last_peered":"2024-05-08T18:12:22.137373+0000","last_clean":"2024-05-08T18:12:22.137373+0000","last_became_active":"2024-05-08T18:08:53.542492+0000","last_became_peered":"2024-05-08T18:08:53.542492+0000","last_unstale":"2024-05-08T18:12:22.137373+0000","last_undegraded":"2024-05-08T18:12:22.137373+0000","last_fullsized":"2024-05-08T18:12:22.137373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:22.137072+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.137072+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:26.003539+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'285","reported_seq":368,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:13.931134+0000","last_change":"2024-05-08T18:12:13.931134+0000","last_active":"2024-05-08T18:12:13.931134+0000","last_peered":"2024-05-08T18:12:13.931134+0000","last_clean":"2024-05-08T18:12:13.931134+0000","last_became_active":"2024-05-08T18:08:55.545619+0000","last_became_peered":"2024-05-08T18:08:55.545619+0000","last_unstale":"2024-05-08T18:12:13.931134+0000","last_undegraded":"2024-05-08T18:12:13.931134+0000","last_fullsized":"2024-05-08T18:12:13.931134+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:13.931028+0000","last_clean_scrub_stamp":"2024-05-08T18:12:13.931028+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:27:49.682137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:12.913550+0000","last_change":"2024-05-08T18:13:12.913550+0000","last_active":"2024-05-08T18:13:12.913550+0000","last_peered":"2024-05-08T18:13:12.913550+0000","last_clean":"2024-05-08T18:13:12.913550+0000","last_became_active":"2024-05-08T18:08:57.577292+0000","last_became_peered":"2024-05-08T18:08:57.577292+0000","last_unstale":"2024-05-08T18:13:12.913550+0000","last_undegraded":"2024-05-08T18:13:12.913550+0000","last_fullsized":"2024-05-08T18:13:12.913550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:12.913308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:12.913308+0000","last_clean_scrub_stamp":"2024-05-08T18:13:12.913308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:54.296537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"32'10","reported_seq":74,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.376977+0000","last_change":"2024-05-08T18:12:38.376977+0000","last_active":"2024-05-08T18:12:38.376977+0000","last_peered":"2024-05-08T18:12:38.376977+0000","last_clean":"2024-05-08T18:12:38.376977+0000","last_became_active":"2024-05-08T18:08:49.490740+0000","last_became_peered":"2024-05-08T18:08:49.490740+0000","last_unstale":"2024-05-08T18:12:38.376977+0000","last_undegraded":"2024-05-08T18:12:38.376977+0000","last_fullsized":"2024-05-08T18:12:38.376977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:38.376714+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.376714+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:14:00.741888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:16.282627+0000","last_change":"2024-05-08T18:13:16.282627+0000","last_active":"2024-05-08T18:13:16.282627+0000","last_peered":"2024-05-08T18:13:16.282627+0000","last_clean":"2024-05-08T18:13:16.282627+0000","last_became_active":"2024-05-08T18:08:47.520628+0000","last_became_peered":"2024-05-08T18:08:47.520628+0000","last_unstale":"2024-05-08T18:13:16.282627+0000","last_undegraded":"2024-05-08T18:13:16.282627+0000","last_fullsized":"2024-05-08T18:13:16.282627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:16.282359+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:16.282359+0000","last_clean_scrub_stamp":"2024-05-08T18:13:16.282359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:45.788437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.091236+0000","last_change":"2024-05-08T18:13:07.091236+0000","last_active":"2024-05-08T18:13:07.091236+0000","last_peered":"2024-05-08T18:13:07.091236+0000","last_clean":"2024-05-08T18:13:07.091236+0000","last_became_active":"2024-05-08T18:09:28.596153+0000","last_became_peered":"2024-05-08T18:09:28.596153+0000","last_unstale":"2024-05-08T18:13:07.091236+0000","last_undegraded":"2024-05-08T18:13:07.091236+0000","last_fullsized":"2024-05-08T18:13:07.091236+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:07.090998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:07.090998+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.090998+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:21.221385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'65","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.376725+0000","last_change":"2024-05-08T18:12:49.376725+0000","last_active":"2024-05-08T18:12:49.376725+0000","last_peered":"2024-05-08T18:12:49.376725+0000","last_clean":"2024-05-08T18:12:49.376725+0000","last_became_active":"2024-05-08T18:08:53.548300+0000","last_became_peered":"2024-05-08T18:08:53.548300+0000","last_unstale":"2024-05-08T18:12:49.376725+0000","last_undegraded":"2024-05-08T18:12:49.376725+0000","last_fullsized":"2024-05-08T18:12:49.376725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'65","last_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_deep_scrub":"32'65","last_deep_scrub_stamp":"2024-05-08T18:12:49.376328+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.376328+0000","objects_scrubbed":5,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:07:33.322089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.918122+0000","last_change":"2024-05-08T18:12:16.918122+0000","last_active":"2024-05-08T18:12:16.918122+0000","last_peered":"2024-05-08T18:12:16.918122+0000","last_clean":"2024-05-08T18:12:16.918122+0000","last_became_active":"2024-05-08T18:08:55.553634+0000","last_became_peered":"2024-05-08T18:08:55.553634+0000","last_unstale":"2024-05-08T18:12:16.918122+0000","last_undegraded":"2024-05-08T18:12:16.918122+0000","last_fullsized":"2024-05-08T18:12:16.918122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:16.917861+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.917861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:11.528942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'23","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.054066+0000","last_change":"2024-05-08T18:12:41.054066+0000","last_active":"2024-05-08T18:12:41.054066+0000","last_peered":"2024-05-08T18:12:41.054066+0000","last_clean":"2024-05-08T18:12:41.054066+0000","last_became_active":"2024-05-08T18:08:57.553835+0000","last_became_peered":"2024-05-08T18:08:57.553835+0000","last_unstale":"2024-05-08T18:12:41.054066+0000","last_undegraded":"2024-05-08T18:12:41.054066+0000","last_fullsized":"2024-05-08T18:12:41.054066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:41.053624+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.053624+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:02:46.543372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.769660+0000","last_change":"2024-05-08T18:12:35.769660+0000","last_active":"2024-05-08T18:12:35.769660+0000","last_peered":"2024-05-08T18:12:35.769660+0000","last_clean":"2024-05-08T18:12:35.769660+0000","last_became_active":"2024-05-08T18:08:49.519157+0000","last_became_peered":"2024-05-08T18:08:49.519157+0000","last_unstale":"2024-05-08T18:12:35.769660+0000","last_undegraded":"2024-05-08T18:12:35.769660+0000","last_fullsized":"2024-05-08T18:12:35.769660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.769378+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.769378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:44.923615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.963915+0000","last_change":"2024-05-08T18:13:01.963915+0000","last_active":"2024-05-08T18:13:01.963915+0000","last_peered":"2024-05-08T18:13:01.963915+0000","last_clean":"2024-05-08T18:13:01.963915+0000","last_became_active":"2024-05-08T18:08:47.495896+0000","last_became_peered":"2024-05-08T18:08:47.495896+0000","last_unstale":"2024-05-08T18:13:01.963915+0000","last_undegraded":"2024-05-08T18:13:01.963915+0000","last_fullsized":"2024-05-08T18:13:01.963915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:01.963654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:01.963654+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.963654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:29:08.778529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.445639+0000","last_change":"2024-05-08T18:12:34.445639+0000","last_active":"2024-05-08T18:12:34.445639+0000","last_peered":"2024-05-08T18:12:34.445639+0000","last_clean":"2024-05-08T18:12:34.445639+0000","last_became_active":"2024-05-08T18:08:51.507178+0000","last_became_peered":"2024-05-08T18:08:51.507178+0000","last_unstale":"2024-05-08T18:12:34.445639+0000","last_undegraded":"2024-05-08T18:12:34.445639+0000","last_fullsized":"2024-05-08T18:12:34.445639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.445366+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.445366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:27.788124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'40","reported_seq":97,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.976447+0000","last_change":"2024-05-08T18:12:19.976447+0000","last_active":"2024-05-08T18:12:19.976447+0000","last_peered":"2024-05-08T18:12:19.976447+0000","last_clean":"2024-05-08T18:12:19.976447+0000","last_became_active":"2024-05-08T18:08:53.518413+0000","last_became_peered":"2024-05-08T18:08:53.518413+0000","last_unstale":"2024-05-08T18:12:19.976447+0000","last_undegraded":"2024-05-08T18:12:19.976447+0000","last_fullsized":"2024-05-08T18:12:19.976447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'40","last_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_deep_scrub":"32'40","last_deep_scrub_stamp":"2024-05-08T18:12:19.976156+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.976156+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:44.797089+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.382028+0000","last_change":"2024-05-08T18:12:56.382028+0000","last_active":"2024-05-08T18:12:56.382028+0000","last_peered":"2024-05-08T18:12:56.382028+0000","last_clean":"2024-05-08T18:12:56.382028+0000","last_became_active":"2024-05-08T18:08:55.568938+0000","last_became_peered":"2024-05-08T18:08:55.568938+0000","last_unstale":"2024-05-08T18:12:56.382028+0000","last_undegraded":"2024-05-08T18:12:56.382028+0000","last_fullsized":"2024-05-08T18:12:56.382028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:56.381778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:56.381778+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.381778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:41:56.402417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:40.287468+0000","last_change":"2024-05-08T18:13:40.287537+0000","last_active":"2024-05-08T18:13:40.287468+0000","last_peered":"2024-05-08T18:13:40.287468+0000","last_clean":"2024-05-08T18:13:40.287468+0000","last_became_active":"2024-05-08T18:08:57.573823+0000","last_became_peered":"2024-05-08T18:08:57.573823+0000","last_unstale":"2024-05-08T18:13:40.287468+0000","last_undegraded":"2024-05-08T18:13:40.287468+0000","last_fullsized":"2024-05-08T18:13:40.287468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:40.287261+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:40.287261+0000","last_clean_scrub_stamp":"2024-05-08T18:13:40.287261+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:48:15.320945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'10","reported_seq":82,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.246550+0000","last_change":"2024-05-08T18:12:27.246550+0000","last_active":"2024-05-08T18:12:27.246550+0000","last_peered":"2024-05-08T18:12:27.246550+0000","last_clean":"2024-05-08T18:12:27.246550+0000","last_became_active":"2024-05-08T18:08:49.514475+0000","last_became_peered":"2024-05-08T18:08:49.514475+0000","last_unstale":"2024-05-08T18:12:27.246550+0000","last_undegraded":"2024-05-08T18:12:27.246550+0000","last_fullsized":"2024-05-08T18:12:27.246550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:27.246102+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.246102+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:23:55.984072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:21.241050+0000","last_change":"2024-05-08T18:13:21.241178+0000","last_active":"2024-05-08T18:13:21.241050+0000","last_peered":"2024-05-08T18:13:21.241050+0000","last_clean":"2024-05-08T18:13:21.241050+0000","last_became_active":"2024-05-08T18:08:47.502514+0000","last_became_peered":"2024-05-08T18:08:47.502514+0000","last_unstale":"2024-05-08T18:13:21.241050+0000","last_undegraded":"2024-05-08T18:13:21.241050+0000","last_fullsized":"2024-05-08T18:13:21.241050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:21.240741+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:21.240741+0000","last_clean_scrub_stamp":"2024-05-08T18:13:21.240741+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:26:40.562247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.057479+0000","last_change":"2024-05-08T18:12:30.057479+0000","last_active":"2024-05-08T18:12:30.057479+0000","last_peered":"2024-05-08T18:12:30.057479+0000","last_clean":"2024-05-08T18:12:30.057479+0000","last_became_active":"2024-05-08T18:08:51.521451+0000","last_became_peered":"2024-05-08T18:08:51.521451+0000","last_unstale":"2024-05-08T18:12:30.057479+0000","last_undegraded":"2024-05-08T18:12:30.057479+0000","last_fullsized":"2024-05-08T18:12:30.057479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.057220+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:54.634269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.405733+0000","last_change":"2024-05-08T18:12:28.405733+0000","last_active":"2024-05-08T18:12:28.405733+0000","last_peered":"2024-05-08T18:12:28.405733+0000","last_clean":"2024-05-08T18:12:28.405733+0000","last_became_active":"2024-05-08T18:08:53.520682+0000","last_became_peered":"2024-05-08T18:08:53.520682+0000","last_unstale":"2024-05-08T18:12:28.405733+0000","last_undegraded":"2024-05-08T18:12:28.405733+0000","last_fullsized":"2024-05-08T18:12:28.405733+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:28.405516+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.405516+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:24:23.016597+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'285","reported_seq":444,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.441218+0000","last_change":"2024-05-08T18:12:15.441218+0000","last_active":"2024-05-08T18:12:15.441218+0000","last_peered":"2024-05-08T18:12:15.441218+0000","last_clean":"2024-05-08T18:12:15.441218+0000","last_became_active":"2024-05-08T18:08:55.550777+0000","last_became_peered":"2024-05-08T18:08:55.550777+0000","last_unstale":"2024-05-08T18:12:15.441218+0000","last_undegraded":"2024-05-08T18:12:15.441218+0000","last_fullsized":"2024-05-08T18:12:15.441218+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:15.440939+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.440939+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:58:26.637944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.873518+0000","last_change":"2024-05-08T18:13:11.873618+0000","last_active":"2024-05-08T18:13:11.873518+0000","last_peered":"2024-05-08T18:13:11.873518+0000","last_clean":"2024-05-08T18:13:11.873518+0000","last_became_active":"2024-05-08T18:08:57.564164+0000","last_became_peered":"2024-05-08T18:08:57.564164+0000","last_unstale":"2024-05-08T18:13:11.873518+0000","last_undegraded":"2024-05-08T18:13:11.873518+0000","last_fullsized":"2024-05-08T18:13:11.873518+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'13","last_scrub_stamp":"2024-05-08T18:13:11.873300+0000","last_deep_scrub":"32'13","last_deep_scrub_stamp":"2024-05-08T18:13:11.873300+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.873300+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:48:10.588507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.183516+0000","last_change":"2024-05-08T18:12:47.183516+0000","last_active":"2024-05-08T18:12:47.183516+0000","last_peered":"2024-05-08T18:12:47.183516+0000","last_clean":"2024-05-08T18:12:47.183516+0000","last_became_active":"2024-05-08T18:08:49.511152+0000","last_became_peered":"2024-05-08T18:08:49.511152+0000","last_unstale":"2024-05-08T18:12:47.183516+0000","last_undegraded":"2024-05-08T18:12:47.183516+0000","last_fullsized":"2024-05-08T18:12:47.183516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:47.183265+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.183265+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:54.291097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:19.187838+0000","last_change":"2024-05-08T18:13:19.187905+0000","last_active":"2024-05-08T18:13:19.187838+0000","last_peered":"2024-05-08T18:13:19.187838+0000","last_clean":"2024-05-08T18:13:19.187838+0000","last_became_active":"2024-05-08T18:08:47.506627+0000","last_became_peered":"2024-05-08T18:08:47.506627+0000","last_unstale":"2024-05-08T18:13:19.187838+0000","last_undegraded":"2024-05-08T18:13:19.187838+0000","last_fullsized":"2024-05-08T18:13:19.187838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:19.187628+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:19.187628+0000","last_clean_scrub_stamp":"2024-05-08T18:13:19.187628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:57.770747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'5","reported_seq":429,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:27.896053+0000","last_change":"2024-05-08T18:12:27.896053+0000","last_active":"2024-05-08T18:12:27.896053+0000","last_peered":"2024-05-08T18:12:27.896053+0000","last_clean":"2024-05-08T18:12:27.896053+0000","last_became_active":"2024-05-08T18:08:51.514446+0000","last_became_peered":"2024-05-08T18:08:51.514446+0000","last_unstale":"2024-05-08T18:12:27.896053+0000","last_undegraded":"2024-05-08T18:12:27.896053+0000","last_fullsized":"2024-05-08T18:12:27.896053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:27.895781+0000","last_clean_scrub_stamp":"2024-05-08T18:12:27.895781+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:25.396027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.280066+0000","last_change":"2024-05-08T18:12:41.280066+0000","last_active":"2024-05-08T18:12:41.280066+0000","last_peered":"2024-05-08T18:12:41.280066+0000","last_clean":"2024-05-08T18:12:41.280066+0000","last_became_active":"2024-05-08T18:08:53.557825+0000","last_became_peered":"2024-05-08T18:08:53.557825+0000","last_unstale":"2024-05-08T18:12:41.280066+0000","last_undegraded":"2024-05-08T18:12:41.280066+0000","last_fullsized":"2024-05-08T18:12:41.280066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:41.279763+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.279763+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:03.126482+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'285","reported_seq":473,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.876546+0000","last_change":"2024-05-08T18:12:28.876546+0000","last_active":"2024-05-08T18:12:28.876546+0000","last_peered":"2024-05-08T18:12:28.876546+0000","last_clean":"2024-05-08T18:12:28.876546+0000","last_became_active":"2024-05-08T18:08:55.551808+0000","last_became_peered":"2024-05-08T18:08:55.551808+0000","last_unstale":"2024-05-08T18:12:28.876546+0000","last_undegraded":"2024-05-08T18:12:28.876546+0000","last_fullsized":"2024-05-08T18:12:28.876546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:28.876292+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.876292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:13:51.241466+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.173413+0000","last_change":"2024-05-08T18:13:02.173413+0000","last_active":"2024-05-08T18:13:02.173413+0000","last_peered":"2024-05-08T18:13:02.173413+0000","last_clean":"2024-05-08T18:13:02.173413+0000","last_became_active":"2024-05-08T18:08:57.563666+0000","last_became_peered":"2024-05-08T18:08:57.563666+0000","last_unstale":"2024-05-08T18:13:02.173413+0000","last_undegraded":"2024-05-08T18:13:02.173413+0000","last_fullsized":"2024-05-08T18:13:02.173413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:02.173161+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:02.173161+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.173161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:43.568916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.735463+0000","last_change":"2024-05-08T18:12:37.735463+0000","last_active":"2024-05-08T18:12:37.735463+0000","last_peered":"2024-05-08T18:12:37.735463+0000","last_clean":"2024-05-08T18:12:37.735463+0000","last_became_active":"2024-05-08T18:08:49.518095+0000","last_became_peered":"2024-05-08T18:08:49.518095+0000","last_unstale":"2024-05-08T18:12:37.735463+0000","last_undegraded":"2024-05-08T18:12:37.735463+0000","last_fullsized":"2024-05-08T18:12:37.735463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.735180+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.735180+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:39:44.843012+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:06.188288+0000","last_change":"2024-05-08T18:13:06.188288+0000","last_active":"2024-05-08T18:13:06.188288+0000","last_peered":"2024-05-08T18:13:06.188288+0000","last_clean":"2024-05-08T18:13:06.188288+0000","last_became_active":"2024-05-08T18:08:47.527102+0000","last_became_peered":"2024-05-08T18:08:47.527102+0000","last_unstale":"2024-05-08T18:13:06.188288+0000","last_undegraded":"2024-05-08T18:13:06.188288+0000","last_fullsized":"2024-05-08T18:13:06.188288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:06.188003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:06.188003+0000","last_clean_scrub_stamp":"2024-05-08T18:13:06.188003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:08:36.576143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.106450+0000","last_change":"2024-05-08T18:12:17.106450+0000","last_active":"2024-05-08T18:12:17.106450+0000","last_peered":"2024-05-08T18:12:17.106450+0000","last_clean":"2024-05-08T18:12:17.106450+0000","last_became_active":"2024-05-08T18:08:51.511132+0000","last_became_peered":"2024-05-08T18:08:51.511132+0000","last_unstale":"2024-05-08T18:12:17.106450+0000","last_undegraded":"2024-05-08T18:12:17.106450+0000","last_fullsized":"2024-05-08T18:12:17.106450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.106103+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.106103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:31.299089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'48","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.947331+0000","last_change":"2024-05-08T18:12:21.947331+0000","last_active":"2024-05-08T18:12:21.947331+0000","last_peered":"2024-05-08T18:12:21.947331+0000","last_clean":"2024-05-08T18:12:21.947331+0000","last_became_active":"2024-05-08T18:08:53.516686+0000","last_became_peered":"2024-05-08T18:08:53.516686+0000","last_unstale":"2024-05-08T18:12:21.947331+0000","last_undegraded":"2024-05-08T18:12:21.947331+0000","last_fullsized":"2024-05-08T18:12:21.947331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'48","last_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_deep_scrub":"32'48","last_deep_scrub_stamp":"2024-05-08T18:12:21.947022+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.947022+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:33.614218+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.369656+0000","last_change":"2024-05-08T18:12:20.369656+0000","last_active":"2024-05-08T18:12:20.369656+0000","last_peered":"2024-05-08T18:12:20.369656+0000","last_clean":"2024-05-08T18:12:20.369656+0000","last_became_active":"2024-05-08T18:08:55.540485+0000","last_became_peered":"2024-05-08T18:08:55.540485+0000","last_unstale":"2024-05-08T18:12:20.369656+0000","last_undegraded":"2024-05-08T18:12:20.369656+0000","last_fullsized":"2024-05-08T18:12:20.369656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.369368+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.369368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:34:12.685507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'9","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.847346+0000","last_change":"2024-05-08T18:13:08.847346+0000","last_active":"2024-05-08T18:13:08.847346+0000","last_peered":"2024-05-08T18:13:08.847346+0000","last_clean":"2024-05-08T18:13:08.847346+0000","last_became_active":"2024-05-08T18:08:57.566748+0000","last_became_peered":"2024-05-08T18:08:57.566748+0000","last_unstale":"2024-05-08T18:13:08.847346+0000","last_undegraded":"2024-05-08T18:13:08.847346+0000","last_fullsized":"2024-05-08T18:13:08.847346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:13:08.846978+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:13:08.846978+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.846978+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:58.532271+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"32'12","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.335989+0000","last_change":"2024-05-08T18:12:59.335989+0000","last_active":"2024-05-08T18:12:59.335989+0000","last_peered":"2024-05-08T18:12:59.335989+0000","last_clean":"2024-05-08T18:12:59.335989+0000","last_became_active":"2024-05-08T18:08:49.508018+0000","last_became_peered":"2024-05-08T18:08:49.508018+0000","last_unstale":"2024-05-08T18:12:59.335989+0000","last_undegraded":"2024-05-08T18:12:59.335989+0000","last_fullsized":"2024-05-08T18:12:59.335989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:59.335739+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:59.335739+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.335739+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:09.899686+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'74","reported_seq":154,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.842012+0000","last_change":"2024-05-08T18:12:58.842089+0000","last_active":"2024-05-08T18:12:58.842012+0000","last_peered":"2024-05-08T18:12:58.842012+0000","last_clean":"2024-05-08T18:12:58.842012+0000","last_became_active":"2024-05-08T18:08:33.635388+0000","last_became_peered":"2024-05-08T18:08:33.635388+0000","last_unstale":"2024-05-08T18:12:58.842012+0000","last_undegraded":"2024-05-08T18:12:58.842012+0000","last_fullsized":"2024-05-08T18:12:58.842012+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'74","last_scrub_stamp":"2024-05-08T18:12:58.841819+0000","last_deep_scrub":"32'74","last_deep_scrub_stamp":"2024-05-08T18:12:58.841819+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.841819+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:12.972206+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:29.208912+0000","last_change":"2024-05-08T18:13:29.209051+0000","last_active":"2024-05-08T18:13:29.208912+0000","last_peered":"2024-05-08T18:13:29.208912+0000","last_clean":"2024-05-08T18:13:29.208912+0000","last_became_active":"2024-05-08T18:08:39.434176+0000","last_became_peered":"2024-05-08T18:08:39.434176+0000","last_unstale":"2024-05-08T18:13:29.208912+0000","last_undegraded":"2024-05-08T18:13:29.208912+0000","last_fullsized":"2024-05-08T18:13:29.208912+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:29.208645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:29.208645+0000","last_clean_scrub_stamp":"2024-05-08T18:13:29.208645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:45:19.126520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:22.196296+0000","last_change":"2024-05-08T18:13:22.196453+0000","last_active":"2024-05-08T18:13:22.196296+0000","last_peered":"2024-05-08T18:13:22.196296+0000","last_clean":"2024-05-08T18:13:22.196296+0000","last_became_active":"2024-05-08T18:08:47.527810+0000","last_became_peered":"2024-05-08T18:08:47.527810+0000","last_unstale":"2024-05-08T18:13:22.196296+0000","last_undegraded":"2024-05-08T18:13:22.196296+0000","last_fullsized":"2024-05-08T18:13:22.196296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:22.196051+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:22.196051+0000","last_clean_scrub_stamp":"2024-05-08T18:13:22.196051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:38.694602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.832156+0000","last_change":"2024-05-08T18:12:25.832156+0000","last_active":"2024-05-08T18:12:25.832156+0000","last_peered":"2024-05-08T18:12:25.832156+0000","last_clean":"2024-05-08T18:12:25.832156+0000","last_became_active":"2024-05-08T18:08:51.519865+0000","last_became_peered":"2024-05-08T18:08:51.519865+0000","last_unstale":"2024-05-08T18:12:25.832156+0000","last_undegraded":"2024-05-08T18:12:25.832156+0000","last_fullsized":"2024-05-08T18:12:25.832156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.831900+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.831900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:22.583694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'93","reported_seq":184,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.436762+0000","last_change":"2024-05-08T18:12:46.436762+0000","last_active":"2024-05-08T18:12:46.436762+0000","last_peered":"2024-05-08T18:12:46.436762+0000","last_clean":"2024-05-08T18:12:46.436762+0000","last_became_active":"2024-05-08T18:08:53.551465+0000","last_became_peered":"2024-05-08T18:08:53.551465+0000","last_unstale":"2024-05-08T18:12:46.436762+0000","last_undegraded":"2024-05-08T18:12:46.436762+0000","last_fullsized":"2024-05-08T18:12:46.436762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'93","last_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_deep_scrub":"32'93","last_deep_scrub_stamp":"2024-05-08T18:12:46.436505+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.436505+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:44:33.626162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.052679+0000","last_change":"2024-05-08T18:12:29.052679+0000","last_active":"2024-05-08T18:12:29.052679+0000","last_peered":"2024-05-08T18:12:29.052679+0000","last_clean":"2024-05-08T18:12:29.052679+0000","last_became_active":"2024-05-08T18:08:55.564865+0000","last_became_peered":"2024-05-08T18:08:55.564865+0000","last_unstale":"2024-05-08T18:12:29.052679+0000","last_undegraded":"2024-05-08T18:12:29.052679+0000","last_fullsized":"2024-05-08T18:12:29.052679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.052326+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.052326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:01.660597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'82","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.404834+0000","last_change":"2024-05-08T18:12:35.404834+0000","last_active":"2024-05-08T18:12:35.404834+0000","last_peered":"2024-05-08T18:12:35.404834+0000","last_clean":"2024-05-08T18:12:35.404834+0000","last_became_active":"2024-05-08T18:08:57.563829+0000","last_became_peered":"2024-05-08T18:08:57.563829+0000","last_unstale":"2024-05-08T18:12:35.404834+0000","last_undegraded":"2024-05-08T18:12:35.404834+0000","last_fullsized":"2024-05-08T18:12:35.404834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-05-08T18:12:35.404580+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.404580+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:32.156373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"32'28","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.301685+0000","last_change":"2024-05-08T18:13:01.301685+0000","last_active":"2024-05-08T18:13:01.301685+0000","last_peered":"2024-05-08T18:13:01.301685+0000","last_clean":"2024-05-08T18:13:01.301685+0000","last_became_active":"2024-05-08T18:08:49.508575+0000","last_became_peered":"2024-05-08T18:08:49.508575+0000","last_unstale":"2024-05-08T18:13:01.301685+0000","last_undegraded":"2024-05-08T18:13:01.301685+0000","last_fullsized":"2024-05-08T18:13:01.301685+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-05-08T18:13:01.301413+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-05-08T18:13:01.301413+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.301413+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:23:44.881643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":86,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:27.209606+0000","last_change":"2024-05-08T18:13:27.209690+0000","last_active":"2024-05-08T18:13:27.209606+0000","last_peered":"2024-05-08T18:13:27.209606+0000","last_clean":"2024-05-08T18:13:27.209606+0000","last_became_active":"2024-05-08T18:08:39.430741+0000","last_became_peered":"2024-05-08T18:08:39.430741+0000","last_unstale":"2024-05-08T18:13:27.209606+0000","last_undegraded":"2024-05-08T18:13:27.209606+0000","last_fullsized":"2024-05-08T18:13:27.209606+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:27.209355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:27.209355+0000","last_clean_scrub_stamp":"2024-05-08T18:13:27.209355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:59:51.205512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.887765+0000","last_change":"2024-05-08T18:12:55.887765+0000","last_active":"2024-05-08T18:12:55.887765+0000","last_peered":"2024-05-08T18:12:55.887765+0000","last_clean":"2024-05-08T18:12:55.887765+0000","last_became_active":"2024-05-08T18:08:47.512883+0000","last_became_peered":"2024-05-08T18:08:47.512883+0000","last_unstale":"2024-05-08T18:12:55.887765+0000","last_undegraded":"2024-05-08T18:12:55.887765+0000","last_fullsized":"2024-05-08T18:12:55.887765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:55.887504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:55.887504+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.887504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:10.017891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.110947+0000","last_change":"2024-05-08T18:12:15.110947+0000","last_active":"2024-05-08T18:12:15.110947+0000","last_peered":"2024-05-08T18:12:15.110947+0000","last_clean":"2024-05-08T18:12:15.110947+0000","last_became_active":"2024-05-08T18:08:51.512112+0000","last_became_peered":"2024-05-08T18:08:51.512112+0000","last_unstale":"2024-05-08T18:12:15.110947+0000","last_undegraded":"2024-05-08T18:12:15.110947+0000","last_fullsized":"2024-05-08T18:12:15.110947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.110542+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.110542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:17.286120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'290","reported_seq":517,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.874681+0000","last_change":"2024-05-08T18:12:15.874681+0000","last_active":"2024-05-08T18:12:15.874681+0000","last_peered":"2024-05-08T18:12:15.874681+0000","last_clean":"2024-05-08T18:12:15.874681+0000","last_became_active":"2024-05-08T18:08:53.529723+0000","last_became_peered":"2024-05-08T18:08:53.529723+0000","last_unstale":"2024-05-08T18:12:15.874681+0000","last_undegraded":"2024-05-08T18:12:15.874681+0000","last_fullsized":"2024-05-08T18:12:15.874681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'290","last_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_deep_scrub":"32'290","last_deep_scrub_stamp":"2024-05-08T18:12:15.874266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.874266+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:03:16.789721+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:44.388148+0000","last_change":"2024-05-08T18:12:44.388148+0000","last_active":"2024-05-08T18:12:44.388148+0000","last_peered":"2024-05-08T18:12:44.388148+0000","last_clean":"2024-05-08T18:12:44.388148+0000","last_became_active":"2024-05-08T18:08:55.567945+0000","last_became_peered":"2024-05-08T18:08:55.567945+0000","last_unstale":"2024-05-08T18:12:44.388148+0000","last_undegraded":"2024-05-08T18:12:44.388148+0000","last_fullsized":"2024-05-08T18:12:44.388148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:44.387867+0000","last_clean_scrub_stamp":"2024-05-08T18:12:44.387867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:05:11.255581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.852306+0000","last_change":"2024-05-08T18:13:10.852306+0000","last_active":"2024-05-08T18:13:10.852306+0000","last_peered":"2024-05-08T18:13:10.852306+0000","last_clean":"2024-05-08T18:13:10.852306+0000","last_became_active":"2024-05-08T18:08:57.578234+0000","last_became_peered":"2024-05-08T18:08:57.578234+0000","last_unstale":"2024-05-08T18:13:10.852306+0000","last_undegraded":"2024-05-08T18:13:10.852306+0000","last_fullsized":"2024-05-08T18:13:10.852306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-05-08T18:13:10.852058+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-05-08T18:13:10.852058+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.852058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:03:17.260134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'20","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:56.914567+0000","last_change":"2024-05-08T18:12:56.914567+0000","last_active":"2024-05-08T18:12:56.914567+0000","last_peered":"2024-05-08T18:12:56.914567+0000","last_clean":"2024-05-08T18:12:56.914567+0000","last_became_active":"2024-05-08T18:08:49.500441+0000","last_became_peered":"2024-05-08T18:08:49.500441+0000","last_unstale":"2024-05-08T18:12:56.914567+0000","last_undegraded":"2024-05-08T18:12:56.914567+0000","last_fullsized":"2024-05-08T18:12:56.914567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:56.914288+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:56.914288+0000","last_clean_scrub_stamp":"2024-05-08T18:12:56.914288+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:15.883745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":54,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.186005+0000","last_change":"2024-05-08T18:12:53.186057+0000","last_active":"2024-05-08T18:12:53.186005+0000","last_peered":"2024-05-08T18:12:53.186005+0000","last_clean":"2024-05-08T18:12:53.186005+0000","last_became_active":"2024-05-08T18:08:39.433490+0000","last_became_peered":"2024-05-08T18:08:39.433490+0000","last_unstale":"2024-05-08T18:12:53.186005+0000","last_undegraded":"2024-05-08T18:12:53.186005+0000","last_fullsized":"2024-05-08T18:12:53.186005+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:53.185807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:53.185807+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.185807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:36.478455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.924067+0000","last_change":"2024-05-08T18:13:04.924126+0000","last_active":"2024-05-08T18:13:04.924067+0000","last_peered":"2024-05-08T18:13:04.924067+0000","last_clean":"2024-05-08T18:13:04.924067+0000","last_became_active":"2024-05-08T18:08:47.510622+0000","last_became_peered":"2024-05-08T18:08:47.510622+0000","last_unstale":"2024-05-08T18:13:04.924067+0000","last_undegraded":"2024-05-08T18:13:04.924067+0000","last_fullsized":"2024-05-08T18:13:04.924067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:04.923862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:04.923862+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.923862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:42:37.781760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.419268+0000","last_change":"2024-05-08T18:12:32.419268+0000","last_active":"2024-05-08T18:12:32.419268+0000","last_peered":"2024-05-08T18:12:32.419268+0000","last_clean":"2024-05-08T18:12:32.419268+0000","last_became_active":"2024-05-08T18:08:51.508336+0000","last_became_peered":"2024-05-08T18:08:51.508336+0000","last_unstale":"2024-05-08T18:12:32.419268+0000","last_undegraded":"2024-05-08T18:12:32.419268+0000","last_fullsized":"2024-05-08T18:12:32.419268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:32.419009+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.419009+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:22.878609+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":102,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.405846+0000","last_change":"2024-05-08T18:12:26.405846+0000","last_active":"2024-05-08T18:12:26.405846+0000","last_peered":"2024-05-08T18:12:26.405846+0000","last_clean":"2024-05-08T18:12:26.405846+0000","last_became_active":"2024-05-08T18:08:53.524320+0000","last_became_peered":"2024-05-08T18:08:53.524320+0000","last_unstale":"2024-05-08T18:12:26.405846+0000","last_undegraded":"2024-05-08T18:12:26.405846+0000","last_fullsized":"2024-05-08T18:12:26.405846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-05-08T18:12:26.405548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.405548+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:45:54.558566+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.006603+0000","last_change":"2024-05-08T18:12:33.006603+0000","last_active":"2024-05-08T18:12:33.006603+0000","last_peered":"2024-05-08T18:12:33.006603+0000","last_clean":"2024-05-08T18:12:33.006603+0000","last_became_active":"2024-05-08T18:08:55.566293+0000","last_became_peered":"2024-05-08T18:08:55.566293+0000","last_unstale":"2024-05-08T18:12:33.006603+0000","last_undegraded":"2024-05-08T18:12:33.006603+0000","last_fullsized":"2024-05-08T18:12:33.006603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.006343+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.006343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:02:42.160580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"32'2","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:39.312539+0000","last_change":"2024-05-08T18:13:39.312679+0000","last_active":"2024-05-08T18:13:39.312539+0000","last_peered":"2024-05-08T18:13:39.312539+0000","last_clean":"2024-05-08T18:13:39.312539+0000","last_became_active":"2024-05-08T18:08:57.571958+0000","last_became_peered":"2024-05-08T18:08:57.571958+0000","last_unstale":"2024-05-08T18:13:39.312539+0000","last_undegraded":"2024-05-08T18:13:39.312539+0000","last_fullsized":"2024-05-08T18:13:39.312539+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:39.312269+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:39.312269+0000","last_clean_scrub_stamp":"2024-05-08T18:13:39.312269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:05:22.193903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.024876+0000","last_change":"2024-05-08T18:12:43.024876+0000","last_active":"2024-05-08T18:12:43.024876+0000","last_peered":"2024-05-08T18:12:43.024876+0000","last_clean":"2024-05-08T18:12:43.024876+0000","last_became_active":"2024-05-08T18:08:49.492278+0000","last_became_peered":"2024-05-08T18:08:49.492278+0000","last_unstale":"2024-05-08T18:12:43.024876+0000","last_undegraded":"2024-05-08T18:12:43.024876+0000","last_fullsized":"2024-05-08T18:12:43.024876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:43.024617+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.024617+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:28.911270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":48,"num_read_kb":44,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:26.206836+0000","last_change":"2024-05-08T18:13:26.206890+0000","last_active":"2024-05-08T18:13:26.206836+0000","last_peered":"2024-05-08T18:13:26.206836+0000","last_clean":"2024-05-08T18:13:26.206836+0000","last_became_active":"2024-05-08T18:08:39.430550+0000","last_became_peered":"2024-05-08T18:08:39.430550+0000","last_unstale":"2024-05-08T18:13:26.206836+0000","last_undegraded":"2024-05-08T18:13:26.206836+0000","last_fullsized":"2024-05-08T18:13:26.206836+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:26.206627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:26.206627+0000","last_clean_scrub_stamp":"2024-05-08T18:13:26.206627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:50:08.476561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"30'2","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.213523+0000","last_change":"2024-05-08T18:12:55.213523+0000","last_active":"2024-05-08T18:12:55.213523+0000","last_peered":"2024-05-08T18:12:55.213523+0000","last_clean":"2024-05-08T18:12:55.213523+0000","last_became_active":"2024-05-08T18:08:47.506414+0000","last_became_peered":"2024-05-08T18:08:47.506414+0000","last_unstale":"2024-05-08T18:12:55.213523+0000","last_undegraded":"2024-05-08T18:12:55.213523+0000","last_fullsized":"2024-05-08T18:12:55.213523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-05-08T18:12:55.213207+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-05-08T18:12:55.213207+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.213207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:41.099860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.030417+0000","last_change":"2024-05-08T18:12:36.030417+0000","last_active":"2024-05-08T18:12:36.030417+0000","last_peered":"2024-05-08T18:12:36.030417+0000","last_clean":"2024-05-08T18:12:36.030417+0000","last_became_active":"2024-05-08T18:08:51.509613+0000","last_became_peered":"2024-05-08T18:08:51.509613+0000","last_unstale":"2024-05-08T18:12:36.030417+0000","last_undegraded":"2024-05-08T18:12:36.030417+0000","last_fullsized":"2024-05-08T18:12:36.030417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.030159+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.030159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:58.141039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.401132+0000","last_change":"2024-05-08T18:12:47.401132+0000","last_active":"2024-05-08T18:12:47.401132+0000","last_peered":"2024-05-08T18:12:47.401132+0000","last_clean":"2024-05-08T18:12:47.401132+0000","last_became_active":"2024-05-08T18:08:53.550344+0000","last_became_peered":"2024-05-08T18:08:53.550344+0000","last_unstale":"2024-05-08T18:12:47.401132+0000","last_undegraded":"2024-05-08T18:12:47.401132+0000","last_fullsized":"2024-05-08T18:12:47.401132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-05-08T18:12:47.400857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.400857+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:04:20.922374+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.354905+0000","last_change":"2024-05-08T18:12:52.354905+0000","last_active":"2024-05-08T18:12:52.354905+0000","last_peered":"2024-05-08T18:12:52.354905+0000","last_clean":"2024-05-08T18:12:52.354905+0000","last_became_active":"2024-05-08T18:08:55.568999+0000","last_became_peered":"2024-05-08T18:08:55.568999+0000","last_unstale":"2024-05-08T18:12:52.354905+0000","last_undegraded":"2024-05-08T18:12:52.354905+0000","last_fullsized":"2024-05-08T18:12:52.354905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:52.354612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:52.354612+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.354612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:53:55.331263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.772534+0000","last_change":"2024-05-08T18:12:40.772534+0000","last_active":"2024-05-08T18:12:40.772534+0000","last_peered":"2024-05-08T18:12:40.772534+0000","last_clean":"2024-05-08T18:12:40.772534+0000","last_became_active":"2024-05-08T18:08:57.566654+0000","last_became_peered":"2024-05-08T18:08:57.566654+0000","last_unstale":"2024-05-08T18:12:40.772534+0000","last_undegraded":"2024-05-08T18:12:40.772534+0000","last_fullsized":"2024-05-08T18:12:40.772534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.772281+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.772281+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:31.689481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.115376+0000","last_change":"2024-05-08T18:13:08.115376+0000","last_active":"2024-05-08T18:13:08.115376+0000","last_peered":"2024-05-08T18:13:08.115376+0000","last_clean":"2024-05-08T18:13:08.115376+0000","last_became_active":"2024-05-08T18:09:28.595107+0000","last_became_peered":"2024-05-08T18:09:28.595107+0000","last_unstale":"2024-05-08T18:13:08.115376+0000","last_undegraded":"2024-05-08T18:13:08.115376+0000","last_fullsized":"2024-05-08T18:13:08.115376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:13:08.115092+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:13:08.115092+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.115092+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:42:27.084548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.231202+0000","last_change":"2024-05-08T18:12:46.231202+0000","last_active":"2024-05-08T18:12:46.231202+0000","last_peered":"2024-05-08T18:12:46.231202+0000","last_clean":"2024-05-08T18:12:46.231202+0000","last_became_active":"2024-05-08T18:08:47.510659+0000","last_became_peered":"2024-05-08T18:08:47.510659+0000","last_unstale":"2024-05-08T18:12:46.231202+0000","last_undegraded":"2024-05-08T18:12:46.231202+0000","last_fullsized":"2024-05-08T18:12:46.231202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:46.230919+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.230919+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:00.423905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.971100+0000","last_change":"2024-05-08T18:12:59.971158+0000","last_active":"2024-05-08T18:12:59.971100+0000","last_peered":"2024-05-08T18:12:59.971100+0000","last_clean":"2024-05-08T18:12:59.971100+0000","last_became_active":"2024-05-08T18:08:39.433532+0000","last_became_peered":"2024-05-08T18:08:39.433532+0000","last_unstale":"2024-05-08T18:12:59.971100+0000","last_undegraded":"2024-05-08T18:12:59.971100+0000","last_fullsized":"2024-05-08T18:12:59.971100+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.970903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.970903+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.970903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:42:32.746818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.054793+0000","last_change":"2024-05-08T18:12:35.054793+0000","last_active":"2024-05-08T18:12:35.054793+0000","last_peered":"2024-05-08T18:12:35.054793+0000","last_clean":"2024-05-08T18:12:35.054793+0000","last_became_active":"2024-05-08T18:08:51.509428+0000","last_became_peered":"2024-05-08T18:08:51.509428+0000","last_unstale":"2024-05-08T18:12:35.054793+0000","last_undegraded":"2024-05-08T18:12:35.054793+0000","last_fullsized":"2024-05-08T18:12:35.054793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:35.054395+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.054395+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:56:03.822537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'73","reported_seq":150,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.946482+0000","last_change":"2024-05-08T18:12:21.946482+0000","last_active":"2024-05-08T18:12:21.946482+0000","last_peered":"2024-05-08T18:12:21.946482+0000","last_clean":"2024-05-08T18:12:21.946482+0000","last_became_active":"2024-05-08T18:08:53.553672+0000","last_became_peered":"2024-05-08T18:08:53.553672+0000","last_unstale":"2024-05-08T18:12:21.946482+0000","last_undegraded":"2024-05-08T18:12:21.946482+0000","last_fullsized":"2024-05-08T18:12:21.946482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'73","last_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_deep_scrub":"32'73","last_deep_scrub_stamp":"2024-05-08T18:12:21.946183+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.946183+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:14.861048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.481040+0000","last_change":"2024-05-08T18:12:14.481040+0000","last_active":"2024-05-08T18:12:14.481040+0000","last_peered":"2024-05-08T18:12:14.481040+0000","last_clean":"2024-05-08T18:12:14.481040+0000","last_became_active":"2024-05-08T18:08:55.550674+0000","last_became_peered":"2024-05-08T18:08:55.550674+0000","last_unstale":"2024-05-08T18:12:14.481040+0000","last_undegraded":"2024-05-08T18:12:14.481040+0000","last_fullsized":"2024-05-08T18:12:14.481040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:14.480775+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.480775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:10:53.762778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'9","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:07.882214+0000","last_change":"2024-05-08T18:13:07.882214+0000","last_active":"2024-05-08T18:13:07.882214+0000","last_peered":"2024-05-08T18:13:07.882214+0000","last_clean":"2024-05-08T18:13:07.882214+0000","last_became_active":"2024-05-08T18:08:57.563858+0000","last_became_peered":"2024-05-08T18:08:57.563858+0000","last_unstale":"2024-05-08T18:13:07.882214+0000","last_undegraded":"2024-05-08T18:13:07.882214+0000","last_fullsized":"2024-05-08T18:13:07.882214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-05-08T18:13:07.881924+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-05-08T18:13:07.881924+0000","last_clean_scrub_stamp":"2024-05-08T18:13:07.881924+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:30:57.023639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"32'8","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.796028+0000","last_change":"2024-05-08T18:12:33.796028+0000","last_active":"2024-05-08T18:12:33.796028+0000","last_peered":"2024-05-08T18:12:33.796028+0000","last_clean":"2024-05-08T18:12:33.796028+0000","last_became_active":"2024-05-08T18:08:49.519328+0000","last_became_peered":"2024-05-08T18:08:49.519328+0000","last_unstale":"2024-05-08T18:12:33.796028+0000","last_undegraded":"2024-05-08T18:12:33.796028+0000","last_fullsized":"2024-05-08T18:12:33.796028+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:33.795614+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.795614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:47.936305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.996672+0000","last_change":"2024-05-08T18:12:45.996672+0000","last_active":"2024-05-08T18:12:45.996672+0000","last_peered":"2024-05-08T18:12:45.996672+0000","last_clean":"2024-05-08T18:12:45.996672+0000","last_became_active":"2024-05-08T18:08:47.511494+0000","last_became_peered":"2024-05-08T18:08:47.511494+0000","last_unstale":"2024-05-08T18:12:45.996672+0000","last_undegraded":"2024-05-08T18:12:45.996672+0000","last_fullsized":"2024-05-08T18:12:45.996672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:45.996412+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.996412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:16.909940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:28.173123+0000","last_change":"2024-05-08T18:13:28.173256+0000","last_active":"2024-05-08T18:13:28.173123+0000","last_peered":"2024-05-08T18:13:28.173123+0000","last_clean":"2024-05-08T18:13:28.173123+0000","last_became_active":"2024-05-08T18:08:39.430906+0000","last_became_peered":"2024-05-08T18:08:39.430906+0000","last_unstale":"2024-05-08T18:13:28.173123+0000","last_undegraded":"2024-05-08T18:13:28.173123+0000","last_fullsized":"2024-05-08T18:13:28.173123+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:28.172889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:28.172889+0000","last_clean_scrub_stamp":"2024-05-08T18:13:28.172889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:37:42.232277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.142014+0000","last_change":"2024-05-08T18:12:21.142014+0000","last_active":"2024-05-08T18:12:21.142014+0000","last_peered":"2024-05-08T18:12:21.142014+0000","last_clean":"2024-05-08T18:12:21.142014+0000","last_became_active":"2024-05-08T18:08:51.505335+0000","last_became_peered":"2024-05-08T18:08:51.505335+0000","last_unstale":"2024-05-08T18:12:21.142014+0000","last_undegraded":"2024-05-08T18:12:21.142014+0000","last_fullsized":"2024-05-08T18:12:21.142014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:21.141767+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.141767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:55.879953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:14.861893+0000","last_change":"2024-05-08T18:12:14.861893+0000","last_active":"2024-05-08T18:12:14.861893+0000","last_peered":"2024-05-08T18:12:14.861893+0000","last_clean":"2024-05-08T18:12:14.861893+0000","last_became_active":"2024-05-08T18:08:53.552830+0000","last_became_peered":"2024-05-08T18:08:53.552830+0000","last_unstale":"2024-05-08T18:12:14.861893+0000","last_undegraded":"2024-05-08T18:12:14.861893+0000","last_fullsized":"2024-05-08T18:12:14.861893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-05-08T18:12:14.861606+0000","last_clean_scrub_stamp":"2024-05-08T18:12:14.861606+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:16.005518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'285","reported_seq":388,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.950874+0000","last_change":"2024-05-08T18:12:20.950874+0000","last_active":"2024-05-08T18:12:20.950874+0000","last_peered":"2024-05-08T18:12:20.950874+0000","last_clean":"2024-05-08T18:12:20.950874+0000","last_became_active":"2024-05-08T18:08:55.555629+0000","last_became_peered":"2024-05-08T18:08:55.555629+0000","last_unstale":"2024-05-08T18:12:20.950874+0000","last_undegraded":"2024-05-08T18:12:20.950874+0000","last_fullsized":"2024-05-08T18:12:20.950874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:20.950610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.950610+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:59.485254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"30'4","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.196038+0000","last_change":"2024-05-08T18:13:04.196038+0000","last_active":"2024-05-08T18:13:04.196038+0000","last_peered":"2024-05-08T18:13:04.196038+0000","last_clean":"2024-05-08T18:13:04.196038+0000","last_became_active":"2024-05-08T18:08:57.558821+0000","last_became_peered":"2024-05-08T18:08:57.558821+0000","last_unstale":"2024-05-08T18:13:04.196038+0000","last_undegraded":"2024-05-08T18:13:04.196038+0000","last_fullsized":"2024-05-08T18:13:04.196038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-05-08T18:13:04.195762+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-05-08T18:13:04.195762+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.195762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:23:11.857120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"32'6","reported_seq":65,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.360827+0000","last_change":"2024-05-08T18:12:58.360896+0000","last_active":"2024-05-08T18:12:58.360827+0000","last_peered":"2024-05-08T18:12:58.360827+0000","last_clean":"2024-05-08T18:12:58.360827+0000","last_became_active":"2024-05-08T18:08:49.508506+0000","last_became_peered":"2024-05-08T18:08:49.508506+0000","last_unstale":"2024-05-08T18:12:58.360827+0000","last_undegraded":"2024-05-08T18:12:58.360827+0000","last_fullsized":"2024-05-08T18:12:58.360827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:58.360616+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:58.360616+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.360616+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:26:22.299329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:33.214447+0000","last_change":"2024-05-08T18:13:33.214599+0000","last_active":"2024-05-08T18:13:33.214447+0000","last_peered":"2024-05-08T18:13:33.214447+0000","last_clean":"2024-05-08T18:13:33.214447+0000","last_became_active":"2024-05-08T18:08:47.500162+0000","last_became_peered":"2024-05-08T18:08:47.500162+0000","last_unstale":"2024-05-08T18:13:33.214447+0000","last_undegraded":"2024-05-08T18:13:33.214447+0000","last_fullsized":"2024-05-08T18:13:33.214447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:33.214214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:33.214214+0000","last_clean_scrub_stamp":"2024-05-08T18:13:33.214214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:40:13.480316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:58.957538+0000","last_change":"2024-05-08T18:12:58.957538+0000","last_active":"2024-05-08T18:12:58.957538+0000","last_peered":"2024-05-08T18:12:58.957538+0000","last_clean":"2024-05-08T18:12:58.957538+0000","last_became_active":"2024-05-08T18:08:39.433658+0000","last_became_peered":"2024-05-08T18:08:39.433658+0000","last_unstale":"2024-05-08T18:12:58.957538+0000","last_undegraded":"2024-05-08T18:12:58.957538+0000","last_fullsized":"2024-05-08T18:12:58.957538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:58.957285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:58.957285+0000","last_clean_scrub_stamp":"2024-05-08T18:12:58.957285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:20.804005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.151592+0000","last_change":"2024-05-08T18:12:20.151592+0000","last_active":"2024-05-08T18:12:20.151592+0000","last_peered":"2024-05-08T18:12:20.151592+0000","last_clean":"2024-05-08T18:12:20.151592+0000","last_became_active":"2024-05-08T18:08:51.512736+0000","last_became_peered":"2024-05-08T18:08:51.512736+0000","last_unstale":"2024-05-08T18:12:20.151592+0000","last_undegraded":"2024-05-08T18:12:20.151592+0000","last_fullsized":"2024-05-08T18:12:20.151592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.151323+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.151323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:29:59.292712+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.179559+0000","last_change":"2024-05-08T18:12:32.179559+0000","last_active":"2024-05-08T18:12:32.179559+0000","last_peered":"2024-05-08T18:12:32.179559+0000","last_clean":"2024-05-08T18:12:32.179559+0000","last_became_active":"2024-05-08T18:08:53.548208+0000","last_became_peered":"2024-05-08T18:08:53.548208+0000","last_unstale":"2024-05-08T18:12:32.179559+0000","last_undegraded":"2024-05-08T18:12:32.179559+0000","last_fullsized":"2024-05-08T18:12:32.179559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:32.179116+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.179116+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:28:47.805125+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'285","reported_seq":403,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.928706+0000","last_change":"2024-05-08T18:12:17.928706+0000","last_active":"2024-05-08T18:12:17.928706+0000","last_peered":"2024-05-08T18:12:17.928706+0000","last_clean":"2024-05-08T18:12:17.928706+0000","last_became_active":"2024-05-08T18:08:55.542780+0000","last_became_peered":"2024-05-08T18:08:55.542780+0000","last_unstale":"2024-05-08T18:12:17.928706+0000","last_undegraded":"2024-05-08T18:12:17.928706+0000","last_fullsized":"2024-05-08T18:12:17.928706+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:17.928438+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.928438+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:09:04.849778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.869544+0000","last_change":"2024-05-08T18:13:09.869544+0000","last_active":"2024-05-08T18:13:09.869544+0000","last_peered":"2024-05-08T18:13:09.869544+0000","last_clean":"2024-05-08T18:13:09.869544+0000","last_became_active":"2024-05-08T18:08:57.562709+0000","last_became_peered":"2024-05-08T18:08:57.562709+0000","last_unstale":"2024-05-08T18:13:09.869544+0000","last_undegraded":"2024-05-08T18:13:09.869544+0000","last_fullsized":"2024-05-08T18:13:09.869544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:13:09.869263+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:13:09.869263+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.869263+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:53:33.422084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:04.135297+0000","last_change":"2024-05-08T18:13:04.135360+0000","last_active":"2024-05-08T18:13:04.135297+0000","last_peered":"2024-05-08T18:13:04.135297+0000","last_clean":"2024-05-08T18:13:04.135297+0000","last_became_active":"2024-05-08T18:09:28.586985+0000","last_became_peered":"2024-05-08T18:09:28.586985+0000","last_unstale":"2024-05-08T18:13:04.135297+0000","last_undegraded":"2024-05-08T18:13:04.135297+0000","last_fullsized":"2024-05-08T18:13:04.135297+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:04.135088+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:04.135088+0000","last_clean_scrub_stamp":"2024-05-08T18:13:04.135088+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:20.298862+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.832553+0000","last_change":"2024-05-08T18:12:57.832553+0000","last_active":"2024-05-08T18:12:57.832553+0000","last_peered":"2024-05-08T18:12:57.832553+0000","last_clean":"2024-05-08T18:12:57.832553+0000","last_became_active":"2024-05-08T18:08:47.511639+0000","last_became_peered":"2024-05-08T18:08:47.511639+0000","last_unstale":"2024-05-08T18:12:57.832553+0000","last_undegraded":"2024-05-08T18:12:57.832553+0000","last_fullsized":"2024-05-08T18:12:57.832553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.832169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.832169+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.832169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:40.687423+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:30.220183+0000","last_change":"2024-05-08T18:13:30.220237+0000","last_active":"2024-05-08T18:13:30.220183+0000","last_peered":"2024-05-08T18:13:30.220183+0000","last_clean":"2024-05-08T18:13:30.220183+0000","last_became_active":"2024-05-08T18:08:39.482227+0000","last_became_peered":"2024-05-08T18:08:39.482227+0000","last_unstale":"2024-05-08T18:13:30.220183+0000","last_undegraded":"2024-05-08T18:13:30.220183+0000","last_fullsized":"2024-05-08T18:13:30.220183+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:30.219978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:30.219978+0000","last_clean_scrub_stamp":"2024-05-08T18:13:30.219978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:12.354995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.124317+0000","last_change":"2024-05-08T18:12:19.124317+0000","last_active":"2024-05-08T18:12:19.124317+0000","last_peered":"2024-05-08T18:12:19.124317+0000","last_clean":"2024-05-08T18:12:19.124317+0000","last_became_active":"2024-05-08T18:08:51.509832+0000","last_became_peered":"2024-05-08T18:08:51.509832+0000","last_unstale":"2024-05-08T18:12:19.124317+0000","last_undegraded":"2024-05-08T18:12:19.124317+0000","last_fullsized":"2024-05-08T18:12:19.124317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.124051+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.124051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:00:41.234930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'101","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:21.388830+0000","last_change":"2024-05-08T18:12:21.388830+0000","last_active":"2024-05-08T18:12:21.388830+0000","last_peered":"2024-05-08T18:12:21.388830+0000","last_clean":"2024-05-08T18:12:21.388830+0000","last_became_active":"2024-05-08T18:08:53.549669+0000","last_became_peered":"2024-05-08T18:08:53.549669+0000","last_unstale":"2024-05-08T18:12:21.388830+0000","last_undegraded":"2024-05-08T18:12:21.388830+0000","last_fullsized":"2024-05-08T18:12:21.388830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'101","last_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_deep_scrub":"32'101","last_deep_scrub_stamp":"2024-05-08T18:12:21.388548+0000","last_clean_scrub_stamp":"2024-05-08T18:12:21.388548+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:53:37.145916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6012,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":104,"num_read_kb":116,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:20.926349+0000","last_change":"2024-05-08T18:12:20.926349+0000","last_active":"2024-05-08T18:12:20.926349+0000","last_peered":"2024-05-08T18:12:20.926349+0000","last_clean":"2024-05-08T18:12:20.926349+0000","last_became_active":"2024-05-08T18:08:55.553954+0000","last_became_peered":"2024-05-08T18:08:55.553954+0000","last_unstale":"2024-05-08T18:12:20.926349+0000","last_undegraded":"2024-05-08T18:12:20.926349+0000","last_fullsized":"2024-05-08T18:12:20.926349+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:20.925962+0000","last_clean_scrub_stamp":"2024-05-08T18:12:20.925962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:59:11.385561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.400598+0000","last_change":"2024-05-08T18:12:31.400598+0000","last_active":"2024-05-08T18:12:31.400598+0000","last_peered":"2024-05-08T18:12:31.400598+0000","last_clean":"2024-05-08T18:12:31.400598+0000","last_became_active":"2024-05-08T18:08:57.563555+0000","last_became_peered":"2024-05-08T18:08:57.563555+0000","last_unstale":"2024-05-08T18:12:31.400598+0000","last_undegraded":"2024-05-08T18:12:31.400598+0000","last_fullsized":"2024-05-08T18:12:31.400598+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:31.400333+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.400333+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:43.067530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.169886+0000","last_change":"2024-05-08T18:13:03.169886+0000","last_active":"2024-05-08T18:13:03.169886+0000","last_peered":"2024-05-08T18:13:03.169886+0000","last_clean":"2024-05-08T18:13:03.169886+0000","last_became_active":"2024-05-08T18:08:57.583285+0000","last_became_peered":"2024-05-08T18:08:57.583285+0000","last_unstale":"2024-05-08T18:13:03.169886+0000","last_undegraded":"2024-05-08T18:13:03.169886+0000","last_fullsized":"2024-05-08T18:13:03.169886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:03.169522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:03.169522+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.169522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:26.711911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.137601+0000","last_change":"2024-05-08T18:13:01.137601+0000","last_active":"2024-05-08T18:13:01.137601+0000","last_peered":"2024-05-08T18:13:01.137601+0000","last_clean":"2024-05-08T18:13:01.137601+0000","last_became_active":"2024-05-08T18:08:49.517681+0000","last_became_peered":"2024-05-08T18:08:49.517681+0000","last_unstale":"2024-05-08T18:13:01.137601+0000","last_undegraded":"2024-05-08T18:13:01.137601+0000","last_fullsized":"2024-05-08T18:13:01.137601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:01.137324+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:01.137324+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.137324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:16.763333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:20.226601+0000","last_change":"2024-05-08T18:13:20.226601+0000","last_active":"2024-05-08T18:13:20.226601+0000","last_peered":"2024-05-08T18:13:20.226601+0000","last_clean":"2024-05-08T18:13:20.226601+0000","last_became_active":"2024-05-08T18:08:47.527321+0000","last_became_peered":"2024-05-08T18:08:47.527321+0000","last_unstale":"2024-05-08T18:13:20.226601+0000","last_undegraded":"2024-05-08T18:13:20.226601+0000","last_fullsized":"2024-05-08T18:13:20.226601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:20.226335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:20.226335+0000","last_clean_scrub_stamp":"2024-05-08T18:13:20.226335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:50.134040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.851149+0000","last_change":"2024-05-08T18:12:29.851149+0000","last_active":"2024-05-08T18:12:29.851149+0000","last_peered":"2024-05-08T18:12:29.851149+0000","last_clean":"2024-05-08T18:12:29.851149+0000","last_became_active":"2024-05-08T18:08:51.514906+0000","last_became_peered":"2024-05-08T18:08:51.514906+0000","last_unstale":"2024-05-08T18:12:29.851149+0000","last_undegraded":"2024-05-08T18:12:29.851149+0000","last_fullsized":"2024-05-08T18:12:29.851149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:29.850896+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.850896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:20.522178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.217266+0000","last_change":"2024-05-08T18:12:30.217266+0000","last_active":"2024-05-08T18:12:30.217266+0000","last_peered":"2024-05-08T18:12:30.217266+0000","last_clean":"2024-05-08T18:12:30.217266+0000","last_became_active":"2024-05-08T18:08:53.536380+0000","last_became_peered":"2024-05-08T18:08:53.536380+0000","last_unstale":"2024-05-08T18:12:30.217266+0000","last_undegraded":"2024-05-08T18:12:30.217266+0000","last_fullsized":"2024-05-08T18:12:30.217266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:30.216965+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.216965+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:36:38.316991+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.247800+0000","last_change":"2024-05-08T18:12:38.247800+0000","last_active":"2024-05-08T18:12:38.247800+0000","last_peered":"2024-05-08T18:12:38.247800+0000","last_clean":"2024-05-08T18:12:38.247800+0000","last_became_active":"2024-05-08T18:08:55.557988+0000","last_became_peered":"2024-05-08T18:08:55.557988+0000","last_unstale":"2024-05-08T18:12:38.247800+0000","last_undegraded":"2024-05-08T18:12:38.247800+0000","last_fullsized":"2024-05-08T18:12:38.247800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:38.247530+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.247530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:36:52.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.993485+0000","last_change":"2024-05-08T18:12:36.993485+0000","last_active":"2024-05-08T18:12:36.993485+0000","last_peered":"2024-05-08T18:12:36.993485+0000","last_clean":"2024-05-08T18:12:36.993485+0000","last_became_active":"2024-05-08T18:08:57.554011+0000","last_became_peered":"2024-05-08T18:08:57.554011+0000","last_unstale":"2024-05-08T18:12:36.993485+0000","last_undegraded":"2024-05-08T18:12:36.993485+0000","last_fullsized":"2024-05-08T18:12:36.993485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:36.993231+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.993231+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:16.134620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.741896+0000","last_change":"2024-05-08T18:12:39.741896+0000","last_active":"2024-05-08T18:12:39.741896+0000","last_peered":"2024-05-08T18:12:39.741896+0000","last_clean":"2024-05-08T18:12:39.741896+0000","last_became_active":"2024-05-08T18:08:49.514951+0000","last_became_peered":"2024-05-08T18:08:49.514951+0000","last_unstale":"2024-05-08T18:12:39.741896+0000","last_undegraded":"2024-05-08T18:12:39.741896+0000","last_fullsized":"2024-05-08T18:12:39.741896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:39.741610+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.741610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:18.882999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.157066+0000","last_change":"2024-05-08T18:12:48.157066+0000","last_active":"2024-05-08T18:12:48.157066+0000","last_peered":"2024-05-08T18:12:48.157066+0000","last_clean":"2024-05-08T18:12:48.157066+0000","last_became_active":"2024-05-08T18:08:47.512796+0000","last_became_peered":"2024-05-08T18:08:47.512796+0000","last_unstale":"2024-05-08T18:12:48.157066+0000","last_undegraded":"2024-05-08T18:12:48.157066+0000","last_fullsized":"2024-05-08T18:12:48.157066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:48.156795+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.156795+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:10.267674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.087520+0000","last_change":"2024-05-08T18:12:18.087520+0000","last_active":"2024-05-08T18:12:18.087520+0000","last_peered":"2024-05-08T18:12:18.087520+0000","last_clean":"2024-05-08T18:12:18.087520+0000","last_became_active":"2024-05-08T18:08:51.510201+0000","last_became_peered":"2024-05-08T18:08:51.510201+0000","last_unstale":"2024-05-08T18:12:18.087520+0000","last_undegraded":"2024-05-08T18:12:18.087520+0000","last_fullsized":"2024-05-08T18:12:18.087520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.087194+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.087194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:55:46.855336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.937087+0000","last_change":"2024-05-08T18:12:25.937087+0000","last_active":"2024-05-08T18:12:25.937087+0000","last_peered":"2024-05-08T18:12:25.937087+0000","last_clean":"2024-05-08T18:12:25.937087+0000","last_became_active":"2024-05-08T18:08:53.524074+0000","last_became_peered":"2024-05-08T18:08:53.524074+0000","last_unstale":"2024-05-08T18:12:25.937087+0000","last_undegraded":"2024-05-08T18:12:25.937087+0000","last_fullsized":"2024-05-08T18:12:25.937087+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:25.936822+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.936822+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:14:27.641008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.381207+0000","last_change":"2024-05-08T18:12:19.381207+0000","last_active":"2024-05-08T18:12:19.381207+0000","last_peered":"2024-05-08T18:12:19.381207+0000","last_clean":"2024-05-08T18:12:19.381207+0000","last_became_active":"2024-05-08T18:08:55.564569+0000","last_became_peered":"2024-05-08T18:08:55.564569+0000","last_unstale":"2024-05-08T18:12:19.381207+0000","last_undegraded":"2024-05-08T18:12:19.381207+0000","last_fullsized":"2024-05-08T18:12:19.381207+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.380953+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.380953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:38:58.173357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.901329+0000","last_change":"2024-05-08T18:13:10.901383+0000","last_active":"2024-05-08T18:13:10.901329+0000","last_peered":"2024-05-08T18:13:10.901329+0000","last_clean":"2024-05-08T18:13:10.901329+0000","last_became_active":"2024-05-08T18:08:57.564344+0000","last_became_peered":"2024-05-08T18:08:57.564344+0000","last_unstale":"2024-05-08T18:13:10.901329+0000","last_undegraded":"2024-05-08T18:13:10.901329+0000","last_fullsized":"2024-05-08T18:13:10.901329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:10.901138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:10.901138+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.901138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:56.190416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.065832+0000","last_change":"2024-05-08T18:12:42.065832+0000","last_active":"2024-05-08T18:12:42.065832+0000","last_peered":"2024-05-08T18:12:42.065832+0000","last_clean":"2024-05-08T18:12:42.065832+0000","last_became_active":"2024-05-08T18:08:49.506079+0000","last_became_peered":"2024-05-08T18:08:49.506079+0000","last_unstale":"2024-05-08T18:12:42.065832+0000","last_undegraded":"2024-05-08T18:12:42.065832+0000","last_fullsized":"2024-05-08T18:12:42.065832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:42.065419+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.065419+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:56.828357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.165328+0000","last_change":"2024-05-08T18:13:00.165328+0000","last_active":"2024-05-08T18:13:00.165328+0000","last_peered":"2024-05-08T18:13:00.165328+0000","last_clean":"2024-05-08T18:13:00.165328+0000","last_became_active":"2024-05-08T18:08:47.506597+0000","last_became_peered":"2024-05-08T18:08:47.506597+0000","last_unstale":"2024-05-08T18:13:00.165328+0000","last_undegraded":"2024-05-08T18:13:00.165328+0000","last_fullsized":"2024-05-08T18:13:00.165328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:00.165065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:00.165065+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.165065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:00.011008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:30.402667+0000","last_change":"2024-05-08T18:12:30.402667+0000","last_active":"2024-05-08T18:12:30.402667+0000","last_peered":"2024-05-08T18:12:30.402667+0000","last_clean":"2024-05-08T18:12:30.402667+0000","last_became_active":"2024-05-08T18:08:51.520868+0000","last_became_peered":"2024-05-08T18:08:51.520868+0000","last_unstale":"2024-05-08T18:12:30.402667+0000","last_undegraded":"2024-05-08T18:12:30.402667+0000","last_fullsized":"2024-05-08T18:12:30.402667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:30.402404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:30.402404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:12:43.180000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'47","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.966151+0000","last_change":"2024-05-08T18:12:26.966151+0000","last_active":"2024-05-08T18:12:26.966151+0000","last_peered":"2024-05-08T18:12:26.966151+0000","last_clean":"2024-05-08T18:12:26.966151+0000","last_became_active":"2024-05-08T18:08:53.516445+0000","last_became_peered":"2024-05-08T18:08:53.516445+0000","last_unstale":"2024-05-08T18:12:26.966151+0000","last_undegraded":"2024-05-08T18:12:26.966151+0000","last_fullsized":"2024-05-08T18:12:26.966151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'47","last_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_deep_scrub":"32'47","last_deep_scrub_stamp":"2024-05-08T18:12:26.965884+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.965884+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:00.217219+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.875520+0000","last_change":"2024-05-08T18:12:24.875520+0000","last_active":"2024-05-08T18:12:24.875520+0000","last_peered":"2024-05-08T18:12:24.875520+0000","last_clean":"2024-05-08T18:12:24.875520+0000","last_became_active":"2024-05-08T18:08:55.556062+0000","last_became_peered":"2024-05-08T18:08:55.556062+0000","last_unstale":"2024-05-08T18:12:24.875520+0000","last_undegraded":"2024-05-08T18:12:24.875520+0000","last_fullsized":"2024-05-08T18:12:24.875520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:24.875266+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.875266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:18.218024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:37.289306+0000","last_change":"2024-05-08T18:13:37.289367+0000","last_active":"2024-05-08T18:13:37.289306+0000","last_peered":"2024-05-08T18:13:37.289306+0000","last_clean":"2024-05-08T18:13:37.289306+0000","last_became_active":"2024-05-08T18:08:57.571538+0000","last_became_peered":"2024-05-08T18:08:57.571538+0000","last_unstale":"2024-05-08T18:13:37.289306+0000","last_undegraded":"2024-05-08T18:13:37.289306+0000","last_fullsized":"2024-05-08T18:13:37.289306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:37.289099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:37.289099+0000","last_clean_scrub_stamp":"2024-05-08T18:13:37.289099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:18.380789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'18","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.372219+0000","last_change":"2024-05-08T18:12:51.372219+0000","last_active":"2024-05-08T18:12:51.372219+0000","last_peered":"2024-05-08T18:12:51.372219+0000","last_clean":"2024-05-08T18:12:51.372219+0000","last_became_active":"2024-05-08T18:08:49.510014+0000","last_became_peered":"2024-05-08T18:08:49.510014+0000","last_unstale":"2024-05-08T18:12:51.372219+0000","last_undegraded":"2024-05-08T18:12:51.372219+0000","last_fullsized":"2024-05-08T18:12:51.372219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-05-08T18:12:51.371857+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.371857+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:11:17.691699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":96,"num_read_kb":88,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.856913+0000","last_change":"2024-05-08T18:13:00.856913+0000","last_active":"2024-05-08T18:13:00.856913+0000","last_peered":"2024-05-08T18:13:00.856913+0000","last_clean":"2024-05-08T18:13:00.856913+0000","last_became_active":"2024-05-08T18:08:47.494495+0000","last_became_peered":"2024-05-08T18:08:47.494495+0000","last_unstale":"2024-05-08T18:13:00.856913+0000","last_undegraded":"2024-05-08T18:13:00.856913+0000","last_fullsized":"2024-05-08T18:13:00.856913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:00.856639+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:00.856639+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.856639+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:17:22.152206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:25.236698+0000","last_change":"2024-05-08T18:12:25.236698+0000","last_active":"2024-05-08T18:12:25.236698+0000","last_peered":"2024-05-08T18:12:25.236698+0000","last_clean":"2024-05-08T18:12:25.236698+0000","last_became_active":"2024-05-08T18:08:51.501632+0000","last_became_peered":"2024-05-08T18:08:51.501632+0000","last_unstale":"2024-05-08T18:12:25.236698+0000","last_undegraded":"2024-05-08T18:12:25.236698+0000","last_fullsized":"2024-05-08T18:12:25.236698+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:25.236418+0000","last_clean_scrub_stamp":"2024-05-08T18:12:25.236418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:39.999356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.379206+0000","last_change":"2024-05-08T18:12:29.379206+0000","last_active":"2024-05-08T18:12:29.379206+0000","last_peered":"2024-05-08T18:12:29.379206+0000","last_clean":"2024-05-08T18:12:29.379206+0000","last_became_active":"2024-05-08T18:08:53.520626+0000","last_became_peered":"2024-05-08T18:08:53.520626+0000","last_unstale":"2024-05-08T18:12:29.379206+0000","last_undegraded":"2024-05-08T18:12:29.379206+0000","last_fullsized":"2024-05-08T18:12:29.379206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:29.378957+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.378957+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:01:54.199891+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.349967+0000","last_change":"2024-05-08T18:12:18.349967+0000","last_active":"2024-05-08T18:12:18.349967+0000","last_peered":"2024-05-08T18:12:18.349967+0000","last_clean":"2024-05-08T18:12:18.349967+0000","last_became_active":"2024-05-08T18:08:55.540431+0000","last_became_peered":"2024-05-08T18:08:55.540431+0000","last_unstale":"2024-05-08T18:12:18.349967+0000","last_undegraded":"2024-05-08T18:12:18.349967+0000","last_fullsized":"2024-05-08T18:12:18.349967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:18.349704+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.349704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:51.482256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.345032+0000","last_change":"2024-05-08T18:12:57.345032+0000","last_active":"2024-05-08T18:12:57.345032+0000","last_peered":"2024-05-08T18:12:57.345032+0000","last_clean":"2024-05-08T18:12:57.345032+0000","last_became_active":"2024-05-08T18:08:49.510157+0000","last_became_peered":"2024-05-08T18:08:49.510157+0000","last_unstale":"2024-05-08T18:12:57.345032+0000","last_undegraded":"2024-05-08T18:12:57.345032+0000","last_fullsized":"2024-05-08T18:12:57.345032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:57.344755+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:57.344755+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.344755+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:14:15.489585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:10.237287+0000","last_change":"2024-05-08T18:13:10.237287+0000","last_active":"2024-05-08T18:13:10.237287+0000","last_peered":"2024-05-08T18:13:10.237287+0000","last_clean":"2024-05-08T18:13:10.237287+0000","last_became_active":"2024-05-08T18:08:47.516196+0000","last_became_peered":"2024-05-08T18:08:47.516196+0000","last_unstale":"2024-05-08T18:13:10.237287+0000","last_undegraded":"2024-05-08T18:13:10.237287+0000","last_fullsized":"2024-05-08T18:13:10.237287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:10.236825+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:10.236825+0000","last_clean_scrub_stamp":"2024-05-08T18:13:10.236825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:12.359658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.007168+0000","last_change":"2024-05-08T18:12:34.007168+0000","last_active":"2024-05-08T18:12:34.007168+0000","last_peered":"2024-05-08T18:12:34.007168+0000","last_clean":"2024-05-08T18:12:34.007168+0000","last_became_active":"2024-05-08T18:08:51.509587+0000","last_became_peered":"2024-05-08T18:08:51.509587+0000","last_unstale":"2024-05-08T18:12:34.007168+0000","last_undegraded":"2024-05-08T18:12:34.007168+0000","last_fullsized":"2024-05-08T18:12:34.007168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:34.006922+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.006922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:48.199909+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'63","reported_seq":136,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.921374+0000","last_change":"2024-05-08T18:12:23.921455+0000","last_active":"2024-05-08T18:12:23.921374+0000","last_peered":"2024-05-08T18:12:23.921374+0000","last_clean":"2024-05-08T18:12:23.921374+0000","last_became_active":"2024-05-08T18:08:53.524651+0000","last_became_peered":"2024-05-08T18:08:53.524651+0000","last_unstale":"2024-05-08T18:12:23.921374+0000","last_undegraded":"2024-05-08T18:12:23.921374+0000","last_fullsized":"2024-05-08T18:12:23.921374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'63","last_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_deep_scrub":"32'63","last_deep_scrub_stamp":"2024-05-08T18:12:23.921184+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.921184+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:44:20.672977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:17.376282+0000","last_change":"2024-05-08T18:12:17.376334+0000","last_active":"2024-05-08T18:12:17.376282+0000","last_peered":"2024-05-08T18:12:17.376282+0000","last_clean":"2024-05-08T18:12:17.376282+0000","last_became_active":"2024-05-08T18:08:55.546380+0000","last_became_peered":"2024-05-08T18:08:55.546380+0000","last_unstale":"2024-05-08T18:12:17.376282+0000","last_undegraded":"2024-05-08T18:12:17.376282+0000","last_fullsized":"2024-05-08T18:12:17.376282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:17.376083+0000","last_clean_scrub_stamp":"2024-05-08T18:12:17.376083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:23:05.332746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'14","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.878935+0000","last_change":"2024-05-08T18:13:09.878935+0000","last_active":"2024-05-08T18:13:09.878935+0000","last_peered":"2024-05-08T18:13:09.878935+0000","last_clean":"2024-05-08T18:13:09.878935+0000","last_became_active":"2024-05-08T18:08:57.564360+0000","last_became_peered":"2024-05-08T18:08:57.564360+0000","last_unstale":"2024-05-08T18:13:09.878935+0000","last_undegraded":"2024-05-08T18:13:09.878935+0000","last_fullsized":"2024-05-08T18:13:09.878935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:13:09.878674+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:13:09.878674+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.878674+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:58:38.482012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.942036+0000","last_change":"2024-05-08T18:12:52.942212+0000","last_active":"2024-05-08T18:12:52.942036+0000","last_peered":"2024-05-08T18:12:52.942036+0000","last_clean":"2024-05-08T18:12:52.942036+0000","last_became_active":"2024-05-08T18:08:49.499469+0000","last_became_peered":"2024-05-08T18:08:49.499469+0000","last_unstale":"2024-05-08T18:12:52.942036+0000","last_undegraded":"2024-05-08T18:12:52.942036+0000","last_fullsized":"2024-05-08T18:12:52.942036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:52.941803+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:52.941803+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.941803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:09.105577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.829233+0000","last_change":"2024-05-08T18:12:51.829233+0000","last_active":"2024-05-08T18:12:51.829233+0000","last_peered":"2024-05-08T18:12:51.829233+0000","last_clean":"2024-05-08T18:12:51.829233+0000","last_became_active":"2024-05-08T18:08:47.511459+0000","last_became_peered":"2024-05-08T18:08:47.511459+0000","last_unstale":"2024-05-08T18:12:51.829233+0000","last_undegraded":"2024-05-08T18:12:51.829233+0000","last_fullsized":"2024-05-08T18:12:51.829233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:51.828945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:51.828945+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.828945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:00:45.312745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.433631+0000","last_change":"2024-05-08T18:12:33.433631+0000","last_active":"2024-05-08T18:12:33.433631+0000","last_peered":"2024-05-08T18:12:33.433631+0000","last_clean":"2024-05-08T18:12:33.433631+0000","last_became_active":"2024-05-08T18:08:51.508145+0000","last_became_peered":"2024-05-08T18:08:51.508145+0000","last_unstale":"2024-05-08T18:12:33.433631+0000","last_undegraded":"2024-05-08T18:12:33.433631+0000","last_fullsized":"2024-05-08T18:12:33.433631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:33.433233+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.433233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:26.348098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:24.224869+0000","last_change":"2024-05-08T18:12:24.225048+0000","last_active":"2024-05-08T18:12:24.224869+0000","last_peered":"2024-05-08T18:12:24.224869+0000","last_clean":"2024-05-08T18:12:24.224869+0000","last_became_active":"2024-05-08T18:08:53.546576+0000","last_became_peered":"2024-05-08T18:08:53.546576+0000","last_unstale":"2024-05-08T18:12:24.224869+0000","last_undegraded":"2024-05-08T18:12:24.224869+0000","last_fullsized":"2024-05-08T18:12:24.224869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-05-08T18:12:24.224613+0000","last_clean_scrub_stamp":"2024-05-08T18:12:24.224613+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:00:07.517261+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:32.808449+0000","last_change":"2024-05-08T18:12:32.808508+0000","last_active":"2024-05-08T18:12:32.808449+0000","last_peered":"2024-05-08T18:12:32.808449+0000","last_clean":"2024-05-08T18:12:32.808449+0000","last_became_active":"2024-05-08T18:08:55.565118+0000","last_became_peered":"2024-05-08T18:08:55.565118+0000","last_unstale":"2024-05-08T18:12:32.808449+0000","last_undegraded":"2024-05-08T18:12:32.808449+0000","last_fullsized":"2024-05-08T18:12:32.808449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:32.808259+0000","last_clean_scrub_stamp":"2024-05-08T18:12:32.808259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:48:00.027611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:00.331027+0000","last_change":"2024-05-08T18:13:00.331027+0000","last_active":"2024-05-08T18:13:00.331027+0000","last_peered":"2024-05-08T18:13:00.331027+0000","last_clean":"2024-05-08T18:13:00.331027+0000","last_became_active":"2024-05-08T18:08:57.552995+0000","last_became_peered":"2024-05-08T18:08:57.552995+0000","last_unstale":"2024-05-08T18:13:00.331027+0000","last_undegraded":"2024-05-08T18:13:00.331027+0000","last_fullsized":"2024-05-08T18:13:00.331027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:00.330783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:00.330783+0000","last_clean_scrub_stamp":"2024-05-08T18:13:00.330783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:12:42.570757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:29.224975+0000","last_change":"2024-05-08T18:12:29.224975+0000","last_active":"2024-05-08T18:12:29.224975+0000","last_peered":"2024-05-08T18:12:29.224975+0000","last_clean":"2024-05-08T18:12:29.224975+0000","last_became_active":"2024-05-08T18:08:49.513429+0000","last_became_peered":"2024-05-08T18:08:49.513429+0000","last_unstale":"2024-05-08T18:12:29.224975+0000","last_undegraded":"2024-05-08T18:12:29.224975+0000","last_fullsized":"2024-05-08T18:12:29.224975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:29.224718+0000","last_clean_scrub_stamp":"2024-05-08T18:12:29.224718+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:26:07.769843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.832203+0000","last_change":"2024-05-08T18:12:49.832203+0000","last_active":"2024-05-08T18:12:49.832203+0000","last_peered":"2024-05-08T18:12:49.832203+0000","last_clean":"2024-05-08T18:12:49.832203+0000","last_became_active":"2024-05-08T18:08:47.518901+0000","last_became_peered":"2024-05-08T18:08:47.518901+0000","last_unstale":"2024-05-08T18:12:49.832203+0000","last_undegraded":"2024-05-08T18:12:49.832203+0000","last_fullsized":"2024-05-08T18:12:49.832203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:49.831921+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.831921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:42.570012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.149758+0000","last_change":"2024-05-08T18:13:05.149758+0000","last_active":"2024-05-08T18:13:05.149758+0000","last_peered":"2024-05-08T18:13:05.149758+0000","last_clean":"2024-05-08T18:13:05.149758+0000","last_became_active":"2024-05-08T18:09:28.590952+0000","last_became_peered":"2024-05-08T18:09:28.590952+0000","last_unstale":"2024-05-08T18:13:05.149758+0000","last_undegraded":"2024-05-08T18:13:05.149758+0000","last_fullsized":"2024-05-08T18:13:05.149758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:05.149428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:05.149428+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.149428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:33.241764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'41","reported_seq":98,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.009169+0000","last_change":"2024-05-08T18:12:28.009169+0000","last_active":"2024-05-08T18:12:28.009169+0000","last_peered":"2024-05-08T18:12:28.009169+0000","last_clean":"2024-05-08T18:12:28.009169+0000","last_became_active":"2024-05-08T18:08:53.515177+0000","last_became_peered":"2024-05-08T18:08:53.515177+0000","last_unstale":"2024-05-08T18:12:28.009169+0000","last_undegraded":"2024-05-08T18:12:28.009169+0000","last_fullsized":"2024-05-08T18:12:28.009169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'41","last_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_deep_scrub":"32'41","last_deep_scrub_stamp":"2024-05-08T18:12:28.008749+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.008749+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:18.526961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:12.944203+0000","last_change":"2024-05-08T18:12:12.944203+0000","last_active":"2024-05-08T18:12:12.944203+0000","last_peered":"2024-05-08T18:12:12.944203+0000","last_clean":"2024-05-08T18:12:12.944203+0000","last_became_active":"2024-05-08T18:08:55.553708+0000","last_became_peered":"2024-05-08T18:08:55.553708+0000","last_unstale":"2024-05-08T18:12:12.944203+0000","last_undegraded":"2024-05-08T18:12:12.944203+0000","last_fullsized":"2024-05-08T18:12:12.944203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:12.944077+0000","last_clean_scrub_stamp":"2024-05-08T18:12:12.944077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:11:02.872453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:35.216964+0000","last_change":"2024-05-08T18:13:35.216964+0000","last_active":"2024-05-08T18:13:35.216964+0000","last_peered":"2024-05-08T18:13:35.216964+0000","last_clean":"2024-05-08T18:13:35.216964+0000","last_became_active":"2024-05-08T18:08:57.567484+0000","last_became_peered":"2024-05-08T18:08:57.567484+0000","last_unstale":"2024-05-08T18:13:35.216964+0000","last_undegraded":"2024-05-08T18:13:35.216964+0000","last_fullsized":"2024-05-08T18:13:35.216964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-05-08T18:13:35.216667+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-05-08T18:13:35.216667+0000","last_clean_scrub_stamp":"2024-05-08T18:13:35.216667+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:40.570368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.021777+0000","last_change":"2024-05-08T18:12:47.021777+0000","last_active":"2024-05-08T18:12:47.021777+0000","last_peered":"2024-05-08T18:12:47.021777+0000","last_clean":"2024-05-08T18:12:47.021777+0000","last_became_active":"2024-05-08T18:08:49.492413+0000","last_became_peered":"2024-05-08T18:08:49.492413+0000","last_unstale":"2024-05-08T18:12:47.021777+0000","last_undegraded":"2024-05-08T18:12:47.021777+0000","last_fullsized":"2024-05-08T18:12:47.021777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:47.021499+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.021499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:37:58.501866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"32'4","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:13.250799+0000","last_change":"2024-05-08T18:13:13.250799+0000","last_active":"2024-05-08T18:13:13.250799+0000","last_peered":"2024-05-08T18:13:13.250799+0000","last_clean":"2024-05-08T18:13:13.250799+0000","last_became_active":"2024-05-08T18:08:47.507752+0000","last_became_peered":"2024-05-08T18:08:47.507752+0000","last_unstale":"2024-05-08T18:13:13.250799+0000","last_undegraded":"2024-05-08T18:13:13.250799+0000","last_fullsized":"2024-05-08T18:13:13.250799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:13.250506+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:13.250506+0000","last_clean_scrub_stamp":"2024-05-08T18:13:13.250506+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:46:51.643769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"32'5","reported_seq":239,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:26.880471+0000","last_change":"2024-05-08T18:12:26.880471+0000","last_active":"2024-05-08T18:12:26.880471+0000","last_peered":"2024-05-08T18:12:26.880471+0000","last_clean":"2024-05-08T18:12:26.880471+0000","last_became_active":"2024-05-08T18:08:51.516835+0000","last_became_peered":"2024-05-08T18:08:51.516835+0000","last_unstale":"2024-05-08T18:12:26.880471+0000","last_undegraded":"2024-05-08T18:12:26.880471+0000","last_fullsized":"2024-05-08T18:12:26.880471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:26.880045+0000","last_clean_scrub_stamp":"2024-05-08T18:12:26.880045+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:45.838146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:43.374059+0000","last_change":"2024-05-08T18:12:43.374059+0000","last_active":"2024-05-08T18:12:43.374059+0000","last_peered":"2024-05-08T18:12:43.374059+0000","last_clean":"2024-05-08T18:12:43.374059+0000","last_became_active":"2024-05-08T18:08:53.554388+0000","last_became_peered":"2024-05-08T18:08:53.554388+0000","last_unstale":"2024-05-08T18:12:43.374059+0000","last_undegraded":"2024-05-08T18:12:43.374059+0000","last_fullsized":"2024-05-08T18:12:43.374059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-05-08T18:12:43.373798+0000","last_clean_scrub_stamp":"2024-05-08T18:12:43.373798+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:10.395570+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'285","reported_seq":420,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:16.415136+0000","last_change":"2024-05-08T18:12:16.415136+0000","last_active":"2024-05-08T18:12:16.415136+0000","last_peered":"2024-05-08T18:12:16.415136+0000","last_clean":"2024-05-08T18:12:16.415136+0000","last_became_active":"2024-05-08T18:08:55.548572+0000","last_became_peered":"2024-05-08T18:08:55.548572+0000","last_unstale":"2024-05-08T18:12:16.415136+0000","last_undegraded":"2024-05-08T18:12:16.415136+0000","last_fullsized":"2024-05-08T18:12:16.415136+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'285","last_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_deep_scrub":"32'285","last_deep_scrub_stamp":"2024-05-08T18:12:16.414863+0000","last_clean_scrub_stamp":"2024-05-08T18:12:16.414863+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:57:08.725122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:41.317532+0000","last_change":"2024-05-08T18:13:41.317532+0000","last_active":"2024-05-08T18:13:41.317532+0000","last_peered":"2024-05-08T18:13:41.317532+0000","last_clean":"2024-05-08T18:13:41.317532+0000","last_became_active":"2024-05-08T18:08:57.574682+0000","last_became_peered":"2024-05-08T18:08:57.574682+0000","last_unstale":"2024-05-08T18:13:41.317532+0000","last_undegraded":"2024-05-08T18:13:41.317532+0000","last_fullsized":"2024-05-08T18:13:41.317532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:41.317155+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:41.317155+0000","last_clean_scrub_stamp":"2024-05-08T18:13:41.317155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:34:40.346977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.343330+0000","last_change":"2024-05-08T18:12:39.343330+0000","last_active":"2024-05-08T18:12:39.343330+0000","last_peered":"2024-05-08T18:12:39.343330+0000","last_clean":"2024-05-08T18:12:39.343330+0000","last_became_active":"2024-05-08T18:08:49.492029+0000","last_became_peered":"2024-05-08T18:08:49.492029+0000","last_unstale":"2024-05-08T18:12:39.343330+0000","last_undegraded":"2024-05-08T18:12:39.343330+0000","last_fullsized":"2024-05-08T18:12:39.343330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.342952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.342952+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:30.014235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:59.828209+0000","last_change":"2024-05-08T18:12:59.828209+0000","last_active":"2024-05-08T18:12:59.828209+0000","last_peered":"2024-05-08T18:12:59.828209+0000","last_clean":"2024-05-08T18:12:59.828209+0000","last_became_active":"2024-05-08T18:08:47.491188+0000","last_became_peered":"2024-05-08T18:08:47.491188+0000","last_unstale":"2024-05-08T18:12:59.828209+0000","last_undegraded":"2024-05-08T18:12:59.828209+0000","last_fullsized":"2024-05-08T18:12:59.828209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:59.827904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:59.827904+0000","last_clean_scrub_stamp":"2024-05-08T18:12:59.827904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:47:58.305517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:23.920309+0000","last_change":"2024-05-08T18:12:23.920309+0000","last_active":"2024-05-08T18:12:23.920309+0000","last_peered":"2024-05-08T18:12:23.920309+0000","last_clean":"2024-05-08T18:12:23.920309+0000","last_became_active":"2024-05-08T18:08:51.517233+0000","last_became_peered":"2024-05-08T18:08:51.517233+0000","last_unstale":"2024-05-08T18:12:23.920309+0000","last_undegraded":"2024-05-08T18:12:23.920309+0000","last_fullsized":"2024-05-08T18:12:23.920309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:23.919920+0000","last_clean_scrub_stamp":"2024-05-08T18:12:23.919920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:14:16.834786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'45","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:18.983908+0000","last_change":"2024-05-08T18:12:18.983908+0000","last_active":"2024-05-08T18:12:18.983908+0000","last_peered":"2024-05-08T18:12:18.983908+0000","last_clean":"2024-05-08T18:12:18.983908+0000","last_became_active":"2024-05-08T18:08:53.518961+0000","last_became_peered":"2024-05-08T18:08:53.518961+0000","last_unstale":"2024-05-08T18:12:18.983908+0000","last_undegraded":"2024-05-08T18:12:18.983908+0000","last_fullsized":"2024-05-08T18:12:18.983908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'45","last_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_deep_scrub":"32'45","last_deep_scrub_stamp":"2024-05-08T18:12:18.983474+0000","last_clean_scrub_stamp":"2024-05-08T18:12:18.983474+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:34.287333+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:19.970940+0000","last_change":"2024-05-08T18:12:19.970940+0000","last_active":"2024-05-08T18:12:19.970940+0000","last_peered":"2024-05-08T18:12:19.970940+0000","last_clean":"2024-05-08T18:12:19.970940+0000","last_became_active":"2024-05-08T18:08:55.542099+0000","last_became_peered":"2024-05-08T18:08:55.542099+0000","last_unstale":"2024-05-08T18:12:19.970940+0000","last_undegraded":"2024-05-08T18:12:19.970940+0000","last_fullsized":"2024-05-08T18:12:19.970940+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:19.970683+0000","last_clean_scrub_stamp":"2024-05-08T18:12:19.970683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:32:54.981624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:12.929769+0000","last_change":"2024-05-08T18:13:12.929769+0000","last_active":"2024-05-08T18:13:12.929769+0000","last_peered":"2024-05-08T18:13:12.929769+0000","last_clean":"2024-05-08T18:13:12.929769+0000","last_became_active":"2024-05-08T18:08:57.578804+0000","last_became_peered":"2024-05-08T18:08:57.578804+0000","last_unstale":"2024-05-08T18:13:12.929769+0000","last_undegraded":"2024-05-08T18:13:12.929769+0000","last_fullsized":"2024-05-08T18:13:12.929769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:13:12.929342+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:13:12.929342+0000","last_clean_scrub_stamp":"2024-05-08T18:13:12.929342+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:54:15.905993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.327424+0000","last_change":"2024-05-08T18:12:41.327424+0000","last_active":"2024-05-08T18:12:41.327424+0000","last_peered":"2024-05-08T18:12:41.327424+0000","last_clean":"2024-05-08T18:12:41.327424+0000","last_became_active":"2024-05-08T18:08:49.492967+0000","last_became_peered":"2024-05-08T18:08:49.492967+0000","last_unstale":"2024-05-08T18:12:41.327424+0000","last_undegraded":"2024-05-08T18:12:41.327424+0000","last_fullsized":"2024-05-08T18:12:41.327424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:41.327063+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.327063+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:10.463865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:09.275882+0000","last_change":"2024-05-08T18:13:09.275882+0000","last_active":"2024-05-08T18:13:09.275882+0000","last_peered":"2024-05-08T18:13:09.275882+0000","last_clean":"2024-05-08T18:13:09.275882+0000","last_became_active":"2024-05-08T18:08:47.527936+0000","last_became_peered":"2024-05-08T18:08:47.527936+0000","last_unstale":"2024-05-08T18:13:09.275882+0000","last_undegraded":"2024-05-08T18:13:09.275882+0000","last_fullsized":"2024-05-08T18:13:09.275882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:09.275495+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:09.275495+0000","last_clean_scrub_stamp":"2024-05-08T18:13:09.275495+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:46.545687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:36.364217+0000","last_change":"2024-05-08T18:12:36.364217+0000","last_active":"2024-05-08T18:12:36.364217+0000","last_peered":"2024-05-08T18:12:36.364217+0000","last_clean":"2024-05-08T18:12:36.364217+0000","last_became_active":"2024-05-08T18:08:51.506972+0000","last_became_peered":"2024-05-08T18:08:51.506972+0000","last_unstale":"2024-05-08T18:12:36.364217+0000","last_undegraded":"2024-05-08T18:12:36.364217+0000","last_fullsized":"2024-05-08T18:12:36.364217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:36.363969+0000","last_clean_scrub_stamp":"2024-05-08T18:12:36.363969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:55.322070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'36","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.890449+0000","last_change":"2024-05-08T18:12:22.890449+0000","last_active":"2024-05-08T18:12:22.890449+0000","last_peered":"2024-05-08T18:12:22.890449+0000","last_clean":"2024-05-08T18:12:22.890449+0000","last_became_active":"2024-05-08T18:08:53.539154+0000","last_became_peered":"2024-05-08T18:08:53.539154+0000","last_unstale":"2024-05-08T18:12:22.890449+0000","last_undegraded":"2024-05-08T18:12:22.890449+0000","last_fullsized":"2024-05-08T18:12:22.890449+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'36","last_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_deep_scrub":"32'36","last_deep_scrub_stamp":"2024-05-08T18:12:22.890142+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.890142+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:17:16.232900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.203783+0000","last_change":"2024-05-08T18:12:39.203783+0000","last_active":"2024-05-08T18:12:39.203783+0000","last_peered":"2024-05-08T18:12:39.203783+0000","last_clean":"2024-05-08T18:12:39.203783+0000","last_became_active":"2024-05-08T18:08:55.557937+0000","last_became_peered":"2024-05-08T18:08:55.557937+0000","last_unstale":"2024-05-08T18:12:39.203783+0000","last_undegraded":"2024-05-08T18:12:39.203783+0000","last_fullsized":"2024-05-08T18:12:39.203783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:39.203546+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.203546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:41:58.173003+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:38.279804+0000","last_change":"2024-05-08T18:13:38.279804+0000","last_active":"2024-05-08T18:13:38.279804+0000","last_peered":"2024-05-08T18:13:38.279804+0000","last_clean":"2024-05-08T18:13:38.279804+0000","last_became_active":"2024-05-08T18:08:57.571733+0000","last_became_peered":"2024-05-08T18:08:57.571733+0000","last_unstale":"2024-05-08T18:13:38.279804+0000","last_undegraded":"2024-05-08T18:13:38.279804+0000","last_fullsized":"2024-05-08T18:13:38.279804+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:38.279549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:38.279549+0000","last_clean_scrub_stamp":"2024-05-08T18:13:38.279549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:19:39.945948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"32'16","reported_seq":83,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.386937+0000","last_change":"2024-05-08T18:12:53.386937+0000","last_active":"2024-05-08T18:12:53.386937+0000","last_peered":"2024-05-08T18:12:53.386937+0000","last_clean":"2024-05-08T18:12:53.386937+0000","last_became_active":"2024-05-08T18:08:49.510490+0000","last_became_peered":"2024-05-08T18:08:49.510490+0000","last_unstale":"2024-05-08T18:12:53.386937+0000","last_undegraded":"2024-05-08T18:12:53.386937+0000","last_fullsized":"2024-05-08T18:12:53.386937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'16","last_scrub_stamp":"2024-05-08T18:12:53.386676+0000","last_deep_scrub":"32'16","last_deep_scrub_stamp":"2024-05-08T18:12:53.386676+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.386676+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:12.923206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:48.062680+0000","last_change":"2024-05-08T18:12:48.062680+0000","last_active":"2024-05-08T18:12:48.062680+0000","last_peered":"2024-05-08T18:12:48.062680+0000","last_clean":"2024-05-08T18:12:48.062680+0000","last_became_active":"2024-05-08T18:08:47.512059+0000","last_became_peered":"2024-05-08T18:08:47.512059+0000","last_unstale":"2024-05-08T18:12:48.062680+0000","last_undegraded":"2024-05-08T18:12:48.062680+0000","last_fullsized":"2024-05-08T18:12:48.062680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:48.062295+0000","last_clean_scrub_stamp":"2024-05-08T18:12:48.062295+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:51:40.800386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:22.904406+0000","last_change":"2024-05-08T18:12:22.904406+0000","last_active":"2024-05-08T18:12:22.904406+0000","last_peered":"2024-05-08T18:12:22.904406+0000","last_clean":"2024-05-08T18:12:22.904406+0000","last_became_active":"2024-05-08T18:08:51.521006+0000","last_became_peered":"2024-05-08T18:08:51.521006+0000","last_unstale":"2024-05-08T18:12:22.904406+0000","last_undegraded":"2024-05-08T18:12:22.904406+0000","last_fullsized":"2024-05-08T18:12:22.904406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:22.904163+0000","last_clean_scrub_stamp":"2024-05-08T18:12:22.904163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:55.812967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'31","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.406151+0000","last_change":"2024-05-08T18:12:45.406224+0000","last_active":"2024-05-08T18:12:45.406151+0000","last_peered":"2024-05-08T18:12:45.406151+0000","last_clean":"2024-05-08T18:12:45.406151+0000","last_became_active":"2024-05-08T18:08:53.554711+0000","last_became_peered":"2024-05-08T18:08:53.554711+0000","last_unstale":"2024-05-08T18:12:45.406151+0000","last_undegraded":"2024-05-08T18:12:45.406151+0000","last_fullsized":"2024-05-08T18:12:45.406151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'31","last_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_deep_scrub":"32'31","last_deep_scrub_stamp":"2024-05-08T18:12:45.405952+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.405952+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:51.199855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.249805+0000","last_change":"2024-05-08T18:12:40.249929+0000","last_active":"2024-05-08T18:12:40.249805+0000","last_peered":"2024-05-08T18:12:40.249805+0000","last_clean":"2024-05-08T18:12:40.249805+0000","last_became_active":"2024-05-08T18:08:55.563425+0000","last_became_peered":"2024-05-08T18:08:55.563425+0000","last_unstale":"2024-05-08T18:12:40.249805+0000","last_undegraded":"2024-05-08T18:12:40.249805+0000","last_fullsized":"2024-05-08T18:12:40.249805+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:40.249448+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.249448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:35.988004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:36.239871+0000","last_change":"2024-05-08T18:13:36.239871+0000","last_active":"2024-05-08T18:13:36.239871+0000","last_peered":"2024-05-08T18:13:36.239871+0000","last_clean":"2024-05-08T18:13:36.239871+0000","last_became_active":"2024-05-08T18:08:57.569869+0000","last_became_peered":"2024-05-08T18:08:57.569869+0000","last_unstale":"2024-05-08T18:13:36.239871+0000","last_undegraded":"2024-05-08T18:13:36.239871+0000","last_fullsized":"2024-05-08T18:13:36.239871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:13:36.239590+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:13:36.239590+0000","last_clean_scrub_stamp":"2024-05-08T18:13:36.239590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:03.016992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:37.407097+0000","last_change":"2024-05-08T18:12:37.407097+0000","last_active":"2024-05-08T18:12:37.407097+0000","last_peered":"2024-05-08T18:12:37.407097+0000","last_clean":"2024-05-08T18:12:37.407097+0000","last_became_active":"2024-05-08T18:08:49.491893+0000","last_became_peered":"2024-05-08T18:08:49.491893+0000","last_unstale":"2024-05-08T18:12:37.407097+0000","last_undegraded":"2024-05-08T18:12:37.407097+0000","last_fullsized":"2024-05-08T18:12:37.407097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:37.406836+0000","last_clean_scrub_stamp":"2024-05-08T18:12:37.406836+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:57:34.907082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.827275+0000","last_change":"2024-05-08T18:13:02.827344+0000","last_active":"2024-05-08T18:13:02.827275+0000","last_peered":"2024-05-08T18:13:02.827275+0000","last_clean":"2024-05-08T18:13:02.827275+0000","last_became_active":"2024-05-08T18:08:47.496666+0000","last_became_peered":"2024-05-08T18:08:47.496666+0000","last_unstale":"2024-05-08T18:13:02.827275+0000","last_undegraded":"2024-05-08T18:13:02.827275+0000","last_fullsized":"2024-05-08T18:13:02.827275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:13:02.827060+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:13:02.827060+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.827060+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:21:32.773786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'5","reported_seq":234,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:31.805113+0000","last_change":"2024-05-08T18:12:31.805113+0000","last_active":"2024-05-08T18:12:31.805113+0000","last_peered":"2024-05-08T18:12:31.805113+0000","last_clean":"2024-05-08T18:12:31.805113+0000","last_became_active":"2024-05-08T18:08:51.510540+0000","last_became_peered":"2024-05-08T18:08:51.510540+0000","last_unstale":"2024-05-08T18:12:31.805113+0000","last_undegraded":"2024-05-08T18:12:31.805113+0000","last_fullsized":"2024-05-08T18:12:31.805113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-05-08T18:12:31.804855+0000","last_clean_scrub_stamp":"2024-05-08T18:12:31.804855+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:00.941657+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'39","reported_seq":96,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:28.253694+0000","last_change":"2024-05-08T18:12:28.253848+0000","last_active":"2024-05-08T18:12:28.253694+0000","last_peered":"2024-05-08T18:12:28.253694+0000","last_clean":"2024-05-08T18:12:28.253694+0000","last_became_active":"2024-05-08T18:08:53.546651+0000","last_became_peered":"2024-05-08T18:08:53.546651+0000","last_unstale":"2024-05-08T18:12:28.253694+0000","last_undegraded":"2024-05-08T18:12:28.253694+0000","last_fullsized":"2024-05-08T18:12:28.253694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'39","last_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_deep_scrub":"32'39","last_deep_scrub_stamp":"2024-05-08T18:12:28.253447+0000","last_clean_scrub_stamp":"2024-05-08T18:12:28.253447+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:47:30.579578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:15.869619+0000","last_change":"2024-05-08T18:12:15.869678+0000","last_active":"2024-05-08T18:12:15.869619+0000","last_peered":"2024-05-08T18:12:15.869619+0000","last_clean":"2024-05-08T18:12:15.869619+0000","last_became_active":"2024-05-08T18:08:55.545456+0000","last_became_peered":"2024-05-08T18:08:55.545456+0000","last_unstale":"2024-05-08T18:12:15.869619+0000","last_undegraded":"2024-05-08T18:12:15.869619+0000","last_fullsized":"2024-05-08T18:12:15.869619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:15.869387+0000","last_clean_scrub_stamp":"2024-05-08T18:12:15.869387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:11:54.487997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:08.238687+0000","last_change":"2024-05-08T18:13:08.238687+0000","last_active":"2024-05-08T18:13:08.238687+0000","last_peered":"2024-05-08T18:13:08.238687+0000","last_clean":"2024-05-08T18:13:08.238687+0000","last_became_active":"2024-05-08T18:08:57.559659+0000","last_became_peered":"2024-05-08T18:08:57.559659+0000","last_unstale":"2024-05-08T18:13:08.238687+0000","last_undegraded":"2024-05-08T18:13:08.238687+0000","last_fullsized":"2024-05-08T18:13:08.238687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:08.238370+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:08.238370+0000","last_clean_scrub_stamp":"2024-05-08T18:13:08.238370+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:06.147782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:41.809070+0000","last_change":"2024-05-08T18:12:41.809070+0000","last_active":"2024-05-08T18:12:41.809070+0000","last_peered":"2024-05-08T18:12:41.809070+0000","last_clean":"2024-05-08T18:12:41.809070+0000","last_became_active":"2024-05-08T18:08:49.513411+0000","last_became_peered":"2024-05-08T18:08:49.513411+0000","last_unstale":"2024-05-08T18:12:41.809070+0000","last_undegraded":"2024-05-08T18:12:41.809070+0000","last_fullsized":"2024-05-08T18:12:41.809070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:41.808797+0000","last_clean_scrub_stamp":"2024-05-08T18:12:41.808797+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:14.047209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.226520+0000","last_change":"2024-05-08T18:12:57.226520+0000","last_active":"2024-05-08T18:12:57.226520+0000","last_peered":"2024-05-08T18:12:57.226520+0000","last_clean":"2024-05-08T18:12:57.226520+0000","last_became_active":"2024-05-08T18:08:47.510214+0000","last_became_peered":"2024-05-08T18:08:47.510214+0000","last_unstale":"2024-05-08T18:12:57.226520+0000","last_undegraded":"2024-05-08T18:12:57.226520+0000","last_fullsized":"2024-05-08T18:12:57.226520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.226257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.226257+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.226257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:54.487220+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.010893+0000","last_change":"2024-05-08T18:12:45.010893+0000","last_active":"2024-05-08T18:12:45.010893+0000","last_peered":"2024-05-08T18:12:45.010893+0000","last_clean":"2024-05-08T18:12:45.010893+0000","last_became_active":"2024-05-08T18:08:49.492865+0000","last_became_peered":"2024-05-08T18:08:49.492865+0000","last_unstale":"2024-05-08T18:12:45.010893+0000","last_undegraded":"2024-05-08T18:12:45.010893+0000","last_fullsized":"2024-05-08T18:12:45.010893+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:45.010494+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.010494+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:42.271457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:01.003402+0000","last_change":"2024-05-08T18:13:01.003402+0000","last_active":"2024-05-08T18:13:01.003402+0000","last_peered":"2024-05-08T18:13:01.003402+0000","last_clean":"2024-05-08T18:13:01.003402+0000","last_became_active":"2024-05-08T18:08:47.495736+0000","last_became_peered":"2024-05-08T18:08:47.495736+0000","last_unstale":"2024-05-08T18:13:01.003402+0000","last_undegraded":"2024-05-08T18:13:01.003402+0000","last_fullsized":"2024-05-08T18:13:01.003402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:01.003113+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:01.003113+0000","last_clean_scrub_stamp":"2024-05-08T18:13:01.003113+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:28.024885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'12","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:35.251283+0000","last_change":"2024-05-08T18:12:35.251283+0000","last_active":"2024-05-08T18:12:35.251283+0000","last_peered":"2024-05-08T18:12:35.251283+0000","last_clean":"2024-05-08T18:12:35.251283+0000","last_became_active":"2024-05-08T18:08:49.512694+0000","last_became_peered":"2024-05-08T18:08:49.512694+0000","last_unstale":"2024-05-08T18:12:35.251283+0000","last_undegraded":"2024-05-08T18:12:35.251283+0000","last_fullsized":"2024-05-08T18:12:35.251283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:35.251012+0000","last_clean_scrub_stamp":"2024-05-08T18:12:35.251012+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:51.414787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:12.251564+0000","last_change":"2024-05-08T18:13:12.251679+0000","last_active":"2024-05-08T18:13:12.251564+0000","last_peered":"2024-05-08T18:13:12.251564+0000","last_clean":"2024-05-08T18:13:12.251564+0000","last_became_active":"2024-05-08T18:08:47.516481+0000","last_became_peered":"2024-05-08T18:08:47.516481+0000","last_unstale":"2024-05-08T18:13:12.251564+0000","last_undegraded":"2024-05-08T18:13:12.251564+0000","last_fullsized":"2024-05-08T18:13:12.251564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:12.251334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:12.251334+0000","last_clean_scrub_stamp":"2024-05-08T18:13:12.251334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:19:13.337224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'8","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:49.057497+0000","last_change":"2024-05-08T18:12:49.057497+0000","last_active":"2024-05-08T18:12:49.057497+0000","last_peered":"2024-05-08T18:12:49.057497+0000","last_clean":"2024-05-08T18:12:49.057497+0000","last_became_active":"2024-05-08T18:08:49.493666+0000","last_became_peered":"2024-05-08T18:08:49.493666+0000","last_unstale":"2024-05-08T18:12:49.057497+0000","last_undegraded":"2024-05-08T18:12:49.057497+0000","last_fullsized":"2024-05-08T18:12:49.057497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-05-08T18:12:49.057230+0000","last_clean_scrub_stamp":"2024-05-08T18:12:49.057230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:48.903173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":46,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"32'6","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:53.898282+0000","last_change":"2024-05-08T18:12:53.898282+0000","last_active":"2024-05-08T18:12:53.898282+0000","last_peered":"2024-05-08T18:12:53.898282+0000","last_clean":"2024-05-08T18:12:53.898282+0000","last_became_active":"2024-05-08T18:08:47.512834+0000","last_became_peered":"2024-05-08T18:08:47.512834+0000","last_unstale":"2024-05-08T18:12:53.898282+0000","last_undegraded":"2024-05-08T18:12:53.898282+0000","last_fullsized":"2024-05-08T18:12:53.898282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:53.897902+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:53.897902+0000","last_clean_scrub_stamp":"2024-05-08T18:12:53.897902+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:13:21.990238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":38,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"32'4","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:39.025905+0000","last_change":"2024-05-08T18:12:39.025905+0000","last_active":"2024-05-08T18:12:39.025905+0000","last_peered":"2024-05-08T18:12:39.025905+0000","last_clean":"2024-05-08T18:12:39.025905+0000","last_became_active":"2024-05-08T18:08:49.518347+0000","last_became_peered":"2024-05-08T18:08:49.518347+0000","last_unstale":"2024-05-08T18:12:39.025905+0000","last_undegraded":"2024-05-08T18:12:39.025905+0000","last_fullsized":"2024-05-08T18:12:39.025905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:39.025648+0000","last_clean_scrub_stamp":"2024-05-08T18:12:39.025648+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:46:42.892114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:02.974127+0000","last_change":"2024-05-08T18:13:02.974127+0000","last_active":"2024-05-08T18:13:02.974127+0000","last_peered":"2024-05-08T18:13:02.974127+0000","last_clean":"2024-05-08T18:13:02.974127+0000","last_became_active":"2024-05-08T18:08:47.496813+0000","last_became_peered":"2024-05-08T18:08:47.496813+0000","last_unstale":"2024-05-08T18:13:02.974127+0000","last_undegraded":"2024-05-08T18:13:02.974127+0000","last_fullsized":"2024-05-08T18:13:02.974127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:02.973841+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:02.973841+0000","last_clean_scrub_stamp":"2024-05-08T18:13:02.973841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:25:08.767744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'12","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:38.727988+0000","last_change":"2024-05-08T18:12:38.727988+0000","last_active":"2024-05-08T18:12:38.727988+0000","last_peered":"2024-05-08T18:12:38.727988+0000","last_clean":"2024-05-08T18:12:38.727988+0000","last_became_active":"2024-05-08T18:08:49.517712+0000","last_became_peered":"2024-05-08T18:08:49.517712+0000","last_unstale":"2024-05-08T18:12:38.727988+0000","last_undegraded":"2024-05-08T18:12:38.727988+0000","last_fullsized":"2024-05-08T18:12:38.727988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-05-08T18:12:38.727710+0000","last_clean_scrub_stamp":"2024-05-08T18:12:38.727710+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:01:00.838590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":28,"num_read_kb":24,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:05.936828+0000","last_change":"2024-05-08T18:13:05.936828+0000","last_active":"2024-05-08T18:13:05.936828+0000","last_peered":"2024-05-08T18:13:05.936828+0000","last_clean":"2024-05-08T18:13:05.936828+0000","last_became_active":"2024-05-08T18:08:47.511691+0000","last_became_peered":"2024-05-08T18:08:47.511691+0000","last_unstale":"2024-05-08T18:13:05.936828+0000","last_undegraded":"2024-05-08T18:13:05.936828+0000","last_fullsized":"2024-05-08T18:13:05.936828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:05.936573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:05.936573+0000","last_clean_scrub_stamp":"2024-05-08T18:13:05.936573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:38:15.915722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'14","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.998374+0000","last_change":"2024-05-08T18:12:50.998374+0000","last_active":"2024-05-08T18:12:50.998374+0000","last_peered":"2024-05-08T18:12:50.998374+0000","last_clean":"2024-05-08T18:12:50.998374+0000","last_became_active":"2024-05-08T18:08:49.496739+0000","last_became_peered":"2024-05-08T18:08:49.496739+0000","last_unstale":"2024-05-08T18:12:50.998374+0000","last_undegraded":"2024-05-08T18:12:50.998374+0000","last_fullsized":"2024-05-08T18:12:50.998374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-05-08T18:12:50.998114+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.998114+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:32.393869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.215826+0000","last_change":"2024-05-08T18:12:50.215826+0000","last_active":"2024-05-08T18:12:50.215826+0000","last_peered":"2024-05-08T18:12:50.215826+0000","last_clean":"2024-05-08T18:12:50.215826+0000","last_became_active":"2024-05-08T18:08:47.510381+0000","last_became_peered":"2024-05-08T18:08:47.510381+0000","last_unstale":"2024-05-08T18:12:50.215826+0000","last_undegraded":"2024-05-08T18:12:50.215826+0000","last_fullsized":"2024-05-08T18:12:50.215826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.215404+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.215404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:33:41.132603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:45.839374+0000","last_change":"2024-05-08T18:12:45.839374+0000","last_active":"2024-05-08T18:12:45.839374+0000","last_peered":"2024-05-08T18:12:45.839374+0000","last_clean":"2024-05-08T18:12:45.839374+0000","last_became_active":"2024-05-08T18:08:49.495590+0000","last_became_peered":"2024-05-08T18:08:49.495590+0000","last_unstale":"2024-05-08T18:12:45.839374+0000","last_undegraded":"2024-05-08T18:12:45.839374+0000","last_fullsized":"2024-05-08T18:12:45.839374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-05-08T18:12:45.839123+0000","last_clean_scrub_stamp":"2024-05-08T18:12:45.839123+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:57:31.725776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.020909+0000","last_change":"2024-05-08T18:12:50.020909+0000","last_active":"2024-05-08T18:12:50.020909+0000","last_peered":"2024-05-08T18:12:50.020909+0000","last_clean":"2024-05-08T18:12:50.020909+0000","last_became_active":"2024-05-08T18:08:47.513139+0000","last_became_peered":"2024-05-08T18:08:47.513139+0000","last_unstale":"2024-05-08T18:12:50.020909+0000","last_undegraded":"2024-05-08T18:12:50.020909+0000","last_fullsized":"2024-05-08T18:12:50.020909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:50.020646+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.020646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:29:05.646654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:50.875573+0000","last_change":"2024-05-08T18:12:50.875573+0000","last_active":"2024-05-08T18:12:50.875573+0000","last_peered":"2024-05-08T18:12:50.875573+0000","last_clean":"2024-05-08T18:12:50.875573+0000","last_became_active":"2024-05-08T18:08:49.498529+0000","last_became_peered":"2024-05-08T18:08:49.498529+0000","last_unstale":"2024-05-08T18:12:50.875573+0000","last_undegraded":"2024-05-08T18:12:50.875573+0000","last_fullsized":"2024-05-08T18:12:50.875573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:50.875317+0000","last_clean_scrub_stamp":"2024-05-08T18:12:50.875317+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:20:27.743465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:17.249934+0000","last_change":"2024-05-08T18:13:17.249992+0000","last_active":"2024-05-08T18:13:17.249934+0000","last_peered":"2024-05-08T18:13:17.249934+0000","last_clean":"2024-05-08T18:13:17.249934+0000","last_became_active":"2024-05-08T18:08:47.506875+0000","last_became_peered":"2024-05-08T18:08:47.506875+0000","last_unstale":"2024-05-08T18:13:17.249934+0000","last_undegraded":"2024-05-08T18:13:17.249934+0000","last_fullsized":"2024-05-08T18:13:17.249934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:17.249723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:17.249723+0000","last_clean_scrub_stamp":"2024-05-08T18:13:17.249723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:16.836681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"32'4","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:33.220189+0000","last_change":"2024-05-08T18:12:33.220189+0000","last_active":"2024-05-08T18:12:33.220189+0000","last_peered":"2024-05-08T18:12:33.220189+0000","last_clean":"2024-05-08T18:12:33.220189+0000","last_became_active":"2024-05-08T18:08:49.512130+0000","last_became_peered":"2024-05-08T18:08:49.512130+0000","last_unstale":"2024-05-08T18:12:33.220189+0000","last_undegraded":"2024-05-08T18:12:33.220189+0000","last_fullsized":"2024-05-08T18:12:33.220189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:33.219930+0000","last_clean_scrub_stamp":"2024-05-08T18:12:33.219930+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:32:14.615685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:57.951243+0000","last_change":"2024-05-08T18:12:57.951243+0000","last_active":"2024-05-08T18:12:57.951243+0000","last_peered":"2024-05-08T18:12:57.951243+0000","last_clean":"2024-05-08T18:12:57.951243+0000","last_became_active":"2024-05-08T18:08:47.511414+0000","last_became_peered":"2024-05-08T18:08:47.511414+0000","last_unstale":"2024-05-08T18:12:57.951243+0000","last_undegraded":"2024-05-08T18:12:57.951243+0000","last_fullsized":"2024-05-08T18:12:57.951243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:57.950978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:57.950978+0000","last_clean_scrub_stamp":"2024-05-08T18:12:57.950978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:06:53.689534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.027487+0000","last_change":"2024-05-08T18:12:40.027487+0000","last_active":"2024-05-08T18:12:40.027487+0000","last_peered":"2024-05-08T18:12:40.027487+0000","last_clean":"2024-05-08T18:12:40.027487+0000","last_became_active":"2024-05-08T18:08:49.515376+0000","last_became_peered":"2024-05-08T18:08:49.515376+0000","last_unstale":"2024-05-08T18:12:40.027487+0000","last_undegraded":"2024-05-08T18:12:40.027487+0000","last_fullsized":"2024-05-08T18:12:40.027487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.027216+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.027216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:35:32.648602+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:47.817910+0000","last_change":"2024-05-08T18:12:47.817910+0000","last_active":"2024-05-08T18:12:47.817910+0000","last_peered":"2024-05-08T18:12:47.817910+0000","last_clean":"2024-05-08T18:12:47.817910+0000","last_became_active":"2024-05-08T18:08:47.525220+0000","last_became_peered":"2024-05-08T18:08:47.525220+0000","last_unstale":"2024-05-08T18:12:47.817910+0000","last_undegraded":"2024-05-08T18:12:47.817910+0000","last_fullsized":"2024-05-08T18:12:47.817910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:47.817632+0000","last_clean_scrub_stamp":"2024-05-08T18:12:47.817632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:31:45.078595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'2","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:42.780098+0000","last_change":"2024-05-08T18:12:42.780098+0000","last_active":"2024-05-08T18:12:42.780098+0000","last_peered":"2024-05-08T18:12:42.780098+0000","last_clean":"2024-05-08T18:12:42.780098+0000","last_became_active":"2024-05-08T18:08:49.496392+0000","last_became_peered":"2024-05-08T18:08:49.496392+0000","last_unstale":"2024-05-08T18:12:42.780098+0000","last_undegraded":"2024-05-08T18:12:42.780098+0000","last_fullsized":"2024-05-08T18:12:42.780098+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:42.779853+0000","last_clean_scrub_stamp":"2024-05-08T18:12:42.779853+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:48:09.011513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:55.756420+0000","last_change":"2024-05-08T18:12:55.756420+0000","last_active":"2024-05-08T18:12:55.756420+0000","last_peered":"2024-05-08T18:12:55.756420+0000","last_clean":"2024-05-08T18:12:55.756420+0000","last_became_active":"2024-05-08T18:08:47.512644+0000","last_became_peered":"2024-05-08T18:08:47.512644+0000","last_unstale":"2024-05-08T18:12:55.756420+0000","last_undegraded":"2024-05-08T18:12:55.756420+0000","last_fullsized":"2024-05-08T18:12:55.756420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:55.756173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:55.756173+0000","last_clean_scrub_stamp":"2024-05-08T18:12:55.756173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:02:11.919948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:34.816815+0000","last_change":"2024-05-08T18:12:34.816815+0000","last_active":"2024-05-08T18:12:34.816815+0000","last_peered":"2024-05-08T18:12:34.816815+0000","last_clean":"2024-05-08T18:12:34.816815+0000","last_became_active":"2024-05-08T18:08:49.519266+0000","last_became_peered":"2024-05-08T18:08:49.519266+0000","last_unstale":"2024-05-08T18:12:34.816815+0000","last_undegraded":"2024-05-08T18:12:34.816815+0000","last_fullsized":"2024-05-08T18:12:34.816815+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:34.816409+0000","last_clean_scrub_stamp":"2024-05-08T18:12:34.816409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:38:36.991987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:25.242971+0000","last_change":"2024-05-08T18:13:25.243102+0000","last_active":"2024-05-08T18:13:25.242971+0000","last_peered":"2024-05-08T18:13:25.242971+0000","last_clean":"2024-05-08T18:13:25.242971+0000","last_became_active":"2024-05-08T18:08:47.500580+0000","last_became_peered":"2024-05-08T18:08:47.500580+0000","last_unstale":"2024-05-08T18:13:25.242971+0000","last_undegraded":"2024-05-08T18:13:25.242971+0000","last_fullsized":"2024-05-08T18:13:25.242971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:25.242718+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:25.242718+0000","last_clean_scrub_stamp":"2024-05-08T18:13:25.242718+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:25:17.800437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:52.822535+0000","last_change":"2024-05-08T18:12:52.822535+0000","last_active":"2024-05-08T18:12:52.822535+0000","last_peered":"2024-05-08T18:12:52.822535+0000","last_clean":"2024-05-08T18:12:52.822535+0000","last_became_active":"2024-05-08T18:08:49.498677+0000","last_became_peered":"2024-05-08T18:08:49.498677+0000","last_unstale":"2024-05-08T18:12:52.822535+0000","last_undegraded":"2024-05-08T18:12:52.822535+0000","last_fullsized":"2024-05-08T18:12:52.822535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:12:52.822284+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:12:52.822284+0000","last_clean_scrub_stamp":"2024-05-08T18:12:52.822284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.447474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:24.234382+0000","last_change":"2024-05-08T18:13:24.234508+0000","last_active":"2024-05-08T18:13:24.234382+0000","last_peered":"2024-05-08T18:13:24.234382+0000","last_clean":"2024-05-08T18:13:24.234382+0000","last_became_active":"2024-05-08T18:08:47.527290+0000","last_became_peered":"2024-05-08T18:08:47.527290+0000","last_unstale":"2024-05-08T18:13:24.234382+0000","last_undegraded":"2024-05-08T18:13:24.234382+0000","last_fullsized":"2024-05-08T18:13:24.234382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:24.234101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:24.234101+0000","last_clean_scrub_stamp":"2024-05-08T18:13:24.234101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:47.780634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:03.223932+0000","last_change":"2024-05-08T18:13:03.223932+0000","last_active":"2024-05-08T18:13:03.223932+0000","last_peered":"2024-05-08T18:13:03.223932+0000","last_clean":"2024-05-08T18:13:03.223932+0000","last_became_active":"2024-05-08T18:08:49.504353+0000","last_became_peered":"2024-05-08T18:08:49.504353+0000","last_unstale":"2024-05-08T18:13:03.223932+0000","last_undegraded":"2024-05-08T18:13:03.223932+0000","last_fullsized":"2024-05-08T18:13:03.223932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:03.223576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:03.223576+0000","last_clean_scrub_stamp":"2024-05-08T18:13:03.223576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:21:26.136048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"32'4","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:40.351619+0000","last_change":"2024-05-08T18:12:40.351619+0000","last_active":"2024-05-08T18:12:40.351619+0000","last_peered":"2024-05-08T18:12:40.351619+0000","last_clean":"2024-05-08T18:12:40.351619+0000","last_became_active":"2024-05-08T18:08:47.510792+0000","last_became_peered":"2024-05-08T18:08:47.510792+0000","last_unstale":"2024-05-08T18:12:40.351619+0000","last_undegraded":"2024-05-08T18:12:40.351619+0000","last_fullsized":"2024-05-08T18:12:40.351619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:40.351359+0000","last_clean_scrub_stamp":"2024-05-08T18:12:40.351359+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:31:49.624570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:46.826997+0000","last_change":"2024-05-08T18:12:46.826997+0000","last_active":"2024-05-08T18:12:46.826997+0000","last_peered":"2024-05-08T18:12:46.826997+0000","last_clean":"2024-05-08T18:12:46.826997+0000","last_became_active":"2024-05-08T18:08:49.496201+0000","last_became_peered":"2024-05-08T18:08:49.496201+0000","last_unstale":"2024-05-08T18:12:46.826997+0000","last_undegraded":"2024-05-08T18:12:46.826997+0000","last_fullsized":"2024-05-08T18:12:46.826997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-05-08T18:12:46.826741+0000","last_clean_scrub_stamp":"2024-05-08T18:12:46.826741+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:17:51.665811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:14.273625+0000","last_change":"2024-05-08T18:13:14.273625+0000","last_active":"2024-05-08T18:13:14.273625+0000","last_peered":"2024-05-08T18:13:14.273625+0000","last_clean":"2024-05-08T18:13:14.273625+0000","last_became_active":"2024-05-08T18:08:47.520265+0000","last_became_peered":"2024-05-08T18:08:47.520265+0000","last_unstale":"2024-05-08T18:13:14.273625+0000","last_undegraded":"2024-05-08T18:13:14.273625+0000","last_fullsized":"2024-05-08T18:13:14.273625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:14.273308+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:14.273308+0000","last_clean_scrub_stamp":"2024-05-08T18:13:14.273308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:22:55.999532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:11.210636+0000","last_change":"2024-05-08T18:13:11.210636+0000","last_active":"2024-05-08T18:13:11.210636+0000","last_peered":"2024-05-08T18:13:11.210636+0000","last_clean":"2024-05-08T18:13:11.210636+0000","last_became_active":"2024-05-08T18:08:47.515323+0000","last_became_peered":"2024-05-08T18:08:47.515323+0000","last_unstale":"2024-05-08T18:13:11.210636+0000","last_undegraded":"2024-05-08T18:13:11.210636+0000","last_fullsized":"2024-05-08T18:13:11.210636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:13:11.210380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:13:11.210380+0000","last_clean_scrub_stamp":"2024-05-08T18:13:11.210380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:24:17.869561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:54.899948+0000","last_change":"2024-05-08T18:12:54.899948+0000","last_active":"2024-05-08T18:12:54.899948+0000","last_peered":"2024-05-08T18:12:54.899948+0000","last_clean":"2024-05-08T18:12:54.899948+0000","last_became_active":"2024-05-08T18:08:49.500380+0000","last_became_peered":"2024-05-08T18:08:49.500380+0000","last_unstale":"2024-05-08T18:12:54.899948+0000","last_undegraded":"2024-05-08T18:12:54.899948+0000","last_fullsized":"2024-05-08T18:12:54.899948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-05-08T18:12:54.899696+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-05-08T18:12:54.899696+0000","last_clean_scrub_stamp":"2024-05-08T18:12:54.899696+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:22:37.754950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:12:51.977478+0000","last_change":"2024-05-08T18:12:51.977478+0000","last_active":"2024-05-08T18:12:51.977478+0000","last_peered":"2024-05-08T18:12:51.977478+0000","last_clean":"2024-05-08T18:12:51.977478+0000","last_became_active":"2024-05-08T18:08:47.513683+0000","last_became_peered":"2024-05-08T18:08:47.513683+0000","last_unstale":"2024-05-08T18:12:51.977478+0000","last_undegraded":"2024-05-08T18:12:51.977478+0000","last_fullsized":"2024-05-08T18:12:51.977478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T18:12:51.977218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T18:12:51.977218+0000","last_clean_scrub_stamp":"2024-05-08T18:12:51.977218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:39:15.519607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-08T18:13:13.963603+0000","last_change":"2024-05-08T18:13:13.963603+0000","last_active":"2024-05-08T18:13:13.963603+0000","last_peered":"2024-05-08T18:13:13.963603+0000","last_clean":"2024-05-08T18:13:13.963603+0000","last_became_active":"2024-05-08T18:09:28.588833+0000","last_became_peered":"2024-05-08T18:09:28.588833+0000","last_unstale":"2024-05-08T18:13:13.963603+0000","last_undegraded":"2024-05-08T18:13:13.963603+0000","last_fullsized":"2024-05-08T18:13:13.963603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-05-08T18:13:13.963354+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-05-08T18:13:13.963354+0000","last_clean_scrub_stamp":"2024-05-08T18:13:13.963354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:05:33.499884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":9384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1528,"ondisk_log_size":1528,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1628,"num_read_kb":1518,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705732,"num_pgs":168,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":462848,"data_stored":145208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705732,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40464,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331376,"statfs":{"total":96636764160,"available":96595329024,"internally_reserved":0,"allocated":991232,"data_stored":733282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705731,"num_pgs":136,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40496,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331344,"statfs":{"total":96636764160,"available":96595296256,"internally_reserved":0,"allocated":1024000,"data_stored":735055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705732,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":430080,"data_stored":144761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T18:13:56.626 DEBUG:teuthology.orchestra.run.smithi053:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T18:13:56.781 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f6902a81640 1 Processor -- start 2024-05-08T18:13:56.782 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f6902a81640 1 -- start start 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f6902a81640 1 --2- >> v2:172.21.15.53:3300/0 conn(0x7f68fc12fdf0 0x7f68fc070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f6902a81640 1 -- --> v1:172.21.15.53:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68fc071790 con 0x7f68fc12fa10 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f6902a81640 1 -- --> v2:172.21.15.53:3300/0 -- mon_getmap magic: 0 -- 0x7f68fc073620 con 0x7f68fc12fdf0 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f690081d640 1 --1- >> v1:172.21.15.53:6789/0 conn(0x7f68fc12fa10 0x7f68fc070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.53:6789/0 says I am v1:172.21.15.53:59204/0 (socket says 172.21.15.53:59204) 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f690081d640 1 -- 172.21.15.53:0/2919583954 learned_addr learned my addr 172.21.15.53:0/2919583954 (peer_addr_for_me v1:172.21.15.53:0/0) 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f68fbfff640 1 --2- 172.21.15.53:0/2919583954 >> v2:172.21.15.53:3300/0 conn(0x7f68fc12fdf0 0x7f68fc070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f68fb7fe640 1 -- 172.21.15.53:0/2919583954 <== mon.0 v1:172.21.15.53:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405282179 0 0) 0x7f68fc071790 con 0x7f68fc12fa10 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f68fb7fe640 1 -- 172.21.15.53:0/2919583954 --> v1:172.21.15.53:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68e4003530 con 0x7f68fc12fa10 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f68fbfff640 1 -- 172.21.15.53:0/2919583954 >> v1:172.21.15.53:6789/0 conn(0x7f68fc12fa10 legacy=0x7f68fc070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.783 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.785+0000 7f68fbfff640 1 -- 172.21.15.53:0/2919583954 --> v2:172.21.15.53:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc0721c0 con 0x7f68fc12fdf0 2024-05-08T18:13:56.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f68fbfff640 1 --2- 172.21.15.53:0/2919583954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fdf0 0x7f68fc070a30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009740 tx=0x7f68ec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3887963a391219b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:56.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f68fb7fe640 1 -- 172.21.15.53:0/2919583954 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ec0b1070 con 0x7f68fc12fdf0 2024-05-08T18:13:56.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f68fb7fe640 1 -- 172.21.15.53:0/2919583954 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec0ac520 con 0x7f68fc12fdf0 2024-05-08T18:13:56.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f68fb7fe640 1 -- 172.21.15.53:0/2919583954 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68ec0ac820 con 0x7f68fc12fdf0 2024-05-08T18:13:56.786 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- 172.21.15.53:0/2919583954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fdf0 msgr2=0x7f68fc070a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 --2- 172.21.15.53:0/2919583954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fdf0 0x7f68fc070a30 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009740 tx=0x7f68ec01c370 comp rx=0 tx=0).stop 2024-05-08T18:13:56.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- 172.21.15.53:0/2919583954 shutdown_connections 2024-05-08T18:13:56.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 --2- 172.21.15.53:0/2919583954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fdf0 0x7f68fc070a30 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:56.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- 172.21.15.53:0/2919583954 >> 172.21.15.53:0/2919583954 conn(0x7f68fc0a1ec0 msgr2=0x7f68fc0a22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:56.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- 172.21.15.53:0/2919583954 shutdown_connections 2024-05-08T18:13:56.787 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- 172.21.15.53:0/2919583954 wait complete. 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 Processor -- start 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- start start 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 0x7f68fc12d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 -- 0x7f68fc072950 con 0x7f68fc12fa10 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f690081d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 0x7f68fc12d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f690081d640 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 0x7f68fc12d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:38800/0 (socket says 172.21.15.53:38800) 2024-05-08T18:13:56.788 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f690081d640 1 -- 172.21.15.53:0/1988485094 learned_addr learned my addr 172.21.15.53:0/1988485094 (peer_addr_for_me v2:172.21.15.53:0/0) 2024-05-08T18:13:56.789 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f690081d640 1 -- 172.21.15.53:0/1988485094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68fc11fac0 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f690081d640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 0x7f68fc12d930 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f68f000c450 tx=0x7f68f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f0017070 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f0005ce0 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.789+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68fc11f620 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68f0007200 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68fc120920 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68fc120290 con 0x7f68fc12fa10 2024-05-08T18:13:56.790 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 5) ==== 46934+0+0 (secure 0 0 0) 0x7f68f001a070 con 0x7f68fc12fa10 2024-05-08T18:13:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f68f97fa640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f68e8039b50 0x7f68e803c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T18:13:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6313+0+0 (secure 0 0 0) 0x7f68f004d080 con 0x7f68fc12fa10 2024-05-08T18:13:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f68fbfff640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f68e8039b50 0x7f68e803c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T18:13:56.791 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.793+0000 7f68fbfff640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f68e8039b50 0x7f68e803c010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0ae000 tx=0x7f68ec0a7000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T18:13:56.795 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.797+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f68f00109f0 con 0x7f68fc12fa10 2024-05-08T18:13:56.957 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.961+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f68fc064150 con 0x7f68fc12fa10 2024-05-08T18:13:56.962 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.965+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f68f001bc60 con 0x7f68fc12fa10 2024-05-08T18:13:56.963 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.965+0000 7f68f97fa640 1 -- 172.21.15.53:0/1988485094 <== mon.0 v2:172.21.15.53:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f68f0011e30 con 0x7f68fc12fa10 2024-05-08T18:13:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.965+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f68e8039b50 msgr2=0x7f68e803c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.965+0000 7f6902a81640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f68e8039b50 0x7f68e803c010 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0ae000 tx=0x7f68ec0a7000 comp rx=0 tx=0).stop 2024-05-08T18:13:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.965+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 msgr2=0x7f68fc12d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T18:13:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.965+0000 7f6902a81640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 0x7f68fc12d930 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f68f000c450 tx=0x7f68f000c910 comp rx=0 tx=0).stop 2024-05-08T18:13:56.965 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.969+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 shutdown_connections 2024-05-08T18:13:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.969+0000 7f6902a81640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.114:6824/1414075515,v1:172.21.15.114:6825/1414075515] conn(0x7f68e8039b50 0x7f68e803c010 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.969+0000 7f6902a81640 1 --2- 172.21.15.53:0/1988485094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68fc12fa10 0x7f68fc12d930 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T18:13:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.969+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 >> 172.21.15.53:0/1988485094 conn(0x7f68fc0a1ec0 msgr2=0x7f68fc1335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T18:13:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.969+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 shutdown_connections 2024-05-08T18:13:56.966 INFO:teuthology.orchestra.run.smithi053.stderr:2024-05-08T18:13:56.969+0000 7f6902a81640 1 -- 172.21.15.53:0/1988485094 wait complete. 2024-05-08T18:13:56.982 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T18:13:56.982 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T18:13:56.983 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T18:13:56.983 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:13:57.075 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T18:13:57.075 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T18:13:57.076 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:13:57.157 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T18:13:57.158 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T18:13:57.158 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:13:57.248 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T18:13:57.248 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T18:13:57.249 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:13:57.335 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T18:13:57.335 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T18:13:57.335 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T18:13:57.335 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:13:57.365 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T18:13:57.365 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T18:13:57.366 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T18:13:57.366 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T18:13:57.389 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T18:13:57.389 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T18:13:57.389 DEBUG:teuthology.orchestra.run.smithi053:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-08T18:13:57.448 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:13:57.448 DEBUG:teuthology.orchestra.run.smithi053:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T18:13:57.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:13:57.687 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T18:13:57.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:13:57.910 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T18:13:58.096 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:13:58.096 DEBUG:teuthology.orchestra.run.smithi114:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T18:13:58.271 INFO:tasks.ceph:Archiving mon data... 2024-05-08T18:13:58.272 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/data/mon.a.tgz 2024-05-08T18:13:58.272 DEBUG:teuthology.orchestra.run.smithi053:> mktemp 2024-05-08T18:13:58.278 INFO:teuthology.orchestra.run.smithi053.stdout:/tmp/tmp.9kPS0YcfE7 2024-05-08T18:13:58.279 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9kPS0YcfE7 2024-05-08T18:13:58.405 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 0666 /tmp/tmp.9kPS0YcfE7 2024-05-08T18:13:58.474 DEBUG:teuthology.orchestra.remote:smithi053:/tmp/tmp.9kPS0YcfE7 is 270KB 2024-05-08T18:13:58.535 DEBUG:teuthology.orchestra.run.smithi053:> rm -fr /tmp/tmp.9kPS0YcfE7 2024-05-08T18:13:58.540 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T18:13:58.541 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:13:58.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T18:13:58.646 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:13:58.651 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T18:13:58.651 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T18:13:58.653 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/remote/smithi053/crash 2024-05-08T18:13:58.653 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:13:58.702 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/remote/smithi114/crash 2024-05-08T18:13:58.704 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T18:13:58.717 INFO:tasks.ceph:Compressing logs... 2024-05-08T18:13:58.717 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:13:58.750 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T18:13:58.770 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22813.log 2024-05-08T18:13:58.771 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T18:13:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23256.log 2024-05-08T18:13:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-osd.0.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22813.log.gz 2024-05-08T18:13:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22401.log 2024-05-08T18:13:58.772 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22812.log 2024-05-08T18:13:58.773 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22401.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23256.log.gz 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22401.log.gz 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21533.log 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22542.log 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2%/var/log/ceph/ceph-client.admin.21533.log: -- replaced with /var/log/ceph/ceph-client.admin.22812.log.gz 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.21533.log.gz 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22698.log 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22542.log.gz 2024-05-08T18:13:58.775 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22490.log 2024-05-08T18:13:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23204.log 2024-05-08T18:13:58.776 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22490.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22698.log.gz 2024-05-08T18:13:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21423.log 2024-05-08T18:13:58.777 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.22490.log.gz 2024-05-08T18:13:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23074.log 2024-05-08T18:13:58.777 INFO:teuthology.orchestra.run.smithi053.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.23204.log.gz 2024-05-08T18:13:58.777 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.21423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22516.log 2024-05-08T18:13:58.778 INFO:teuthology.orchestra.run.smithi053.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.21423.log.gz 2024-05-08T18:13:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22996.log 2024-05-08T18:13:58.778 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23074.log.gz 2024-05-08T18:13:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22439.log 2024-05-08T18:13:58.778 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22996.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22516.log.gz 2024-05-08T18:13:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23100.log 2024-05-08T18:13:58.779 INFO:teuthology.orchestra.run.smithi053.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22996.log.gz 2024-05-08T18:13:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23389.log 2024-05-08T18:13:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23100.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22439.log.gz 2024-05-08T18:13:58.779 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23022.log 2024-05-08T18:13:58.780 INFO:teuthology.orchestra.run.smithi053.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23100.log.gz 2024-05-08T18:13:58.781 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22606.log 2024-05-08T18:13:58.781 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23022.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.23389.log.gz 2024-05-08T18:13:58.781 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T18:13:58.781 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23022.log.gz 2024-05-08T18:13:58.782 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23334.log 2024-05-08T18:13:58.782 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.22606.log.gz 2024-05-08T18:13:58.782 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23126.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.21494.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23334.log.gz 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23308.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23126.log.gz 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.21494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23363.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 86.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.21494.log.gz 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23230.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.23308.log.gz 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22932.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23363.log: /var/log/ceph/ceph-client.admin.23230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22602.log 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.23363.log.gz 2024-05-08T18:13:58.800 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23230.log.gz 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23441.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22602.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.22932.log.gz 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.22602.log.gz 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.22906.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23441.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22906.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23441.log.gz 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22604.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.22906.log.gz 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23415.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23048.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22604.log: /var/log/ceph/ceph-client.admin.23415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22708.log 2024-05-08T18:13:58.801 INFO:teuthology.orchestra.run.smithi053.stderr: 87.5% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.22604.log.gz -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23415.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22709.log 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.23048.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22802.log 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22709.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.22708.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22709.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22958.log 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22597.log 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22958.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22802.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22568.log 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22958.log.gz 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23282.log 2024-05-08T18:13:58.802 INFO:teuthology.orchestra.run.smithi053.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.22597.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23465.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23282.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.22568.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23282.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22464.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23465.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20180.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22464.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.23465.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.22464.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22814.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph.tmp-client.admin.20180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23178.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20180.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22814.log: gzip 86.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.22814.log.gz --verbose 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr: -- /var/log/ceph/ceph-client.admin.23152.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.23178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22710.log 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr: 85.7%/var/log/ceph/ceph-client.admin.23152.log: -- replaced with /var/log/ceph/ceph-client.admin.23178.log.gz 2024-05-08T18:13:58.803 INFO:teuthology.orchestra.run.smithi053.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.23152.log.gz 2024-05-08T18:13:58.804 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/ceph-client.admin.22710.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.22710.log.gz 2024-05-08T18:13:58.813 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29786.log 2024-05-08T18:13:58.813 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-08T18:13:58.813 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.29786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30376.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56920.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55150.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.30376.log: /var/log/ceph/ceph-client.0.56920.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.29786.log.gz 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30966.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62230.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.55150.log: /var/log/ceph/ceph-client.0.30966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31556.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.62230.log: gzip -5 --verbose 91.4% -- replaced with /var/log/ceph/ceph-client.0.56920.log.gz 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.0.65180.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.31556.log: gzip -5 --verbose 91.7% -- replaced with /var/log/ceph/ceph-client.0.30376.log.gz 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.0.86390.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.65180.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.55150.log.gz 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49250.log 2024-05-08T18:13:58.814 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43940.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.86390.log: -- replaced with /var/log/ceph/ceph-client.0.62230.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.30966.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.49250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45120.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65180.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.43940.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.31556.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76390.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.45120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74620.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.86390.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.0.76390.log: -5 --verbose -- /var/log/ceph/ceph-client.0.41580.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.74620.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49250.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85210.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43940.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- 90.7% /var/log/ceph/ceph-osd.2.log 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.0.76390.log.gz 2024-05-08T18:13:58.815 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45120.log.gz 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.41580.log: /var/log/ceph/ceph-client.0.85210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83440.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74620.log.gz 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32730.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.83440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76974.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.41580.log.gz 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.0.32730.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28504.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85210.log.gz 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.76974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40400.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83440.log.gz 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:gzip/var/log/ceph/ceph-client.admin.28504.log: -5 --verbose -- /var/log/ceph/ceph-client.0.53380.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76974.log.gz 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.40400.log: gzip 86.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.28504.log.gz --verbose 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.0.38040.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.53380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86980.log 2024-05-08T18:13:58.816 INFO:teuthology.orchestra.run.smithi114.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.32730.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.38040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39220.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.86980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61640.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40400.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82850.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53380.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28432.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38040.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.61640.log: /var/log/ceph/ceph-client.0.82850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35680.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.86980.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66950.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% 86.3% -- replaced with /var/log/ceph/ceph-client.0.39220.log.gz/var/log/ceph/ceph-client.0.35680.log: 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28432.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.71080.log 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.66950.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82850.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.35680.log.gz 2024-05-08T18:13:58.817 INFO:teuthology.orchestra.run.smithi114.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.61640.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80490.log 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.71080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85800.log 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66950.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.80490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47480.log 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.85800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52790.log 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.47480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48660.log 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.52790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79310.log 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.80490.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.71080.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85800.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.48660.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47480.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52790.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48660.log.gz 2024-05-08T18:13:58.818 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75210.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.79310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29196.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.75210.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.29196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73440.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59280.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.79310.log.gz 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.73440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69310.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36860.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr: 92.2%/var/log/ceph/ceph-client.0.59280.log: /var/log/ceph/ceph-client.0.69310.log: -- replaced with /var/log/ceph/ceph-client.0.29196.log.gz 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75210.log.gz 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61050.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.36860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23788.log 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5%/var/log/ceph/ceph-client.0.61050.log: -- replaced with /var/log/ceph/ceph-client.0.69310.log.gz 91.4% 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.0.59280.log.gz 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73440.log.gz 2024-05-08T18:13:58.819 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51020.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.23788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51610.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36860.log.gz 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.23788.log.gz 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.51020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84620.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.51610.log: /var/log/ceph/ceph-client.0.84620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87575.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.0.51020.log.gz 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.61050.log.gz 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23836.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51610.log.gz 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.87575.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84620.log.gz 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65770.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.23836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72260.log 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23836.log.gz/var/log/ceph/ceph-client.0.65770.log: 2024-05-08T18:13:58.820 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33320.log 2024-05-08T18:13:58.821 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79900.log 2024-05-08T18:13:58.821 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.72260.log: /var/log/ceph/ceph-client.0.33320.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.65770.log.gz 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 91.5% -- replaced with /var/log/ceph/ceph-client.0.33320.log.gz -5 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.0.34500.log 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72260.log.gz 93.4% -- replaced with /var/log/ceph/ceph-client.0.87575.log.gz 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.79900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71670.log 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.34500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40990.log 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.71670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33910.log 2024-05-08T18:13:58.829 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.40990.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.79900.log.gz 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.34500.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.64000.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.33910.log: gzip 91.4% -- replaced with /var/log/ceph/ceph-client.0.71670.log.gz -5 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.64000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28456.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-mgr.x.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.40990.log.gz 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39810.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.33910.log.gz 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28456.log: 86.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78726.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28456.log.gz 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35090.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64000.log.gz 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.78726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68720.log 2024-05-08T18:13:58.830 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.35090.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39810.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.78726.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46300.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.68720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56330.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.35090.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68130.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.46300.log: /var/log/ceph/ceph-client.0.56330.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68720.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.46300.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69900.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56330.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.68130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36270.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.69900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28480.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.68130.log.gz/var/log/ceph/ceph-client.0.36270.log: 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58100.log 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.69900.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28480.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.28480.log.gz 2024-05-08T18:13:58.831 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36270.log.gz 2024-05-08T18:13:58.832 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23860.log 2024-05-08T18:13:58.832 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.58100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45710.log 2024-05-08T18:13:58.832 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.23860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38630.log 2024-05-08T18:13:58.832 INFO:teuthology.orchestra.run.smithi114.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.23860.log.gz 2024-05-08T18:13:58.832 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.45710.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.58100.log.gz 2024-05-08T18:13:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63410.log 2024-05-08T18:13:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.38630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82260.log 2024-05-08T18:13:58.833 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.45710.log.gz 2024-05-08T18:13:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.63410.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.38630.log.gz 2024-05-08T18:13:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43350.log 2024-05-08T18:13:58.833 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.82260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81670.log 2024-05-08T18:13:58.834 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63410.log.gz 2024-05-08T18:13:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.43350.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82260.log.gz 2024-05-08T18:13:58.835 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43350.log.gz 2024-05-08T18:13:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54560.log 2024-05-08T18:13:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.81670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75800.log 2024-05-08T18:13:58.835 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.54560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72850.log 2024-05-08T18:13:58.836 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.75800.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.81670.log.gz 2024-05-08T18:13:58.836 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54560.log.gz 2024-05-08T18:13:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-08T18:13:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.72850.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75800.log.gz 2024-05-08T18:13:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23812.log 2024-05-08T18:13:58.837 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57510.log 2024-05-08T18:13:58.838 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.23812.log: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-08T18:13:58.839 INFO:teuthology.orchestra.run.smithi114.stderr: 91.8% 85.6% -- replaced with /var/log/ceph/ceph-client.admin.23812.log.gz 2024-05-08T18:13:58.839 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-08T18:13:58.839 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77558.log 2024-05-08T18:13:58.840 INFO:teuthology.orchestra.run.smithi114.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.72850.log.gz 2024-05-08T18:13:58.840 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.57510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67540.log 2024-05-08T18:13:58.840 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.77558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62820.log 2024-05-08T18:13:58.840 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.67540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70490.log 2024-05-08T18:13:58.840 INFO:teuthology.orchestra.run.smithi114.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.77558.log.gz 2024-05-08T18:13:58.841 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.62820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48070.log 2024-05-08T18:13:58.841 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5%/var/log/ceph/ceph-client.0.70490.log: -- replaced with /var/log/ceph/ceph-client.0.57510.log.gz 2024-05-08T18:13:58.841 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.67540.log.gz 2024-05-08T18:13:58.842 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62820.log.gz 2024-05-08T18:13:58.842 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.70490.log.gz 2024-05-08T18:13:58.843 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37450.log 2024-05-08T18:13:58.843 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.48070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84030.log 2024-05-08T18:13:58.843 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.37450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42170.log 2024-05-08T18:13:58.843 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.84030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58690.log 2024-05-08T18:13:58.845 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42170.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.48070.log.gz 2024-05-08T18:13:58.845 INFO:teuthology.orchestra.run.smithi114.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37450.log.gz 2024-05-08T18:13:58.845 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78142.log 2024-05-08T18:13:58.845 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.58690.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.0.84030.log.gz -5 2024-05-08T18:13:58.845 INFO:teuthology.orchestra.run.smithi114.stderr: --verbose -- /var/log/ceph/ceph-client.0.44530.log 2024-05-08T18:13:58.846 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.78142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42760.log 2024-05-08T18:13:58.847 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.44530.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42170.log.gz 2024-05-08T18:13:58.847 INFO:teuthology.orchestra.run.smithi114.stderr: 90.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28528.log 2024-05-08T18:13:58.847 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.0.78142.log.gz 2024-05-08T18:13:58.847 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.42760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53970.log 2024-05-08T18:13:58.847 INFO:teuthology.orchestra.run.smithi114.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.58690.log.gz 2024-05-08T18:13:58.848 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.admin.28528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64590.log 2024-05-08T18:13:58.849 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44530.log.gz 86.3% 2024-05-08T18:13:58.849 INFO:teuthology.orchestra.run.smithi114.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28528.log.gz/var/log/ceph/ceph-client.0.53970.log: 2024-05-08T18:13:58.849 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49840.log 2024-05-08T18:13:58.849 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.64590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81080.log 2024-05-08T18:13:58.849 INFO:teuthology.orchestra.run.smithi114.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42760.log.gz 2024-05-08T18:13:58.850 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.49840.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.53970.log.gz 2024-05-08T18:13:58.850 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50430.log 2024-05-08T18:13:58.850 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3%/var/log/ceph/ceph-client.0.81080.log: -- replaced with /var/log/ceph/ceph-client.0.64590.log.gz 2024-05-08T18:13:58.850 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52200.log 2024-05-08T18:13:58.851 INFO:teuthology.orchestra.run.smithi114.stderr: 91.3%/var/log/ceph/ceph-client.0.50430.log: -- replaced with /var/log/ceph/ceph-client.0.49840.log.gz 2024-05-08T18:13:58.851 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46890.log 2024-05-08T18:13:58.852 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60460.log 2024-05-08T18:13:58.852 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.52200.log: /var/log/ceph/ceph-client.0.46890.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81080.log.gz 2024-05-08T18:13:58.852 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.50430.log.gz 2024-05-08T18:13:58.852 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59870.log 2024-05-08T18:13:58.853 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.60460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55740.log 2024-05-08T18:13:58.854 INFO:teuthology.orchestra.run.smithi114.stderr: 92.2% 91.6% -- replaced with /var/log/ceph/ceph-client.0.52200.log.gz 2024-05-08T18:13:58.854 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.59870.log: -- replaced with /var/log/ceph/ceph-client.0.46890.log.gz 2024-05-08T18:13:58.854 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32146.log 2024-05-08T18:13:58.854 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.55740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74030.log 2024-05-08T18:13:58.855 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.32146.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59870.log.gz 2024-05-08T18:13:58.855 INFO:teuthology.orchestra.run.smithi114.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.32146.log.gz 2024-05-08T18:13:58.855 INFO:teuthology.orchestra.run.smithi114.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.0.60460.log.gz 2024-05-08T18:13:58.855 INFO:teuthology.orchestra.run.smithi114.stderr:gzip 91.5% -5 -- replaced with /var/log/ceph/ceph-client.0.55740.log.gz --verbose 2024-05-08T18:13:58.855 INFO:teuthology.orchestra.run.smithi114.stderr: -- /var/log/ceph/ceph-client.0.66360.log 2024-05-08T18:13:58.857 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.74030.log: /var/log/ceph/ceph-client.0.66360.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.66360.log.gz 2024-05-08T18:13:58.857 INFO:teuthology.orchestra.run.smithi114.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74030.log.gz 2024-05-08T18:13:58.882 INFO:teuthology.orchestra.run.smithi114.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T18:13:58.974 INFO:teuthology.orchestra.run.smithi053.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T18:13:59.657 INFO:teuthology.orchestra.run.smithi114.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T18:13:59.771 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T18:13:59.773 INFO:teuthology.orchestra.run.smithi053.stderr: 2024-05-08T18:13:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:real 0m1.020s 2024-05-08T18:13:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:user 0m1.204s 2024-05-08T18:13:59.773 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m0.081s 2024-05-08T18:13:59.800 INFO:teuthology.orchestra.run.smithi114.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T18:13:59.817 INFO:teuthology.orchestra.run.smithi114.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T18:13:59.817 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-05-08T18:13:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m1.050s 2024-05-08T18:13:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m3.055s 2024-05-08T18:13:59.818 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.220s 2024-05-08T18:13:59.819 INFO:tasks.ceph:Archiving logs... 2024-05-08T18:13:59.819 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/remote/smithi053/log 2024-05-08T18:13:59.820 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:14:00.033 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/remote/smithi114/log 2024-05-08T18:14:00.034 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T18:14:00.517 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T18:14:00.531 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T18:14:00.531 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:14:00.534 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T18:14:00.600 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T18:14:00.608 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T18:14:00.608 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:14:00.611 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T18:14:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:14:00.621 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================== 2024-05-08T18:14:00.621 INFO:teuthology.orchestra.run.smithi053.stdout:*hv01.front.sepi 138.236.128.36 3 u 43 64 377 0.064 +1.779 0.628 2024-05-08T18:14:00.621 INFO:teuthology.orchestra.run.smithi053.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.094 -2.736 0.701 2024-05-08T18:14:00.621 INFO:teuthology.orchestra.run.smithi053.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.100 -1.456 0.575 2024-05-08T18:14:00.621 INFO:teuthology.orchestra.run.smithi053.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:14:00.623 INFO:teuthology.orchestra.run.smithi114.stdout: remote refid st t when poll reach delay offset jitter 2024-05-08T18:14:00.623 INFO:teuthology.orchestra.run.smithi114.stdout:============================================================================== 2024-05-08T18:14:00.623 INFO:teuthology.orchestra.run.smithi114.stdout:+hv01.front.sepi 138.236.128.36 3 u 42 64 377 0.056 +2.665 1.336 2024-05-08T18:14:00.623 INFO:teuthology.orchestra.run.smithi114.stdout:+hv02.front.sepi 63.231.80.2 3 u 41 64 377 0.076 -1.524 1.347 2024-05-08T18:14:00.623 INFO:teuthology.orchestra.run.smithi114.stdout:*hv03.front.sepi 74.6.168.72 3 u 47 64 377 0.093 -2.326 1.439 2024-05-08T18:14:00.623 INFO:teuthology.orchestra.run.smithi114.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-08T18:14:00.624 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T18:14:00.633 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T18:14:00.633 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T18:14:00.718 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T18:14:00.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T18:14:00.739 INFO:teuthology.task.internal:Duration was 957.041873 seconds 2024-05-08T18:14:00.739 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T18:14:00.748 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T18:14:00.748 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:14:00.750 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T18:14:00.788 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T18:14:00.788 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2024-05-08T18:14:00.789 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:14:00.842 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-05-08T18:14:00.842 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T18:14:00.853 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T18:14:00.853 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:14:00.886 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T18:14:00.921 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T18:14:00.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:14:00.954 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T18:14:01.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T18:14:01.029 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T18:14:01.029 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:14:01.040 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T18:14:01.052 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T18:14:01.081 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:14:01.086 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:14:01.095 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2024-05-08T18:14:01.107 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-05-08T18:14:01.132 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:14:01.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:14:01.165 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T18:14:01.180 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T18:14:01.180 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T18:14:01.190 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T18:14:01.191 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/remote/smithi053 2024-05-08T18:14:01.191 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:14:01.230 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/ivancich-2024-05-08_17:43:43-rgw-wip-eric-testing-1-distro-default-smithi/7697871/remote/smithi114 2024-05-08T18:14:01.230 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T18:14:01.252 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T18:14:01.252 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:14:01.274 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T18:14:01.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T18:14:01.308 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T18:14:01.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T18:14:01.318 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T18:14:01.318 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:14:01.322 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T18:14:01.326 INFO:teuthology.orchestra.run.smithi053.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:14 /home/ubuntu/cephtest 2024-05-08T18:14:01.345 INFO:teuthology.orchestra.run.smithi114.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 18:14 /home/ubuntu/cephtest 2024-05-08T18:14:01.347 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T18:14:01.360 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T18:14:01.383 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{ubuntu_latest}} duration: 957.0418727397919 flavor: default owner: scheduled_ivancich@teuthology success: true 2024-05-08T18:14:01.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T18:14:01.467 INFO:teuthology.run:pass